Could wearing a swastika in the United States in 2017 be considered "fighting words"? According to wikipedia wearing a symbol is not technically "fighting words" but I think a large percentage of people would disagree with the court.
https://en.wikipedia.org/wiki/Fighting_words
You could easily argue that ... And that it wore it for the express purpose of racially intimidating people. But, that argument goes away if he was sought out -- meaning, if you came across him and it so enraged you that you lashed out, you have an argument. If you saw a post on Twitter and premeditated an attack, you couldn't use that defense.