At least here in Germany Antifa people passionately fight the Nazis, am confused now

ETA anti fa(scistic) action
I am in the UK. I have vague recollections of neo-nazis here in the 70s behaving like terrorists throwing bricks through windows of houses where non-white people lived, beating up non-white people, wearing our flag as clothing. I have no desire to go back to those days.
Last night, for the first time, I watched some video of Charlottesville. That wasn't imho 'free speech' that was bullying, very much along the lines of the neo-nazis in 70s Britain.
For those who might be confused, the neo-nazis are the ones who carry swastikas and praise people like Hitler, who agree with nazi policies of 'white supremacy' and being hateful and even violent against people who are not white-skinned. Or even white-skinned enough, because now I'm seeing caucasians from places like Spain or Greece described (by the neo-nazis) as not being white.
What's different in this era to the bad old days in the 70s? The way the neo-nazi groups are making much better use of marketing techniques to confuse people. They're using 'nice' names for their groups. They're not nazis, they're the 'alt-right', they're 'Britain First', they're 'patriots', they're 'Christians'. Their marketing material suggests that they don't hate non-white people, they just want a white homeland for themselves. The groups are more likely to have nicely-spoken leaders who are fluent in doublespeak. But when the neo-nazis who follow these leaders are talking you find out what the real beliefs are, and they are clearly full of Hate First. Hate for people who aren't white enough, people who don't follow Christianity, people who aren't straight, people who are Jewish.
And now the modern neo-nazis are against people who aren't racist! If you're not racist then you're "anti-white" in their doublespeak, you're pro "white genocide"--though where that's happened other than somewhere like during the Holocaust where it was whites killing whites I have no idea.
Have these modern groups really managed to twist things so that the people protesting against nazi beliefs are the nazis? That people protesting against bullies are the bullies? Apparently they have, and I think this might be the scariest aspect of it yet.
If the neo-nazis, by whichever name they choose to call themselves, wish to go back to their 4-chan and their neo-nazi forums where they talk about the Bell Curve and Jews running the world, then they can have their free speech, even if it is hate speech. But when speech is used to bully and intimidate in the streets, when it's used to lie, then it's not free speech, it's hate speech.