Hate is a strong word and racism cannot be defined quite so simply. Hate is not a prerequisite. Treating people differently whether intentionally or unintentionally would fall under racism be it because of presumed inheritable traits, abilities, or qualities.
If you avoid someone of another race who looks like a thug its no different from avoiding a thuggish looking person of your own race.
"Thug" is a term of endearment, a badge of honor, in the rap community therefore it is likely racist.