I always have issues with stuff like this because I do the same thing, and yes, to other black men. I do it to every man I see on the street. I will size you up and if I feel stranger-danger, I will switch directions.
It's fucked up because it can happen to me, but I have to keep it real. I do the same too.