That's completely subjective depending where you are, really.
White dude tries the black jokes in hotlanta ... yow.
Same thing in new york and LA, not so big a deal.... wait let's put a stipulation on what i'm saying here as a professional comedian that's one thing ... as some dude on the street .. yea, you're right prepare for at the very least a stern talking to.
I like racists like me who can take it and dish it out with a smile on their face. After all what better use for ignorance than humor and entertainment?