Being descriptive isn't being racist, but there is a very thin line that exists where it can quickly escalate to racist, or be confused as racist. For instance ...
I am asian, I was near some folks in an elevator, with a fellow telling an amusing anecdote to a friend. I wasn't really listening but "overhearing" the conversation. He was complaining about *whatever* and got to the line "stupid chinese fella couldn't even talk".
Theres a couple different ways to view this, my initial reaction was to be annoyed, than to analyze. What do you mean "Stupid Chinese" ? Is he just a stupid guy, that happens to be chinese ? Being descriptive like that shouldn't offend me, or anyone besides the stupid. However is he stupid because he's chinese ? Thats how easy something can be confused. Also is his english so poor ? I agree immigrants that come into the country legally (as my father did) should try to learn the language of the land (as my father did). Though even after 30 years of speaking english, his is not comparable to my own, as would be expected of anyone besides a native, or a linguist. Even with my fathers decent overall communication skills, I would bet $1000.00 that someone has said "Stupid chinaman can't talk no good" in reference to him before.
Also you can joke with friends in ways you can't with strangers. In a crowd of people I would never yell out something like "I hate white people, and no, I'm not doing any math homework for you !", but amongst friends that would be a pretty innocuous remark. In the end I choose to judge by intent, and not by words specifically.
In your specific case I would say the only folks to be likely offended, would be the homosexual. I consider myself a very tolerant, accepting person, but even in my case, I slip out a little "thats gay", or "what a douche-fag, ass-pounding, aids-spreading, reach-around artist" remark, almost without thinking about how offensive that would be to a gay person. In this case that immediately makes me a huge hypocrite, and I will try to make myself a better human being from here on.