Well yellow can be offensive, it depends on how you use it. But mostly in HK I don't think guys would go off like you guys if they were called yellow. It depends on whether are you saying something like "Oh you're yellow (usually there's a misunderstanding there), apologies." Or "You blahblahblah.".