If there was a Black or Asian person who was vociferously nationalistic to the point of being openly racist I would have no problem calling them gammon too.

You have more right to be upset about being called a bowl of strawberry ice cream than they do about being called gammon.