Because that's how language works
What, language works by changing the context of one's intent? By fooling people into thinking you are saying something you're not?

Your argument is that if you call someone a name but don't really believe it...
No, my argument is that calling someone a name is not a statement that I think my race is superior to theirs.

misunderstood
So you're admitting that it isn't racist, just that it can be misunderstood as racist? That's really not the same thing, is it?