It's hard-wired into our brains to be that way. The challenge is to try to recognize our own biases and stay objective.
You're no more objective than I am. We're just on different sides of the bias here.