Humans are pre-programmed this way...to react to differences.
Reactions can vary form positive to negative....either way..it does take a conscious effort to reprogram ourselves in the interests of being reasonable and sometimes fair.
But the (basic) instinct is natural and necessary in some cases.