That's how oppression works. Thousands of otherwise decent people are persuaded to go along with an unfair system because changing it seems like too much bother. The appropriate response when somebody demands a change in that unfair system is to listen, rather than turn away or yell, as a child might, that it's not your fault. Of course it isn't your fault. I'm sure you're lovely. That doesn't mean you don't have a responsibility to do something about it.