This same phenomenon is of much wider scope. It is often taken for granted that the person who discriminates against others because of their race, religion, color, or whatever, incurs no costs by doing so but simply imposes costs on others. This view is on a par with the very similar fallacy that a country does not hurt itself by imposing tariffs on the products of other countries. Both are equally wrong. The man who objects to buying from or working alongside a Negro, for example, thereby limits his range of choice. He will generally have to pay a higher price for what he buys or receive a lower return for his work. Or, put the other way, those of us who regard color of skin or religion as irrelevant can buy some things more cheaply as a result.
|—||Milton Friedman, Capitalism and Freedom (1962), Chapter VII: Capitalism and Discrimination|