The speaker, discussing the impact of privilege, notes that one's perception of equity is influenced by their background and experiences, with many in privileged positions viewing movements for equality as oppression against them. This perception can drive political polarization both on the right and left.