The speaker expresses confusion over the fact that many wealthy people seem to be stingy with their money instead of donating to worthwhile charities. They critique the notion that wealth is purely the result of effort and emphasize the role that privilege and luck play in achieving financial success.