The speaker discusses the drawbacks of paying high taxes and the potential benefits of moving to a state with lower taxes, specifically mentioning the avoidance of capital gains taxes as a means of building wealth.