The speaker challenges the idea of Joe Rogan's impact on politics, suggesting that if Rogan became politically active and called out the system, he would be destroyed.