The speaker talks about the concern regarding the association with people who can be misconstrued to have radical ideas, such as Michael Malice and Joe Rogan, in academia. They argue that Joe Rogan is centrist and not radical despite being attacked for certain opinions.