The speaker argues that Dr. Fauci lost credibility with a broad swath of people due to his use of determinism, stating that getting the vaccine would ultimately end the pandemic. However, the pandemic did not end and instead evolved, leading to him losing supporters.