The speaker shares his personal experience on how mundane phone calls and lack of proper planning can affect productivity and emphasizes the need to eliminate distractions to focus during work time.