The speaker discusses the need for benchmarks to evaluate the performance of visual scene understanding in AI systems, particularly in aiding the blind, as well as the importance of evaluating performance in both simulated and real-world environments.