The speaker discusses the limitations of large language models and the neocortex, which has different levels. They also mention Neuralink's brain computer interface, which has recently reached 100 billion bytes and works well.