The speaker wonders what it would take for an AI system to have a moment of innovation similar to humans, and also shares personal experiences of discovering previously made discoveries.