The speakers discuss the potential of deeper networks and quantum computing in achieving Artificial General Intelligence (AGI), highlighting how simple problems can be solved using deeper networks and the challenge of building a quantum computer for AGI.