The speaker discusses the challenges of achieving efficient interoperation between the computation graphs of deep neural net frameworks and open-cog hypergraph, as well as the need for effective scalability in open-cog hypergraph for distributed computing.