The speaker discusses the challenges of developing a minimal state dimension for a robot hand and object in contact, and the importance of considering mechanics when developing representations. They suggest that learning is likely the key to success.