The future calls for co-designing neural networks and hardware, with each propelling the development of the other. Nvidia does exactly that, alternating the manufacture of hardware and the creation of neural networks to create a cycle of development.