The real power of neural networks does not come from their inscrutability or mystery, but rather from their differentiability. In this podcast, the hosts discuss the idea that the power of neural networks stems from their ability to differentiate and the lack of mysticism surrounding them.