A discussion about the power of deep neural networks and how they can be trained end to end with backpropagation.