The mismatch between artificial and biological neural networks holds the potential to help researchers understand how brains work and incorporate these differences into developing new ideas that can improve artificial neural networks.