Deep neural networks are composed of many individual neurons, which combine in complex and counterintuitive ways to solve challenging tasks, ranging from machine translation to Go. This complexity grants neural networks their power but also earns them their reputation as confusing and opaque black boxes. Understanding how deep neural networks function is critical for explaining their decisions and enabling us to build more powerful systems.