The ability of artificial intelligence to differentiate between a cat and a dog lies in the connections between the layers of neurons in its system, with the deeper layers becoming more abstract and complex, culminating in the AI being able to classify between the two animals through formal logic.