The use of neural networks and learning from data can lead to brilliant success and frustrating failures, with limited introspection into how the network operates. While better quality and organized data can improve the issue, the atomic nature of symbols in AI can still present a challenge.