Unregulated AI systems in finance could lead to massive breaches and crashes, causing companies to allocate resources towards cybersecurity and ultimately leading to fear and mistrust from the public. The stability of these systems is crucial for their successful integration into society.