The speaker realized that being a CEO was not what he signed up for and either he had to leave or the toxicity in the company had to go, eventually deciding to quit.