The speaker shares how he decides what to quit by going towards things that give him energy rather than feeling obligated to stick with something. He gives an example of quitting car racing classes and pursuing his new business venture that does give him energy.