The speaker describes how he derived his self-esteem from external factors such as his academic achievements, social skills, and pleasing his parents, which created a toxic dynamic in his family.