Confidence levels can be affected by early childhood experiences and self-stories, which can vary greatly between individuals and impact social confidence in particular. The speaker explores how much childhood self-story influences present confidence levels.