The speaker discusses the strong bond that can arise between people who have left a pre-existing structure such as a religion or career, potentially due to feeling bothered or troubled by it, and the alienation and loneliness that can result from being solely responsible for oneself.