The speaker emphasizes the importance of prioritizing relationships and cutting out negative influences in order to improve the quality of life. Despite the Harvard longevity study suggesting relationships are essential to a healthy life, the speaker chooses to prioritize quality over quantity of relationships.