The speaker emphasizes the importance of forming genuine friendships and not just settling for popularity and status based on a large group of acquaintances. He recalls experiences of realizing that some of his supposed friends were only associated with him due to the primacy effect.