The speaker discusses how some family gossip can be fun and gossipy, while other gossip can be petty and bitter, with some of it being genuinely concerning and warranting the whisper network treatment.