The speaker advises the listener to consider if they truly want to be in a relationship with their current partner before exploring polyamory with someone else. They suggest evaluating their feelings and taking things slow if they do decide to pursue a new relationship.