The speaker suggests that some men are not looking for sexual partners in their relationships, but rather for motherly figures instead. They advise against using the justification of talking about sex with one's partner to justify infidelity.