The speaker explains that cheating isn't always the sign of a consistent pattern and states that focusing on only the infidelity aspect might ruin the intimacy aspect of the relationship. They also suggest that the lack of intimacy in a relationship increases the possibility of cheating on either side.