The speaker points out the hypocrisy of judging people based on their past, since everyone has one, and brings up the example of not knowing people during their past relationships.