The speaker argues that potential pleasure alone isn't enough to justify certain actions, such as killing animals or debating the morality of abortion, when pleasure and pain should be considered equally in moral decisions.