The speaker talks about how difficult it was for him to find ways to spend his free time while working as a policeman in Mount Vernon, often resorting to spending $150 on drinks and appetizers.