The speaker expresses challenges that come with being an entrepreneur, including the difficulty in asking for previews for calls, the widespread notion of building something, and the loss of benefits in moving from a W2 job to entrepreneurship.