The speaker advises being honest and clear about declining invitations instead of making up stories, and suggests offering an alternative time or suggesting someone else for the job. They also mention their personal reluctance to travel internationally for business, which limits their advance bookings.