The speaker highlights the challenges of managing a large staff, particularly in areas like security, police and contracts, which require background checks and proper management.