The speaker recommends losing around 5% of your total calories every week or two weeks depending on factors such as inflammation from food, training, and other fluctuations in the body. Additionally, he emphasizes the importance of maintaining a positive mindset, as negative mental states often accompany bodybuilding and fitness training.