The speaker suggests that we should weigh the net benefits and taxes on our nervous system before indulging in certain activities and foods, particularly during stressful times, in order to optimize our health and well-being. They emphasize the importance of balance in maintaining a healthy lifestyle.