The speaker notes that in survival situations, women are often tougher and calmer than men, while men tend to come off as aggressive and focused on building shelter.