The speaker emphasizes the importance of minimizing phone usage around children to prevent them from developing an addiction to their phone as well as promote quality family time.