Episode
#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
1:29:29
Published: Thu Feb 20 2020
Description
Andrew Ng is one of the most impactful educators, researchers, innovators, and leaders in artificial intelligence and technology space in general. He co-founded Coursera and Google Brain, launched deeplearning.ai, Landing.ai, and the AI fund, and was the Chief Scientist at Baidu. As a Stanford professor, and with Coursera and deeplearning.ai, he has helped educate and inspire millions of students including me. EPISODE LINKS: Andrew Twitter: https://twitter.com/AndrewYNg Andrew Facebook: https://www.facebook.com/andrew.ng.96 Andrew LinkedIn: https://www.linkedin.com/in/andrewyng/ deeplearning.ai: https://www.deeplearning.ai landing.ai: https://landing.ai AI Fund: https://aifund.ai/ AI for Everyone: https://www.coursera.org/learn/ai-for-everyone The Batch newsletter: https://www.deeplearning.ai/thebatch/ This conversation is part of the Artificial Intelligence podcast. If you would like to get more information about this podcast go to https://lexfridman.com/ai or connect with @lexfridman on Twitter, LinkedIn, Facebook, Medium, or YouTube where you can watch the video versions of these conversations. If you enjoy the podcast, please rate it 5 stars on Apple Podcasts, follow on Spotify, or support it on Patreon. This episode is presented by Cash App. Download it (App Store, Google Play), use code "LexPodcast". This episode is also supported by the Techmeme Ride Home podcast. Get it on Apple Podcasts, on its website, or find it by searching "Ride Home" in your podcast app. Here's the outline of the episode. On some podcast players you should be able to click the timestamp to jump to that time. OUTLINE: 00:00 - Introduction 02:23 - First few steps in AI 05:05 - Early days of online education 16:07 - Teaching on a whiteboard 17:46 - Pieter Abbeel and early research at Stanford 23:17 - Early days of deep learning 32:55 - Quick preview: deeplearning.ai, landing.ai, and AI fund 33:23 - deeplearning.ai: how to get started in deep learning 45:55 - Unsupervised learning 49:40 - deeplearning.ai (continued) 56:12 - Career in deep learning 58:56 - Should you get a PhD? 1:03:28 - AI fund - building startups 1:11:14 - Landing.ai - growing AI efforts in established companies 1:20:44 - Artificial general intelligence
Chapters
In this podcast, listeners can learn about the cryptocurrency Bitcoin and the history of money, all thanks to Cash App.
00:00 - 02:34 (02:34)
Summary
In this podcast, listeners can learn about the cryptocurrency Bitcoin and the history of money, all thanks to Cash App. By using the promo code LEXPODCAST, listeners can donate to a good cause and get $10 on Cash App.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
Andrew Ng, creator of the Google Brain project and founder of deeplearning.ai, spent countless late nights recording machine learning tutorials for online platforms to help people learn, often staying up until 2 a.m. or 3 a.m., according to his interview on the "Voices in AI" podcast.
02:34 - 07:06 (04:31)
Summary
Andrew Ng, creator of the Google Brain project and founder of deeplearning.ai, spent countless late nights recording machine learning tutorials for online platforms to help people learn, often staying up until 2 a.m. or 3 a.m., according to his interview on the "Voices in AI" podcast.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
The rise of machine learning and data science may bring in more people with a concrete use for it in their daily lives and jobs than software engineering, making it an even easier entree into the developer world.
07:06 - 19:09 (12:03)
Summary
The rise of machine learning and data science may bring in more people with a concrete use for it in their daily lives and jobs than software engineering, making it an even easier entree into the developer world. The machine learning movement started with more people learning about its applications to their work, reaching a broader range of people doing infrastructure, data pipelines, and software surrounding the core machine learning model.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
The lack of practical applications of reinforcement learning during the author's time at Stanford inspired him to seek ways to create work in the area that would have a positive impact and influence people.
19:09 - 23:40 (04:31)
Summary
The lack of practical applications of reinforcement learning during the author's time at Stanford inspired him to seek ways to create work in the area that would have a positive impact and influence people. This mindset led to the successful development of the autonomous helicopter work for flying helicopters using reinforcement learning.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
Researchers are advocating for teaching students how to define their own problem and find their own data sets for AI projects instead of using pre-existing data sets, to yield better results in AI projects.
23:40 - 33:19 (09:38)
Summary
Researchers are advocating for teaching students how to define their own problem and find their own data sets for AI projects instead of using pre-existing data sets, to yield better results in AI projects. This method is ideal for small data sets with around 100 examples.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
The deep learning specialization is slightly easier for people who have done the machine learning course, but it is still possible to jump into directly.
33:19 - 40:12 (06:53)
Summary
The deep learning specialization is slightly easier for people who have done the machine learning course, but it is still possible to jump into directly. Debugging machine learning programs is different than the traditional software engineering approach, and the AI Fund, Landing AI, and Deep Learning AI specialize in creating new companies, helping established ones with AI, and educating individuals, respectively.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
The podcast discusses a potential daily routine for individuals learning deep learning, focusing on the fundamentals of supervised learning with simple data sets like MNIST, and discouraging the exclusive use of deep learning in AI teams.
40:12 - 51:27 (11:14)
Summary
The podcast discusses a potential daily routine for individuals learning deep learning, focusing on the fundamentals of supervised learning with simple data sets like MNIST, and discouraging the exclusive use of deep learning in AI teams.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
Taking notes, preferably handwritten, increases retention.
51:27 - 56:01 (04:34)
Summary
Taking notes, preferably handwritten, increases retention. Although typing is faster for most people, the act of taking notes is still beneficial compared to not taking any notes at all.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
It's important to consider the people and opportunities available when deciding whether to pursue a PhD or work on projects and continue learning through other means.
56:01 - 1:04:21 (08:20)
Summary
It's important to consider the people and opportunities available when deciding whether to pursue a PhD or work on projects and continue learning through other means. A great logo or prestigious institution may not guarantee a fulfilling experience.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
Startups that have a deep understanding of their customers and are customer obsessed are more likely to succeed with AI-driven projects to move the world forward.
1:04:21 - 1:11:13 (06:51)
Summary
Startups that have a deep understanding of their customers and are customer obsessed are more likely to succeed with AI-driven projects to move the world forward. While many startup studios are trying to figure out how to systematically build companies with a high success rate, it is important to find ways to serve people in meaningful ways whether in academic, corporate, or startup settings.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
The machine learning model is only a small part of the entire software system required to build an effective machine learning solution.
1:11:14 - 1:21:36 (10:22)
Summary
The machine learning model is only a small part of the entire software system required to build an effective machine learning solution. Good software engineering is crucial for managing the change process and deploying the solution to achieve real impact.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
The biggest problem with self-driving cars is not ethical dilemmas with trolley problems, but rather the difficulty of navigating unexpected scenarios, such as sudden obstacles in the road.
1:21:36 - 1:27:39 (06:02)
Summary
The biggest problem with self-driving cars is not ethical dilemmas with trolley problems, but rather the difficulty of navigating unexpected scenarios, such as sudden obstacles in the road.
Episode#73 – Andrew Ng: Deep Learning, Education, and Real-World AI
PodcastLex Fridman Podcast
An individual's outlook on life can be to help others achieve their dreams and to advance humanity as a whole.
1:27:39 - 1:29:13 (01:34)
Summary
An individual's outlook on life can be to help others achieve their dreams and to advance humanity as a whole. Helping someone achieve their goals can be one of life's most rewarding experiences, and giving back to organizations that inspire and educate future innovators can bring happiness through one's contributions to the greater good.