The process of processing the raw sensor data gathered by Waymo's autonomous vehicles involves real-time operations of fleet cars, exchange of real-time information, and massive amounts of data for training ML models and evaluating the entire system in simulation. Building custom frameworks for data mining is crucial in identifying interesting edge cases for training and evaluating subcomponents of the autonomous driving system on various ML models.