Pre-training can provide a large boost in reducing data needs for models, as there are many signals that carry over across different domains and sensors. However, current models, such as behavior prediction for other vehicles on the road, still require continuous addition of data.