The challenge of long range video understanding involves tracking, understanding entities and their goals, and predicting their behavior in a video clip, which is currently an unsolved problem.