In the early days of video games, developers had to find clever ways to optimize graphics for speed due to hardware limitations. This included creating separate programs specifically optimized for certain image sizes and implementing compiled shapes to improve efficiency.