The idea that rockets go straight up is a common misconception. In reality, they go parallel to the Earth and then tilt due to the effects of gravity.