The tweaks and adjustments made to AI language models such as GPT-4 may provide some temporary gains in performance, but the real progress will come from the exponential growth of compute power.