The true measurement of an AI's game performance is achieved by sticking it in games with varying skill levels to test whether it performs better than a strong or expert human player. This concept is similar to developing a self-driving car that should be tested on the road with non-expert drivers.