The use of Long Short-Term Memory (LSTM) in reinforcement learning has been an improvement over traditional RNNs, but efficient planning among the many possible action sequences still needs to be addressed.