Self-play can quickly develop reasonable strategies in StarCraft despite long sequences of actions in games. This is possible with at least 10 minutes per game on average, making it quicker than relying on supervised learning for large LSTMs or transformers.