Discrete decision making in neural networks can offer better guarantees of generalization, particularly relating to out-of-distribution data. While increasing the size of the training set is one solution, incorporating a programmatic decision-making approach in addition to neural networks can further improve performance.