Neural networks have been used to act as knowledge bases and language models investigated as knowledge bases to aggregate important information over long periods of time, allowing useful representations of state that can aid in decision making.