The attention mechanism in natural language processing needs to improve to allow for better representation of long-term memory. One possible solution involves forming hierarchical representations that allow for more clever use of tokens.