The dynamics of the synapse change constantly and this presents a challenge for creating accurate models for neurobiology and computation. Understanding the synaptic dynamics is crucial to understanding the functioning of complex networks in the brain.
The use of learning systems in AI and biology has been surprising and essential, although it may take a while for it to be integrated into large networks. It is assumed that it is simply capturing data which will be useful in the future, but no one knows how it works in biology yet.
The brain compresses information into useful chunks to be stored as memories, rather than storing every piece of information that comes in, according to a physicist's viewpoint from 35 years ago.
The dynamics of the synapse change is going on all the time, but there's a dynamic system in which you can say that the synapses don't change much during a computation. It is important to consider both the synaptic and system dynamics to model neurobiology.