- Open Access
Emergent self-attention from astrocyte-gated associative memory dynamics
Phys. Rev. Research 8, 023276 – Published 11 June, 2026
DOI: https://doi.org/10.1103/6q3q-vfs9
Abstract
We introduce a Hopfield-type associative memory in which effective connectivity is multiplicatively modulated by astrocytic gains evolving under an entropy-regularized replicator equation. The coupled neuron-astrocyte dynamics admit a Lyapunov function, ensuring global convergence. At fixed points, astrocytic gains implement a softmax-normalized allocation over pattern similarity scores, yielding a mechanistic realization of self-attention as emergent routing on the gain simplex. In regimes of high memory load and interference, the model significantly improves retrieval accuracy relative to classical Hopfield dynamics and recent neuron-astrocyte baselines. These results establish a dynamical systems framework linking glial modulation, competitive resource allocation, and attentionlike computation.
Physics Subject Headings (PhySH)
Article Text
References (31)
- J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proc. Natl. Acad. Sci. USA 79, 2554 (1982).
- D. J. Amit, Modeling Brain Function: The World of Attractor Neural Networks (Cambridge University Press, Cambridge, 1989).
- D. Krotov and J. J. Hopfield, Dense associative memory for pattern recognition, in Advances in Neural Information Processing Systems (Curran Associates, Inc., Red Hook, NY, 2016), Vol. 29, pp. 1172–1180.
- D. Krotov and J. Hopfield, Large associative memory problem in neurobiology and machine learning, in 9th International Conference on Learning Representations (2021).
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, I. Polosukhin, Attention is all you need, in Advances in Neural Information Processing Systems (Curran Associates, Inc., Red Hook, NY, 2017), pp. 5998–6008.
- H. Ramsauer, B. Schäfl, J. Lehner, P. Seidl, M. Widrich, T. Adler, L. Gruber, M. Holzleitner, M. Pavlović, G. K. Sandve, V. Greiff, D. Kreil, M. Kopp, G. Klambauer, J. Brandstetter, and S. Hochreiter, Hopfield networks is all you need, arXiv:2008.02217.
- A. Araque, R. P. Sanzgiri, V. Parpura, and P. G. Haydon, Astrocyte-induced modulation of synaptic transmission, Can. J. Physiol. Pharmacol. 77, 699 (1999).
- G. Perea, M. Navarrete, and A. Araque, Tripartite synapses: Astrocytes process and control synaptic information, Trends Neurosci. 32, 421 (2009).
- M. Letellier, Y. K. Park, T. E. Chater, P. H. Chipman, S. G. Gautam, T. Oshima-Takago, and Y. Goda, Astrocytes regulate heterogeneity of presynaptic strengths in hippocampal networks, Proc. Natl. Acad. Sci. USA 113, E2685 (2016).
- M. De Pittà, N. Brunel, and A. Volterra, Astrocytes: Orchestrating synaptic plasticity? Neuroscience 323, 43 (2016).
- C. Giaume, A. Koulakoff, L. Roux, D. Holcman, and N. Rouach, Astroglial networks: A step further in neuroglial and gliovascular interactions, Nat. Rev. Neurosci. 11, 87 (2010).
- A. Verkhratsky and M. Nedergaard, Physiology of astroglia, Physiol. Rev. 98, 239 (2018).
- S. S. Purushotham and Y. Buskila, Astrocytic modulation of neuronal signalling, Front. Network Physiol. 3, 1205544 (2023).
- S. Makovkin, E. Kozinov, M. Ivanchenko, and S. Gordleeva, Controlling synchronization of gamma oscillations by astrocytic modulation in a model hippocampal neural network, Sci. Rep. 12, 6970 (2022).
- L. Thompson, J. Khuc, M. S. Saccani, N. Zokaei, and M. Cappelletti, Gamma oscillations modulate working memory recall precision, Exp. Brain Res. 239, 2711 (2021).
- K.-I. Dewa, K. Kaseda, A. Kuwahara, H. Kubotera, A. Yamasaki, N. Awata, A. Komori, M. A. Holtz, A. Kasai, H. Skibbe, N. Takata, T. Yokoyama, M. Tsuda, G. Numata, S. Nakamura, E. Takimoto, M. Sakamoto, M. Ito, T. Masuda, and J. Nagai, The astrocytic ensemble acts as a multiday trace to stabilize memory, Nature (London) 648, 146 (2025).
- S. Zbaranska and S. A. Josselyn, Astrocytes: Emerging stars of engrams, Cell Res. 35, 241 (2025).
- S. A. Josselyn and S. Tonegawa, Memory engrams: Recalling the past and imagining the future, Science 367, eaaw4325 (2020).
- L. Kozachkov, K. V. Kastanenka, and D. Krotov, Building transformers from neurons and astrocytes, Proc. Natl. Acad. Sci. USA 120, e2219150120 (2023).
- L. Kozachkov, J.-J. Slotine, and D. Krotov, Neuron–astrocyte associative memory, Proc. Natl. Acad. Sci. USA 122, e2417788122 (2025).
- P. Coucheney, B. Gaujal, and P. Mertikopoulos, Penalty-regulated dynamics and robust learning procedures in games, Math. Oper. Res. 40, 611 (2015).
- M. A. Di Castro, J. Chuquet, N. Liaudet, K. Bhaukaurally, M. Santello, D. Bouvier, P. Tiret, and A. Volterra, Local detection and modulation of synaptic release by astrocytes, Nat. Neurosci. 14, 1276 (2011).
- G. Perea and A. Araque, Astrocytes potentiate transmitter release at single hippocampal synapses, Science 317, 1083 (2007).
- C. Agulhon, T. A. Fiacco, and K. D. McCarthy, Hippocampal short- and long-term plasticity are not modulated by astrocyte signaling, Science 327, 1250 (2010).
- E. Shigetomi, S. Patel, and B. S. Khakh, Probing the complexities of astrocyte calcium signaling, Trends Cell Biol. 26, 300 (2016).
- A. Halder, K. F. Caluya, B. Travacca, and S. J. Moura, Hopfield neural network flow: A geometric viewpoint, IEEE Trans. Neural Networks Learn. Syst. 31, 4869 (2020).
- R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, Adaptive mixtures of local experts, Neural Comput. 3, 79 (1991).
- S. Betteti, G. Baggio, F. Bullo, and S. Zampieri, Input-driven dynamics for robust memory retrieval in Hopfield networks, Sci. Adv. 11, eadu6991 (2025).
- M. K. Benna and S. Fusi, Computational principles of synaptic memory consolidation, Nat. Neurosci. 19, 1697 (2016).
- A. Vivet and A. Arenas, Astrocyte-gated associative memory: Code repository, GitHub repository, 2026, https://github.com/arnauvivett/Astrocyte-gated-associative-memory-, accessed 10 February 2026.
- P. Mertikopoulos and W. H. Sandholm, Riemannian game dynamics, J. Econ. Theory 177, 315 (2018).