Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

Complex dynamics in the Sherrington-Kirkpatrick game

Desmond Chan*

Tobias Galla†

  • Department of Informatics, King's College, London WC2B 4BG, United Kingdom

  • Instituto de Física Interdisciplinar y Sistemas Complejos, IFISC, Edifici Instituts Universitaris de Recerca, Campus Universitat de les Illes Balears, E-07122 Palma, Mallorca, Spain

  • *Contact author: desmond.chan@kcl.ac.uk
  • †Contact author: tobias.galla@ifisc.uib-csic.es

Phys. Rev. E 114, 044325 – Published 28 October, 2026

DOI: https://doi.org/10.1103/b1qh-k8pn

Abstract

We study the outcome of adaptive learning among many players engaged in sets of two-strategy, two-player games. We are interested in typical games and therefore generate the payoff matrices randomly at the outset. These payoff matrices then remain fixed throughout the learning process. This provides a game-theoretic foundation for the Sherrington-Kirkpatrick (SK) game recently introduced by Garnier-Brun et al. [Phys. Rev. X 14, 021039 (2024)]. The original model studied by these authors corresponds to the special case with no bias toward either strategy. Here, we determine the stability of learning in SK games with general random biases and show that the nature of the stable state is affected by random fields. We also introduce a grand-canonical version of the SK game, in which players may choose to abstain. For this extended model, we again determine the stability of learning. Our analysis confirms that complex situations involving many players are often unlearnable, even if each player chooses between only two actions. The rate at which players forget past payoffs and the competitiveness of the game emerge as key parameters determining whether learning converges to a unique fixed point, whether multiple fixed points arise, or whether the dynamics remain persistently volatile.

View figure in article

Physics Subject Headings (PhySH)

Article Text

References (40)

  1. J. von Neumann and O. Morgenstern, Theory of Games and Economic Behavior (Princeton University Press, Princeton, 1944).
  2. C. Hauert and G. Szabó, Game theory and physics, Am. J. Phys. 73, 405 (2005).
  3. A. Traulsen and C. Hauert, Stochastic evolutionary game dynamics, Rev. Nonlinear Dyn. Complexity 2, 25 (2009).
  4. J. F. Nash, Equilibrium points in n-person games, Proc. Natl. Acad. Sci. USA 36, 48 (1950).
  5. J. Berg and A. Engel, Matrix games, mixed strategies, and statistical mechanics, Phys. Rev. Lett. 81, 4999 (1998).
  6. J. Berg and M. Weigt, Entropy and typical properties of Nash equilibria in two-player games, Europhys. Lett. 48, 129 (1999).
  7. A. McLennan and J. Berg, Asymptotic expected number of Nash equilibria of two-player normal form games, Games Econ. Behav. 51, 264 (2005).
  8. C. Daskalakis, P. W. Goldberg, and C. H. Papadimitriou, The complexity of computing a Nash equilibrium, Commun. ACM 52, 89 (2009).
  9. Y. Sato, E. Akiyama, and J. D. Farmer, Chaos in learning a simple two-person game, Proc. Natl. Acad. Sci. USA 99, 4748 (2002).
  10. Y. Sato and J. P. Crutchfield, Coupled replicator equations for the dynamics of learning in multiagent systems, Phys. Rev. E 67, 015206(R) (2003).
  11. Y. Sato, E. Akiyama, and J. P. Crutchfield, Stability and diversity in collective adaptation, Physica D 210, 21 (2005).
  12. T. Galla and J. D. Farmer, Complex dynamics in learning complicated games, Proc. Natl. Acad. Sci. USA 110, 1232 (2013).
  13. J. B. Sanders, J. D. Farmer, and T. Galla, The prevalence of chaotic dynamics in games with many players, Sci. Rep. 8, 4902 (2018).
  14. M. Pangallo, T. Heinrich, and J. Doyne Farmer, Best reply structure and equilibrium convergence in generic games, Sci. Adv. 5, eaat1328 (2019).
  15. M. Opper and S. Diederich, Phase transition and 1/f noise in a game dynamical model, Phys. Rev. Lett. 69, 1616 (1992).
  16. J. Garnier-Brun, M. Benzaquen, and J.-P. Bouchaud, Unlearnable games and “satisficing” decisions: A simple model for a complex world, Phys. Rev. X 14, 021039 (2024).
  17. D. Sherrington and S. Kirkpatrick, Solvable model of a spin-glass, Phys. Rev. Lett. 35, 1792 (1975).
  18. P. C. Menezes and D. Sherrington, Minority game with SK interactions, J. Phys. A: Math. Theor. 46, 505004 (2013).
  19. R. M. May, Will a large complex system be stable? Nature (London) 238, 413 (1972).
  20. D. Challet, A. De Martino, M. Marsili, and I. Perez Castillo, Minority games with finite score memory, J. Stat. Mech. (2006) P03004.
  21. C. Camerer and T.-H. Hua, Experience-weighted attraction learning in normal form games, Econometrica 67, 827 (1999).
  22. R. A. Rescorla and A. R. Wagner, A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement, in Classical Conditioning II: Current Research and Theory, edited by A. H. Black and W. F. Prokasy (Appleton-Century-Crofts, New York, 1972), pp. 64–99.
  23. R. S. Sutton, A. G. Barto, and A. Barto, Reinforcement Learning: An Introduction (MIT Press, Cambridge, 1998), Vol. 1.
  24. M. Pessiglione, B. Seymour, G. Flandin, R. J. Dolan, and C. D. Frith, Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans, Nature (London) 442, 1042 (2006).
  25. O. Dan, O. Plonsky, and Y. Loewenstein, Behavior engineering using quantitative reinforcement learning models, Nat. Commun. 16, 4109 (2025).
  26. A. Traulsen, T. Röhl, and H. G. Schuster, Stochastic gain in population dynamics, Phys. Rev. Lett. 93, 028701 (2004).
  27. C. De Dominicis, Dynamics as a substitute for replicas in systems with quenched random impurities, Phys. Rev. B 18, 4913 (1978).
  28. A. C. C. Coolen, The Mathematical Theory of Minority Games: Statistical Mechanics of Interacting Agents (Oxford University Press, Oxford, 2005).
  29. T. Galla, Generating-functional analysis of random Lotka-Volterra systems: A step-by-step guide, arXiv:2405.14289.
  30. G. Bunin, Ecological communities with Lotka-Volterra dynamics, Phys. Rev. E 95, 042414 (2017).
  31. F. Roy, G. Biroli, G. Bunin, and C. Cammarota, Numerical implementation of dynamical mean field theory for disordered systems: Application to the Lotka-Volterra model of ecosystems, J. Phys. A: Math. Theor. 52, 484001 (2019).
  32. There can be multiple solutions of Eq.  (19) in the interval (−1,1) in certain circumstances. This arises when Γ>0 and λ<2Γσ2χ. Although we cannot formally demonstrate that this never occurs for the parameter ranges considered in this work, we have not encountered any multivaluedness. We therefore hypothesize that, for any combination of parameters in the stable fixed-point regime, there is a unique solution m(z) of Eq.  (19).
  33. L. Sidhom and T. Galla, Ecological communities from random generalized Lotka-Volterra dynamics with nonlinear feedback, Phys. Rev. E 101, 032101 (2020).
  34. D. Challet, M. Marsili, and Y.-C. Zhang, Modeling market mechanism with Minority Game, Physica A 276, 284 (2000).
  35. B. Mandelbrot, The variation of certain speculative prices J BUS 36, 394 (1963).
  36. R. N. Mantegna and H. E. Stanley, Introduction to Econophysics: Correlations and Complexity in Finance (Cambridge University Press, Cambridge, 1999).
  37. J.-P. Bouchaud, I. Giardina, and M. Mezard, On a universal mechanism for long ranged volatility correlations, Quantitative Finance 1, 212 (2001).
  38. H. Rieger, Solvable model of a complex ecosystem with randomly interacting species, J. Phys. A: Math. Gen. 22, 3447 (1989).
  39. Data and codes: https://github.com/Desmondccw/complex_dynamics_in_sk_game.
  40. S. O'Rourke, D. Renfrew, A. Soshnikov, and V. Vu, Products of independent elliptic random matrices, J. Stat. Phys. 160, 89 (2015).

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation