Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

Modeling language evolution using a spin glass approach

Hediye Yarahmadi1, Kwang Il Ryom1, Giuseppe Longobardi2, and Alessandro Treves1,*

  • 1SISSA–Cognitive Neuroscience, Trieste 34136, Italy
  • 2University of York, Heslington, York YO10 5DD, United Kingdom

  • *Contact author: ale@sissa.it

Phys. Rev. E 113, 034312 – Published 18 March, 2026

DOI: https://doi.org/10.1103/52k8-zz47

Abstract

The evolution of natural languages poses a riddle to any theoretical perspective based on efficiency considerations. If languages are already optimally effective means of organization and communication of thought, then why do they change? And if they are driven to become optimally effective in the future, then why do they change so slowly, and why do they diversify, rather than converge toward an optimum? We look here at the hypothesis that disorder, rather than efficiency, may play a dominant role. Most traditional approaches to study diachronic language dynamics emphasize lexical data, but it would seem that a crucial contribution to the effectiveness of a thought-coding device is given by its core generative structure, i.e., its syntax. Based on the reduction of syntax to a set of binary syntactic parameters, we introduce here a model of natural language change in which diachronic dynamics can stem from disordered interactions between/among parameters, even in the idealized limit of identical external inputs. We show in which region of “phase space” such dynamics show the glassy features that are observed in natural language across time. In particular, binary syntactic vectors remain trapped in glassy metastable (i.e., tendentially stable) states when the degree of asymmetry in the disordered interactions is below a critical value, consistent with studies of spin glasses with asymmetric interactions. We further show that an added Hopfield-type memory term would indeed, if strong enough, stabilize syntactic configurations even above the critical value, but losing the multiplicity of stable states. Finally, using a notion of linguistic distance in syntactic state space we show that a phylogenetic signal may remain among related languages, despite their gradually divergent syntax, exactly as recently pointed out for real-world languages. These statistical results appear to generalize beyond the dataset of 94 syntactic parameters across 58 languages used in this study.

View figure in article

Physics Subject Headings (PhySH)

Article Text

Supplemental Material

References (40)

  1. C. Guardiano and G. Longobardi, Parametric comparison and language taxonomy, in Grammaticalization and Parametric Variation (Oxford University Press, Oxford, UK, 2005), pp. 149–174.
  2. A. Ceolin, C. Guardiano, G. Longobardi, M. A. Irimia, L. Bortolussi, and A. Sgarro, At the boundaries of syntactic prehistory, Phil. Trans. Roy. Soc. B 376, 20200197 (2021).
  3. E. L. Keenan, Universal Grammar (RLE Linguistics A: General Linguistics) (Routledge, New York, NY, 2014).
  4. M. Swadesh, Lexico-statistic dating of prehistoric ethnic contacts: With special reference to North American Indians and Eskimos, Proc. Am. Philos. Soc. 96, 452 (1952).
  5. R. D. Gray and Q. D. Atkinson, Language-tree divergence times support the anatolian theory of Indo-European origin, Nature (London) 426, 435 (2003).
  6. L. Sagart, G. Jacques, Y. Lai, R. J. Ryder, V. Thouzeau, S. J. Greenhill, and J.-M. List, Dated language phylogenies shed light on the ancestry of Sino-Tibetan, Proc. Natl. Acad. Sci. USA 116, 10317 (2019).
  7. S. J. Greenhill, P. Heggarty, and R. D. Gray, Bayesian phylolinguistics, Handbook Histor. Ling. 2, 226 (2020).
  8. R. Bouckaert, P. Lemey, M. Dunn, S. J. Greenhill, A. V. Alekseyenko, A. J. Drummond, R. D. Gray, M. A. Suchard, and Q. D. Atkinson, Mapping the origins and expansion of the Indo-European language family, Science 337, 957 (2012).
  9. W. Chang, C. Cathcart, D. Hall, and A. Garrett, Ancestry-constrained phylogenetic analysis supports the Indo-European steppe hypothesis, Language 91, 194 (2015).
  10. J.-M. List, S. J. Greenhill, and R. D. Gray, The potential of automatic word comparison for historical linguistics, PLoS One 12, e0170046 (2017).
  11. N. Chomsky and H. Lasnik, The theory of principles and parameters, Syntax 1, 506 (1993).
  12. M. C. Baker, The Atoms of Language: The Mind's Hidden Rules of Grammar (Basic Books, New York, NY, 2008).
  13. A. Moro, Impossible Languages (MIT Press, Cambridge, MA, 2016).
  14. I. Roberts, Diachronic Syntax (Oxford University Press, Oxford, UK, 2007).
  15. T. Biberauer and I. Roberts, Changing EPP parameters in the history of english: Accounting for variation and change, English Lang. Ling. 9, 5 (2005).
  16. G. Longobardi and G. Rigon, Syntactic change: A minimalist approach to grammaticalization, Language 84, 428 (2008).
  17. G. Longobardi and C. Guardiano, Evidence for syntax as a signal of historical relatedness, Lingua 119, 1679 (2009).
  18. G. Longobardi, C. Guardiano, G. Silvestri, A. Boattini, and A. Ceolin, Toward a syntactic phylogeny of modern Indo-European languages, J. Histor. Ling. 3, 122 (2013).
  19. C. Galves, S. Cyrino, R. Lopes, F. Sandalo, and J. Avelar, Parameter Theory and Linguistic Change, Vol. 2 (Oxford University Press, Oxford, UK, 2012).
  20. A. Ceolin, C. Guardiano, M. A. Irimia, and G. Longobardi, Formal syntax and deep history, Front. Psychol. 11, 488871 (2020).
  21. N. Chomsky, Lectures on Government and Binding: The Pisa Lectures (Walter de Gruyter, Berlin, 1993).
  22. J. D. Fodor, Unambiguous triggers, Ling. Inquiry 29, 1 (1998).
  23. S. Karimi and M. Piattelli-Palmarini, Introduction to the special issue on parameters, Ling. Anal. 41, 141 (2017).
  24. C. Guardiano and G. Longobardi, Parameter theory and parametric comparison, in The Oxford Handbook of Universal Grammar, edited by I. Roberts (Oxford University Press, Oxford, UK, 2016), pp. 377–401.
  25. D. J. Amit, Modeling Brain Function: The World of Attractor Neural Networks (Cambridge University Press, Cambridge, UK, 1989).
  26. D. Sherrington and S. Kirkpatrick, Solvable model of a spin-glass, Phys. Rev. Lett. 35, 1792 (1975).
  27. M. E. Fisher, Lattice statistics—A review and an exact isotherm for a plane lattice gas, J. Math. Phys. 4, 278 (1963).
  28. K. Nutzel, The length of attractors in asymmetric random neural networks with deterministic dynamics, J. Phys. A: Math. Gen. 24, L151 (1991).
  29. K. Nutzel and U. Krey, Subtle dynamic behaviour of finite-size sherrington-kirkpatrick spin glasses with nonsymmetric couplings, J. Phys. A: Math. Gen. 26, L591 (1993).
  30. A. Crisanti, M. Falcioni, and A. Vulpiani, Transition from regular to complex behaviour in a discrete deterministic asymmetric neural network model, J. Phys. A: Math. Gen. 26, 3441 (1993).
  31. J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proc. Natl. Acad. Sci. USA 79, 2554 (1982).
  32. A. Treves and D. J. Amit, Metastable states in asymmetrically diluted Hopfield networks, J. Phys. A: Math. Gen. 21, 3155 (1988).
  33. See Supplemental Material at http://link.aps.org/supplemental/10.1103/52k8-zz47 for details on intra- and interlanguage distances in the (ζ,ϕ), (ζ,ρ), and (ρ,ϕ) planes.
  34. K. I. Ryom and A. Treves, Speed inversion in a potts glass model of cortical dynamics, PRX Life 1, 013005 (2023).
  35. F. Morcos, A. Pagnani, B. Lunt, A. Bertolino, D. S. Marks, C. Sander, R. Zecchina, J. N. Onuchic, T. Hwa, and M. Weigt, Direct-coupling analysis of residue coevolution captures native contacts across many protein families, Proc. Natl. Acad. Sci. USA 108, E1293 (2011).
  36. Y. Roudi, J. Tyrcha, and J. Hertz, Ising model for neural data: Model quality and approximate methods for extracting functional connectivity, Phys. Rev. E 79, 051915 (2009).
  37. N. Friedmann, A. Belletti, and L. Rizzi, Growing trees: The acquisition of the left periphery, Glossa: J. Gen. Ling. 6 (2021).
  38. N. Bosch and T. Biberauer, On another topic, how do acquisition orders vary? The left-periphery and topicalization in bilingual and monolingual acquisition, in Proceedings of the 49th annual Boston University Conference on Language Development (2025), p. 129, http://www.lingref.com/bucld/49/BUCLD49-10.pdf.
  39. G. Longobardi and A. Treves, Grammatical parameters from a gene-like code to self-organizing attractors, in A Cartesian Dream: A Geometrical Account of Syntax. In honor of Andrea Moro, edited by M. P. Greco and D. Mocci (Lingbuzz Press, Tromsø, Norway, 2024), arXiv:2307.03152.
  40. P. Crisma, G. Fabbris, G. Longobardi, and C. Guardiano, What are your values? Default and asymmetry in parameter states, J. Histor. Syntax 9, 1 (2025).

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation