- Open Access
Universalities in the avalanche dynamics of novelties and non-novelties and some notes on the Heaps law
Phys. Rev. Research 8, 043083 – Published 22 October, 2026
DOI: https://doi.org/10.1103/shhp-4dht
Abstract
Unprecedented events intertwine with the repetition of the past in natural phenomena and human activities. Key statistical patterns, such as Heaps’ and Taylor’s laws and Zipf’s law, have been identified as characterizing the dynamical processes that govern the emergence of novelties and the abundance of repeated elements. Observing these statistical regularities has been pivotal in motivating the search for modeling schemes that can explain them and clarify key mechanisms underlying the appearance of new elements and their subsequent recurrence. In this study, we analyze sequences of novel and non-novel elements, referred to as avalanches, in real-world systems. We show that avalanche statistics provide a complementary characterization of innovation dynamics, extending beyond the three fundamental laws mentioned above. Although arising from collective dynamics, some systems behave as a single instance of a stochastic process. Others, such as natural language, exhibit features that we can only explain by a superposition of different dynamics. This distinction is not apparent when considering Heaps’ law alone, while it clearly emerges in the avalanche statistics. By interpreting these empirical observations, we also advance the theoretical understanding of urn-based models that successfully reproduce the observed behaviors associated with Heaps’, Zipf’s, and Taylor’s laws. We derive analytical expressions that accurately describe the probability distributions of avalanches and the Heaps law beyond its asymptotic regime. Building on these results, we derive a scaling relation that we show also holds in real-world systems, indicating a form of universality in the dynamics of novelty.
Physics Subject Headings (PhySH)
Article Text
Supplemental Material
References (63)
- F. Saracco, R. Di Clemente, A. Gabrielli, and L. Pietronero, From innovation to diversification: A simple competitive model, PLoS One 10, e0140420 (2015).
- S. Thurner, P. Klimek, and R. Hanel, Schumpeterian economic dynamics as a quantifiable model of evolution, New J. Phys. 12, 075029 (2010).
- M. M. Dankulov, R. Melnik, and B. Tadić, The dynamics of meaningful social interactions and the emergence of collective knowledge, Sci. Rep. 5, 12197 (2015).
- I. Iacopini, G. Di Bona, E. Ubaldi, V. Loreto, and V. Latora, Interacting discovery processes on complex networks, Phys. Rev. Lett. 125, 248301 (2020).
- I. Iacopini, S. Milojević, and V. Latora, Network dynamics of innovation processes, Phys. Rev. Lett. 120, 048301 (2018).
- M. Gerlach and E. G. Altmann, Stochastic model for the vocabulary growth in natural languages, Phys. Rev. X 3, 021006 (2013).
- J. Han, J. Yin, X. Wu, D. Wang, and C. Li, Environment and covid-19 incidence: A critical review, J. Environ. Sci. 124, 933 (2023).
- J. Sheth, Impact of covid-19 on consumer behavior: Will the old habits return or die? J. Bus. Res. 117, 280 (2020).
- F. Tria, V. Loreto, V. Domenico, P. Servedio, and S. H Strogatz, The dynamics of correlated novelties, Sci. Rep. 4, 5890 (2014).
- C. Cattuto, A. Baldassarri, V. D. P. Servedio, V. Loreto, Emergent community structure in social tagging systems, Adv. Complex Syst. 11, 597 (2011).
- E. Ubaldi, R. Burioni, V. Loreto, and F. Tria, Emergence and evolution of social networks through exploration of the adjacent possible space, Commun. Phys. 4, 28 (2021).
- H. S. Heaps, Information Retrieval Computational and Theoretical Aspects (Academic Press, Inc., New York, 1978).
- G. K. Zipf, The Psychobiology of Language (Houghton-Mifflin, New York, 1935).
- L. Roy Taylor, Aggregation, variance and the mean, Nature (London) 189, 732 (1961).
- V. Loreto, V. D. P. Servedio, S. H. Strogatz, and F. Tria, Dynamics on Expanding Spaces: Modeling the Emergence of Novelties (Springer International Publishing, Cham, 2016), pp. 59–83.
- L. Lü, Z.-K. Zhang, and T. Zhou, Zipf’s law leads to Heaps’ law: Analyzing their relation in finite-size systems, PLoS One 5, e14139 (2010).
- M. Gerlach and E. G. Altmann, Scaling laws and fluctuations in the statistics of word frequencies, New J. Phys. 16, 113010 (2014).
- F. Tria, I. Crimaldi, G. Aletti, and V. D. P. Servedio, Taylor’s law in innovation processes, Entropy 22, 573 (2020).
- F. Tria, V. Loreto, and V. D. P. Servedio, Zipf’s, Heaps’ and Taylor’s laws are determined by the expansion into the adjacent possible, Entropy 20, 752 (2018).
- in Proceedings of the International School of Physics “Enrico Fermi”, “Mechanics of Earthquake Faulting, edited by A. Bizzarri, S. Das, and A. Petri (IOS Press and Societé Italiana di Fisica, Amsterdam and Bologna, 2019), Vol. 202.
- A. Bizzarri, A. Petri, and A. Baldassarri, Earthquake dynamics constrained from laboratory experiments: New insights from granular materials, Ann. Geophys. 64, SE441 (2021).
- I. Main, Statistical physics, seismogenesis, and seismic hazard, Rev. Geophys. 34 433 (1996).
- S. Zapperi, P. Cizeau, G. Durin, and H. Eugene Stanley, Dynamics of a ferromagnetic domain wall: Avalanches, depinning transition, and the Barkhausen effect, Phys. Rev. B 58, 6353 (1998).
- G. Caldarelli, F. Di Tolla, and A. Petri, Self-organization and annealed disorder in fracturing processes, Phys. Rev. Lett. 77, 2503 (1996).
- G. Cannelli, R. Cantelli, and F. Cordero, Self-organized criticality of the fracture processes associated with hydrogen precipitation in niobium by acoustic emission, Phys. Rev. Lett. 70, 3923 (1993).
- A. Petri, G. Paparo, A. Vespignani, A. Alippi, and M. Costantini, Experimental evidence for critical dynamics in microfracturing processes, Phys. Rev. Lett. 73, 3423 (1994).
- D. M. Dimiduk, C. Woodward, R. LeSar, and M. D. Uchic, Scale-free intermittent flow in crystal plasticity, Science 312, 1188 (2006).
- A. Baldassarri, M. A. Annunziata, A. Gnoli, G. Pontuale, and A. Petri, Breakdown of scaling and friction weakening in intermittent granular flow, Sci. Rep. 9, 16962 (2019).
- A. Baldassarri, F. Dalton, A. Petri, S. Zapperi, G. Pontuale, and L. Pietronero, Brownian forces in sheared granular matter, Phys. Rev. Lett. 96, 118002 (2006).
- A. Petri, Statistics of intermittent granular flow from confined tabletop experiments, Riv. Nuovo Cimento 47, 353 (2024).
- A. Petri, A. Baldassarri, F. Dalton, G. Pontuale, L. Pietronero, and S. Zapperi, Stochastic dynamics of a sheared granular medium, Eur. Phys. J. B 64, 531 (2008).
- M. P. Ciamarra, F. Dalton, L. de Arcangelis, C. Godano, E. Lippiello, and A. Petri, The role of interstitial impurities in the frictional instability of seismic fault models, Tribol. Lett. 48, 89 (2012).
- J. Antonaglia, W. J. Wright, X. Gu, R. R. Byer, T. C. Hufnagel, M. LeBlanc, J. T. Uhl, and K. A. Dahmen, Bulk metallic glasses deform via slip avalanches, Phys. Rev. Lett. 112, 155501 (2014).
- L. de Arcangelis, C. Perrone-Capano, and H. J Herrmann, Self-organized criticality model for brain plasticity, Phys. Rev. Lett. 96, 028107 (2006).
- F. Lombardi, H. J. Herrmann, C. Perrone-Capano, D. Plenz, and L. de Arcangelis, Balance between excitation and inhibition controls the temporal organization of neuronal avalanches, Phys. Rev. Lett. 108, 228703 (2012).
- M. Kumar Nandi, A. Sarracino, H. J. Herrmann, and L. de Arcangelis, Scaling of avalanche shape and activity power spectrum in neuronal networks, Phys. Rev. E 106, 024304 (2022).
- S. Scarpetta et al., Criticality of neuronal avalanches in human sleep and their relationship with sleep macro-and micro-architecture, Iscience 26, 107840, 2023 .
- D. Chialvo, A. G. Torrado, E. Gudowska-Nowak, J. Ochab, P. Montoya, M. Nowak, and E. Tagliazucchi, How we move is universal: Scaling in the average shape of human activity, Pap. Phys. 7, 070017 (2015).
- R. Gallotti and D. R Chialvo, How ants move: Individual and collective scaling properties, J. R. Soc. Interface 15, 20180223 (2018).
- L. de Arcangelis and H. J Herrmann, Activity-dependent neuronal model on complex networks, Front. Physiol. 3, 62 (2012).
- A. Petri and G. Pontuale, Morphology and dynamics in soc universality classes, J. Stat. Mech.: Theory Exp. (2018) 063201.
- G. Pontuale, F. Colaiori, and A. Petri, Slow crack propagation through a disordered medium: Critical transition and dissipation, Europhys. Lett. 101, 16005 (2013).
- S. Scarpetta and A. de Candia, Neural avalanches at the critical point between replay and non-replay of spatiotemporal patterns, PLoS One 8, e64162 (2013).
- J. P Sethna, K. A Dahmen, and C. R Myers, Crackling noise, Nature (London) 410, 242 (2001).
- S. Zapperi, Crackling Noise: Statistical Physics of Avalanche Phenomena (Oxford University Press, Oxford, 2022).
- L. de Arcangelis, C. Godano, J. R. Grasso, and E. Lippiello, Statistical physics approach to earthquake occurrence and forecasting, Phys. Rep. 628, 1 (2016).
- L. de Arcangelis, C. Godano, E. Lippiello, and M. Nicodemi, Universality in solar flare and earthquake occurrence, Phys. Rev. Lett. 96, 051102 (2006).
- L. Laurson, X. Illa, S. Santucci, K. T. Tallakstad, K. J. Måloy, and M. J. Alava, Evolution of the average avalanche shape with the universality class, Nat. Commun. 4, 2927 (2013).
- P. Kumar, E. Korkolis, R. Benzi, D. Denisov, A. Niemeijer, P. Schall, F. Toschi, and J. Trampert, On interevent time distributions of avalanche dynamics, Sci. Rep. 10, 626 (2020).
- G. Di Bona, A. Bellina, G. de Marzo, A. Petralia, I. Iacopini, and V. Latora, The dynamics of higher-order novelties, Nat. Commun. 16, 393 (2025).
- B. de Finetti, La prévision: Ses lois logiques, ses sources subjective, Annales De L'institut Henri Poincaré (1937), Vol. 7.
- J. Frank and C. Kingman, Random partitions in population genetics, Proc. R. Soc. London A 361, 1 (1978).
- J. Pitman, The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator, Ann. Probab. 25, 855 (1997).
- G. T. Raffaelli, M. Lalli, and F. Tria, Inference through innovation processes tested in the authorship attribution task, Commun. Phys. 7, 300 (2024).
- See Supplemental Material at http://link.aps.org/supplemental/10.1103/shhp-4dht for detailed mathematical derivations and supplementary results.
- B. Monechi, A. Ruiz-Serrano, F. Tria, and V. Loreto, Waves of novelties in the expansion into the adjacent possible, PLoS One 12, e0179303 (2017).
- S. A. Kauffman, Investigations (Oxford University Press, New York, 2000).
- J. Pitman et al., Combinatorial stochastic processes, Technical Report 621, Department of Statistics, University of California, 1996.
- P. Zhang, C. Chen, and H. Mahmoud, Explicit characterization of moments of balanced triangular Pólya urns by an elementary approach, Stat. Probab. Lett. 96, 149 (2015).
- We should stop the integration at time , but neglecting this detail corresponds to the same order of approximation as that made in Eq. (8) and does not affect the results.
- S. A Kauffman, Investigations: The Nature of Autonomous Agents and the Worlds They Mutually Create, SFI working papers (Oxford University Press, Oxford, 2000).
- https://figshare.com/articles/dataset/datasets_avalanches/30186733.
- Filippo Santoro, avalanches, GitHub (2025), https://github.com/filidibava/avalanches.