Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

Numerical estimation of limiting large-deviation rate functions

Peter Werner* and Alexander K. Hartmann†

  • *Contact author: peter.werner@uni-oldenburg.de
  • †Contact author: a.hartmann@uni-oldenburg.de

Phys. Rev. E 113, 034117 – Published 13 March, 2026

DOI: https://doi.org/10.1103/sj6t-pctp

Abstract

For statistics of rare events in systems obeying a large-deviation principle, the rate function is a key quantity. When numerically estimating the rate function, one is always restricted to finite system sizes. Thus, if the interest is in the limiting rate function for infinite system sizes, first, several system sizes have to be studied numerically. Here, rare-event algorithms using biased ensembles give access to the low-probability region. Second, some kind of system-size extrapolation has to be performed. Here, we demonstrate how rare-event importance sampling schemes can be combined with multihistogram reweighting. We study two ways of performing the system-size extrapolation, either directly acting on the empirical rate functions or on the scaled cumulant generating functions, to obtain the infinite-size limit. The presented method is demonstrated for a binomial distributed variable, a Markov process of random bits, and the largest connected component of Erdős-Rényi random graphs. Analytical solutions are available in all cases for direct comparison. It is observed in particular that phase transitions appearing in the biased ensembles can lead to systematic deviations from the true result.

View figure in article

Physics Subject Headings (PhySH)

Article Text

References (51)

  1. F. den Hollander, Large Deviations (American Mathematical Society, Providence, 2000).
  2. H. Touchette, The large deviation approach to statistical mechanics, Phys. Rep. 478, 1 (2009).
  3. H. Touchette, A basic introduction to large deviations: Theory, applications, simulations, arXiv:1106.4146.
  4. A. Engel, R. Monasson, and A. K. Hartmann, On large deviation properties of Erdös-Rényi random graphs, J. Stat. Phys. 117, 387 (2004).
  5. A. K. Hartmann, Large-deviation properties of largest component for random graphs, Eur. Phys. J. B 84, 627 (2011).
  6. A. K. Hartmann, Large-deviation properties of the largest 2-core component for random graphs, Eur. Phys. J.: Spec. Top. 226, 567 (2017).
  7. C. Giardinà, J. Kurchan, and L. Peliti, Direct evaluation of large-deviation functions, Phys. Rev. Lett. 96, 120603 (2006).
  8. V. Lecomte and J. Tailleur, A numerical approach to large deviations in continuous time, J. Stat. Mech. (2007) P03004.
  9. E. Guevara Hidalgo, T. Nemoto, and V. Lecomte, Finite-time and finite-size scalings in the evaluation of large-deviation functions: Numerical approach in continuous time, Phys. Rev. E 95, 062134 (2017).
  10. M. Körner, H. G. Katzgraber, and A. K. Hartmann, Probing tails of energy distributions using importance-sampling in the disorder with a guiding function, J. Stat. Mech. (2006) P04005.
  11. F. Cérou and A. Guyader, Adaptive multilevel splitting for rare event analysis, Stochastic Anal. Appl. 25, 417 (2007).
  12. T. Agranov, P. Zilber, N. R. Smith, T. Admon, Y. Roichman, and B. Meerson, Airy distribution: Experiment, large deviations, and additional statistics, Phys. Rev. Res. 2, 013174 (2020).
  13. A. K. Hartmann, S. N. Majumdar, and A. Rosso, Sampling fractional Brownian motion in presence of absorption: A Markov chain method, Phys. Rev. E 88, 022119 (2013).
  14. A. K. Hartmann and B. Meerson, First-passage area distribution and optimal fluctuations of fractional Brownian motion, Phys. Rev. E 109, 014146 (2024).
  15. N. R. Smith and S. N. Majumdar, Condensation transition in large deviations of self-similar Gaussian processes with stochastic resetting, J. Stat. Mech. (2022) 053212.
  16. W. Staffeldt and A. K. Hartmann, Rare-event properties of the Nagel-Schreckenberg model, Phys. Rev. E 100, 062301 (2019).
  17. A. K. Hartmann, P. L. Doussal, S. N. Majumdar, A. Rosso, and G. Schehr, High-precision simulation of the height distribution for the KPZ equation, Europhys. Lett. 121, 67004 (2018).
  18. A. K. Hartmann, B. Meerson, and P. Sasorov, Optimal paths of nonequilibrium stochastic fields: The Kardar-Parisi-Zhang interface as a test case, Phys. Rev. Res. 1, 032043 (2019).
  19. A. K. Hartmann, A. Krajenbrink, and P. Le Doussal, Probing large deviations of the Kardar-Parisi-Zhang equation at short times with an importance sampling of directed polymers in random media, Phys. Rev. E 101, 012134 (2020).
  20. N. R. Smith, Large deviations in chaotic systems: Exact results and dynamical phase transition, Phys. Rev. E 106, L042202 (2022).
  21. A. K. Hartmann, High-precision work distributions for extreme nonequilibrium processes in large systems, Phys. Rev. E 89, 052103 (2014).
  22. P. Werner and A. K. Hartmann, Similarity of extremely rare nonequilibrium processes to equilibrium processes, Phys. Rev. E 104, 034407 (2021).
  23. P. Werner, A. K. Hartmann, and S. N. Majumdar, Work distribution for unzipping processes, Phys. Rev. E 110, 024115 (2024).
  24. J. A. Bucklew, Introduction to Rare Event Simulation (Springer-Verlag, New York, 2004).
  25. F. Bouchet, J. Rolland, and J. Wouters, Rare event sampling methods, Chaos 29, 080402 (2019).
  26. J. Tailleur and V. Lecomte, Simulation of large deviation functions using population dynamics, AIP Conf. Proc. 1091, 212 (2009).
  27. C.-E. Bréhier, Large deviations principle for the adaptive multilevel splitting algorithm in an idealized setting, Lat. Am. J. Probab. Math. Stat. 12, 717 (2015).
  28. F. Cérou, A. Guyader, and M. Rousset, Adaptive multilevel splitting: Historical perspective and recent results, Chaos 29, 043108 (2019).
  29. F. Coghi and H. Touchette, Adaptive power method for estimating large deviations in Markov chains, Phys. Rev. E 107, 034137 (2023).
  30. C. Hartmann, O. Kebiri, L. Neureither, and L. Richter, Variational approach to rare event simulation using least-squares regression, Chaos 29, 063107 (2019).
  31. T. Grafke and E. Vanden-Eijnden, Numerical computation of rare events via large deviation theory, Chaos 29, 063118 (2019).
  32. M. Alqahtani and T. Grafke, Instantons for rare events in heavy-tailed distributions, J. Phys. A: Math. Theor. 54, 175001 (2021).
  33. P. Glasserman and Y. Wang, Counterexamples in importance sampling for large deviations probabilities, Ann. Appl. Probab. 7, 731 (1997).
  34. A. M. Ferrenberg and R. H. Swendsen, New Monte Carlo technique for studying phase transitions, Phys. Rev. Lett. 61, 2635 (1988).
  35. A. M. Ferrenberg and R. H. Swendsen, Optimized Monte Carlo data analysis, Phys. Rev. Lett. 63, 1195 (1989).
  36. S. Kumar, J. M. Rosenberg, D. Bouzida, R. H. Swendsen, and P. A. Kollman, THE weighted histogram analysis method for free-energy calculations on biomolecules. I. The method, J. Comp. Chem. 13, 1011 (1992).
  37. A. M. Ferrenberg, D. P. Landau, and R. H. Swendsen, Statistical errors in histogram reweighting, Phys. Rev. E 51, 5092 (1995).
  38. T. Bereau and R. H. Swendsen, Optimized convergence for multiple histogram analysis, J. Comput. Phys. 228, 6119 (2009).
  39. T. Nemoto, E. Guevara Hidalgo, and V. Lecomte, Finite-time and finite-size scalings in the evaluation of large-deviation functions: Analytical study using a birth-death process, Phys. Rev. E 95, 012102 (2017).
  40. E. G. Hidalgo, Breakdown of the finite-time and -population scalings of the large deviation function in the large-size limit of a contact process, J. Stat. Mech. (2018) 083211.
  41. A. Edelman, A. Guionnet, and S. Péché, Beyond universality in random matrix theory, Ann. Appl. Probab. 26, 1659 (2016).
  42. P. G. Bolhuis, D. Chandler, C. Dellago, and P. L. Geissler, Transition path sampling: Throwing ropes over rough mountain passes, in the dark, Annu. Rev. Phys. Chem. 53, 291 (2002).
  43. A. K. Hartmann, Sampling rare events: Statistics of local sequence alignments, Phys. Rev. E 65, 056102 (2002).
  44. C. M. Rohwer, F. Angeletti, and H. Touchette, Convergence of large-deviation estimators, Phys. Rev. E 92, 052104 (2015).
  45. S. Bhamidi, J. Hannig, C. Y. Lee, and J. Nolen, The importance sampling technique for understanding rare events in Erdős–Rényi random graphs, Electron. J. Probab. 20, 1 (2015).
  46. L. Peliti and S. Pigolotti, Stochastic Thermodynamics: An Introduction (Princeton University Press, Princeton, 2021).
  47. T. Antal, M. Droz, and Z. Rácz, Probability distribution of magnetization in the one-dimensional Ising model: effects of boundary conditions, J. Phys. A: Math. Gen. 37, 1465 (2004).
  48. A. K. Hartmann, Big Practical Guide to Computer Simulations (World Scientific, Singapore, 2015).
  49. G. E. Crooks and D. Chandler, Efficient transition path sampling for nonequilibrium stochastic dynamics, Phys. Rev. E 64, 026109 (2001).
  50. N. O'Connell, Some large deviation results for sparse random graphs, Probab. Theory Relat. Fields 110, 277 (1998).
  51. Python plot and source data files at Oldenburg research data repository DARE, https://www.doi.org/10.57782/ITTFSO.

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation