- Open Access
Noiseless limit and improved-prior limit of the maximum entropy method and their implications for the analytic continuation problem
Phys. Rev. Research 8, 033009 – Published 6 July, 2026
DOI: https://doi.org/10.1103/yqjh-ycbh
Abstract
Quantum Monte Carlo (QMC) methods are uniquely capable of providing exact simulations of quantum many-body systems. Unfortunately, the applications of a QMC simulation are limited because extracting dynamic properties requires solving the analytic continuation problem. Across the many fields that use QMC methods, there is no universally accepted analytic continuation algorithm for extracting dynamic properties, but many publications compare to the maximum entropy method. We investigate when entropy maximization is an acceptable approach. We show that stochastic sampling algorithms reduce to entropy maximization when the Bayesian prior is near to the true solution. We investigate when is Bryan’s controversial optimization algorithm [Bryan, Eur. Biophys. J. 18, 165 (1990)] for entropy maximization (sometimes known as the maximum entropy method—MEM) appropriate to use. We show that Bryan’s algorithm is appropriate when the noise is near zero or when the Bayesian prior is near the true solution. We also investigate the mean squared error, finding a better scaling when the Bayesian prior is near the true solution than when the noise is near zero. Together, these three results indicate that enhancing the quality of the Bayesian prior enhances the validity of the MEM and has better return on investment than reducing the noise. We point to examples of improved data-driven Bayesian priors that have already leveraged this advantage. We support these results by solving the double Gaussian problem using both Bryan’s algorithm and the newly formulated dual approach to entropy maximization [Chuna et al., J. Phys. A: Math. Theor. 58, 335203 (2025)].
Physics Subject Headings (PhySH)
Article Text
References (81)
- W. M. C. Foulkes, L. Mitas, R. J. Needs, and G. Rajagopal, Quantum Monte Carlo simulations of solids, Rev. Mod. Phys. 73, 33 (2001).
- J. Anderson, Quantum Monte Carlo: Origins, Development, Applications (Oxford University Press, USA, 2007).
- D. M. Ceperley, Path integrals in the theory of condensed helium, Rev. Mod. Phys. 67, 279 (1995).
- M. Boninsegni, N. V. Prokofev, and B. V. Svistunov, Worm algorithm and diagrammatic Monte Carlo: A new approach to continuous-space path integral Monte Carlo simulations, Phys. Rev. E 74, 036701 (2006).
- E. Rabani, D. R. Reichman, G. Krilov, and B. J. Berne, The calculation of transport properties in quantum liquids using the maximum entropy numerical analytic continuation method: Application to liquid para-hydrogen, Proc. Natl. Acad. Sci. USA 99, 1129 (2002).
- T. Dornheim, Z. Moldabekov, P. Tolias, M. Böhme, and J. Vorberger, Physical insights from imaginary-time density–density correlation functions, Matter Radiat. Extremes 8, 056601 (2023).
- T. Dornheim, Z. A. Moldabekov, and J. Vorberger, Nonlinear density response from imaginary-time correlation functions: Ab initio path integral Monte Carlo simulations of the warm dense electron gas, J. Chem. Phys. 155, 054110 (2021).
- M. Jarrell and J. Gubernatis, Bayesian inference and the analytic continuation of imaginary-time quantum Monte Carlo data, Phys. Rep. 269, 133 (1996).
- M. Asakawa, Y. Nakahara, and T. Hatsuda, Maximum entropy analysis of the spectral functions in lattice QCD, Prog. Part. Nucl. Phys. 46, 459 (2001).
- A. Rothkopf, Heavy quarkonium in extreme conditions, Phys. Rep. 858, 1 (2020).
- L. Huang and S. Liang, Stochastic pole expansion method for analytic continuation of the Green’s function, Phys. Rev. B 108, 235143 (2023).
- S. H. Glenzer and R. Redmer, X-ray Thomson scattering in high energy density plasmas, Rev. Mod. Phys. 81, 1625 (2009).
- T. Dornheim, Z. A. Moldabekov, K. Ramakrishna, P. Tolias, A. D. Baczewski, D. Kraus, T. R. Preston, D. A. Chapman, M. P. Böhme, T. Döppner, F. Graziani, M. Bonitz, A. Cangi, and J. Vorberger, Electronic density response of warm dense matter, Phys. Plasmas 30, 032705 (2023).
- M. Schörner, M. Bethkenhagen, T. Döppner, D. Kraus, L. B. Fletcher, S. H. Glenzer, and R. Redmer, X-ray Thomson scattering spectra from density functional theory molecular dynamics simulations based on a modified Chihara formula, Phys. Rev. E 107, 065207 (2023).
- D. S. Bespalov, U. Zastrau, Z. A. Moldabekov, T. Gawne, T. Dornheim, M. Meshhal, A. Amouretti, M. Andrzejewski, K. Appel, C. Baehtz, et al., Momentum-resolved X-ray thomson scattering benchmark of Electronic-response models in warm dense aluminium, Phys. Rev. Lett. 136, 245102 (2026).
- A. Filinov and M. Bonitz, Collective and single-particle excitations in two-dimensional dipolar Bose gases, Phys. Rev. A 86, 043628 (2012).
- T. Dornheim, Z. A. Moldabekov, J. Vorberger, and B. Militzer, Path integral Monte Carlo approach to the structural properties and collective excitations of liquid without fixed nodes, Sci. Rep. 12, 708 (2022).
- M. Boninsegni and D. M. Ceperley, Density fluctuations in liquid . Path integrals and maximum entropy, J. Low Temp. Phys. 104, 339 (1996).
- G. Ferré and J. Boronat, Dynamic structure factor of liquid across the normal-superfluid transition, Phys. Rev. B 93, 104510 (2016).
- H. Yoon, J.-H. Sim, and M. J. Han, Analytic continuation via domain knowledge free machine learning, Phys. Rev. B 98, 245101 (2018).
- R. Fournier, L. Wang, O. V. Yazyev, and Q. Wu, Artificial neural network approach to the analytic continuation problem, Phys. Rev. Lett. 124, 056401 (2020).
- X. Xie, F. Bao, T. Maier, and C. Webster, Analytic continuation of noisy data using Adams Bashforth residual neural network, Discrete Contin. Dyn. Syst. 15, 877 (2022).
- L. Wang, S. Shi, and K. Zhou, Reconstructing spectral functions via automatic differentiation, Phys. Rev. D 106, L051502 (2022).
- L. Wang, S. Shi, and K. Zhou, Unsupervised learning spectral functions with neural networks, J. Phys.: Conf. Ser. 2586, 012158 (2023).
- G. Aarts, K. Fukushima, T. Hatsuda, A. Ipp, S. Shi, L. Wang, and K. Zhou, Physics-driven learning for inverse problems in quantum chromodynamics, Nat. Rev. Phys. 7, 154 (2025).
- S. Groth, T. Dornheim, and J. Vorberger, Ab initio path integral Monte Carlo approach to the static and dynamic density response of the uniform electron gas, Phys. Rev. B 99, 235122 (2019).
- S. Shi, L. Wang, and K. Zhou, Rethinking the ill-posedness of the spectral function reconstruction—Why is it fundamentally hard and how artificial neural networks can help, Comput. Phys. Commun. 282, 108547 (2023).
- T. Dornheim, S. Groth, J. Vorberger, and M. Bonitz, Ab initio path integral Monte Carlo results for the dynamic structure factor of correlated electrons: From the electron liquid to warm dense matter, Phys. Rev. Lett. 121, 255001 (2018).
- E. Vitali, M. Rossi, L. Reatto, and D. E. Galli, Ab initio low-energy dynamics of superfluid and solid , Phys. Rev. B 82, 174510 (2010).
- N. V. Prokof’ev and B. V. Svistunov, Spectral analysis by the method of consistent constraints, JETP Lett. 97, 649 (2013).
- S. Saccani, S. Moroni, and M. Boninsegni, Excitation spectrum of a supersolid, Phys. Rev. Lett. 108, 175301 (2012).
- N. S. Nichols, P. Sokol, and A. Del Maestro, Parameter-free differential evolution algorithm for the analytic continuation of imaginary time correlation functions, Phys. Rev. E 106, 025312 (2022).
- F. Bao, Y. Tang, M. Summers, G. Zhang, C. Webster, V. Scarola, and T. A. Maier, Fast and efficient stochastic optimization for analytic continuation, Phys. Rev. B 94, 125149 (2016).
- H. Shao and A. W. Sandvik, Progress on stochastic analytic continuation of quantum Monte Carlo data, Phys. Rep. 1003, 1 (2023).
- H.-T. Shu, H.-T. Ding, O. Kaczmarek, S. Mukherjee, and H. Ohno, A stochastic approach to the reconstruction of spectral functions in lattice QCD, arXiv:1510.02901.
- A. S. Mishchenko, N. V. Prokof’ev, A. Sakamoto, and B. V. Svistunov, Diagrammatic quantum Monte Carlo study of the Fröhlich polaron, Phys. Rev. B 62, 6317 (2000).
- J. Otsuki, M. Ohzeki, H. Shinaoka, and K. Yoshimi, Sparse modeling approach to analytical continuation of imaginary-time quantum Monte Carlo data, Phys. Rev. E 95, 061302 (2017).
- J. Otsuki, M. Ohzeki, H. Shinaoka, and K. Yoshimi, Sparse modeling in quantum many-body problems, J. Phys. Soc. Jpn. 89, 012001 (2020).
- A. Benedix Robles, P.-A. Hofmann, T. Chuna, T. Dornheim, and M. Hecht, PyLIT: Reformulation and implementation of the analytic continuation problem using kernel representation methods, Comput. Phys. Commun. 319, 109904 (2026).
- Y. Kora and M. Boninsegni, Dynamic structure factor of superfluid from quantum Monte Carlo: Maximum entropy revisited, Phys. Rev. B 98, 134509 (2018).
- K. Beach, Identifying the maximum entropy method as a special limit of stochastic analytic continuation, arXiv:cond-mat/0403055.
- R. Bryan, Maximum entropy analysis of oversampled data problems, Eur. Biophys. J. 18, 165 (1990).
- S. F. Gull, Developments in maximum entropy data analysis, Maximum Entropy and Bayesian Methods, edited by J. Skilling (Springer, Dordrecht, 1989), pp. 53–71.
- A. Rothkopf, Bryan’s maximum entropy method—Diagnosis of a flawed argument and its remedy, Data 5, 85 (2020).
- M. Asakawa, Comment on “Heavy quarkonium in extreme conditions”, arXiv:2001.10205.
- A. Rothkopf, Improved maximum entropy analysis with an extended search space, J. Comput. Phys. 238, 106 (2013).
- A. Kelly, A. Rothkopf, and J.-I. Skullerud, Bayesian study of relativistic open and hidden charm in anisotropic lattice QCD, Phys. Rev. D 97, 114509 (2018).
- T. Chuna, N. Barnfield, T. Dornheim, M. P. Friedlander, and T. Hoheisel, Dual formulation of the maximum entropy method applied to analytic continuation of quantum Monte Carlo data, J. Phys. A: Math. Theor. 58, 335203 (2025).
- S. Fuchs, T. Pruschke, and M. Jarrell, Analytic continuation of quantum Monte Carlo data by stochastic analytical inference, Phys. Rev. E 81, 056701 (2010).
- L. Huang, ACFlow: An open source toolkit for analytic continuation of quantum Monte Carlo data, Comput. Phys. Commun. 292, 108863 (2023).
- O. Goulko, A. S. Mishchenko, L. Pollet, N. Prokof’ev, and B. Svistunov, Numerical analytic continuation: Answers to well-posed questions, Phys. Rev. B 95, 014102 (2017).
- D. Bergeron and A.-M. S. Tremblay, Algorithms for optimized maximum entropy and diagnostic tools for analytic continuation, Phys. Rev. E 94, 023303 (2016).
- O. Gunnarsson, M. W. Haverkort, and G. Sangiovanni, Analytical continuation of imaginary axis data using maximum entropy, Phys. Rev. B 81, 155107 (2010).
- J. Fei, C.-N. Yeh, and E. Gull, Nevanlinna analytical continuation, Phys. Rev. Lett. 126, 056402 (2021).
- S. Kim, P. Petreczky, and A. Rothkopf, Quarkonium in-medium properties from realistic lattice NRQCD, J. High Energy Phys. 11 (2018) 088.
- G. James, D. Witten, T. Hastie, and R. Tibshirani, An Introduction to Statistical Learning, Springer Texts in Statistics (Springer, New York, 2013).
- C. Yeh, Bias-variance decomposition of mean squared error, GitHub, 2019, https://chrisyeh96.github.io/2019/07/18/bias-variance-decomposition.html.
- J. J. Meyer, The multivariate bias-variance decomposition, 2020, https://johannesjakobmeyer.com/blog/005-multivariate-bias-variance-decomposition/.
- T. Chuna, InverseProblemSolvers, GitHub, 2025, https://github.com/chunatho/InverseProblemSolvers.
- M. P. Friedlander, DualPerspective, GitHub, 2025, https://github.com/MPF-Optimization-Laboratory/DualPerspective.jl.
- J. Kaufmann and K. Held, ana_cont: Python package for analytic continuation, Comput. Phys. Commun. 282, 108519 (2023).
- D. P. Landau and K. Binder, A Guide to Monte Carlo Simulations in Statistical Physics, 2nd ed. (Cambridge University Press, Cambridge, UK, 2021).
- M. E. Tuckerman, Statistical Mechanics: Theory and Molecular Simulation (Oxford University Press, Oxford, UK, 2023).
- M. Jarrell, The maximum entropy method: Analytic continuation of QMC data, in Correlated Electrons: From Models to Materials, Modeling and Simulation, edited by E. Pavarini, E. Koch, F. Anders, and M. Jarrell (Forschungszentrum Jülich Zentralbibliothek, Verlag, Jülich, 2012), Vol. 2, Chap. 13.
- N. G. Diamantis and E. Manousakis, Flat histogram quantum Monte Carlo for analytic continuation to real time, arXiv:1411.5984.
- S. Habershon, B. J. Braams, and D. E. Manolopoulos, Quantum mechanical correlation functions, maximum entropy analytic continuation, and ring polymer molecular dynamics, J. Chem. Phys. 127, 174108 (2007).
- Z. A. Moldabekov, S. Schwalbe, T. Gawne, T. R. Preston, J. Vorberger, and T. Dornheim, Applying the Liouville–Lanczos method of time-dependent density-functional theory to warm dense matter, Matter Radiat. Extremes 10, 047601 (2025).
- Z. A. Moldabekov, S. Schwalbe, U. Hernandez Acosta, T. Gawne, J. Vorberger, M. Pavanello, and T. Dornheim, Enhancing the efficiency of time-dependent density functional theory calculations of dynamic response properties, npj Comput. Mater. 12, 168 (2026).
- T. Chuna, N. Barnfield, J. Vorberger, M. P. Friedlander, T. Hoheisel, and T. Dornheim, Estimates of the dynamic structure factor for the finite temperature electron liquid via analytic continuation of path integral Monte Carlo data, Phys. Rev. B 112, 125112 (2025).
- Z. Wu, N. E. Huang, S. R. Long, and C.-K. Peng, On the trend, detrending, and variability of nonlinear and nonstationary time series, Proc. Natl. Acad. Sci. USA 104, 14889 (2007).
- P. J. Brockwell and R. A. Davis, Introduction to Time Series and Forecasting, 2nd ed. (Springer, New York, NY, 2002).
- R. Adhikari and R. K. Agrawal, An introductory study on time series modeling and forecasting, arXiv:1302.6613.
- A. Lovato, S. Gandolfi, J. Carlson, S. C. Pieper, and R. Schiavilla, Electromagnetic and neutral-weak response functions of and , Phys. Rev. C 91, 062501 (2015).
- H. M. Bellenbaum, M. P. Böhme, M. Bonitz, T. Döppner, L. B. Fletcher, T. Gawne, D. Kraus, Z. A. Moldabekov, S. Schwalbe, J. Vorberger, and T. Dornheim, Estimating ionization states and continuum lowering from ab initio path integral Monte Carlo simulations for warm dense hydrogen, Phys. Rev. Res. 7, 033016 (2025).
- P. Buividovich, J. Ostmeyer, and A. Troisi, High-precision quantum Monte-Carlo study of charge transport in a lattice model of molecular organic semiconductors, PoS LATTICE 2024, 067 (2024).
- E. Katz, S. Sachdev, E. S. Sørensen, and W. Witczak-Krempa, Conformal field theories at nonzero temperature: Operator product expansions, Monte Carlo, and holography, Phys. Rev. B 90, 245109 (2014).
- P. Buividovich and B. Hind, Spectral reconstruction based on dimensional reduction in high-temperature gauge theories, arXiv:2512.23560.
- T. M. Chuna, J. Vorberger, P. Tolias, A. Benedix Robles, M. Hecht, P.-A. Hofmann, Z. A. Moldabekov, and T. Dornheim, Second roton feature in the strongly coupled electron liquid, J. Chem. Phys. 163, 034117 (2025).
- T. Dornheim, J. Vorberger, S. Groth, N. Hoffmann, Z. Moldabekov, and M. Bonitz, The static local field correction of the warm dense electron gas: An ab initio path integral Monte Carlo study and machine learning representation, J. Chem. Phys. 151, 194104 (2019).
- T. Dornheim, Z. A. Moldabekov, and P. Tolias, Analytical representation of the local field correction of the uniform electron gas within the effective static approximation, Phys. Rev. B 103, 165102 (2021).
- G. Giuliani and G. Vignale, Quantum Theory of the Electron Liquid (Cambridge University Press, Cambridge, 2008).