- Open Access
Escaping the Krylov space during the finite-precision Lanczos algorithm
Phys. Rev. E 112, 025306 – Published 11 August, 2025
DOI: https://doi.org/10.1103/k94p-vls8
Abstract
The Lanczos algorithm, introduced by Cornelius Lanczos, has been known for a long time and is widely used in computational physics. While often employed to approximate extreme eigenvalues and eigenvectors of an operator, interest in the sequence of basis vectors produced by the algorithm has been recently increased in the context of Krylov complexity. Although it is generally accepted and partially proven that the procedure is numerically stable for approximating the eigenvalues, there are numerical problems when investigating the Krylov basis constructed via the Lanczos procedure. In this paper, we show that the loss of orthogonality and the attempt of reorthogonalization fall short of understanding and addressing the problem. Instead, the sequence of numerical Lanczos vectors in finite-precision arithmetic escapes the true vector space spanned by the exact Lanczos vectors. This poses a real threat to the interpretation in view of the operator growth hypothesis.
Physics Subject Headings (PhySH)
Article Text
References (58)
- C. Lanczos, An iteration method for the solution of the eigenvalue problem of linear differential and integral operators, J. Res. Natl. Bur. Stand. 45, 255 (1950).
- J. Skilling, The eigenvalues of mega-dimensional matrices, Maximum Entropy and Bayesian Methods (Kluwer, Dordrecht, 1988), pp. 455–466.
- M. Hutchinson, A stochastic estimator of the trace of the influence matrix for Laplacian smoothing splines, Comm. Statist. Simulation Comput. 18, 1059 (1989).
- D. A. Drabold and O. F. Sankey, Maximum entropy approach for linear scaling in the electronic structure problem, Phys. Rev. Lett. 70, 3631 (1993).
- J. Jaklič and P. Prelovšek, Lanczos method for the calculation of finite-temperature quantities in correlated systems, Phys. Rev. B 49, 5065 (1994).
- M. Aichhorn, M. Daghofer, H. G. Evertz, and W. von der Linden, Low-temperature Lanczos method for strongly correlated systems, Phys. Rev. B 67, 161103(R) (2003).
- A. Weiße, G. Wellein, A. Alvermann, and H. Fehske, The kernel polynomial method, Rev. Mod. Phys. 78, 275 (2006).
- H. Avron and S. Toledo, Randomized algorithms for estimating the trace of an implicit symmetric positive semi-definite matrix, J. ACM 58, 1 (2011).
- A. K. Saibaba, A. Alexanderian, and I. C. F. Ipsen, Randomized matrix-free trace and log-determinant estimators, Numer. Math. 137, 353 (2017).
- T. Chen, The Lanczos algorithm for matrix functions: a handbook for scientists, arXiv:2410.11090.
- H. D. Simon, Analysis of the symmetric Lanczos algorithm with reorthogonalization methods, Linear Algebra Appl. 61, 101 (1984).
- J. H. Wilkinson, The Algebraic Eigenvalue Problem, 1st ed., Monographs on Numerical Analysis (Oxford University Press, New York, 1988).
- W. Wülling, On stabilization and convergence of clustered Ritz values in the Lanczos method, SIAM J. Matrix Anal. Appl. 27, 891 (2005).
- W. Wülling, The stabilization of weights in the Lanczos and conjugate gradient method, BIT Numer. Math. 45, 395 (2005).
- G. Meurant and Z. Strakoš, The Lanczos and conjugate gradient algorithms in finite precision arithmetic, Acta Numer. 15, 471 (2006).
- F. Roosta-Khorasani and U. Ascher, Improved bounds on sample size for implicit matrix trace estimators, Found. Comput. Math. 15, 1187 (2015).
- J. Schnack, J. Richter, and R. Steinigeweg, Accuracy of the finite-temperature Lanczos method compared to simple typicality-based estimates, Phys. Rev. Res. 2, 013186 (2020).
- T. Chen, A. Greenbaum, C. Musco, and C. Musco, Error bounds for Lanczos-based matrix function approximation, SIAM J. Matrix Anal. Appl. 43, 787 (2022).
- T. Chen and G. Meurant, Near-optimal convergence of the full orthogonalization method, Electron. Trans. Numer. Anal. 60, 421 (2024).
- J. M. Deutsch, Quantum statistical mechanics in a closed system, Phys. Rev. A 43, 2046 (1991).
- M. Srednicki, Chaos and quantum thermalization, Phys. Rev. E 50, 888 (1994).
- J. Schnack and H. Feldmeier, Statistical properties of fermionic molecular dynamics, Nucl. Phys. A 601, 181 (1996).
- J. Schnack and H. Feldmeier, The nuclear liquid–gas phase transition within fermionic molecular dynamics, Phys. Lett. B 409, 6 (1997).
- H. Tasaki, From quantum dynamics to the canonical distribution: General picture and a rigorous example, Phys. Rev. Lett. 80, 1373 (1998).
- M. Rigol, V. Dunjko, and M. Olshanii, Thermalization and its mechanism for generic isolated quantum systems, Nature (London) 452, 854 (2008).
- P. Reimann, Foundation of statistical mechanics under experimentally realistic conditions, Phys. Rev. Lett. 101, 190403 (2008).
- A. Polkovnikov, K. Sengupta, A. Silva, and M. Vengalattore, Colloquium: Nonequilibrium dynamics of closed interacting quantum systems, Rev. Mod. Phys. 83, 863 (2011).
- P. Reimann and M. Kastner, Equilibration of isolated macroscopic quantum systems, New J. Phys. 14, 043020 (2012).
- A. J. Short and T. C. Farrelly, Quantum equilibration in finite time, New J. Phys. 14, 013063 (2012).
- R. Steinigeweg, A. Khodja, H. Niemeyer, C. Gogolin, and J. Gemmer, Pushing the limits of the eigenstate thermalization hypothesis towards mesoscopic quantum systems, Phys. Rev. Lett. 112, 130403 (2014).
- C. Gogolin and J. Eisert, Equilibration, thermalisation, and the emergence of statistical mechanics in closed quantum systems, Rep. Prog. Phys. 79, 056001 (2016).
- L. D'Alessio, Y. Kafri, A. Polkovnikov, and M. Rigol, From quantum chaos and eigenstate thermalization to statistical mechanics and thermodynamics, Adv. Phys. 65, 239 (2016).
- F. Borgonovi, F. M. Izrailev, L. F. Santos, and V. G. Zelevinsky, Quantum chaos and thermalization in isolated systems of interacting particles, Phys. Rep. 626, 1 (2016).
- M. Schiulaz, M. Tavora, and L. F. Santos, From few- to many-body quantum systems, Quantum Sci. Technol. 3, 044006 (2018).
- P. Reimann and J. Gemmer, Why are macroscopic experiments reproducible? Imitating the behavior of an ensemble by single pure states, Physica A 552, 121840 (2020).
- D. E. Parker, X. Cao, A. Avdoshkin, T. Scaffidi, and E. Altman, A universal operator growth hypothesis, Phys. Rev. X 9, 041017 (2019).
- M. Schiulaz, E. J. Torres-Herrera, and L. F. Santos, Thouless and relaxation time scales in many-body quantum systems, Phys. Rev. B 99, 174313 (2019).
- Y. Liao, A. Vikram, and V. Galitski, Many-body level statistics of single-particle quantum chaos, Phys. Rev. Lett. 125, 250601 (2020).
- R. Heveling, J. Wang, and J. Gemmer, Numerically probing the universal operator growth hypothesis, Phys. Rev. E 106, 014152 (2022).
- P. Caputa, J. M. Magan, and D. Patramanis, Geometry of Krylov complexity, Phys. Rev. Res. 4, 013041 (2022).
- K. Hashimoto, K. Murata, N. Tanahashi, and R. Watanabe, Krylov complexity and chaos in quantum mechanics, J. High Energ. Phys. 11 (2023) 040.
- E. Rabinovici, A. Sanchez-Garrido, R. Shir, and J. Sonner, Krylov complexity from integrability to chaos, J. High Energ. Phys. 07 (2022) 151.
- Q. Hu, W.-Y. Zhang, Y. Han, and W.-L. You, Krylov complexity in quantum many-body scars of spin-1 models, Phys. Rev. B 111, 165106 (2025).
- S. Nandy, B. Mukherjee, A. Bhattacharyya, and A. Banerjee, Quantum state complexity meets many-body scars, J. Phys.: Condens. Matter 36, 155601 (2024).
- A. Bhattacharya, P. Nandy, P. P. Nath, and H. Sahu, On Krylov complexity in open systems: an approach via bi-Lanczos algorithm, J. High Energ. Phys. 12 (2023) 066.
- P. Nandy, A. S. Matsoukas-Roubeas, P. Martínez-Azcona, A. Dymarsky, and A. del Campo, Quantum dynamics in Krylov space: Methods and applications, Phys. Rep. 1125-1128, 1 (2025).
- A. Sánchez-Garrido, On Krylov complexity, arXiv:2407.03866.
- A. Bhattacharya, P. P. Nath, and H. Sahu, Krylov complexity for nonlocal spin chains, Phys. Rev. D 109, 066010 (2024).
- H. G. Menzler and R. Jha, Krylov delocalization/localization across ergodicity breaking, Phys. Rev. B 110, 125137 (2024).
- S. Baiguera, V. Balasubramanian, P. Caputa, S. Chapman, J. Haferkamp, M. P. Heller, and N. Y. Halpern, Quantum complexity in gravity, quantum field theory, and quantum information science, arXiv:2503.10753.
- L. T. Muus, Superoperators, time-ordering and density operators, in Electron Spin Relaxation in Liquids: Based on lectures given at the NATO Advanced Study Institute held at “Spåtind,” Norway, in August 1971 (Springer US, Boston, MA, 1972), pp. 1–24.
- E. Rabinovici, A. Sánchez-Garrido, R. Shir, and J. Sonner, Operator complexity: a journey to the edge of Krylov space, J. High Energ. Phys. 06 (2021) 062.
- J. L. F. Barbón, E. Rabinovici, R. Shir, and R. Sinha, On the evolution of operator complexity beyond scrambling, J. High Energ. Phys. 10 (2019) 264.
- F. Johannesmann, J. Eckseler, H. Schlüter, and J. Schnack, Nonergodic one-magnon magnetization dynamics of the antiferromagnetic delta chain, Phys. Rev. B 108, 064304 (2023).
- J. Wang, M. H. Lamann, R. Steinigeweg, and J. Gemmer, Diffusion constants from the recursion method, Phys. Rev. B 110, 104413 (2024).
- M. Pieper, Methods, problems and applications of Krylov complexity, Master thesis, Bielefeld University, Faculty of Physics, 2025.
- K. Bärwinkel, H.-J. Schmidt, and J. Schnack, Structure and relevant dimension of the Heisenberg model and applications to spin rings, J. Magn. Magn. Mater. 212, 240 (2000).
- K. Bärwinkel, H.-J. Schmidt, and J. Schnack, Ground state properties of antiferromagnetic Heisenberg spin rings, J. Magn. Magn. Mater. 220, 227 (2000).