- Physical Review Journals
All JournalsPhysics Magazine

Physical Review D

Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

Block Lanczos algorithm for lattice QCD spectroscopy and matrix elements

Daniel C. Hackett and Michael L. Wagman

PDF

Phys. Rev. D 112, 014514 – Published 25 July, 2025

DOI: https://doi.org/10.1103/fp74-q35q

Abstract

Recent work introduced a new framework for analyzing correlation functions with improved convergence and signal-to-noise properties, as well as rigorous quantification of excited-state effects, based on the Lanczos algorithm and spurious eigenvalue filtering with the Cullum-Willoughby test. Here, we extend this framework to the analysis of correlation-function matrices built from multiple interpolating operators in lattice quantum chromodynamics (QCD) by constructing an oblique generalization of the block Lanczos algorithm, as well as a new physically motivated reformulation of the Cullum-Willoughby test that generalizes to block Lanczos straightforwardly. The resulting block Lanczos method directly extends generalized eigenvalue problem (GEVP) methods, which can be viewed as applying a single iteration of block Lanczos. Block Lanczos provides qualitative and quantitative advantages over GEVP methods analogous to the benefits of Lanczos over the standard effective mass, including faster convergence to ground- and excited-state energies, explicitly computable two-sided error bounds, straightforward extraction of matrix elements of external currents, and asymptotically constant signal-to-noise. No fits or statistical inference are required. Proof-of-principle calculations are performed for noiseless mock-data examples as well as two-by-two proton correlation-function matrices in lattice QCD.

View figure in article

Physics Subject Headings (PhySH)

Article Text

Supplemental Material

References (103)

  1. G. Fox, R. Gupta, O. Martin, and S. Otto, Monte Carlo estimates of the mass gap of the O(2) and O(3) spin models in (1+1)-dimensions, Nucl. Phys. B205, 188 (1982).
  2. C. Michael and I. Teasdale, Extracting glueball masses from lattice QCD, Nucl. Phys. B215, 433 (1983).
  3. M. Lüscher and U. Wolff, How to calculate the elastic scattering matrix in two-dimensional quantum field theories by numerical simulation, Nucl. Phys. B339, 222 (1990).
  4. B. Blossier, M. Della Morte, G. von Hippel, T. Mendes, and R. Sommer, On the generalized eigenvalue method for energies and matrix elements in lattice field theory, J. High Energy Phys. 04 (2009) 094.
  5. G. T. Fleming, Beyond generalized eigenvalues in lattice quantum field theory, arXiv:2309.05111.
  6. M. Fischer, B. Kostrzewa, J. Ostmeyer, K. Ottnad, M. Ueding, and C. Urbach, On the generalised eigenvalue method and its relation to Prony and generalised pencil of function methods, Eur. Phys. J. A 56, 206 (2020).
  7. G. C. F. M. Prony, Essai Experimental et Analytique, J. l’école Polytech. Paris 1, 24 (1795).
  8. G. T. Fleming, What can lattice QCD theorists learn from NMR spectroscopists?, arXiv:hep-lat/0403023.
  9. H.-W. Lin and S. D. Cohen, Lattice QCD beyond ground states, arXiv:0709.1902.
  10. G. T. Fleming, S. D. Cohen, H.-W. Lin, and V. Pereyra, Excited-state effective masses in lattice QCD, Phys. Rev. D 80, 074506 (2009).
  11. C. Aubin and K. Orginos, A new approach for Delta form factors, AIP Conf. Proc. 1374, 621 (2011).
  12. C. Aubin and K. Orginos, An improved method for extracting matrix elements from lattice three-point functions, Proc. Sci. LATTICE2011 (2011) 148.
  13. J. R. Green, J. W. Negele, A. V. Pochinsky, S. N. Syritsyn, M. Engelhardt, and S. Krieg, Nucleon electromagnetic form factors from lattice QCD using a nearly physical pion mass, Phys. Rev. D 90, 074507 (2014).
  14. K. Ottnad, T. Harris, H. Meyer, G. von Hippel, J. Wilhelm, and H. Wittig, Nucleon average quark momentum fraction with Nf=2+1 Wilson fermions, EPJ Web Conf. 175, 06026 (2018).
  15. K. Ottnad, Excited states in nucleon structure calculations, Eur. Phys. J. A 57, 50 (2021).
  16. M. L. Wagman, Lanczos, the transfer matrix, and the signal-to-noise problem, Phys. Rev. Lett. 134, 241901 (2025).
  17. D. C. Hackett and M. L. Wagman, Lanczos for lattice QCD matrix elements, arXiv:2407.21777.
  18. G. H. Golub, Some uses of the Lanczos algorithm in numerical algebra, in Topics in numerical analysis: Proceedings of the Royal Irish Academy Conference on Numerical Analysis, Dublin, 1972, edited by J. J. H. Miller (Academic Press, New York, 1973), pp. 173–184.
  19. J. Cullum and W. E. Donath, A block lanczos algorithm for computing the q algebraically largest eigenvalues and a corresponding eigenspace of large, sparse, real symmetric matrices, in 1974 IEEE Conference on Decision and Control including the 13th Symposium on Adaptive Processes (IEEE Press, New York, 1974), pp. 505–509.
  20. G. Golub and R. Underwood, The block lanczos method for computing eigenvalues, in Mathematical Software, edited by J. R. Rice (Academic Press, New York, 1977), pp. 361–377.
  21. Y. Saad, On the rates of convergence of the Lanczos and the block-Lanczos methods, SIAM J. Numer. Anal. 17, 687 (1980).
  22. B. Parlett, The Symmetric Eigenvalue Problem, Classics in Applied Mathematics (Society for Industrial and Applied Mathematics, Philadelphia, 1980).
  23. H. M. Kim and R. R. Craig Jr., Structural dynamics analysis using an unsymmetric block lanczos algorithm, Int. J. Numer. Methods Eng. 26, 2305 (1988).
  24. H. M. Kim and R. R. Craig Jr., Computational enhancement of an unsymmetric block Lanczos algorithm, Int. J. Numer. Methods Eng. 30, 1083 (1990).
  25. Z. Bai, D. Day, and Q. Ye, ABLE: An adaptive block Lanczos method for non-Hermitian eigenvalue problems, SIAM J. Matrix Anal. Appl. 20, 1060 (1999).
  26. A. M. Abdel-Rehim, A. Stathopoulos, and K. Orginos, Extending the eigCG algorithm to nonsymmetric Lanczos for linear systems with multiple right-hand sides, Num. Linear Algebra Appl. 21, 473 (2014).
  27. M. Lüscher and P. Weisz, Definition and general properties of the transfer matrix in continuum limit improved lattice gauge theories, Nucl. Phys. B240, 349 (1984).
  28. J. B. Kogut and L. Susskind, Hamiltonian formulation of Wilson’s lattice gauge theories, Phys. Rev. D 11, 395 (1975).
  29. Y. Saad, The Lanczos biorthogonalization algorithm and other oblique projection methods for solving large unsymmetric systems, SIAM J. Numer. Anal. 19, 485 (1982).
  30. R. Abbott, G. T. Fleming, D. C. Hackett, D. A. Pefkou, and M. L. Wagman, Filtered Rayleigh-Ritz is all you need, arXiv:2503.17357.
  31. T. mpmath development team, mpmath: A python Library for Arbitrary-Precision Floating-Point Arithmetic (version 1.3.0) (2023), http://mpmath.org/.
  32. B. Parlett, Misconvergence in the Lanczos algorithm, in Reliable Numerical Commputation (Oxford University Press, New York, 1990).
  33. A. B. J. Kuijlaars, Which eigenvalues are found by the Lanczos method?, SIAM J. Matrix Anal. Appl. 22, 306 (2000).
  34. J. Garza-Vargas and A. Kulkarni, The Lanczos algorithm under few iterations: Concentration and location of the output, SIAM J. Matrix Anal. Appl. 41, 1312 (2020).
  35. See Supplemental Material at http://link.aps.org/supplemental/10.1103/fp74-q35q for data used to generate the noiseless matrix element example.
  36. L. Maiani, G. Martinelli, M. L. Paciello, and B. Taglienti, Scalar densities and baryon mass differences in lattice QCD with Wilson fermions, Nucl. Phys. B293, 420 (1987).
  37. S. J. Dong, K. F. Liu, and A. G. Williams, Lattice calculation of the strangeness magnetic moment of the nucleon, Phys. Rev. D 58, 074504 (1998).
  38. S. Capitani, M. Della Morte, G. von Hippel, B. Jager, A. Juttner, B. Knippschild, H. B. Meyer, and H. Wittig, The nucleon axial charge from lattice QCD with controlled errors, Phys. Rev. D 86, 074502 (2012).
  39. D. C. Hackett, P. R. Oare, D. A. Pefkou, and P. E. Shanahan, Gravitational form factors of the pion from lattice QCD, Phys. Rev. D 108, 114504 (2023).
  40. R. A. Briceño, M. T. Hansen, and A. Walker-Loud, Multichannel 1→2 transition amplitudes in a finite volume, Phys. Rev. D 91, 034501 (2015).
  41. L. Leskovec, Electroweak transitions involving resonances, Proc. Sci. LATTICE2023 (2024) 119 [arXiv:2401.02495].
  42. S. Kaniel, Estimates for some computational techniques in linear algebra, Math. Comput. 20, 369 (1966).
  43. C. C. Paige, The computation of eigenvalues and eigenvectors of very large sparse matrices, Ph.D. thesis, London University, London, 1971.
  44. B. N. Parlett and D. S. Scott, The Lanczos algorithm with selective orthogonalization, Math. Comput. 33, 217 (1979).
  45. B. N. Parlett, Do we fully understand the symmetric Lanczos algorithm yet (1995), https://apps.dtic.mil/sti/citations/tr/ADA289614.
  46. J. Cullum and R. A. Willoughby, Computing eigenvalues of very large symmetric matrices—an implementation of a Lanczos algorithm with no reorthogonalization, J. Comput. Phys. 44, 329 (1981).
  47. J. K. Cullum and R. A. Willoughby, Lanczos procedures, in Lanczos Algorithms for Large Symmetric Eigenvalue Computations Vol. I Theory (Birkhäuser Boston, Boston, MA, 1985), pp. 92–163.
  48. S. Park, R. Gupta, B. Yoon, S. Mondal, T. Bhattacharya, Y.-C. Jang, B. Joó, and F. Winter (Nucleon Matrix Elements (NME) Collaboration), Precision nucleon charges and form factors using (2+1)-flavor lattice QCD, Phys. Rev. D 105, 054505 (2022).
  49. B. Yoon et al., Isovector charges of the nucleon from 2+1-flavor QCD with clover fermions, Phys. Rev. D 95, 074508 (2017).
  50. S. Mondal, R. Gupta, S. Park, B. Yoon, T. Bhattacharya, B. Joó, and F. Winter (Nucleon Matrix Elements (NME) Collaboration), Nucleon momentum fraction, helicity and transversity from 2+1-flavor lattice QCD, J. High Energy Phys. 04 (2020) 004.
  51. R. Edwards, R. Gupta, N. Joó, K. Orginos, D. Richards, F. Winter, and B. Yoon, U.S. 2+1 flavor clover lattice generation program (unpublished).
  52. M. Lüscher and P. Weisz, On-shell improved lattice gauge theories, Commun. Math. Phys. 98, 433 (1985); 98, 433(E) (1985).
  53. B. Sheikholeslami and R. Wohlert, Improved continuum limit lattice action for QCD with Wilson fermions, Nucl. Phys. B259, 572 (1985).
  54. C. Morningstar and M. J. Peardon, Analytic smearing of SU(3) link variables in lattice QCD, Phys. Rev. D 69, 054501 (2004).
  55. S. Gusken, U. Low, K. H. Mutter, R. Sommer, A. Patel, and K. Schilling, Nonsinglet axial vector couplings of the baryon octet in lattice QCD, Phys. Lett. B 227, 266 (1989).
  56. S. Gusken, A study of smearing techniques for hadron correlation functions, Nucl. Phys. B, Proc. Suppl. 17, 361 (1990).
  57. G. S. Bali, B. Lang, B. U. Musch, and A. Schäfer, Novel quark smearing for hadrons with high momenta in lattice QCD, Phys. Rev. D 93, 094515 (2016).
  58. D. C. Hackett, D. A. Pefkou, and P. E. Shanahan, Gravitational form factors of the proton from lattice QCD, Phys. Rev. Lett. 132, 251904 (2024).
  59. P. B. Denton, S. J. Parke, T. Tao, and X. Zhang, Eigenvectors from Eigenvalues: A survey of a basic identity in linear algebra, Bull. Am. Math. Soc. 59, 31 (2022).
  60. C. Jacobi, De binis quibuslibet functionibus homogeneis secundi ordinis per substitutiones lineares in alias binas tranformandis quae solis quadratis variabilium constant; una cum variis theorematis de tranformatione etdeterminatione integralium multiplicium., J. Reine Angew. Math. 1834, 1 (1834).
  61. B. Efron, The Jackknife, the Bootstrap and Other Resampling Plans, Regional Conference Series in Applied Mathematics Vol. 38 (Society for Industrial and Applied Mathematics, Philadelphia, PA, 1982).
  62. T. J. DiCiccio and B. Efron, Bootstrap confidence intervals, Stat. Sci. 11, 189 (1996).
  63. A. C. Davison and D. V. Hinkley, The basic bootstraps, in Bootstrap Methods and their Application, Cambridge Series in Statistical and Probabilistic Mathematics (Cambridge University Press, Cambridge, England, 1997), pp. 11–69.
  64. P. Young, Everything you wanted to know about data analysis and fitting but were afraid to ask, arXiv:1210.3781.
  65. S. Amarasinghe, R. Baghdadi, Z. Davoudi, W. Detmold, M. Illa, A. Parreño, A. V. Pochinsky, P. E. Shanahan, and M. L. Wagman, Variational study of two-nucleon systems with lattice QCD, Phys. Rev. D 107, 094508 (2023).
  66. W. Detmold, M. Illa, W. I. Jay, A. Parreño, R. J. Perry, P. E. Shanahan, and M. L. Wagman, Constraints on the finite volume two-nucleon spectrum at mπ≈806  MeV, Phys. Rev. D 111, 114501 (2025).
  67. J. Bulava, R. G. Edwards, E. Engelson, B. Joo, H.-W. Lin, C. Morningstar, D. G. Richards, and S. J. Wallace, Nucleon, Δ and Ω excited states in Nf=2+1 lattice QCD, Phys. Rev. D 82, 014507 (2010).
  68. J. Bulava, B. Fahy, B. Hörz, K. J. Juge, C. Morningstar, and C. H. Wong, I=1 and I=2 π−π scattering phase shifts from Nf=2+1 lattice QCD, Nucl. Phys. B910, 842 (2016).
  69. J. Dragos, R. Horsley, W. Kamleh, D. B. Leinweber, Y. Nakamura, P. E. L. Rakow, G. Schierholz, R. D. Young, and J. M. Zanotti, Nucleon matrix elements using the variational method in lattice QCD, Phys. Rev. D 94, 074505 (2016).
  70. S. R. Beane et al. (NPLQCD, QCDSF Collaborations), Charged multihadron systems in lattice QCD+QED, Phys. Rev. D 103, 054504 (2021).
  71. C. Stein, Inadmissibility of the usual estimator for the mean of a multivariate normal distribution, in Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Contributions to the Theory of Statistics (University of California Press, Berkeley, CA, 1956), pp. 197–206.
  72. O. Ledoit and M. Wolf, A well-conditioned estimator for large-dimensional covariance matrices, J. Multivariate Anal. 88, 365 (2004).
  73. H. Akaike, A new look at the statistical model identification, IEEE Trans. Autom. Control 19, 716 (1974).
  74. E. Rinaldi, S. Syritsyn, M. L. Wagman, M. I. Buchoff, C. Schroeder, and J. Wasem, Lattice QCD determination of neutron-antineutron matrix elements with physical quark masses, Phys. Rev. D 99, 074510 (2019).
  75. J. Ostmeyer, A. Sen, and C. Urbach, On the equivalence of Prony and Lanczos methods for Euclidean correlation functions, Eur. Phys. J. A 61, 26 (2025).
  76. D. Chakraborty, D. Sood, A. Radhakrishnan, and N. Mathur, Estimating energy levels from lattice QCD correlation functions using a transfer matrix formalism, arXiv:2412.01900.
  77. R. G. Edwards and B. Joó (SciDAC, LHPC, UKQCD Collaborations), The chroma software system for lattice QCD, Nucl. Phys. B, Proc. Suppl. 140, 832 (2005).
  78. M. A. Clark, R. Babich, K. Barros, R. C. Brower, and C. Rebbi (QUDA Collaboration), Solving lattice QCD systems of equations using mixed precision solvers on GPUs, Comput. Phys. Commun. 181, 1517 (2010).
  79. R. Babich, M. A. Clark, B. Joó, G. Shi, R. C. Brower, and S. Gottlieb (QUDA Collaboration), Scaling lattice QCD beyond 100 GPUs, arXiv:1109.2935.
  80. M. A. Clark, B. Joó, A. Strelchenko, M. Cheng, A. Gambhir, and R. C. Brower (QUDA Collaboration), Accelerating lattice QCD multigrid on GPUs using fine-grained parallelization, arXiv:1612.07873.
  81. F. Winter, M. Clark, R. Edwards, and B. Joó, A framework for lattice QCD calculations on GPUs, in 2014 IEEE 28th International Parallel and Distributed Processing Symposium (2014), pp. 1073–1082.
  82. E. Romero and C. Kallidonis, chromaform, https://github.com/eromero-vlc/chromaform.
  83. C. R. Harris et al., Array programming with numpy, Nature (London) 585, 357 (2020).
  84. P. Virtanen et al. (SciPy 1.0 Contributors), scipy 1.0: Fundamental algorithms for scientific computing in python, Nat. Methods 17, 261 (2020).
  85. J. Reback et al., pandas-dev/pandas: pandas 1.0.3 (2020).
  86. Wes McKinney, Data structures for statistical computing in python, in Proceedings of the 9th python in Science Conference, edited by Stéfan van der Walt and Jarrod Millman (2010), pp. 56–61.
  87. G. P. Lepage, lsqfit v. 11.7, 10.5281/zenodo.4037174 (2020),
  88. G. P. Lepage, gvar v. 11.9.1 10.5281/zenodo.4290884 (2020),
  89. Wolfram Research Inc., Mathematica, Version 14.0, https://www.wolfram.com/mathematica.
  90. J. D. Hunter, matplotlib: A 2d graphics environment, Comput. Sci. Eng. 9, 90 (2007).
  91. M. L. Waskom, seaborn: Statistical data visualization, J. Open Source Softwaare 6, 3021 (2021).
  92. M. L. Wagman and M. J. Savage, Statistics of baryon correlation functions in lattice QCD, Phys. Rev. D 96, 114508 (2017).
  93. W. Detmold, W. I. Jay, G. Kanwar, P. E. Shanahan, and M. L. Wagman, Multiparticle interpolating operators in quantum field theories with cubic symmetry, Phys. Rev. D 109, 094516 (2024).
  94. D. B. Leinweber, R. M. Woloshyn, and T. Draper, Electromagnetic structure of octet baryons, Phys. Rev. D 43, 1659 (1991).
  95. W. Melnitchouk, S. O. Bilson-Thompson, F. D. R. Bonnet, J. N. Hedditch, F. X. Lee, D. B. Leinweber, A. G. Williams, J. M. Zanotti, and J. B. Zhang, Excited baryons in lattice QCD, Phys. Rev. D 67, 114506 (2003).
  96. J. E. Mandula, G. Zweig, and J. Govaerts, Covariant lattice glueball fields, Nucl. Phys. B228, 109 (1983).
  97. J. E. Mandula, G. Zweig, and J. Govaerts, Representations of the rotation reflection symmetry group of the four-dimensional cubic lattice, Nucl. Phys. B228, 91 (1983).
  98. S. Basak, R. G. Edwards, G. T. Fleming, U. M. Heller, C. Morningstar, D. Richards, I. Sato, and S. Wallace, Group-theoretical construction of extended baryon operators in lattice QCD, Phys. Rev. D 72, 094506 (2005).
  99. S. Basak, R. Edwards, G. T. Fleming, U. M. Heller, C. Morningstar, D. Richards, I. Sato, and S. J. Wallace (Lattice Hadron Physics (LHPC) Collaboration), Clebsch-Gordan construction of lattice interpolating fields for excited baryons, Phys. Rev. D 72, 074501 (2005).
  100. T. Luu and M. J. Savage, Extracting scattering phase-shifts in higher partial-waves from lattice QCD calculations, Phys. Rev. D 83, 114508 (2011).
  101. C. E. Thomas, R. G. Edwards, and J. J. Dudek, Helicity operators for mesons in flight on the lattice, Phys. Rev. D 85, 014507 (2012).
  102. C. Morningstar, J. Bulava, B. Fahy, J. Foley, Y. C. Jhang, K. J. Juge, D. Lenkner, and C. H. Wong, Extended hadron and two-hadron operators of definite momentum for spectrum calculations in lattice QCD, Phys. Rev. D 88, 014511 (2013).
  103. S. Prelovsek, U. Skerbis, and C. B. Lang, Lattice operators for scattering of particles with spin, J. High Energy Phys. 01 (2017) 129.

Outline

Information

Phys. Rev. D 112, 014514– Published 25 July, 2025
  • Received 27 February 2025
  • Accepted 19 May 2025
Crossmark - Check for updates button
Creative Commons Logo

Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article’s title, journal citation, and DOI. Funded by SCOAP3.

Published by the American Physical Society

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation