- Letter
- Open Access
Simulating correlated electrons with symmetry-enforced normalizing flows
Phys. Rev. Research 8, L012071 – Published 25 March, 2026
DOI: https://doi.org/10.1103/4741-cvvs
Abstract
We present the first proof of principle that normalizing flows can accurately learn the Boltzmann distribution of the fermionic Hubbard model—a key framework for describing the electronic structure of graphene and related materials. State-of-the-art methods like hybrid Monte Carlo often suffer from ergodicity issues near the time-continuum limit, leading to biased estimates. Leveraging symmetry-aware architectures as well as independent and identically distributed sampling, our approach resolves these issues and achieves significant speedups over traditional methods.
Physics Subject Headings (PhySH)
Article Text
References (61)
- D. P. Arovas, E. Berg, S. A. Kivelson, and S. Raghu, The Hubbard model, Annu. Rev. Condens. Matter Phys. 13, 239 (2022).
- J. Hubbard, Electron correlations in narrow energy bands, Proc. R. Soc. London A 276, 238 (1963).
- J. Hubbard, Electron correlations in narrow energy bands. II. The degenerate band case, Proc. R. Soc. London A 277, 237 (1964).
- J. Hubbard, Electron correlations in narrow energy bands. III. An improved solution, Proc. R. Soc. London A 281, 401 (1964).
- L. Razmadze and T. Luu, Hubbard interaction at finite T on a hexagonal lattice, PoS LATTICE2024, 071 (2024).
- E. Ibarra-García-Padilla, H. Lange, R. G. Melko, R. T. Scalettar, J. Carrasquilla, A. Bohrdt, and E. Khatami, Autoregressive neural quantum states of Fermi Hubbard models, Phys. Rev. Res. 7, 013122 (2025).
- J. Ostmeyer, E. Berkowitz, S. Krieg, T. A. Lähde, T. Luu, and C. Urbach, Semimetal–Mott insulator quantum phase transition of the Hubbard model on the honeycomb lattice, Phys. Rev. B 102, 245105 (2020).
- J. Ostmeyer, L. Razmadze, E. Berkowitz, T. Luu, and U.-G. Meißner, Effective theory for graphene nanoribbons with junctions, Phys. Rev. B 109, 195135 (2024).
- P. Sinilkov, E. Berkowitz, T. Luu, and M. Rodekamp, Search for stable states in two-body excitations of the Hubbard model on the honeycomb lattice, PoS LATTICE2024, 075 (2025).
- M. Rodekamp, E. Berkowitz, C. Gäntgen, S. Krieg, T. Luu, J. Ostmeyer, and G. Pederiva, Single-particle spectrum of doped -perylene, Eur. Phys. J. B 98, 36 (2025).
- P. Buividovich, D. Smith, M. Ulybyshev, and L. von Smekal, Hybrid-Monte-Carlo study of competing order in the extended fermionic Hubbard model on the hexagonal lattice, Phys. Rev. B 98, 235129 (2018).
- S. Beyl, F. Goth, and F. F. Assaad, Revisiting the hybrid quantum Monte Carlo method for Hubbard and electron-phonon models, Phys. Rev. B 97, 085144 (2018).
- D. Smith and L. von Smekal, Monte Carlo simulation of the tight-binding model of graphene with partially screened Coulomb interactions, Phys. Rev. B 89, 195429 (2014).
- M. V. Ulybyshev, P. V. Buividovich, M. I. Katsnelson, and M. I. Polikarpov, Monte Carlo study of the semimetal-insulator phase transition in monolayer graphene with a realistic interelectron interaction potential, Phys. Rev. Lett. 111, 056801 (2013).
- J.-L. Wynen, E. Berkowitz, C. Körber, T. A. Lähde, and T. Luu, Avoiding ergodicity problems in lattice discretizations of the Hubbard model, Phys. Rev. B 100, 075141 (2019).
- F. Temmen, E. Berkowitz, A. Kennedy, T. Luu, J. Ostmeyer, and X. Yu, Overcoming ergodicity problems of the hybrid Monte Carlo method using radial updates, PoS LATTICE2024, 068 (2024).
- F. Noé, S. Olsson, J. Köhler, and H. Wu, Boltzmann generators: Sampling equilibrium states of many-body systems with deep learning, Science 365, eaaw1147 (2019).
- M. S. Albergo, G. Kanwar, and P. E. Shanahan, Flow-based generative models for Markov chain Monte Carlo in lattice field theory, Phys. Rev. D 100, 034515 (2019).
- K. A. Nicoli, C. J. Anders, L. Funcke, T. Hartung, K. Jansen, P. Kessel, S. Nakajima, and P. Stornati, Estimation of thermodynamic observables in lattice field theories with deep generative models, Phys. Rev. Lett. 126, 032001 (2021).
- M. Caselle, E. Cellini, A. Nada, and M. Panero, Stochastic normalizing flows as non-equilibrium transformations, J. High Energy Phys. 07 (2022) 015.
- K. Cranmer, G. Kanwar, S. Racanière, D. J. Rezende, and P. E. Shanahan, Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics, Nat. Rev. Phys. 5, 526 (2023).
- D. Wu, L. Wang, and P. Zhang, Solving statistical mechanics using variational autoregressive networks, Phys. Rev. Lett. 122, 080602 (2019).
- K. A. Nicoli, S. Nakajima, N. Strodthoff, W. Samek, K.-R. Müller, and P. Kessel, Asymptotically unbiased estimation of physical observables with neural samplers, Phys. Rev. E 101, 023304 (2020).
- M. Caselle, E. Cellini, and A. Nada, Sampling Nambu-Goto theory using normalizing flows, PoS LATTICE2023, 015 (2024).
- M. Caselle, E. Cellini, and A. Nada, Sampling the lattice Nambu-Goto string using continuous normalizing flows, J. High Energy Phys. 02 (2024) 048.
- N. W. A. Gebauer, M. Gastegger, and K. T. Schütt, Symmetry-adapted generation of 3d point sets for the targeted discovery of molecules, in Advances in Neural Information Processing Systems, edited by H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Curran Associates Inc., Red Hook, NY, 2019), Vol. 32, pp. 7566–7578.
- N. W. A. Gebauer, M. Gastegger, S. S. P. Hessmann, K.-R. Müller, and K. T. Schütt, Inverse design of 3d molecular structures with conditional generative neural networks, Nat. Commun. 13, 973 (2022).
- D. Rezende and S. Mohamed, Variational inference with normalizing flows, in Proceedings of the 32nd International Conference on Machine Learning (PMLR, 2015), Vol. 37, p. 1530.
- I. Kobyzev, S. J. Prince, and M. A. Brubaker, Normalizing flows: An introduction and review of current methods, IEEE Trans. Pattern Anal. Mach. Intell. 43, 3964 (2021).
- G. Papamakarios, E. Nalisnick, D. J. Rezende, S. Mohamed, and B. Lakshminarayanan, Normalizing flows for probabilistic modeling and inference, J. Mach. Learn. Res. 22, 1 (2021).
- A. van den Oord, N. Kalchbrenner, and K. Kavukcuoglu, Pixel recurrent neural networks, in Proceedings of the 33rd International Conference on Machine Learning (PMLR, 2016), Vol. 48, p. 1747.
- A. van den Oord, N. Kalchbrenner, L. Espeholt, K. Kavukcuoglu, O. Vinyals, and A. Graves, Conditional image generation with PixelCNN decoders, in Advances in Neural Information Processing Systems, edited by D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett (Curran Associates, Inc., Red Hook, NY, 2016), Vol. 29, p. 4797.
- P. Białas, P. Korcyl, T. Stebel, and D. Zapolski, Rényi entanglement entropy of a spin chain with generative neural networks, Phys. Rev. E 110, 044116 (2024).
- A. Bulgarelli, E. Cellini, K. Jansen, S. Kühn, A. Nada, S. Nakajima, K. A. Nicoli, and M. Panero, Flow-based sampling for entanglement entropy and the machine learning of defects, Phys. Rev. Lett. 134, 151601 (2025).
- S. Chen, O. Savchuk, S. Zheng, B. Chen, H. Stoecker, L. Wang, and K. Zhou, Fourier-flow model generating Feynman paths, Phys. Rev. D 107, 056001 (2023).
- R. Abbott, D. Boyda, G. Kanwar, F. Romero-Lopez, D. Hackett, P. Shanahan, and J. Urban, Progress in normalizing flows for 4d gauge theories, PoS LATTICE2024, 066 (2025).
- K. A. Nicoli, C. J. Anders, L. Funcke, T. Hartung, K. Jansen, P. Kessel, S. Nakajima, and P. Stornati, Machine learning of thermodynamic observables in the presence of mode collapse, PoS LATTICE2021, 338 (2022).
- K. A. Nicoli, C. J. Anders, T. Hartung, K. Jansen, P. Kessel, and S. Nakajima, Detecting and mitigating mode-collapse for flow-based sampling of lattice field theories, Phys. Rev. D 108, 114501 (2023).
- G. Kanwar, M. S. Albergo, D. Boyda, K. Cranmer, D. C. Hackett, S. Racanière, D. J. Rezende, and P. E. Shanahan, Equivariant flow-based sampling for lattice gauge theory, Phys. Rev. Lett. 125, 121601 (2020).
- J. Kreit, D. Schuh, K. A. Nicoli, and L. Funcke, SESaMo: Symmetry-enforcing stochastic modulation for normalizing flows, arXiv:2505.19619.
- R. C. Brower, D. Schaich, and C. Rebbi, Hybrid Monte Carlo simulation on the graphene hexagonal lattice, PoS Lattice 2011, 056 (2012).
- T. Luu and T. A. Lähde, Quantum Monte Carlo calculations for carbon nanotubes, Phys. Rev. B 93, 155106 (2016).
- M. Rodekamp, Machine learning for path deformation and Bayesian data analysis in selected lattice field theories, Ph.D. thesis, Rheinische Friedrich-Wilhelms-Universität Bonn, Bonn, 2024.
- J. Hubbard, Calculation of partition functions, Phys. Rev. Lett. 3, 77 (1959).
- The approximation in Eq. (3) becomes exact in the limit , with the error scaling as .
- Other choices for incorporating the hopping term into the fermion matrix include the diagonal discretization [41, 42] and the linear discretization [13]. For more details, we refer to the Appendix.
- L. Dinh, D. Krueger, and Y. Bengio, NICE: Non-linear independent components estimation, in 3rd International Conference on Learning Representations, ICLR 2015, Workshop Track Proceedings (2015).
- L. Dinh, J. Sohl-Dickstein, and S. Bengio, Density estimation using real NVP, in International Conference on Learning Representations (OpenReview.net, 2017).
- C. Durkan, A. Bekasov, I. Murray, and G. Papamakarios, Neural spline flows, in Advances in Neural Information Processing Systems (Curran Associates, Inc., Red Hook, NY, 2019), Vol. 32, pp. 7509–7520
- D. P. Kingma and P. Dhariwal, Glow: Generative flow with invertible 1×1 convolutions, in Advances in Neural Information Processing Systems (Curran Associates, Inc., Red Hook, NY 2018), Vol. 31, pp. 10215-10224.
- R. T. Q. Chen, Y. Rubanova, J. Bettencourt, and D. K. Duvenaud, Neural ordinary differential equations, in Advances in Neural Information Processing Systems (Curran Associates, Inc., Red Hook, NY, 2018), Vol. 31, pp. 6571-6583.
- T. Cohen and M. Welling, Group equivariant convolutional networks, in Proceedings of the 33rd International Conference on Machine Learning (OpenReview.net, 2016), Vol. 48, p. 2990.
- T. S. Cohen, M. Geiger, J. Köhler, and M. Welling, Spherical CNNs, in International Conference on Learning Representations (2018).
- D. Boyda, G. Kanwar, S. Racanière, D. J. Rezende, M. S. Albergo, K. Cranmer, D. C. Hackett, and P. E. Shanahan, Sampling using gauge equivariant flows, Phys. Rev. D 103, 074504 (2021).
- The convergence of the breaking parameter during training is not affected by its initialization. We therefore initialize an exact symmetry with .
- S. Kullback and R. A. Leibler, On information and sufficiency, Ann. Math. Stat. 22, 79 (1951).
- R. Abbott, M. S. Albergo, A. Botev, D. Boyda, K. Cranmer, D. C. Hackett, A. G. Matthews, S. Racanière, A. Razavi, D. J. Rezende et al., Aspects of scaling and scalability for flow-based sampling of lattice QCD, Eur. Phys. J. A 59, 257 (2023).
- L. Del Debbio, J. Marsh Rossney, and M. Wilson, Efficient modeling of trivializing maps for lattice theory using normalizing flows: A first look at scalability, Phys. Rev. D 104, 094507 (2021).
- R. Abbott, M. S. Albergo, A. Botev, D. Boyda, K. Cranmer, D. C. Hackett, G. Kanwar, A. G. D. G. Matthews, S. Racanière, A. Razavi, D. J. Rezende, F. Romero-López, P. E. Shanahan, and J. M. Urban, Normalizing flows for lattice gauge theory in arbitrary space-time dimension, arXiv:2305.02402.
- J. Komijani and M. K. Marinkovic, Generative models for scalar field theories: How to deal with poor scaling? PoS LATTICE2022, 019 (2023).
- D. Schuh, J. Kreit, E. Berkowitz, L. Funcke, T. Luu, K. Nicoli, and M. Rodekamp, Dataset for “Simulating correlated electrons with symmetry-enforced normalizing flows”, Zenodo (2025), doi: https://doi.org/10.5281/zenodo.15878888.