Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

Towards interpretability of neural quantum states

Fabian Döschl* and Annabelle Bohrdt

  • *Contact author: Fa.Doeschl@physik.uni-muenchen.de

Phys. Rev. B 114, 245114 – Published 13 October, 2026

DOI: https://doi.org/10.1103/2cfz-dm5f

Abstract

Neural quantum states (NQS) have emerged as a powerful variational ansatz for representing quantum many-body wave functions. Their internal mechanisms, however, remain poorly understood. We investigate the role of correlations in NQS-like quantum state representation by employing a correlation-based interpretable neural network architecture and then proving our observations using Boolean function theory. The correlator neural network demonstrates that, even for simple product states, correlations up to the systemsize in the chosen computational basis are required to represent a quantum state faithfully. We explain these observations using Fourier expansion, which reveals the correlator basis as the effective basis of the internal NQS structure, the resulting necessity for high-order correlations as supported by an entanglement bound that scales with the correlation order, the consequences of linear dependencies in constrained Hilbert spaces for correlation requirements, and the connections between spin basis rotations and the correlator basis. Furthermore, we analyze how neural networks achieve high correlation orders by increasing the magnitude of the network weights, which can be compensated by increasing the network depth. Lastly, we discuss how activation functions, network architectures, and the choice of reference basis influence correlation requirements. Our results provide insights and a better understanding of the internal structure and requirements of NQS, enabling a more systematic use of NQS in future research.

View figure in article

Physics Subject Headings (PhySH)

Article Text

Supplemental Material

References (73)

  1. W. M. C. Foulkes, L. Mitas, R. J. Needs, and G. Rajagopal, Quantum Monte Carlo simulations of solids, Rev. Mod. Phys. 73, 33 (2001).
  2. F. Becca and S. Sorella, Quantum Monte Carlo Approaches for Correlated Systems (Cambridge University Press, Cambridge, 2017).
  3. G. Pan and Z. Y. Meng, The sign problem in quantum Monte Carlo simulations, in Encyclopedia of Condensed Matter Physics (Elsevier, Amsterdam, 2024), pp. 879–893.
  4. U. Schollwöck, The density-matrix renormalization group in the age of matrix product states, Ann. Phys. 326, 96 (2011).
  5. G. Carleo and M. Troyer, Solving the quantum many-body problem with artificial neural networks, Science 355, 602 (2017).
  6. A. Chen and M. Heyl, Empowering deep neural quantum states through efficient optimization, Nat. Phys. 20, 1476 (2024).
  7. A. Chen, Z.-Q. Wan, A. Sengupta, A. Georges, and C. Roth, Neural network-augmented Pfaffian wave-functions for scalable simulations of interacting fermions, Proc. Natl. Acad. Sci. USA 123, e2535288123 (2026).
  8. L. L. Viteritti, R. Rende, and F. Becca, Transformer variational wave functions for frustrated quantum spin systems, Phys. Rev. Lett. 130, 236401 (2023).
  9. H. Lange, A. Van de Walle, A. Abedinnia, and A. Bohrdt, From architectures to applications: A review of neural quantum states, Quantum Sci. Technol. 9, 040501 (2024).
  10. M. Schmitt and M. Heyl, Simulating dynamics of correlated matter with neural quantum states, arXiv:2506.03124.
  11. C. Giuliani, F. Vicentini, R. Rossi, and G. Carleo, Learning ground states of gapped quantum Hamiltonians with kernel methods, Quantum 7, 1096 (2023).
  12. H. Lange, F. Döschl, J. Carrasquilla, and A. Bohrdt, Neural network approach to quasiparticle dispersions in doped antiferromagnets, Commun. Phys. 7, 187 (2024).
  13. F. Döschl, F. A. Palm, H. Lange, F. Grusdt, and A. Bohrdt, Neural network quantum states for the interacting Hofstadter model with higher local occupations and long-range interactions, Phys. Rev. B 111, 045408 (2025).
  14. Z. Denis, A. Sinibaldi, and G. Carleo, Comment on “Can neural quantum states learn volume-law ground states?” Phys. Rev. Lett. 134, 079701 (2025).
  15. D. S. Kufel, J. Kemp, D. Vu, S. M. Linsel, C. R. Laumann, and N. Y. Yao, Approximately symmetric neural networks for quantum spin liquids, Phys. Rev. Lett. 135, 056702 (2025).
  16. X. Gao and L.-M. Duan, Efficient representation of quantum many-body states with deep neural networks, Nat. Commun. 8, 662 (2017).
  17. O. Sharir, A. Shashua, and G. Carleo, Neural tensor contractions and the expressive power of deep neural quantum states, Phys. Rev. B 106, 205136 (2022).
  18. D.-L. Deng, X. Li, and S. Das Sarma, Quantum entanglement in neural network states, Phys. Rev. X 7, 021021 (2017).
  19. I. Glasser, N. Pancotti, M. August, I. D. Rodriguez, and J. I. Cirac, Neural-network quantum states, string-bond states, and chiral topological states, Phys. Rev. X 8, 011006 (2018).
  20. B. Barton, J. Carrasquilla, C. Roth, and A. Valenti, Connectivity determines the capability of sparse neural network quantum states, Mach. Learn.: Sci. Technol. 7, 035025 (2026).
  21. G. Carleo, Y. Nomura, and M. Imada, Constructing exact representations of quantum many-body systems with deep neural networks, Nat. Commun. 9, 5322 (2018).
  22. H. Kol-Namer and M. Goldstein, Neural network ground state from the neural tangent kernel perspective: The sign bias, arXiv:2411.03980.
  23. R. Rende, L. L. Viteritti, L. Bardone, F. Becca, and S. Goldt, A simple linear algebra identity to optimize large-scale neural network quantum states, Commun. Phys. 7, 260 (2024).
  24. S. Dash, L. Gravina, F. Vicentini, M. Ferrero, and A. Georges, Efficiency of neural quantum states in light of the quantum geometric tensor, Commun. Phys. 8, 92 (2025).
  25. M. S. Moss, A. Orfi, C. Roth, A. M. Sengupta, A. Georges, D. Sels, A. Dawid, and A. Valenti, Double descent: When do neural quantum states generalize? Phys. Rev. E 113, 045303 (2026).
  26. G. Passetti, D. Hofmann, P. Neitemeier, L. Grunwald, M. A. Sentef, and D. M. Kennes, Can neural quantum states learn volume-law ground states? Phys. Rev. Lett. 131, 036502 (2023).
  27. G. Cybenko, Approximation by superpositions of a sigmoidal function, Math. Control Signal Systems 2, 303 (1989).
  28. K. Hornik, M. Stinchcombe, and H. White, Multilayer feedforward networks are universal approximators, Neural Networks 2, 359 (1989).
  29. K. Hornik, M. Stinchcombe, and H. White, Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks, Neural Networks 3, 551 (1990).
  30. M. Hibat-Allah, R. G. Melko, and J. Carrasquilla, Investigating topological order using recurrent neural networks, Phys. Rev. B 108, 075152 (2023).
  31. M. Hibat-Allah, E. M. Inack, R. Wiersema, R. G. Melko, and J. Carrasquilla, Variational neural annealing, Nat. Mach. Intell. 3, 952 (2021).
  32. D. Pfau, S. Axelrod, H. Sutterud, I. von Glehn, and J. S. Spencer, Accurate computation of quantum excited states with neural networks, Science 385, eadn0137 (2024).
  33. Y. Gu, W. Li, H. Lin, B. Zhan, R. Li, Y. Huang, D. He, Y. Wu, T. Xiang, M. Qin, L. Wang, and D. Lv, Solving the Hubbard model with neural quantum states, Nat. Commun. 17, 7838 (2026).
  34. A. Chen, V. D. Naik, and M. Heyl, Convolutional transformer wave functions, Phys. Rev. Res. 8, L022040 (2026).
  35. Z. Denis and G. Carleo, Accurate neural quantum states for interacting lattice bosons, Quantum 9, 1772 (2025).
  36. D.-L. Deng, X. Li, and S. Das Sarma, Machine learning topological states, Phys. Rev. B 96, 195145 (2017).
  37. R. Kaubruegger, L. Pastori, and J. C. Budich, Chiral topological phases from artificial neural networks, Phys. Rev. B 97, 195136 (2018).
  38. S. Lu, X. Gao, and L.-M. Duan, Efficient representation of topologically ordered states with restricted Boltzmann machines, Phys. Rev. B 99, 155136 (2019).
  39. T.-H. Yang, M. Soleimanifar, T. Bergamaschi, and J. Preskill, When can classical neural networks represent quantum states? arXiv:2410.23152.
  40. A. Valenti, E. Greplova, N. H. Lindner, and S. D. Huber, Correlation-enhanced neural networks as interpretable variational quantum states, Phys. Rev. Res. 4, L012010 (2022).
  41. C. Miles, A. Bohrdt, R. Wu, C. Chiu, M. Xu, G. Ji, M. Greiner, K. Q. Weinberger, E. Demler, and E.-A. Kim, Correlator convolutional neural networks as an interpretable architecture for image-like quantum matter data, Nat. Commun. 12, 3905 (2021).
  42. K. Fischer, A. René, C. Keup, M. Layer, D. Dahmen, and M. Helias, Decomposing neural networks as mappings of correlation functions, Phys. Rev. Res. 4, 043143 (2022).
  43. A. Suresh, H. Schlömer, B. Hashemi, and A. Bohrdt, Interpretable correlator transformer for image-like quantum matter data, Mach. Learn.: Sci. Technol. 6, 025006 (2025).
  44. K. Cybiński, J. Enouen, A. Georges, and A. Dawid, Speak so a physicist can understand you! TetrisCNN for detecting phase transitions and order parameters, arXiv:2411.02237.
  45. See Supplemental Material at http://link.aps.org/supplemental/10.1103/2cfz-dm5f for additional details on the methods and their generalizations, the relation between the correlator basis and spin moments and its connection to the logarithmic wave function encoding, and derivation of entanglement bounds, which also contains Refs. [70, 71, 72, 73].
  46. D. Luo, G. Carleo, B. K. Clark, and J. Stokes, Gauge equivariant neural networks for quantum lattice gauge theories, Phys. Rev. Lett. 127, 276402 (2021).
  47. Y. Sheffer, E. Berg, and A. Stern, Preparing topological states with finite depth simultaneous commuting gates, Phys. Rev. B 111, 115160 (2025).
  48. R. O'Donnell, Analysis of Boolean Functions (Cambridge University Press, Cambridge, 2014).
  49. M. Hibat-Allah, M. Ganahl, L. E. Hayward, R. G. Melko, and J. Carrasquilla, Recurrent neural network wave functions, Phys. Rev. Res. 2, 023358 (2020).
  50. M. Hibat-Allah, R. G. Melko, and J. Carrasquilla, Supplementing recurrent neural network wave functions with symmetry and annealing to improve accuracy, arXiv:2207.14314.
  51. N. Lang and H. P. Büchler, Minimal instances for toric code ground states, Phys. Rev. A 86, 022336 (2012).
  52. W. Zhao, M. Fang, and D. Su, Graph-based approach to entanglement entropy of quantum error-correcting codes, Phys. Rev. A 113, 052412 (2026).
  53. M. Bukov, M. Schmitt, and M. Dupont, Learning the ground state of a non-stoquastic quantum Hamiltonian in a rugged neural network landscape, SciPost Phys. 10, 147 (2021).
  54. I. Schurov, A. Kravchenko, M. I. Katsnelson, A. A. Bagrov, and T. Westerhout, Learning complexity of many-body quantum sign structures through the lens of Boolean Fourier analysis, arXiv:2508.09870.
  55. Z. Liu, D. Qian, and J. Wang, Enhancing neural-network variational Monte Carlo through basis transformation, arXiv:2604.15888.
  56. J. R. Moreno, J. Cohn, D. Sels, and M. Motta, Enhancing the expressivity of variational neural, and hardware-efficient quantum states through orbital rotations, arXiv:2302.11588.
  57. J. Augusto Sobral, M. Perle, and M. S. Scheurer, Physics-informed transformers for electronic quantum states, Nat. Commun. 16, 10811 (2025).
  58. T. M. Cover and J. A. Thomas, Kolmogorov complexity, in Elements of Information Theory (John Wiley & Sons, Ltd, 2005), Chap. 14, pp. 463–508.
  59. D. Galvin, Three tutorial lectures on entropy and counting, arXiv:1406.7872.
  60. Y. Wu, C. Guo, Y. Fan, P. Zhou, and H. Shang, NNQS-transformer: An efficient and scalable neural network quantum states approach for ab initio quantum chemistry, in Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (Association for Computing Machinery, New York, 2023).
  61. L. L. Viteritti, R. Rende, A. Parola, S. Goldt, and F. Becca, Transformer wave function for two dimensional frustrated magnets: Emergence of a spin-liquid phase in the Shastry-Sutherland model, Phys. Rev. B 111, 134411 (2025).
  62. H. Lange, G. Bornet, G. Emperauger, C. Chen, T. Lahaye, S. Kienle, A. Browaeys, and A. Bohrdt, Transformer neural networks and quantum simulators: A hybrid approach for simulating strongly correlated systems, Quantum 9, 1675 (2025).
  63. J. R. Moreno, G. Carleo, A. Georges, and J. Stokes, Fermionic wave functions from neural-network constrained hidden states, Proc. Natl. Acad. Sci. USA 119, e2122059119 (2022).
  64. B. J. Wurst, D. M. Kennes, and J. B. Profe, Efficiency of the hidden fermion determinant states ansatz in the light of different complexity measures, Phys. Rev. Res. 7, 023316 (2025).
  65. H. Lange, A. Böhler, C. Roth, and A. Bohrdt, Simulating the two-dimensional t−j model at finite doping with neural quantum states, Phys. Rev. Lett. 135, 136504 (2025).
  66. D. Luo and B. K. Clark, Backflow transformations via neural networks for quantum many-body wave functions, Phys. Rev. Lett. 122, 226401 (2019).
  67. R. Rende, S. Goldt, F. Becca, and L. L. Viteritti, Fine-tuning neural network quantum states, Phys. Rev. Res. 6, 043280 (2024).
  68. K. Choo, A. Mezzacapo, and G. Carleo, Fermionic neural-network states for ab-initio electronic structure, Nat. Commun. 11, 2368 (2020).
  69. F. Döschl and A. Bohrdt, CoTra_NQS: Code and data supporting the results presented in this paper, GitHub repository, 2026, https://github.com/FabianDoeschl/CoTra_NQS.
  70. G. Carleo, K. Choo, D. Hofmann, J. E. T. Smith, T. Westerhout, F. Alet, E. J. Davis, S. Efthymiou, I. Glasser, S.-H. Lin, et al., NetKet: A machine learning toolkit for many-body quantum systems, SoftwareX 10, 100311 (2019).
  71. E. Waring, VII. Problems concerning interpolations, Philos. Trans. R. Soc. London 69, 59 (1779).
  72. A. M. Bayen and T. Siauw, Interpolation, in An Introduction to MATLAB® Programming and Numerical Methods for Engineers, edited by A. M. Bayen and T. Siauw (Academic Press, Boston, 2015), Chap. 14, pp. 211–223.
  73. M. Lindsey, Multiscale interpolative construction of quantized tensor trains, arXiv:2311.12554.

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation