- Letter
- Open Access
Ground-state properties via machine learning quantum constraints
Phys. Rev. Research 4, L032043 – Published 22 September, 2022
DOI: https://doi.org/10.1103/PhysRevResearch.4.L032043
Abstract
Ground-state properties are central to our understanding of quantum many-body systems. At first glance, it seems natural and essential to obtain the ground state before analyzing its properties; however, its exponentially large Hilbert space has made such studies costly, if not prohibitive, on sufficiently large system sizes. Here, we propose an alternative strategy based upon the expectation values of an ensemble of operators and the elusive yet vital quantum constraints between them where the search for ground-state properties simply equates to classical constrained minimization. These quantum constraints are generally obtainable via sampling and then machine learning on a large number of systematically consistent quantum many-body states. We showcase our perspective on one-dimensional fermion chains and spin chains for applicability, effectiveness, caveats, and unique advantages especially for strongly correlated systems, thermodynamic-limit systems, property designs, etc.
Physics Subject Headings (PhySH)
Article Text
Supplemental Material
References (60)
- R. T. Scalettar, E. Y. Loh, J. E. Gubernatis, A. Moreo, S. R. White, D. J. Scalapino, R. L. Sugar, and E. Dagotto, Phase Diagram of the Two-Dimensional Negative- Hubbard Model, Phys. Rev. Lett. 62, 1407 (1989).
- A. Moreo and D. J. Scalapino, Two-Dimensional Negative- Hubbard Model, Phys. Rev. Lett. 66, 946 (1991).
- J. P. F. LeBlanc, A. E. Antipov, F. Becca, I. W. Bulik, G. K.-L. Chan, C.-M. Chung, Y. Deng, M. Ferrero, T. M. Henderson, C. A. Jiménez-Hoyos, E. Kozik, X.-W. Liu, A. J. Millis, N. V. Prokof'ev, M. Qin, G. E. Scuseria, H. Shi, B. V. Svistunov, L. F. Tocchio, I. S. Tupitsyn et al., Solutions of the Two-Dimensional Hubbard Model: Benchmarks and Results from a Wide Range of Numerical Algorithms, Phys. Rev. X 5, 041041 (2015).
- S. R. White, Density Matrix Formulation for Quantum Renormalization Groups, Phys. Rev. Lett. 69, 2863 (1992).
- U. Schollwöck, The density-matrix renormalization group, Rev. Mod. Phys. 77, 259 (2005).
- E. Y. Loh, J. E. Gubernatis, R. T. Scalettar, S. R. White, D. J. Scalapino, and R. L. Sugar, Sign problem in the numerical simulation of many-electron systems, Phys. Rev. B 41, 9301 (1990).
- W. M. C. Foulkes, L. Mitas, R. J. Needs, and G. Rajagopal, Quantum Monte Carlo simulations of solids, Rev. Mod. Phys. 73, 33 (2001).
- M. Troyer and U.-J. Wiese, Computational Complexity and Fundamental Limitations to Fermionic Quantum Monte Carlo Simulations, Phys. Rev. Lett. 94, 170201 (2005).
- E. Fradkin, S. A. Kivelson, and J. M. Tranquada, Colloquium, Rev. Mod. Phys. 87, 457 (2015).
- D. Poland, S. Rychkov, and A. Vichi, The conformal bootstrap: Theory, numerical techniques, and applications, Rev. Mod. Phys. 91, 015002 (2019).
- X. Han, Quantum many-body Bootstrap, arXiv:2006.06002.
- T. Deutsch, Exact solution of the many-body problem with a complexity, arXiv:2111.15281.
- M. A. Nielsen, Neural Networks and Deep Learning (Determination Press, 2015).
- Y. LeCun, Y. Bengio, and G. Hinton, Deep learning, Nature (London) 521, 436 (2015).
- M. Jordan and T. Mitchell, Machine learning: Trends, perspectives, and prospects, Science 349, 255 (2015).
- G. Torlai, G. Mazzola, J. Carrasquilla, M. Troyer, R. Melko, and G. Carleo, Neural-network quantum state tomography, Nat. Phys. 14, 447 (2018).
- J. Carrasquilla, G. Torlai, R. G. Melko, and L. Aolita, Reconstructing quantum states with generative models, Nat. Mach. Intell. 1, 155 (2019).
- L. Wang, Discovering phase transitions with unsupervised learning, Phys. Rev. B 94, 195105 (2016).
- J. Carrasquilla and R. G. Melko, Machine learning phases of matter, Nat. Phys. 13, 431 (2017).
- Y. Zhang and E.-A. Kim, Quantum Loop Topography for Machine Learning, Phys. Rev. Lett. 118, 216401 (2017).
- K. Ch'ng, J. Carrasquilla, R. G. Melko, and E. Khatami, Machine Learning Phases of Strongly Correlated Fermions, Phys. Rev. X 7, 031038 (2017).
- P. Broecker, J. Carrasquilla, R. G. Melko, and S. Trebst, Machine learning quantum phases of matter beyond the fermion sign problem, Sci. Rep. 7, 8823 (2017).
- Y. Zhang, R. G. Melko, and E.-A. Kim, Machine learning quantum spin liquids with quasiparticle statistics, Phys. Rev. B 96, 245119 (2017).
- P. Zhang, H. Shen, and H. Zhai, Machine Learning Topological Invariants with Neural Networks, Phys. Rev. Lett. 120, 066401 (2018).
- W. Lian, S.-T. Wang, S. Lu, Y. Huang, F. Wang, X. Yuan, W. Zhang, X. Ouyang, X. Wang, X. Huang, L. He, X. Chang, D.-L. Deng, and L. Duan, Machine Learning Topological Phases with a Solid-State Quantum Simulator, Phys. Rev. Lett. 122, 210503 (2019).
- G. Carleo and M. Troyer, Solving the quantum many-body problem with artificial neural networks, Science 355, 602 (2017).
- D.-L. Deng, X. Li, and S. Das Sarma, Quantum Entanglement in Neural Network States, Phys. Rev. X 7, 021021 (2017).
- A. A. Melnikov, H. Poulsen Nautrup, M. Krenn, V. Dunjko, M. Tiersch, A. Zeilinger, and H. J. Briegel, Active learning machine learns to create new quantum experiments, Proc. Natl. Acad. Sci. USA 115, 1221 (2018).
- Y. Zhang, A. Mesaros, K. Fujita, S. Edkins, M. Hamidian, K. Ch'ng, H. Eisaki, S. Uchida, J. S. Davis, E. Khatami et al., Machine learning in electronic-quantum-matter imaging experiments, Nature (London) 570, 484 (2019).
- C. Valagiannopoulos, Predicting the quantum texture from transmission probabilities, J. Appl. Phys. 127, 174301 (2020).
- See Supplemental Material at http://link.aps.org/supplemental/10.1103/PhysRevResearch.4.L032043 for further details on constrained optimization algorithms, generation of training samples, the settings of our ANNs, and additional examples and results on 1D spin and fermion chains, such as multiple Fermi seas, which include Refs. [43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56].
- Such scenarios also provide valuable additional training samples.
- The arguments can generalize to complex straightforwardly noting that the minimum energy requires .
- F. Verstraete, V. Murg, and J. Cirac, Matrix product states, projected entangled pair states, and variational renormalization group methods for quantum spin systems, Adv. Phys. 57, 143 (2008).
- G. Vidal, Classical Simulation of Infinite-Size Quantum Lattice Systems in One Spatial Dimension, Phys. Rev. Lett. 98, 070201 (2007).
- J. Jordan, R. Orús, G. Vidal, F. Verstraete, and J. I. Cirac, Classical Simulation of Infinite-Size Quantum Lattice Systems in Two Spatial Dimensions, Phys. Rev. Lett. 101, 250602 (2008).
- Although the model at also offers a good starting point, the truncation in and for a metal state may cause issues.
- J.-B. Wang and Y. Zhang, Single-shot quantum measurements sketch quantum states, arXiv:2203.01348.
- M. Fannes, B. Nachtergaele, and R. F. Werner, Finitely correlated states on quantum spin chains, Commun. Math. Phys. 144, 443 (1992).
- U. Schollwöck, The density-matrix renormalization group in the age of matrix product states, Annal. Phys. (NY) 326, 96 (2011).
- We note that random matrix product states have emergent statistics [57, 58, 59] against sampling generality at large dimension , hence, our small choice.
- E. Lieb, T. Schultz, and D. Mattis, Two soluble models of an antiferromagnetic chain, Annal. Phys. (NY) 16, 407 (1961).
- A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga, A. Desmaison, A. Kopf, E. Yang, Z. DeVito, M. Raison, A. Tejani, S. Chilamkurthy, B. Steiner, L. Fang, J. Bai et al., Pytorch: An imperative style, high-performance deep learning library, in Advances in Neural Information Processing Systems, edited by H. Wallach, H. Larochelle, A. Beygelzimer, F. Alche-Buc, E. Fox, and R. Garnett (Curran, Vancouver, Canada, 2019), Vol. 32.
- J. Han and C. Moraga, The influence of the sigmoid function parameters on the speed of backpropagation learning, in From Natural to Artificial Neural Computation, edited by J. Mira and F. Sandoval (Springer, Berlin/Heidelberg, 1995), pp. 195–201.
- K. He, X. Zhang, S. Ren, and J. Sun, Deep residual learning for image recognition, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV (IEEE, Piscataway, NJ, 2016).
- K. Fukushima, Visual feature extraction by a multilayered network of analog threshold elements, IEEE Trans. Syst. Sci. Cybern. 5, 322 (1969).
- X. Glorot, A. Bordes, and Y. Bengio, Deep sparse rectifier neural networks, in Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Proceedings of Machine Learning Research, edited by G. Gordon, D. Dunson, and M. Dudík (PMLR, Fort Lauderdale, FL, 2011), Vol. 15, pp. 315–323.
- S. Ioffe and C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift, in Proceedings of the 32nd International Conference on International Conference on Machine Learning, ICML'15 (JMLR.org, Lille, France, 2015), Vol. 37, pp. 448–456.
- J. Hauschild and F. Pollmann, Efficient numerical simulations with Tensor Networks: Tensor Network Python (TeNPy), SciPost Phys. Lect. Notes, 5 (2018).
- C. E. Brodley and M. A. Friedl, Identifying mislabeled training data, J. Artif. Intell. Res. 11, 131 (1999).
- E. Beigman and B. B. Klebanov, Learning with annotation noise, in ACL 2009, Proceedings of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the AFNLP, Singapore, edited by K. Su, J. Su, and J. Wiebe (The Association for Computer Linguistics, Singapore, 2009), pp. 280–287.
- D. Rolnick, A. Veit, S. J. Belongie, and N. Shavit, Deep learning is robust to massive label noise, arXiv:1705.10694.
- Y. Kim, J. Yim, J. Yun, and J. Kim, NLNL: negative learning for noisy labels, in 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019 (IEEE, Piscataway, NJ, 2019), pp. 101–110.
- M. Zhao, S. Zhong, X. Fu, B. Tang, and M. Pecht, Deep residual shrinkage networks for fault diagnosis, IEEE Trans. Indust. Inform. 16, 4681 (2020).
- M. J. D. Powell, A direct search optimization method that models the objective and constraint functions by linear interpolation, in Advances in Optimization and Numerical Analysis, edited by S. Gomez and J.-P. Hennart (Springer, Dordrecht, 1994), pp. 51–67.
- M. J. D. Powell, Uobyqa: Unconstrained optimization by quadratic approximation, Math. Program. 92, 555 (2002).
- S. Garnerone, T. R. de Oliveira, and P. Zanardi, Typicality in random matrix product states, Phys. Rev. A 81, 032336 (2010).
- S. Garnerone, T. R. de Oliveira, S. Haas, and P. Zanardi, Statistical properties of random matrix product states, Phys. Rev. A 82, 052312 (2010).
- J. Haferkamp, C. Bertoni, I. Roth, and J. Eisert, Emergent statistical mechanics from properties of disordered random matrix product states, PRX Quantum 2, 040308 (2021).
- https://github.com/PeilinZHENG/MLQC