- Open Access
Nearly Query-Optimal Classical Shadow Estimation of Unitary Channels
PRX Quantum 6, 030366 – Published 30 September, 2025
DOI: https://doi.org/10.1103/wccm-zys6
Abstract
Classical shadow estimation (CSE) is a powerful tool for learning the properties of quantum states and quantum processes. Here we consider the CSE task for quantum unitary channels. By querying an unknown unitary channel multiple times in quantum experiments, the goal is to learn a classical description from which one can accurately predict many different linear properties of the channel, i.e., the expectation values of arbitrary observables measured on the output of upon arbitrary input states. Based on collective measurements on multiple systems, we propose a query-efficient protocol for this task, whose query complexity has a quadratic advantage over the previous best approach for this problem, and almost saturates the information-theoretic lower bound. To further enhance practicality, we also present a variant protocol using only single-copy measurements, which still offers much better query performance than previous protocols that do not use quantum memory, and can serve as a key subroutine for learning an arbitrary unknown Hamiltonian from dynamics. In addition to linear properties of unitary channels, our protocol can also be applied to simultaneously predict many nonlinear properties, such as out-of-time-ordered correlators.
Physics Subject Headings (PhySH)
Popular Summary
In quantum mechanics, the evolution of a closed system is governed by a unitary channel acting on quantum states. Learning such channels is a fundamental problem in physics and has applications across various fields, including characterizing complex quantum dynamics, learning quantum Hamiltonians, probing quantum chaos, and variational quantum algorithms. Traditional tomographic approaches can fully characterize an unknown unitary channel but require a prohibitively large number of experiments, rendering them resource consuming and inefficient.
Our research provides a more efficient way to learn key behaviors of unitary channels under the framework of classical shadow estimation. We propose a protocol that lets scientists predict many different properties of an unknown unitary after applying it significantly fewer times. Our protocol achieves a quadratic improvement in query complexity, meaning that the required number of accesses to the unitary grows much slower as the system gets large, compared to the best previous methods. We prove that this improvement is essentially nearly optimal, that is, the access number cannot be further reduced. For practical implementation, we further introduce a variant protocol that operates without using quantum memories. As a key application, we show that this protocol can serve as a key subroutine for learning an arbitrary Hamiltonian from short-time dynamics, outperforming existing approaches in terms of both the query complexity and total evolution time.
Our work offers both theoretical insights and state-of-the-art tools for learning unitary channels, advancing the understanding of complex quantum systems, and paving the way for future research.
Article Text
References (84)
- V. Gebhart, R. Santagati, A. A. Gentile, E. M. Gauger, D. Craig, N. Ares, L. Banchi, F. Marquardt, L. Pezzè, and C. Bonato, Learning quantum systems, Nat. Rev. Phys. 5, 141 (2023).
- J. Carrasco, A. Elben, C. Kokail, B. Kraus, and P. Zoller, Theoretical and experimental perspectives of quantum verification, PRX Quantum 2, 010102 (2021).
- M. Kliesch and I. Roth, Theory of quantum system certification, PRX Quantum 2, 010201 (2021).
- M. Mohseni and D. A. Lidar, Direct characterization of quantum dynamics, Phys. Rev. Lett. 97, 170501 (2006).
- M. C. Caro, H.-Y. Huang, N. Ezzell, J. Gibbs, A. T. Sornborger, L. Cincio, P. J. Coles, and Z. Holmes, Out-of-distribution generalization for learning quantum dynamics, Nat. Commun. 14, 3751 (2023).
- J. Haah, R. Kothari, R. O’Donnell, and E. Tang, Query-optimal estimation of unitary channels in diamond distance, in 2023 IEEE 64th Annual Symposium on Foundations of Computer Science (FOCS) (IEEE, Santa Cruz, CA, USA, 2023), pp. 363–390.
- S. Aaronson, Shadow tomography of quantum states, in Proceedings of the 50th Annual ACM SIGACT Symposium on Theory of Computing (Association for Computing Machinery, Los Angeles, CA, USA, 2018), pp. 325–338.
- C. Bădescu and R. O’Donnell, Improved Quantum data analysis, in Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing (Association for Computing Machinery, Virtual, Italy, 2021), pp. 1398–1411.
- H.-Y. Huang, R. Kueng, and J. Preskill, Predicting many properties of a quantum system from very few measurements, Nat. Phys. 16, 1050 (2020).
- C. Bertoni, J. Haferkamp, M. Hinsche, M. Ioannou, J. Eisert, and H. Pashayan, Shallow shadows: Expectation estimation using low-depth random Clifford circuits, Phys. Rev. Lett. 133, 020602 (2024).
- D. Grier, H. Pashayan, and L. Schaeffer, Sample-optimal classical shadows for pure states, Quantum 8, 1373 (2024).
- H.-Y. Hu, S. Choi, and Y.-Z. You, Classical shadow tomography with locally scrambled quantum dynamics, Phys. Rev. Res. 5, 023027 (2023).
- B. Vermersch, A. Rath, B. Sundar, C. Branciard, J. Preskill, and A. Elben, Enhanced estimation of quantum properties with common randomized measurements, PRX Quantum 5, 010352 (2024).
- J. Helsen and M. Walter, Thrifty shadow estimation: Reusing quantum circuits and bounding tails, Phys. Rev. Lett. 131, 240602 (2023).
- Y. Zhou and Q. Liu, Performance analysis of multi-shot shadow estimation, Quantum 7, 1044 (2023).
- M. Arienzo, M. Heinrich, I. Roth, and M. Kliesch, Closed-form analytic expressions for shadow estimation with brickwork circuits, Quantum Inf. Comput. 23, 961 (2023).
- Y. Zhou and Z. Liu, A hybrid framework for estimating nonlinear functions of quantum states, npj Quantum Inf. 10, 62 (2024).
- Q. Zhang, Q. Liu, and Y. Zhou, Minimal-Clifford shadow estimation by mutually unbiased bases, Phys. Rev. Appl. 21, 064001 (2024).
- Q. Liu, Z. Li, X. Yuan, H. Zhu, and Y. Zhou, Auxiliary-free replica shadow estimation, arXiv:2407.20865.
- A. Elben, S. T. Flammia, H.-Y. Huang, R. Kueng, J. Preskill, B. Vermersch, and P. Zoller, The randomized measurement toolbox, Nat. Rev. Phys. 5, 9 (2023).
- J. Kunjummen, M. C. Tran, D. Carney, and J. M. Taylor, Shadow process tomography of quantum channels, Phys. Rev. A 107, 042403 (2023).
- R. Levy, D. Luo, and B. K. Clark, Classical shadows for quantum process tomography on near-term quantum computers, Phys. Rev. Res. 6, 013029 (2024).
- H.-Y. Huang, S. Chen, and J. Preskill, Learning to predict arbitrary quantum processes, PRX Quantum 4, 040337 (2023).
- M. C. Caro, Learning quantum processes and Hamiltonians via the Pauli transfer matrix, ACM Trans. Quantum Comput. 5, 1 (2024).
- H. Zhao, L. Lewis, I. Kannan, Y. Quek, H.-Y. Huang, and M. C. Caro, Learning quantum states and unitaries of bounded gate complexity, PRX Quantum 5, 040306 (2024).
- H.-Y. Huang, Y. Liu, M. Broughton, I. Kim, A. Anshu, Z. Landau, and J. R. McClean, Learning shallow quantum circuits, in Proceedings of the 56th Annual ACM Symposium on Theory of Computing (Association for Computing Machinery, Vancouver, BC, Canada, 2024), pp. 1343–1351.
- H.-Y. Huang, R. Kueng, and J. Preskill, Information-theoretic bounds on quantum advantage in machine learning, Phys. Rev. Lett. 126, 190505 (2021).
- M. C. Caro, H.-Y. Huang, M. Cerezo, K. Sharma, A. Sornborger, L. Cincio, and P. J. Coles, Generalization in quantum machine learning from few training data, Nat. Commun. 13, 4919 (2022).
- H.-Y. Huang, M. Broughton, J. Cotler, S. Chen, J. Li, M. Mohseni, H. Neven, R. Babbush, R. Kueng, J. Preskill et al., Quantum advantage in learning from experiments, Science 376, 1182 (2022).
- T. Surawy-Stepney, J. Kahn, R. Kueng, and M. Guta, Projected least-squares quantum process tomography, Quantum 6, 844 (2022).
- J. Biamonte, P. Wittek, N. Pancotti, P. Rebentrost, N. Wiebe, and S. Lloyd, Quantum machine learning, Nature 549, 195 (2017).
- M. Schuld and N. Killoran, Quantum machine learning in feature Hilbert spaces, Phys. Rev. Lett. 122, 040504 (2019).
- M. Cerezo, A. Arrasmith, R. Babbush, S. C. Benjamin, S. Endo, K. Fujii, J. R. McClean, K. Mitarai, X. Yuan, L. Cincio et al., Variational quantum algorithms, Nat. Rev. Phys. 3, 625 (2021).
- C. Kokail, C. Maier, R. van Bijnen, T. Brydges, M. K. Joshi, P. Jurcevic, C. A. Muschik, P. Silvi, R. Blatt, C. F. Roos et al., Self-verifying variational quantum simulation of lattice models, Nature 569, 355 (2019).
- J. Gibbs, Z. Holmes, M. C. Caro, N. Ezzell, H.-Y. Huang, L. Cincio, A. T. Sornborger, and P. J. Coles, Dynamical simulation via quantum machine learning with provable generalization, Phys. Rev. Res. 6, 013241 (2024).
- D. Stilck França, L. A. Markovich, V. Dobrovitski, A. H. Werner, and J. Borregaard, Efficient and robust estimation of many-qubit Hamiltonians, Nat. Commun. 15, 311 (2024).
- A. Gu, L. Cincio, and P. J. Coles, Practical Hamiltonian learning with unitary dynamics and Gibbs states, Nat. Commun. 15, 312 (2024).
- H. Zhu, Multiqubit Clifford groups are unitary 3-designs, Phys. Rev. A 96, 062336 (2017).
- Z. Webb, The Clifford group forms a unitary 3-design, Quantum Inf. Comput. 16, 1379 (2016).
- S. Chen, J. Cotler, H.-Y. Huang, and J. Li, Exponential separations between learning with and without quantum memory, in 2021 IEEE 62nd Annual Symposium on Foundations of Computer Science (FOCS) (IEEE, Denver, CO, USA, 2022), pp. 574–585.
- Some references alternatively call Hamiltonian learning protocols without (with) quantum memory as incoherent (coherent) protocols [65], or protocols without (with) quantum control [68].
- S. Massar and S. Popescu, Optimal extraction of information from finite quantum ensembles, Phys. Rev. Lett. 74, 1259 (1995).
- M. Hayashi, Asymptotic estimation theory for a finite-dimensional pure state model, J. Phys. A: Math. Gen. 31, 4633 (1998).
- D. Bruß and C. Macchiavello, Optimal state estimation for -dimensional quantum systems, Phys. Lett. A 253, 249 (1999).
- H. Zhu and M. Hayashi, Universally Fisher-symmetric informationally complete measurements, Phys. Rev. Lett. 120, 030404 (2018).
- A. W. Harrow, The church of the symmetric subspace, arXiv:1308.6595.
- A. Anshu, Z. Landau, and Y. Liu, Distributed quantum inner product estimation, in Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing (Association for Computing Machinery, Rome, Italy, 2022), pp. 44–51.
- Z. Hou, J.-F. Tang, J. Shang, H. Zhu, J. Li, Y. Yuan, K.-D. Wu, G.-Y. Xiang, C.-F. Li, and G.-C. Guo, Deterministic realization of collective measurements via photonic quantum walks, Nat. Commun. 9, 1414 (2018).
- L. O. Conlon, T. Vogl, C. D. Marciniak, I. Pogorelov, S. K. Yung, F. Eilenberger, D. W. Berry, F. S. Santana, R. Blatt, T. Monz et al., Approaching optimal entangling collective measurements on quantum computing platforms, Nat. Phys. 19, 351 (2023).
- K. Zhou, C. Yi, W.-Z. Yan, Z. Hou, H. Zhu, G.-Y. Xiang, C.-F. Li, and G.-C. Guo, Experimental realization of genuine three-copy collective measurements for optimal information extraction, Phys. Rev. Lett. 134, 210201 (2025).
- K.-D. Wu, E. Bäumer, J.-F. Tang, K. V. Hovhannisyan, M. Perarnau-Llobet, G.-Y. Xiang, C.-F. Li, and G.-C. Guo, Minimizing backaction through entangled measurements, Phys. Rev. Lett. 125, 210401 (2020).
- M.-D. Choi, Completely positive linear maps on complex matrices, Linear Algebra Appl. 10, 285 (1975).
- R. Kothari, An optimal quantum algorithm for the oracle identification problem, in 31st International Symposium on Theoretical Aspects of Computer Science (Schloss Dagstuhl – Leibniz-Zentrum für Informatik, Dagstuhl, Germany, 2014), pp. 482–493.
- S. Arunachalam and R. de Wolf, Guest column: A survey of quantum learning theory, ACM SIGACT News 48, 41 (2017).
- B. Collins and I. Nechita, Random matrix techniques in quantum information theory, J. Math. Phys 57, 015215 (2016).
- I. Nechita, Asymptotics of random density matrices, Ann. Henri Poincaré 8, 1521 (2007).
- K. Życzkowski, K. A. Penson, I. Nechita, and B. Collins, Generating random density matrices, J. Math. Phys. 52, 062201 (2011).
- E. Lubkin, Entropy of an -system from its correlation with a -reservoir, J. Math. Phys 19, 1028 (1978).
- J. L. O’Brien, G. J. Pryde, A. Gilchrist, D. F. V. James, N. K. Langford, T. C. Ralph, and A. G. White, Quantum process tomography of a controlled-NOT gate, Phys. Rev. Lett. 93, 080502 (2004).
- Y. Yang, R. Renner, and G. Chiribella, Optimal universal programming of unitary gates, Phys. Rev. Lett. 125, 210501 (2020).
- V. Giovannetti, S. Lloyd, and L. Maccone, Advances in quantum metrology, Nat. Photonics 5, 222 (2011).
- C. L. Degen, F. Reinhard, and P. Cappellaro, Quantum sensing, Rev. Mod. Phys. 89, 035002 (2017).
- M. D. Shulman, S. P. Harvey, J. M. Nichol, S. D. Bartlett, A. C. Doherty, V. Umansky, and A. Yacoby, Suppressing qubit dephasing using real-time Hamiltonian estimation, Nat. Commun. 5, 5156 (2014).
- L. Innocenti, L. Banchi, A. Ferraro, S. Bose, and M. Paternostro, Supervised learning of time-independent Hamiltonians for gate design, New J. Phys. 22, 065001 (2020).
- A. Bluhm, M. C. Caro, and A. Oufkir, Hamiltonian property testing, arXiv:2403.02968.
- M. Ma, S. T. Flammia, J. Preskill, and Y. Tong, Learning -body Hamiltonians via compressed sensing, arXiv:2410.18928.
- Q. Zhao, Y. Zhou, A. F. Shaw, T. Li, and A. M. Childs, Hamiltonian simulation with random inputs, Phys. Rev. Lett. 129, 270502 (2022).
- A. Dutkiewicz, T. E. O’Brien, and T. Schuster, The advantage of quantum control in many-body Hamiltonian learning, Quantum 8, 1537 (2024).
- E. Bairey, I. Arad, and N. H. Lindner, Learning a local Hamiltonian from local measurements, Phys. Rev. Lett. 122, 020504 (2019).
- W. Yu, J. Sun, Z. Han, and X. Yuan, Robust and efficient Hamiltonian learning, Quantum 7, 1045 (2023).
- H.-Y. Hu, M. Ma, W. Gong, Q. Ye, Y. Tong, S. T. Flammia, and S. F. Yelin, Ansatz-free Hamiltonian learning with Heisenberg-limited scaling, accepted by PRX Quantum.
- A. Zhao, Learning the structure of any Hamiltonian from minimal assumptions, in Proceedings of the 57th Annual ACM SIGACT Symposium on Theory of Computing (Association for Computing Machinery, Prague, Czechia, 2025), pp. 1201–1211.
- H.-Y. Huang, Y. Tong, D. Fang, and Y. Su, Learning many-body Hamiltonians with Heisenberg-limited scaling, Phys. Rev. Lett. 130, 200403 (2023).
- J. Haah, R. Kothari, and E. Tang, Learning quantum Hamiltonians from high-temperature Gibbs states and real-time evolutions, Nat. Phys. 20, 1027 (2024).
- J. Castaneda and N. Wiebe, Hamiltonian learning via shadow tomography of pseudo-Choi states, Quantum 9, 1700 (2025).
- A. Bakshi, A. Liu, A. Moitra, and E. Tang, Structure learning of Hamiltonians from real-time evolution, in 2024 IEEE 65th Annual Symposium on Foundations of Computer Science (FOCS) (IEEE, Chicago, IL, USA, 2024), pp. 1037–1050.
- S. Xu and B. Swingle, Scrambling dynamics and out-of-time-ordered correlators in quantum many-body systems, PRX Quantum 5, 010201 (2024).
- C.-F. Chen, A. Lucas, and C. Yin, Speed limits and locality in many-body quantum dynamics, Rep. Prog. Phys. 86, 116001 (2023).
- H. Shen, P. Zhang, Y.-Z. You, and H. Zhai, Information scrambling in quantum neural networks, Phys. Rev. Lett. 124, 200504 (2020).
- C. W. von Keyserlingk, T. Rakovszky, F. Pollmann, and S. L. Sondhi, Operator hydrodynamics, OTOCs, and entanglement growth in systems without conservation laws, Phys. Rev. X 8, 021013 (2018).
- B. Vermersch, A. Elben, L. M. Sieberer, N. Y. Yao, and P. Zoller, Probing scrambling using statistical correlations between randomized measurements, Phys. Rev. X 9, 021061 (2019).
- R. J. Garcia, Y. Zhou, and A. Jaffe, Quantum scrambling with classical shadows, Phys. Rev. Res. 3, 033155 (2021).
- L. Leone, S. F. E. Oliviero, Y. Zhou, and A. Hamma, Quantum chaos is quantum, Quantum 5, 453 (2021).
- A. A. Mele, Introduction to Haar measure tools in quantum information: A beginner’s tutorial, Quantum 8, 1340 (2024).
