- Physical Review Journals
All JournalsPhysics Magazine

Physical Review Research

Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

Improving the prediction stability of reservoir computing by means of dynamic structural bias

Jieyi Liu1, Kaiwen Jiang1, Jingfang Fan2, and Yong Zou1,*

  • *Contact author: yzou@phy.ecnu.edu.cn
PDF

Phys. Rev. Research 8, 023114 – Published 4 May, 2026

DOI: https://doi.org/10.1103/5nbr-bqxb

Abstract

Optimization of computational efficiency and improving predictive stability remain key challenges in reservoir computing (RC) research. Building on the principle of Poincaré recurrence theorem, we propose a dynamic structural bias RC algorithm, significantly improving the prediction stability. Our framework refines the conventional training process by introducing a two-step mechanism. First, a reference state library is constructed from the training time series. Second, this library is used in conjunction with a dot-product similarity calculation to generate a structural, dynamic bias term. This dynamic bias introduces high-fidelity historical information into the reservoir's state update equation. The benefit is that the bias in the prediction phase acts as a dynamic constraint guiding the reservoir evolution toward the true known trajectory. We prove that our algorithm enhances the model's ability to maintain generalized synchronization with the target system's attractor in the autonomous prediction phase. Consequently, our method achieves two key advantages: predictive stability is dramatically improved, and the model's sensitivity to network hyperparameters is reduced. We demonstrate the effectiveness of our method through the reconstruction and long-term prediction of various low-dimensional chaotic systems, showing a substantially increased prediction horizon and a more stable, faithful reproduction of the attractor's structural geometry.

View figure in article

Physics Subject Headings (PhySH)

Article Text

References (60)

  1. H. Jaeger and H. Haas, Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication, Science 304, 78 (2004).
  2. M. Yan, C. Huang, P. Bienstman, P. Tino, W. Lin, and J. Sun, Emerging opportunities and challenges for the future of reservoir computing, Nat. Commun. 15, 2056 (2024).
  3. J. Pathak, B. Hunt, M. Girvan, Z. Lu, and E. Ott, Model-free prediction of large spatiotemporally chaotic systems from data: A reservoir computing approach, Phys. Rev. Lett. 120, 024102 (2018).
  4. Y. Kawai, J. Park, and M. Asada, A small-world topology enhances the echo state property and signal propagation in reservoir computing, Neural Networks 112, 15 (2019).
  5. L. E. Suárez, A. Mihalik, F. Milisav, K. Marshall, M. Li, P. E. Vértes, G. Lajoie, and B. Misic, Connectome-based reservoir computing with the conn2res toolbox, Nat. Commun. 15, 656 (2024).
  6. K. Srinivasan, N. Coble, J. Hamlin, T. Antonsen, E. Ott, and M. Girvan, Parallel machine learning for forecasting the dynamics of complex networks, Phys. Rev. Lett. 128, 164101 (2022).
  7. A. Wikner, J. Harvey, M. Girvan, B. R. Hunt, A. Pomerance, T. Antonsen, and E. Ott, Stabilizing machine learning prediction of dynamics: Novel noise-inspired regularization tested with reservoir computing, Neural Networks 170, 94 (2024).
  8. H.-H. Ren, Y.-L. Bai, M.-H. Fan, L. Ding, X.-X. Yue, and Q.-H. Yu, Constructing polynomial libraries for reservoir computing in nonlinear dynamical system forecasting, Phys. Rev. E 109, 024227 (2024).
  9. F. Köster, K. Kanno, J. Ohkubo, and A. Uchida, Attention-enhanced reservoir computing, Phys. Rev. Appl. 22, 014039 (2024).
  10. D. J. Gauthier, E. Bollt, A. Griffith, and W. A. Barbosa, Next generation reservoir computing, Nat. Commun. 12, 5564 (2021).
  11. S. K. Tavakoli and A. Longtin, Boosting reservoir computer performance with multiple delays, Phys. Rev. E 109, 054203 (2024).
  12. Y. Du, H. Luo, J. Guo, J. Xiao, Y. Yu, and X. Wang, Multifunctional reservoir computing, Phys. Rev. E 111, 035303 (2025).
  13. H. Fan, J. Jiang, C. Zhang, X. Wang, and Y.-C. Lai, Long-term prediction of chaotic systems with machine learning, Phys. Rev. Res. 2, 012080 (2020).
  14. T. Arcomano, I. Szunyogh, J. Pathak, A. Wikner, B. R. Hunt, and E. Ott, A machine learning-based global atmospheric forecast model, Geophys. Res. Lett. 47, e2020GL087776 (2020).
  15. Y.-G. Ham, J.-H. Kim, and J.-J. Luo, Deep learning for multi-year enso forecasts, Nature (London) 573, 568 (2019).
  16. L. Larger, A. Baylón-Fuentes, R. Martinenghi, V. S. Udaltsov, Y. K. Chembo, and M. Jacquot, High-speed photonic reservoir computing using a time-delay-based architecture: Million words per second classification, Phys. Rev. X 7, 011015 (2017).
  17. W.-J. Wang, Y. Tang, J. Xiong, and Y.-C. Zhang, Stock market index prediction based on reservoir computing models, Expert Syst. Appl. 178, 115022 (2021).
  18. K. Vandoorne, P. Mechet, T. Van Vaerenbergh, M. Fiers, G. Morthier, D. Verstraeten, B. Schrauwen, J. Dambre, and P. Bienstman, Experimental demonstration of reservoir computing on a silicon photonics chip, Nat. Commun. 5, 3541 (2014).
  19. X. Liang, J. Tang, Y. Zhong, B. Gao, H. Qian, and H. Wu, Physical reservoir computing with emerging electronics, Nat. Electron. 7, 193 (2024).
  20. I. Estébanez, I. Fischer, and M. C. Soriano, Constructive role of noise for high-quality replication of chaotic attractor dynamics using a hardware-based reservoir computer, Phys. Rev. Appl. 12, 034058 (2019).
  21. R. M. Zur, Y. Jiang, L. L. Pesce, and K. Drukker, Noise injection for training artificial neural networks: A comparison with weight decay and early stopping, Med. Phys. 36, 4810 (2009).
  22. C. M. Bishop, Training with noise is equivalent to tikhonov regularization, Neural Comput. 7, 108 (1995).
  23. L.-W. Kong, H.-W. Fan, C. Grebogi, and Y.-C. Lai, Machine learning prediction of critical transition and system collapse, Phys. Rev. Res. 3, 013090 (2021).
  24. R. Xiao, L.-W. Kong, Z.-K. Sun, and Y.-C. Lai, Predicting amplitude death with machine learning, Phys. Rev. E 104, 014205 (2021).
  25. H. Fan, L. Wang, Y. Du, Y. Wang, J. Xiao, and X. Wang, Learning the dynamics of coupled oscillators from transients, Phys. Rev. Res. 4, 013137 (2022).
  26. T. Weng, H. Yang, C. Gu, J. Zhang, and M. Small, Synchronization of chaotic systems and their machine-learning models, Phys. Rev. E 99, 042203 (2019).
  27. X. Chen, T. Weng, C. Gu, and H. Yang, Synchronizing hyperchaotic subsystems with a single variable: A reservoir computing approach, Physica A 534, 122273 (2019).
  28. L. Zhao, Z. Sun, M. Tang, S. Guan, and Y. Zou, Learning successive weak synchronization transitions and coupling directions by reservoir computing, Chaos Solitons Fractals 168, 113139 (2023).
  29. L.-W. Kong, G. A. Brewer, and Y.-C. Lai, Reservoir-computing based associative memory and itinerancy for complex dynamical attractors, Nat. Commun. 15, 4840 (2024).
  30. Y. Du, H. Fan, and X. Wang, Versatile reservoir computing for heterogeneous complex networks, Phys. Rev. Appl. 24, L031002 (2025).
  31. J. A. Platt, S. G. Penny, T. A. Smith, T.-C. Chen, and H. D. Abarbanel, A systematic exploration of reservoir computing for forecasting complex spatiotemporal dynamics, Neural Networks 153, 530 (2022).
  32. J. Pathak, Z. Lu, B. R. Hunt, M. Girvan, and E. Ott, Using machine learning to replicate chaotic attractors and calculate lyapunov exponents from data, Chaos 27, 121102 (2017).
  33. E. Lorenz, Deterministic nonperiodic flow, J. Atmos. Sci. 20, 130 (1963).
  34. J. C. Sprott, Chaos and Time-Series Analysis (Oxford University Press, Oxford, 2003).
  35. V. Le Guen and N. Thome, Shape and time distortion loss for training deep time series forecasting models, Advances in Neural Information Processing Systems, Vol. 32 (Curran Associates, Inc., 2019).
  36. O. E. Rössler, An equation for continuous chaos, Phys. Lett. A 57, 397 (1976).
  37. T. Ueta and G. Chen, Bifurcation analysis of Chen's equation, Int. J. Bifurcation Chaos 10, 1917 (2000).
  38. J. L. Hindmarsh and R. M. Rose, A model of neuronal bursting using three coupled first order differential equations, Proc. R. Soc. London Ser. B 221, 87 (1984).
  39. H. Ma, D. Prosperino, and C. Räth, A novel approach to minimal reservoir computing, Sci. Rep. 13, 12970 (2023).
  40. J. A. Platt, S. G. Penny, T. A. Smith, T.-C. Chen, and H. D. I. Abarbanel, Constraining chaos: Enforcing dynamical invariants in the training of reservoir computers, Chaos 33, 103107 (2023).
  41. P. Grassberger and I. Procaccia, Characterization of strange attractors, Phys. Rev. Lett. 50, 346 (1983).
  42. H. Kantz and T. Schreiber, Nonlinear Time Series Analysis, 2nd ed. (Cambridge University Press, Cambridge, 2004).
  43. X. Chen, T. Weng, H. Yang, C. Gu, J. Zhang, and M. Small, Mapping topological characteristics of dynamical systems into neural networks: A reservoir computing approach, Phys. Rev. E 102, 033314 (2020).
  44. X. Chen, T. Weng, and H. Yang, Synchronization of spatiotemporal chaos and reservoir computing via scalar signals, Chaos Solitons Fractals 169, 113314 (2023).
  45. J. M. Hyman and B. Nicolaenko, The Kuramoto-Sivashinsky equation: A bridge between PDE's and dynamical systems, Physica D 18, 113 (1986).
  46. S. Toh, Statistical model with localized structures describing the spatio-temporal chaos of Kuramoto-Sivashinsky equation, J. Phys. Soc. Jpn. 56, 949 (1987).
  47. R. W. Wittenberg and P. Holmes, Scale and space localization in the Kuramoto-Sivashinsky equation, Chaos 9, 452 (1999).
  48. Y. Lan and P. Cvitanović, Unstable recurrent patterns in Kuramoto-Sivashinsky dynamics, Phys. Rev. E 78, 026208 (2008).
  49. S. L. Brunton, B. W. Brunton, J. L. Proctor, E. Kaiser, and J. N. Kutz, Chaos as an intermittently forced linear system, Nat. Commun. 8, 19 (2017).
  50. J. D. Hart, Attractor reconstruction with reservoir computers: The effect of the reservoir's conditional Lyapunov exponents on faithful attractor reconstruction, Chaos 34, 043123 (2024).
  51. G. Tanaka, T. Yamane, J. B. Héroux, R. Nakane, N. Kanazawa, S. Takeda, H. Numata, D. Nakano, and A. Hirose, Recent advances in physical reservoir computing: A review, Neural Networks 115, 100 (2019).
  52. Y. Kuriki, J. Nakayama, K. Takano, and A. Uchida, Impact of input mask signals on delay-based photonic reservoir computing with semiconductor lasers, Opt. Express 26, 5777 (2018).
  53. J. Sun, W. Yang, T. Zheng, X. Xiong, Y. Liu, Z. Wang, Z. Li, and X. Zou, Novel nondelay-based reservoir computing with a single micromechanical nonlinear resonator for high-efficiency information processing, Microsyst. Nanoeng. 7, 83 (2021).
  54. L. Appeltant, M. C. Soriano, G. Van der Sande, J. Danckaert, S. Massar, J. Dambre, B. Schrauwen, C. R. Mirasso, and I. Fischer, Information processing using a single dynamical node as complex system, Nat. Commun. 2, 468 (2011).
  55. S. Kan, K. Nakajima, Y. Takeshima, T. Asai, Y. Kuwahara, and M. Akai-Kasaya, Simple reservoir computing capitalizing on the nonlinear response of materials: Theory and physical implementations, Phys. Rev. Appl. 15, 024030 (2021).
  56. F. Stelzer, A. Röhm, K. Lüdge, and S. Yanchuk, Performance boost of time-delay reservoir computing by non-resonant clock cycle, Neural Networks 124, 158 (2020).
  57. D. Nishioka, T. Tsuchiya, W. Namiki, M. Takayanagi, M. Imura, Y. Koide, T. Higuchi, and K. Terabe, Edge-of-chaos learning achieved by ion-electron–coupled dynamics in an ion-gating reservoir, Sci. Adv. 8, eade1156 (2022).
  58. A. Banerjee, J. D. Hart, R. Roy, and E. Ott, Machine learning link inference of noisy delay-coupled networks with optoelectronic experimental tests, Phys. Rev. X 11, 031014 (2021).
  59. A. Banerjee, S. Chandra, and E. Ott, Network inference from short, noisy, low time-resolution, partial measurements: Application to C. elegans neuronal calcium dynamics, Proc. Natl. Acad. Sci. USA 120, e2216030120 (2023).
  60. J. Liu and Y. Zou, GitHub, https://github.com/yongPIK/DynamicBiasedRC (2026).

Outline

Information

Phys. Rev. Research 8, 023114– Published 4 May, 2026
  • Received 15 November 2025
  • Accepted 2 April 2026
Crossmark - Check for updates button
Creative Commons Logo

Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.

Published by the American Physical Society

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation