- Open Access
Data-driven reconstruction of a multivariate Langevin equation to model complex systems
Phys. Rev. E 112, 024115 – Published 11 August, 2025
DOI: https://doi.org/10.1103/zncf-n4y3
Abstract
Obtaining an accurate description of complex systems is challenging, particularly when their elements exhibit intricate interactions. We propose a data-driven multivariate Langevin equation (LE) to approximate real-world complex systems' observables. By reconstructing the drift and diffusion terms of the LE through a nonparametric technique following the definition of the Kramers-Moyal coefficients, our approach unravels the main features of a complex system without requiring a priori knowledge about the underlying governing mechanisms. We illustrate our framework's adaptability, reliability, and capability to extract pertinent information through three case studies. First, we benchmark the framework with a simple prototypical example from mechanics, a particle confined by a bistable potential energy well. We then turn to two more involved examples from financial markets, the electricity day-ahead prices and currency-exchange rates, where the nonparametric multivariate LE has not previously been applied. In all cases, our framework accurately identifies the equilibrium values, metastabilty regions, and distinct diffusion behaviors, in a functional agnostic manner, as opposed to price-equation models that require specific domain knowledge.
Physics Subject Headings (PhySH)
Article Text
References (81)
- S. Kalliadasis, S. Krumscheid, and G. A. Pavliotis, A new framework for extracting coarse-grained models from time series with multiscale structure, J. Comput. Phys. 296, 314 (2015).
- H. Mori, Transport, collective motion, and Brownian motion, Prog. Theor. Phys. 33, 423 (1965).
- R. Zwanzig, Nonlinear generalized Langevin equations, J. Stat. Phys. 9, 215 (1973).
- A. Chorin and P. Stinis, Problem reduction, renormalization, and memory, Commun. Appl. Math. Comput. Sci. 1, 1 (2006).
- A. Russo, M. A. Durán-Olivencia, I. G. Kevrekidis, and S. Kalliadasis, Machine learning memory kernels as closure for non-Markovian stochastic processes, IEEE Trans. Neural Netw. Learn. Syst. 35, 6531 (2024).
- H. Grabert, Projection Operator Techniques in Nonequilibrium Statistical Mechanics, 1st ed. (Springer, Berlin, 1982).
- R. Friedrich, S. Siegert, J. Peinke, S. Lück, M. Siefert, M. Lindemann, J. Raethjen, G. Deuschl, and G. Pfister, Extracting model equations from experimental data, Phys. Lett. A 271, 217 (2000).
- R. Friedrich, J. Peinke, M. Sahimi, and M. R. R. Tabar, Approaching complexity by stochastic methods: From biological systems to turbulence, Phys. Rep. 506, 87 (2011).
- M. Anvari, M. R. R. Tabar, J. Peinke, and K. Lehnertz, Disentangling the stochastic behavior of complex time series, Sci. Rep. 6, 35435 (2016).
- P. Xie, R. Car, and W. E, Ab initio generalized Langevin equation, Proc. Nat. Acad. Sci. USA 121, e2308668121 (2024).
- M. R. R. Tabar, Analysis and Data-Based Reconstruction of Complex Nonlinear Dynamical Systems, 1st ed. (Springer, Cham, 2019).
- S. Siegert, R. Friedrich, and J. Peinke, Analysis of data sets of stochastic systems, Phys. Lett. A 243, 275 (1998).
- A. M. van Mourik, A. Daffertshofer, and P. J. Beek, Estimating Kramers–Moyal coefficients in short and non-stationary data sets, Phys. Lett. A 351, 13 (2006).
- D. Kleinhans and R. Friedrich, Maximum likelihood estimation of drift and diffusion functions, Phys. Lett. A 368, 194 (2007).
- S. J. Lade, Finite sampling interval effects in Kramers–Moyal analysis, Phys. Lett. A 373, 3705 (2009).
- D. Lamouroux and K. Lehnertz, Kernel-based regression of drift and diffusion coefficients of stochastic processes, Phys. Lett. A 373, 3507 (2009).
- C. Honisch and R. Friedrich, Estimation of Kramers-Moyal coefficients at low sampling rates, Phys. Rev. E 83, 066701 (2011).
- F. Nikakhtar, L. Parkavousi, M. Sahimi, M. R. R. Tabar, U. Feudel, and K. Lehnertz, Data-driven reconstruction of stochastic dynamical equations based on statistical moments, New J. Phys. 25, 083025 (2023).
- M. R. Tabar, F. Nikakhtar, L. Parkavousi, A. Akhshi, U. Feudel, and K. Lehnertz, Revealing higher-order interactions in high-dimensional complex systems: A data-driven approach, Phys. Rev. X 14, 011050 (2024).
- E. Anahua, S. Barth, and J. Peinke, Markovian power curves for wind turbines, Wind Energy 11, 219 (2008).
- J. Gottschall and J. Peinke, How to improve the estimation of power curves for wind turbines, Environ. Res. Lett. 3, 015005 (2008).
- R. Friedrich, J. Peinke, and C. Renner, How to quantify deterministic and random influences on the statistics of the foreign exchange market, Phys. Rev. Lett. 84, 5224 (2000).
- M. Petelczyc, J. J. Żebrowski, and R. Baranowski, Kramers-Moyal coefficients in the analysis and modeling of heart rate variability, Phys. Rev. E 80, 031127 (2009).
- C. Wiedemann, H. M. Bette, M. Wächter, J. Freund, T. Guhr, and J. Peinke, Extension of the Langevin power curve analysis by separation per operational state, arXiv:2305.15512.
- M. Verleysen and D. François, The curse of dimensionality in data mining and time series prediction, in Computational Intelligence and Bioinspired Systems, edited by J. Cabestany, A. Prieto, and F. Sandoval (Springer, Berlin, 2005), pp. 758–770.
- B. D. Goddard, A. Nold, N. Savva, G. A. Pavliotis, and S. Kalliadasis, General dynamical density functional theory for classical fluids, Phys. Rev. Lett. 109, 120603 (2012).
- B. D. Goddard, A. Nold, N. Savva, P. Yatsyshin, and S. Kalliadasis, Unification of dynamic density functional theory for colloidal fluids to include inertia and hydrodynamic interactions: derivation and numerical experiments, J. Phys.: Condens. Matter 25, 035101 (2013).
- M. A. Durán-Olivencia, P. Yatsyshin, B. D. Goddard, and S. Kalliadasis, General framework for fluctuating dynamic density functional theory, New J. Phys. 19, 123022 (2017).
- A. Provenzale, Climate as a complex dynamical system, in Mathematical Models and Methods for Planet Earth (Springer International, Cham, 2014), pp. 135–142.
- M. Schmuck, M. Pradas, S. Kalliadasis, and G. A. Pavliotis, New stochastic mode reduction strategy for dissipative systems, Phys. Rev. Lett. 110, 244101 (2013).
- P. Alaton, B. Djehiche, and D. Stillberger, On modelling and pricing weather derivatives, Appl. Math. Finance 9, 1 (2002).
- H. Risken, The Fokker-Planck Equation: Methods of Solution and Applications, 2nd ed. (Springer, Berlin, 1996).
- R. F. Pawula, Approximation of the linear Boltzmann equation by the Fokker-Planck equation, Phys. Rev. 162, 186 (1967).
- T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed. (Springer, New York, 2009).
- B. Silverman, Density Estimation for Statistics and Data Analysis, 1st ed. (Chapman & Hall, London, 1986).
- D. Scott, Multivariate Density Estimation: Theory, Practice, and Visualization, 1st ed. (John Wiley & Sons, New York, 1992).
- P. E. Kloeden and E. Platen, Numerical Solution of Stochastic Differential Equations, 1st ed. (Springer, Berlin, 1992).
- C. Harris, Electricity Markets: Pricing, Structures and Economics, 1st ed. (John Wiley & Sons, New York, 2006).
- S. Borenstein, The trouble with electricity markets: Understanding California's restructuring disaster, J. Econ. Perspect. 16, 191 (2002).
- C. R. Knittel and M. R. Roberts, An empirical examination of restructured electricity prices, Energy Econ. 27, 791 (2005).
- L. Tschora, E. Pierre, M. Plantevit, and C. Robardet, Electricity price forecasting on the day-ahead market using machine learning, Appl. Energy 313, 118752 (2022).
- J. Lago, G. Marcjasz, B. De Schutter, and R. Weron, Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark, Appl. Energy 293, 116983 (2021).
- J. J. Lucia and E. S. Schwartz, Electricity prices and power derivatives: Evidence from the Nordic power exchange, Rev. Deriv. Res. 5, 5 (2002).
- B. Hambly, S. Howison, and T. Kluge, Modelling spikes and pricing swing options in electricity markets, Quant. Finance 9, 937 (2009).
- R. Huisman and R. Mahieu, Regime jumps in electricity prices, Energy Econ. 25, 425 (2003).
- R. Weron, M. Bierbrauer, and S. Trück, Modeling electricity prices: Jump diffusion and regime switching, Physica A 336, 39 (2004).
- J. Collet, V. Duwig, and N. Oudjane, Some non-Gaussian models for electricity spot prices, in Proceedings of the 9th International Conference on Probabilistic Methods Applied to Power Systems (PMAPS'06) (Stockholm, Sweden, 2006), pp. 1–7.
- F. E. Benth, The stochastic volatility model of Barndorff-Nielsen and Shephard in commodity markets, Math. Finance 21, 595 (2011).
- S. Borovkova and M. D. Schmeck, Electricity price modeling with stochastic time change, Energy Econ. 63, 51 (2017).
- R. Weron, Electricity price forecasting: A review of the state-of-the-art with a look into the future, Int. J. Forecast. 30, 1030 (2014).
- T. Deschatre, O. Féron, and P. Gruet, A survey of electricity spot and futures price models for risk management applications, Energy Econ. 102, 105504 (2021).
- B. Uniejewski, J. Nowotarski, and R. Weron, Automated variable selection and shrinkage for day-ahead electricity price forecasting, Energies 9, 621 (2016).
- F. Ziel and R. Weron, Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs multivariate modeling frameworks, Energy Econ. 70, 396 (2018).
- J. Portela González, A. Muñoz San Roque, and E. Alonso Pérez, Forecasting functional time series with a new Hilbertian ARMAX model: Application to electricity price forecasting, IEEE Trans. Power Syst. 33, 545 (2018).
- S. Krumscheid, M. Pradas, G. A. Pavliotis, and S. Kalliadasis, Data-driven coarse graining in action: Modeling and prediction of complex systems, Phys. Rev. E 92, 042139 (2015).
- Y. Stepanov, P. Rinn, T. Guhr, J. Peinke, and R. Schäfer, Stability and hierarchy of quasi-stationary states: Financial markets as an example, J. Stat. Mech. (2015) P08011.
- J. Chen, Essentials of Foreign Exchange Trading, 1st ed. (John Wiley & Sons, New York, 2009).
- R. N. Mantegna and H. E. Stanley, Introduction to Econophysics: Correlations and Complexity in Finance, 1st ed. (Cambridge University Press, Cambridge, UK, 1999).
- M. O'Hara, Market Microstructure Theory, 1st ed. (John Wiley & Sons, New York, 1998).
- R. K. Lyons, The Microstructure Approach to Exchange Rates, 1st ed. (The MIT Press, Cambridge, MA, 2001).
- S. M. D. Queirós, Trading volume in financial markets: An introductory review, Chaos Solit. Fractals 88, 24 (2016).
- L. Bachelier, Théorie de la spéculation, Ann. Sci. École Norm. Sup. 17, 21 (1900).
- R. C. Merton, Theory of rational option pricing, Bell J. Econ. Manage. Sci. 4, 141 (1973).
- V. Stojkoski, T. Sandev, L. Basnarkov, L. Kocarev, and R. Metzler, Generalised geometric Brownian motion: Theory and applications to option pricing, Entropy 22, 1432 (2020).
- I. Halperin and M. Dixon, “Quantum Equilibrium-Disequilibrium”: Asset price dynamics, symmetry breaking, and defaults as dissipative instantons, Physica A 537, 122187 (2020).
- S. L. Heston, A closed-form solution for options with stochastic volatility with applications to bond and currency options, Rev. Financ. Stud. 6, 327 (1993).
- T. Bollerslev, R. Y. Chou, and K. F. Kroner, ARCH modeling in finance: A review of the theory and empirical evidence, J. Econom. 52, 5 (1992).
- S. Degiannakis and E. Xekalaki, Autoregressive conditional heteroscedasticity (ARCH) models: A review, Qual. Technol. Quant. Manage. 1, 271 (2004).
- M. B. Garman and S. W. Kohlhagen, Foreign currency option values, J. Int. Money Finance 2, 231 (1983).
- J. O. Grabbe, The pricing of call and put options on foreign exchange, J. Int. Money Finance 2, 239 (1983).
- P. Doust, The stochastic intrinsic currency volatility model: A consistent framework for multiple FX rates and their volatilities, Appl. Math. Finance 19, 381 (2012).
- M. Escobar and C. Gschnaidtner, A multivariate stochastic volatility model with applications in the foreign exchange market, Rev. Deriv. Res. 21, 1 (2018).
- R. T. Baillie and T. Bollerslev, Common stochastic trends in a system of exchange rates, J. Finance 44, 167 (1989).
- W. J. Crowder, Foreign exchange market efficiency and common stochastic trends, J. Int. Money Finance 13, 551 (1994).
- J.-P. Bouchaud and R. Cont, A Langevin approach to stock market fluctuations and crashes, Eur. Phys. J. B 6, 543 (1998).
- T. Wand, T. Wiedemann, J. Harren, and O. Kamps, Estimating stable fixed points and Langevin potentials for financial dynamics, Phys. Rev. E 109, 024226 (2024).
- C. Renner, J. Peinke, and R. Friedrich, Evidence of Markov properties of high frequency exchange rate data, Physica A 298, 499 (2001).
- F. Farahpour, Z. Eskandari, A. Bahraminasab, G. R. Jafari, F. Ghasemi, M. Sahimi, and M. R. R. Tabar, A Langevin equation for the rates of currency exchange based on the Markov analysis, Physica A 385, 601 (2007).
- P. Rinn, Y. Stepanov, J. Peinke, T. Guhr, and R. Schäfer, Dynamics of quasi-stationary systems: Finance as an example, Europhys. Lett. 110, 68003 (2015).
- B. Derrida, Non-equilibrium steady states: Fluctuations and large deviations of the density and of the current, J. Stat. Mech. (2007) P07023.
- R. Becker, S. Hurn, and V. Pavlov, Modelling spikes in electricity prices, Econ. Rec. 83, 371 (2007).