Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

State- versus Reaction-Based Information Processing in Biochemical Networks

Anne-Lena Moor1,2,*, Age Tjalma3, Manuel Reinhardt3, Pieter Rein ten Wolde3,†, and Christoph Zechner4,1,2,‡

  • *Contact author: annemoor96@gmail.com
  • †Contact author: tenwolde@amolf.nl
  • ‡Contact author: czechner@sissa.it

Phys. Rev. Lett. 136, 248401 – Published 17 June, 2026

DOI: https://doi.org/10.1103/nfk6-8x5s

Abstract

Trajectory mutual information is frequently used to quantify information transfer in biochemical systems. Tractable solutions of the trajectory mutual information can be obtained via the widely used linear-noise approximation (LNA) using Gaussian channel theory. This approach is expected to be accurate for sufficiently large systems. However, recent observations show that there are cases, where the mutual information obtained this way differs qualitatively from results derived using an exact Markov jump process formalism, and that the differences remain even in the large copy number regime. In this Letter, we show that these differences can be explained by introducing the notion of reaction- versus state-based descriptions of trajectories. In chemical systems, the information is encoded in the sequence of reaction events, and the reaction-based trajectories of Markov jump processes capture this information. We show that within the Gaussian formalism, trajectories can be defined either based on individual reaction channels, or on a state-based level, where different reaction channels are summarized into a single noise term. While both definitions agree in terms of copy number fluctuations, state-based trajectories contain in general less information than reaction-based trajectories. The commonly used Gaussian mutual information via the linear-noise approximation is consistent with a state-based trajectory notion, which causes a systematic loss of information independent of system size. We show that an alternative, reaction-based variant of the Gaussian mutual information prevents this loss of information. We illustrate the consequences of different trajectory descriptions for two common cellular reaction motifs and discuss their connection with Berg-Purcell and maximum-likelihood sensing.

View figure in article

Physics Subject Headings (PhySH)

Article Text

Supplemental Material

References (40)

  1. C. E. Shannon, A mathematical theory of communication, Bell Syst. Tech. J. 27, 379 (1948).
  2. F. Tostevin and P. R. ten Wolde, Mutual information between input and output trajectories of biochemical networks, Phys. Rev. Lett. 102, 218101 (2009).
  3. R. M. Fano, Transmission of information: A statistical theory of communications, Am. J. Phys. 29, 793 (1961).
  4. L. Duso and C. Zechner, Path mutual information for a class of biochemical reaction networks, in 2019 IEEE 58th Conference on Decision and Control (CDC) (2019), pp. 6610–6615.
  5. M. Sinzger, M. Gehri, and H. Koeppl, Poisson channel with binary Markov input and average sojourn time constraint, in 2020 IEEE International Symposium on Information Theory (ISIT) (2020), pp. 2873–2878.
  6. F. Tostevin and P. R. ten Wolde, Mutual information in time-varying biochemical systems, Phys. Rev. E 81, 061917 (2010).
  7. W. H. de Ronde, F. Tostevin, and P. R. ten Wolde, Effect of feedback on the fidelity of information transmission of time-varying signals, Phys. Rev. E 82, 031914 (2010).
  8. E. Ziv, I. Nemenman, and C. H. Wiggins, Optimal signal processing in small stochastic biochemical networks, PLoS One 2, 1 (2007).
  9. S. Tănase-Nicola and P. R. ten Wolde, Regulatory control and the costs and benefits of biochemical noise, PLoS Comput. Biol. 4, 1 (2008).
  10. N. G. Van Kampen, Stochastic Processes in Physics and Chemistry (Elsevier, New York, 1992), Vol. 1.
  11. A.-L. Moor and C. Zechner, Dynamic information transfer in stochastic biochemical networks, Phys. Rev. Res. 5, 013032 (2023).
  12. M. Reinhardt, G. Tkačik, and P. R. ten Wolde, Path weight sampling: Exact Monte Carlo computation of the mutual information between stochastic trajectories, Phys. Rev. X 13, 041017 (2023).
  13. T. M. Cover, Elements of Information Theory (John Wiley & Sons, New York, 1999).
  14. See Supplemental Material at http://link.aps.org/supplemental/10.1103/nfk6-8x5s for mathematical details and derivations, which includes Refs. [15–18].
  15. D. T. Gillespie, The chemical Langevin equation, J. Chem. Phys. 113, 297 (2000).
  16. E. W. J. Wallace, A simplified derivation of the linear noise approximation, arXiv:1004.4280.
  17. Andrew H. Jazwinski, ed., Nonlinear filtering theory, in Stochastic Processes and Filtering Theory, Vol. 64, Mathematics in Science and Engineering (Elsevier, New York, 1970), pp. 162–193.
  18. P. B. Warren, S. Tânase-Nicola, and P. R. Ten Wolde, Exact results for noise power spectra in linear biochemical reaction networks, J. Chem. Phys. 125, 144904 (2006).
  19. T. T. Kadota, M. Zakai, and J. Ziv, Mutual information of the white Gaussian channel with and without feedback, IEEE Trans. Inf. Theory 17, 368 (1971).
  20. M. Hitsuda, Mutual information in Gaussian channels, J. Multivariate Anal. 4, 66 (1974).
  21. T. E. Duncan, On the calculation of mutual information, SIAM J. Appl. Math. 19, 215 (1970).
  22. R. S. Liptser and A. N. Shiriaev, Statistics of Random Processes: General Theory (Springer, New York, 1977), Vol. 394.
  23. R. E. Kálmán and R. S. Bucy, New results in linear filtering and prediction theory, J. Basic Eng. 83, 95 (1961).
  24. A. Bain and D. Crisan, Fundamentals of Stochastic Filtering (Springer, New York, 2009), Vol. 3.
  25. A. Kutschireiter, S. C. Surace, and J.-P. Pfister, The Hitchhiker’s guide to nonlinear filtering, J. Math. Psychol. 94, 102307 (2020).
  26. S. Tănase-Nicola, P. B. Warren, and P. R. ten Wolde, Signal detection, modularity, and the correlation between extrinsic and intrinsic noise in biochemical networks, Phys. Rev. Lett. 97, 068102 (2006).
  27. R. Chétrite, M. L. Rosinberg, T. Sagawa, and G. Tarjus, Information thermodynamics for interacting stochastic systems without bipartite structure, J. Stat. Mech. (2019) 114002.
  28. H. Berg and E. M. Purcell, Physics of chemoreception, Biophys. J. 20, 193 (1977).
  29. R. G. Endres and N. S. Wingreen, Maximum likelihood and the single receptor, Phys. Rev. Lett. 103, 158101 (2009).
  30. K. Kaizu, W. de Ronde, J. Paijmans, K. Takahashi, F. Tostevin, and P. R. ten Wolde, The Berg-Purcell limit revisited, Biophys. J. 106, 976 (2014).
  31. W. Bialek and S. Setayeshgar, Physical limits to biochemical signaling, Proc. Natl. Acad. Sci. U.S.A. 102, 10040 (2005).
  32. A. H. Lang, C. K. Fisher, T. Mora, and P. Mehta, Thermodynamics of statistical inference by cells, Phys. Rev. Lett. 113, 148103 (2014).
  33. T. Mora and I. Nemenman, Physical limit to concentration sensing in a changing environment, Phys. Rev. Lett. 123, 198101 (2019).
  34. P. R. ten Wolde, N. B. Becker, T. E. Ouldridge, and A. Mugler, Fundamental limits to cellular sensing, J. Stat. Phys. 162, 1395 (2016).
  35. G. Malaguti and P. R. ten Wolde, Theory for the optimal detection of time-varying signals in cellular sensing systems, eLife 10, e62574 (2021).
  36. N. W. Pierce, G. Kleiger, S.-o. Shan, and R. J. Deshaies, Detection of sequential polyubiquitylation on a millisecond timescale, Nature (London) 462, 615 (2009).
  37. D. M. Suter, N. Molina, D. Gatfield, K. Schneider, U. Schibler, and F. Naef, Mammalian genes are transcribed with widely different bursting kinetics, Science 332, 472 (2011).
  38. D. M. Busiello and A. Maritan, Entropy production in master equations and Fokker-Planck equations: Facing the coarse-graining and recovering the information loss, J. Stat. Mech. (2019) 104013.
  39. D. M. Busiello, J. Hidalgo, and A. Maritan, Entropy production for coarse-grained dynamics, New J. Phys. 21, 073004 (2019).
  40. https://github.com/zechnerlab/PathMI_state_vs_reaction/.

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation