- Physical Review Journals
All JournalsPhysics Magazine

Physical Review Research

Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Letter
  • Open Access

Resource limitations induce phase transitions in biological information processing

Takehiro Tottori1,2,* and Tetsuya J. Kobayashi2,†

  • *Contact author: takehiro.tottori@riken.jp
  • †Contact author: tetsuya@mail.crmind.net
PDF

Phys. Rev. Research 7, L042012 – Published 14 October, 2025

DOI: https://doi.org/10.1103/nz4j-tyv1

Abstract

Biological information processing exhibits remarkable diversity across different organisms, which is presumably shaped by evolutionary optimization under limited resources. Starting from simple memoryless responses, more complex memory-based strategies may have evolved as resources became more available. In this Letter, we investigate minimal models of biological information processing under resource limitations by applying an optimal control technique proposed in [Tottori and Kobayashi, Phys. Rev. Res. 7, 043048 (2025)]. We find that resource limitations such as sensing reliability, intrinsic stochasticity, and energy cost induce discontinuous phase transitions between memoryless and memory-based strategies, even though the minimal models fall within the standard linear-quadratic-Gaussian class. Moreover, these transitions can be nonmonotonic: Optimal information processing initially shifts from memoryless to memory-based strategies as sensing reliability increases, but then reverts to memoryless strategies if it increases further. Our results suggest that the complexity of biological information processing may be an evolvable trait that can switch back and forth between distinct strategies in a punctuated manner.

View figure in article

Physics Subject Headings (PhySH)

See Also

Theory for optimal estimation and control under resource limitations and its applications to biological information processing and decision-making

Takehiro Tottori and Tetsuya J. Kobayashi
Phys. Rev. Research 7, 043048 (2025)

Article Text

References (76)

  1. M. O. Ernst and M. S. Banks, Humans integrate visual and haptic information in a statistically optimal fashion, Nature (London) 415, 429 (2002).
  2. Y. Weiss, E. P. Simoncelli, and E. H. Adelson, Motion illusions as optimal percepts, Nat. Neurosci. 5, 598 (2002).
  3. K. P. Körding and D. M. Wolpert, Bayesian integration in sensorimotor learning, Nature (London) 427, 244 (2004).
  4. W. Bialek and S. Setayeshgar, Physical limits to biochemical signaling, Proc. Natl. Acad. Sci. USA 102, 10040 (2005).
  5. F. Tostevin and P. R. ten Wolde, Mutual information between input and output trajectories of biochemical networks, Phys. Rev. Lett. 102, 218101 (2009).
  6. A. Celani and M. Vergassola, Bacterial strategies for chemotaxis response, Proc. Natl. Acad. Sci. USA 107, 1391 (2010).
  7. H. H. Mattingly, K. Kamino, B. B. Machta, and T. Emonet, Escherichia coli chemotaxis is information limited, Nat. Phys. 17, 1426 (2021).
  8. N. B. Becker, A. Mugler, and P. R. ten Wolde, Optimal prediction by cellular signaling networks, Phys. Rev. Lett. 115, 258103 (2015).
  9. K. Nakamura and T. J. Kobayashi, Connection between the bacterial chemotactic network and optimal filtering, Phys. Rev. Lett. 126, 128102 (2021).
  10. K. Nakamura and T. J. Kobayashi, Optimal sensing and control of run-and-tumble chemotaxis, Phys. Rev. Res. 4, 013120 (2022).
  11. H. A. Simon, Rational choice and the structure of the environment, Psychol. Rev. 63, 129 (1956).
  12. F. Lieder and T. L. Griffiths, Resource-rational analysis: Understanding human cognition as the optimal use of limited computational resources, Behav. Brain Sci. 43, e1 (2020).
  13. R. Bhui, L. Lai, and S. J. Gershman, Resource-rational decision making, Curr. Opin. Behav. Sci., 41, 15 (2021).
  14. R. Polana, D. Burdakov, and T. A. Hare, Rationality, preferences, and emotions with biological constraints: It all starts from our senses, Trends Cognit. Sci. 28, 264 (2024).
  15. S. B. Laughlin, R. R. de Ruyter van Steveninck, and J. C. Anderson, The metabolic cost of neural information, Nat. Neurosci. 1, 36 (1998).
  16. P. Lennie, The cost of cortical computation, Curr. Biol. 13, 493 (2003).
  17. V. Balasubramanian, Brain power, Proc. Natl. Acad. Sci. USA 118, e2107022118 (2021).
  18. M. B. Elowitz, A. J. Levine, E. D. Siggia, and P. S. Swain, Stochastic gene expression in a single cell, Science 297, 1183 (2002).
  19. H. H. Mattingly, K. Kamino, J. Ong, R. Kottou, T. Emonet, and B. B. Machta, Chemotaxing E. coli do not count single molecules, arXiv:2407.07264.
  20. G. Lan, P. Sartori, S. Neumann, V. Sourjik, and Y. Tu, The energy–speed–accuracy trade-off in sensory adaptation, Nat. Phys. 8, 422 (2012).
  21. C. C. Govern and P. R. ten Wolde, Optimal resource allocation in cellular sensing systems, Proc. Natl. Acad. Sci. USA 111, 17486 (2014).
  22. C. C. Govern and P. R. ten Wolde, Energy dissipation and noise correlations in biochemical sensing, Phys. Rev. Lett. 113, 258102 (2014).
  23. G. Malaguti and P. R. ten Wolde, Theory for the optimal detection of time-varying signals in cellular sensing systems, eLife 10, e62574 (2021).
  24. G. Malaguti and P. R. ten Wolde, Receptor time integration via discrete sampling, Phys. Rev. E 105, 054406 (2022).
  25. A. J. Tjalma, V. Galstyan, J. Goedhart, L. Slim, N. B. Becker, and P. R. ten Wolde, Trade-offs between cost and information in cellular prediction, Proc. Natl. Acad. Sci. USA 120, e2303078120 (2023).
  26. A. J. Tjalma and P. R. ten Wolde, Predicting concentration changes via discrete receptor sampling, Phys. Rev. Res. 6, 033049 (2024).
  27. P. Mehta and D. J. Schwab, Energetic costs of cellular computation, Proc. Natl. Acad. Sci. USA 109, 17978 (2012).
  28. A. H. Lang, C. K. Fisher, T. Mora, and P. Mehta, Thermodynamics of statistical inference by cells, Phys. Rev. Lett. 113, 148103 (2014).
  29. S. E. Harvey, S. Lahiri, and S. Ganguli, Universal energy-accuracy tradeoffs in nonequilibrium cellular sensing, Phys. Rev. E 108, 014403 (2023).
  30. D. Hartich, A. C. Barato, and U. Seifert, Sensory capacity: An information theoretical measure of the performance of a sensor, Phys. Rev. E 93, 022116 (2016).
  31. S. J. Bryant and B. B. Machta, Physical constraints in intracellular signaling: The cost of sending a bit, Phys. Rev. Lett. 131, 068401 (2023).
  32. F. Creutzig, A. Globerson, and N. Tishby, Past-future information bottleneck in dynamical systems, Phys. Rev. E 79, 041925 (2009).
  33. R. Fox and N. Tishby, Minimum-information LQG control Part II: Retentive controllers, in Proceedings of the 2016 IEEE 55th Conference on Decision and Control (CDC) (IEEE, Piscataway, NJ, 2016), pp. 5603–5609.
  34. V. Sachdeva, T. Mora, A. M. Walczak, and S. E. Palmer, Optimal prediction with resource constraints using the information bottleneck, PLoS Comput. Biol. 17, e1008743 (2021).
  35. G. Tavoni, T. Doi, C. Pizzica, V. Balasubramanian, and J. I. Gold, Human inference reflects a normative balance of complexity and accuracy, Nat. Hum. Behav. 6, 1153 (2022).
  36. L. Boominathan and X. Pitkow, Phase transitions in when feedback is useful, Adv. Neural Inf. Process. Syst. 35, 10849 (2022).
  37. K. V. B. Verano, E. Panizon, and A. Celani, Olfactory search with finite-state controllers, Proc. Natl. Acad. Sci. USA 120, e2304230120 (2023).
  38. Z. Chen, Bayesian filtering: From Kalman filters to particle filters, and beyond, Statistics 182, 1 (2003).
  39. A. Bain and D. Crisan, Fundamentals of Stochastic Filtering, Stochastic Modelling and Applied Probability Vol. 60, edited by B. Rozovski and G. Grimmett (Springer, New York, NY, 2009).
  40. A. Bensoussan, Stochastic Control of Partially Observable Systems (Cambridge University Press, Cambridge, 1992).
  41. J. Yong and X. Y. Zhou, Stochastic Controls (Springer, New York, NY, 1999).
  42. A. Bensoussan, Estimation and Control of Dynamical Systems, Interdisciplinary Applied Mathematics Vol. 48 (Springer International Publishing, Cham, 2018).
  43. T. J. Kobayashi, Implementation of dynamic Bayesian decision making by intracellular kinetics, Phys. Rev. Lett. 104, 228104 (2010).
  44. M. Hinczewski and D. Thirumalai, Cellular signaling networks function as generalized Wiener-Kolmogorov filters to suppress noise, Phys. Rev. X 4, 041017 (2014).
  45. C. Zechner, G. Seelig, M. Rullan, and M. Khammash, Molecular circuits for dynamic noise filtering, Proc. Natl. Acad. Sci. USA 113, 4729 (2016).
  46. T. Mora and I. Nemenman, Physical limit to concentration sensing in a changing environment, Phys. Rev. Lett. 123, 198101 (2019).
  47. K. Husain, W. Pittayakanchit, G. Pattanayak, M. J. Rust, and A. Murugan, Kalman-like self-tuned sensitivity in biophysical sensing, Cell Syst. 9, 459 (2019).
  48. M. Novak and B. M. Friedrich, Bayesian gradient sensing in the presence of rotational diffusion, New J. Phys. 23, 043026 (2021).
  49. J. Rode, M. Novak, and B. M. Friedrich, Information theory of chemotactic agents using both spatial and temporal gradient sensing, PRX Life 2, 023012 (2024).
  50. A. T. Piet, A. El Hady, and C. D. Brody, Rats adopt the optimal timescale for evidence integration in a dynamic environment, Nat. Commun. 9, 4265 (2018).
  51. A. Mayer, V. Balasubramanian, A. M. Walczak, and T. Mora, How a well-adapting immune system remembers, Proc. Natl. Acad. Sci. USA 116, 8815 (2019).
  52. R. A. Heinonen, L. Biferale, A. Celani, and M. Vergassola, Optimal policies for Bayesian olfactory search in turbulent flows, Phys. Rev. E 107, 055105 (2023).
  53. T. Tottori and T. J. Kobayashi, companion paper, Theory for optimal estimation and control under resource limitations and its applications to biological information processing and decision-making, Phys. Rev. Res. 7, 043048 (2025).
  54. In linear-Gaussian settings, the infinite-dimensional posterior distributions can be reduced to finite-dimensional sufficient statistics. Hence, memory capacity is not a critical factor in such cases. However, intrinsic noise remains unaccounted for.
  55. W. Li and E. Todorov, An iterative optimal control and estimation design for nonlinear stochastic system, in Proceedings of the 45th IEEE Conference on Decision and Control (IEEE, Piscataway, NJ, 2006), pp. 3242–3247.
  56. W. Li and E. Todorov, Iterative linearization methods for approximately optimal control and estimation of non-linear stochastic system, Int. J. Control 80, 1439 (2007).
  57. K. Friston, J. Kilner, and L. Harrison, A free energy principle for the brain, J. Physiol. Paris, 100, 70 (2006).
  58. K. Friston, The free-energy principle: A unified brain theory? Nat. Rev. Neurosci. 11, 127 (2010).
  59. J. S. Li, A. A. Sarma, T. J. Sejnowski, and J. C. Doyle, Internal feedback in the cortical perception–action loop enables fast and accurate behavior, Proc. Natl. Acad. Sci. USA 120, e2300445120 (2023).
  60. J. J. Moore, A. Genkin, M. Tournoy, J. L. Pughe-Sanford, R. R. de Ruyter van Steveninck, and D. B. Chklovskii, The neuron as a direct data-driven controller, Proc. Natl. Acad. Sci. USA 121, e2311893121 (2024).
  61. D. R. Sowinski, J. Carroll-Nellenback, R. N. Markwick, J. Piero, M. Gleiser, A. Kolchinsky, G. Ghoshal, and A. Frank, Semantic information in a model of resource gathering agents, PRX Life 1, 023003 (2023).
  62. A. Celani and E. Panizon, Olfactory search, arXiv:2405.03374.
  63. G. M. Viswanathan, S. V. Buldyrev, S. Havlin, M. G. E. da Luz, E. P. Raposo, and H. E. Stanley, Optimizing the success of random searches, Nature (London) 401, 911 (1999).
  64. O. Bnichou, M. Coppey, M. Moreau, P.-H. Suet, and R. Voituriez, Optimal search strategies for hidden targets, Phys. Rev. Lett. 94, 198101 (2005).
  65. A. M. Hein, F. Carrara, D. R. Brumley, R. Stocker, and S. A. Levin, Natural search algorithms as a bridge between organisms, evolution, and ecology, Proc. Natl. Acad. Sci. USA 113, 9413 (2016).
  66. T. Tottori and T. J. Kobayashi, Memory-limited partially observable stochastic control and its mean-field control approach, Entropy 24, 1599 (2022).
  67. T. Tottori and T. J. Kobayashi, Forward-backward sweep method for the system of HJB-FP equations in memory-limited partially observable stochastic control, Entropy 25, 208 (2023).
  68. T. Tottori and T. J. Kobayashi, Decentralized stochastic control with finite-dimensional memories: A memory limitation approach, Entropy 25, 791 (2023).
  69. S. Sasagawa, Y.-I. Ozaki, K. Fujita, and S. Kuroda, Prediction and validation of the distinct dynamics of transient and sustained ERK activation, Nat. Cell Biol. 7, 365 (2005).
  70. M. W. Covert, T. H. Leung, J. E. Gaston, and D. Baltimore, Achieving stability of lipopolysaccharide-induced NF−κB activation, Science 309, 1854 (2005).
  71. Y. Hasegawa, Multidimensional biochemical information processing of dynamical patterns, Phys. Rev. E 97, 022401 (2018).
  72. L. Hahn, A. M. Walczak, and T. Mora, Dynamical information synergy in biochemical signaling networks, Phys. Rev. Lett. 131, 128401 (2023).
  73. L. Ruthotto, S. J. Osher, W. Li, L. Nurbekyan, and S. W. Fung, A machine learning framework for solving high-dimensional mean field game and mean field control problems, Proc. Natl. Acad. Sci. USA 117, 9183 (2020).
  74. A. T. Lin, S. W. Fung, W. Li, L. Nurbekyan, and S. J. Osher, Alternating the population and control neural networks to solve high-dimensional stochastic mean-field games, Proc. Natl. Acad. Sci. USA 118, e2024713118 (2021).
  75. H. Cao, X. Guo, and M. Laurire, Connecting GANs, mean-field games, and optimal transport, SIAM J. Appl. Math. 84, 1255 (2024).
  76. https://github.com/takehirotottori/Tottori2025-OMSC.

Outline

Information

Phys. Rev. Research 7, L042012– Published 14 October, 2025
  • Received 25 September 2024
  • Accepted 16 September 2025
Crossmark - Check for updates button
Creative Commons Logo

Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.

Published by the American Physical Society

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation