- Physical Review Journals
All JournalsPhysics Magazine

Physical Review Research

Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

Theory for optimal estimation and control under resource limitations and its applications to biological information processing and decision-making

Takehiro Tottori1,2,* and Tetsuya J. Kobayashi2,†

  • *Contact author: takehiro.tottori@riken.jp
  • †Contact author: tetsuya@mail.crmind.net
PDF

Phys. Rev. Research 7, 043048 – Published 14 October, 2025

DOI: https://doi.org/10.1103/gvl6-cvby

Abstract

While the information processing of organisms is evolutionarily optimized, it exhibits remarkable diversity in its complexity and capability. One potential source of this diversity is the limitations of resources available for information processing. However, we still lack a theoretical framework that clarifies the relationship between biological information processing and resource limitations and integrates it with downstream decision-making. Together with the accompanying letter [Tottori and Kobayashi, Phys. Rev. Res. 7, L042012 (2025)], this full paper presents an optimal estimation and control framework that explicitly incorporates resource limitations inherent in biological systems. While the accompanying letter focuses on the nontrivial phase transitions induced by resource limitations, the present full paper establishes the theoretical foundation and provides a comprehensive analysis of these transitions. The proposed framework formulates memory that organisms can store and operate, and optimizes it using optimal control theory. This approach accounts for various resource limitations—such as memory capacity, intrinsic noise, and energy cost—and unifies estimation and control. Applying this theory to minimal models of biological information processing and decision-making, we demonstrate that resource limitations can induce discontinuous and nonmonotonic phase transitions between memoryless and memory-based strategies. These results provide a comprehensive theoretical foundation for studying how organisms process information and make decisions under resource limitations, and suggest that the rich diversity observed in biological systems may emerge from such constraints.

View figure in article

Physics Subject Headings (PhySH)

See Also

Resource limitations induce phase transitions in biological information processing

Takehiro Tottori and Tetsuya J. Kobayashi
Phys. Rev. Research 7, L042012 (2025)

Article Text

References (204)

  1. M. O. Ernst and M. S. Banks, Humans integrate visual and haptic information in a statistically optimal fashion, Nature (London) 415, 429 (2002).
  2. Y. Weiss, E. P. Simoncelli, and E. H. Adelson, Motion illusions as optimal percepts, Nat. Neurosci. 5, 598 (2002).
  3. K. P. Körding and D. M. Wolpert, Bayesian integration in sensorimotor learning, Nature (London) 427, 244 (2004).
  4. A. A. Stocker and E. P. Simoncelli, Noise characteristics and prior expectations in human visual speed perception, Nat. Neurosci. 9, 578 (2006).
  5. T. E. J. Behrens, M. W. Woolrich, M. E. Walton, and M. F. S. Rushworth, Learning the value of information in an uncertain world, Nat. Neurosci. 10, 1214 (2007).
  6. J. Burge, M. O. Ernst, and M. S. Banks, The statistical determinants of adaptation rate in human reaching, J. Vision 8, 20 (2008).
  7. H. C. Berg and E. M. Purcell, Physics of chemoreception, Biophys. J. 20, 193 (1977).
  8. W. Bialek and S. Setayeshgar, Physical limits to biochemical signaling, Proc. Natl. Acad. Sci. USA 102, 10040 (2005).
  9. R. G. Endres and N. S. Wingreen, Maximum likelihood and the single receptor, Phys. Rev. Lett. 103, 158101 (2009).
  10. F. Tostevin and P. R. ten Wolde, Mutual information between input and output trajectories of biochemical networks, Phys. Rev. Lett. 102, 218101 (2009).
  11. A. Celani and M. Vergassola, Bacterial strategies for chemotaxis response, Proc. Natl. Acad. Sci. USA 107, 1391 (2010).
  12. H. H. Mattingly, K. Kamino, B. B. Machta, and T. Emonet, Escherichia coli chemotaxis is information limited, Nat. Phys. 17, 1426 (2021).
  13. N. B. Becker, A. Mugler, and P. R. ten Wolde, Optimal prediction by cellular signaling networks, Phys. Rev. Lett. 115, 258103 (2015).
  14. K. Nakamura and T. J. Kobayashi, Connection between the bacterial chemotactic network and optimal filtering, Phys. Rev. Lett. 126, 128102 (2021).
  15. K. Nakamura and T. J. Kobayashi, Optimal sensing and control of run-and-tumble chemotaxis, Phys. Rev. Res. 4, 013120 (2022).
  16. S. B. Laughlin, R. R. de Ruyter van Steveninck, and J. C. Anderson, The metabolic cost of neural information, Nat. Neurosci. 1, 36 (1998).
  17. S. B. Laughlin, Energy as a constraint on the coding and processing of sensory information, Curr. Opin. Neurobiol. 11, 475 (2001).
  18. P. Lennie, The cost of cortical computation, Curr. Biol. 13, 493 (2003).
  19. J. E. Niven and S. B. Laughlin, Energy limitation as a selective pressure on the evolution of sensory systems, J. Exp. Biol. 211, 1792 (2008).
  20. D. F. Rolfe and G. C. Brown, Cellular energy utilization and molecular origin of standard metabolic rate in mammals, Physiol. Rev. 77, 731 (1997).
  21. A. Ames, CNS energy metabolism as related to function, Brain Res. Rev. 34, 42 (2000).
  22. L. C. Aiello and P. Wheeler, The expensive-tissue hypothesis: The brain and the digestive system in human and primate evolution, Curr. Anthropol. 36, 199 (1995).
  23. K. Isler and C. P. van Schaik, Metabolic costs of brain size evolution, Biol. Lett. 2, 557 (2006).
  24. K. Fonseca-Azevedo and S. Herculano-Houzel, Metabolic constraint imposes tradeoff between body size and number of brain neurons in human evolution, Proc. Natl. Acad. Sci. USA 109, 18571 (2012).
  25. V. Balasubramanian, Brain power, Proc. Natl. Acad. Sci. USA 118, e2107022118 (2021).
  26. M. B. Elowitz, A. J. Levine, E. D. Siggia, and P. S. Swain, Stochastic gene expression in a single cell, Science 297, 1183 (2002).
  27. P. S. Swain, M. B. Elowitz, and E. D. Siggia, Intrinsic and extrinsic contributions to stochasticity in gene expression, Proc. Natl. Acad. Sci. USA 99, 12795 (2002).
  28. J. Paulsson, Summing up the noise in gene networks, Nature (London) 427, 415 (2004).
  29. I. Lestas, G. Vinnicombe, and J. Paulsson, Fundamental limits on the suppression of molecular fluctuations, Nature (London) 467, 174 (2010).
  30. Y. Taniguchi, P. J. Choi, G.-W. Li, H. Chen, M. Babu, J. Hearn, A. Emili, and X. S. Xie, Quantifying E. coli proteome and transcriptome with single-molecule sensitivity in single cells, Science 329, 533 (2010).
  31. T. Shibata and K. Fujimoto, Noisy signal amplification in ultrasensitive signal transduction, Proc. Natl. Acad. Sci. USA 102, 331 (2005).
  32. M. Ueda and T. Shibata, Stochastic signal processing and transduction in chemotactic response of eukaryotic cells, Biophys. J. 93, 11 (2007).
  33. T. J. Kobayashi and A. Kamimura, Dynamics of intracellular information decoding, Phys. Biol. 8, 055007 (2011).
  34. H. H. Mattingly, K. Kamino, J. Ong, R. Kottou, T. Emonet, and B. B. Machta, Chemotaxing E. coli do not count single molecules, arXiv:2407.07264.
  35. G. Lan, P. Sartori, S. Neumann, V. Sourjik, and Y. Tu, The energyspeedaccuracy trade-off in sensory adaptation, Nat. Phys. 8, 422 (2012).
  36. C. C. Govern and P. R. ten Wolde, Optimal resource allocation in cellular sensing systems, Proc. Natl. Acad. Sci. USA 111, 17486 (2014).
  37. C. C. Govern and P. R. ten Wolde, Energy dissipation and noise correlations in biochemical sensing, Phys. Rev. Lett. 113, 258102 (2014).
  38. G. Malaguti and P. R. ten Wolde, Theory for the optimal detection of time-varying signals in cellular sensing systems, eLife 10, e62574 (2021).
  39. G. Malaguti and P. R. ten Wolde, Receptor time integration via discrete sampling, Phys. Rev. E 105, 054406 (2022).
  40. A. J. Tjalma, V. Galstyan, J. Goedhart, L. Slim, N. B. Becker, and P. R. ten Wolde, Trade-offs between cost and information in cellular prediction, Proc. Natl. Acad. Sci. USA 120, e2303078120 (2023).
  41. A. J. Tjalma and P. R. t. Wolde, Predicting concentration changes via discrete receptor sampling, Phys. Rev. Res. 6, 033049 (2024).
  42. P. Mehta and D. J. Schwab, Energetic costs of cellular computation, Proc. Natl. Acad. Sci. USA 109, 17978 (2012).
  43. A. H. Lang, C. K. Fisher, T. Mora, and P. Mehta, Thermodynamics of statistical inference by cells, Phys. Rev. Lett. 113, 148103 (2014).
  44. S. E. Harvey, S. Lahiri, and S. Ganguli, Universal energy-accuracy tradeoffs in nonequilibrium cellular sensing, Phys. Rev. E 108, 014403 (2023).
  45. D. Hartich, A. C. Barato, and U. Seifert, Sensory capacity: An information theoretical measure of the performance of a sensor, Phys. Rev. E 93, 022116 (2016).
  46. S. J. Bryant and B. B. Machta, Physical constraints in intracellular signaling: The cost of sending a bit, Phys. Rev. Lett. 131, 068401 (2023).
  47. S. Ito and T. Sagawa, Maxwell’s demon in biochemical signal transduction with feedback loop, Nat. Commun. 6, 7498 (2015).
  48. T. Matsumoto and T. Sagawa, Role of sufficient statistics in stochastic thermodynamics and its implication to sensory adaptation, Phys. Rev. E 97, 042103 (2018).
  49. N. Ohga, S. Ito, and A. Kolchinsky, Thermodynamic bound on the asymmetry of cross-correlations, Phys. Rev. Lett. 131, 077101 (2023).
  50. https://creativecommons.org/licenses/by/4.0/.
  51. G. Kallianpur, Stochastic Filtering Theory, Stochastic Modelling and Applied Probability, edited by A. V. Balakrishnan (Springer New York, New York, NY, 1980), Vol. 13.
  52. Z. Chen, Bayesian filtering: From Kalman filters to particle filters, and beyond, Statistics 182, 1 (2003).
  53. A. H. Jazwinski, Stochastic Processes and Filtering Theory (Courier Corporation, Mineola, New York, 2007).
  54. A. Bain and D. Crisan, in Fundamentals of Stochastic Filtering, Stochastic Modelling and Applied Probability, edited by B. Rozovski and G. Grimmett (Springer, New York, NY, 2009), Vol. 60.
  55. A. Pouget, P. Dayan, and R. Zemel, Information processing with population codes, Nat. Rev. Neurosci. 1, 125 (2000).
  56. D. C. Knill and A. Pouget, The Bayesian brain: The role of uncertainty in neural coding and computation, Trends Neurosci. 27, 712 (2004).
  57. K. Doya, S. Ishii, A. Pouget, and R. P. N. Rao, Bayesian Brain: Probabilistic Approaches to Neural Coding (The MIT Press, Cambridge, MA, 2006).
  58. K. P. Körding and D. M. Wolpert, Bayesian decision theory in sensorimotor control, Trends Cognit. Sci., 10, 319 (2006).
  59. A. Pouget, J. M. Beck, W. J. Ma, and P. E. Latham, Probabilistic brains: Knowns and unknowns, Nat. Neurosci. 16, 1170 (2013).
  60. H. Sohn and D. Narain, Neural implementations of Bayesian inference, Curr. Opin. Neurobiol. 70, 121 (2021).
  61. R. D. Lange, S. Shivkumar, A. Chattoraj, and R. M. Haefner, Bayesian encoding and decoding as distinct perspectives on neural coding, Nat. Neurosci. 26, 2063 (2023).
  62. S. Denève, J.-R. Duhamel, and A. Pouget, Optimal sensorimotor integration in recurrent cortical networks: A neural implementation of kalman filters, J. Neurosci. 27, 5744 (2007).
  63. R. Wilson and L. Finkel, A neural Implementation of the Kalman Filter, Advances in Neural Information Processing Systems (Curran Associates, Red Hook, New York, 2009), Vol. 22.
  64. N. Hiratani and T. Fukai, Redundancy in synaptic connections enables neurons to learn optimally, Proc. Natl. Acad. Sci. USA 115, E6871 (2018).
  65. N. Hiratani and P. E. Latham, Rapid Bayesian learning in the mammalian olfactory system, Nat. Commun. 11, 3845 (2020).
  66. L. Aitchison, J. Jegminat, J. A. Menendez, J.-P. Pfister, A. Pouget, and P. E. Latham, Synaptic plasticity as Bayesian inference, Nat. Neurosci. 24, 565 (2021).
  67. A. Kutschireiter, M. A. Basnak, R. I. Wilson, and J. Drugowitsch, Bayesian inference in ring attractor networks, Proc. Natl. Acad. Sci. USA 120, e2210622120 (2023).
  68. B. W. Andrews, T.-M. Yi, and P. A. Iglesias, Optimal noise filtering in the chemotactic response of Escherichia coli, PLoS Comput. Biol. 2, e154 (2006).
  69. T. J. Kobayashi, Implementation of dynamic bayesian decision making by intracellular kinetics, Phys. Rev. Lett. 104, 228104 (2010).
  70. M. Hinczewski and D. Thirumalai, Cellular signaling networks function as generalized wiener-kolmogorov filters to suppress noise, Phys. Rev. X 4, 041017 (2014).
  71. C. Zechner, G. Seelig, M. Rullan, and M. Khammash, Molecular circuits for dynamic noise filtering, Proc. Natl. Acad. Sci USA 113, 4729 (2016).
  72. T. Mora and I. Nemenman, Physical limit to concentration sensing in a changing environment, Phys. Rev. Lett. 123, 198101 (2019).
  73. K. Husain, W. Pittayakanchit, G. Pattanayak, M. J. Rust, and A. Murugan, Kalman-like self-tuned sensitivity in biophysical sensing, Cell Syst. 9, 459 (2019).
  74. M. Novak and B. M. Friedrich, Bayesian gradient sensing in the presence of rotational diffusion, New J. Phys. 23, 043026 (2021).
  75. A. Auconi, M. Novak, and B. M. Friedrich, Gradient sensing in Bayesian chemotaxis, Europhys. Lett. 138, 12001 (2022).
  76. J. Rode, M. Novak, and B. M. Friedrich, Information theory of chemotactic agents using both spatial and temporal gradient sensing, PRX Life 2, 023012 (2024).
  77. K. Nakamura and T. J. Kobayashi, Gradient sensing limit of an elongated cell with orientational control, Phys. Rev. E 110, 064407 (2024).
  78. R. S. Zemel, P. Dayan, and A. Pouget, Probabilistic interpretation of population codes, Neural Comput. 10, 403 (1998).
  79. W. J. Ma, J. M. Beck, P. E. Latham, and A. Pouget, Bayesian inference with probabilistic population codes, Nat. Neurosci. 9, 1432 (2006).
  80. A. A. Faisal, L. P. J. Selen, and D. M. Wolpert, Noise in the nervous system, Nat. Rev. Neurosci. 9, 292 (2008).
  81. C. Ribrault, K. Sekimoto, and A. Triller, From the stochasticity of molecular processes to the variability of synaptic transmission, Nat. Rev. Neurosci. 12, 375 (2011).
  82. M. D. McDonnell and L. M. Ward, The benefits of noise in neural systems: bridging theory and experiment, Nat. Rev. Neurosci. 12, 415 (2011).
  83. R. Dukas, Costs of memory: Ideas and predictions, J. Theor. Biol. 197, 41 (1999).
  84. F. Mery and T. J. Kawecki, A fitness cost of learning ability in Drosophila melanogaster, Proc. R. Soc. London B 270, 2465 (2003).
  85. F. Mery and T. J. Kawecki, A cost of long-term memory in Drosophila, Science 308, 1148 (2005).
  86. J. M. S. Burger, M. Kolss, J. Pont, and T. J. Kawecki, Learning ability and longevity: A symmetrical evolutionary trade-off in Drosophila, Evolution 62, 1294 (2008).
  87. M. Kolss and T. J. Kawecki, Reduced learning ability as a consequence of evolutionary adaptation to nutritional stress in Drosophila melanogaster, Ecol. Entomol. 33, 583 (2008).
  88. J. G. Burns, J. Foucaud, and F. Mery, Costs of memory: Lessons from “mini” brains, Proc. R. Soc. B 278, 923 (2011).
  89. N. Tishby, F. C. Pereira, and W. Bialek, The information bottleneck method, arXiv:physics/0004057.
  90. G. Chechik, A. Globerson, N. Tishby, and Y. Weiss, Information bottleneck for gaussian variables, J. Mach. Learn. Res. 6, 165 (2005).
  91. F. Creutzig, A. Globerson, and N. Tishby, Past-future information bottleneck in dynamical systems, Phys. Rev. E 79, 041925 (2009).
  92. R. Fox and N. Tishby, Minimum-information LQG control part I: Memoryless controllers, in 2016 IEEE 55th Conference on Decision and Control (CDC) (IEEE, Piscataway, NJ, 2016), pp. 5610–5616.
  93. R. Fox and N. Tishby, Minimum-information LQG control Part II: Retentive controllers, in 2016 IEEE 55th Conference on Decision and Control (CDC) (IEEE, Piscataway, NJ, 2016), pp. 5603–5609.
  94. V. Sachdeva, T. Mora, A. M. Walczak, and S. E. Palmer, Optimal prediction with resource constraints using the information bottleneck, PLoS Comput. Biol. 17, e1008743 (2021).
  95. M. Bauer and W. Bialek, Information bottleneck in molecular sensing, PRX Life 1, 023005 (2023).
  96. E. Todorov and M. I. Jordan, Optimal feedback control as a theory of motor coordination, Nat. Neurosci. 5, 1226 (2002).
  97. E. Todorov, Optimality principles in sensorimotor control, Nat. Neurosci. 7, 907 (2004).
  98. E. Todorov, Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system, Neural Comput. 17, 1084 (2005).
  99. J. A. Kromer, S. Mrcker, S. Lange, C. Baier, and B. M. Friedrich, Decision making improves sperm chemotaxis in the presence of noise, PLoS Comput. Biol. 14, e1006109 (2018).
  100. C. Calascibetta, L. Biferale, F. Borra, A. Celani, and M. Cencini, Optimal tracking strategies in a turbulent flow, Commun. Phys. 6, 256 (2023).
  101. W. M. Wonham, On the separation theorem of stochastic control, SIAM J. Control 6, 312 (1968).
  102. M. H. A. Davis and P. Varaiya, Dynamic programming conditions for partially observable stochastic systems, SIAM J. Control 11, 226 (1973).
  103. A. Bensoussan, Stochastic Control of Partially Observable Systems (Cambridge University Press, Cambridge, 1992).
  104. J. Yong and X. Y. Zhou, Stochastic Controls (Springer New York, New York, NY, 1999).
  105. M. Nisio, Stochastic Control Theory, Probability Theory and Stochastic Modelling (Springer, Tokyo, Japan, 2015), Vol. 72.
  106. A. Bensoussan, Estimation and Control of Dynamical Systems, Interdisciplinary Applied Mathematics (Springer International, Cham, 2018), Vol. 48.
  107. G. Wang, Z. Wu, and J. Xiong, An Introduction to Optimal Control of FBSDE with Incomplete Information, SpringerBriefs in Mathematics (Springer International, Cham, 2018).
  108. W. Li and E. Todorov, An iterative optimal control and estimation design for nonlinear stochastic system, in Proceedings of the 45th IEEE Conference on Decision and Control (IEEE, Piscataway, NJ, 2006), pp. 3242–3247.
  109. W. Li and E. Todorov, Iterative linearization methods for approximately optimal control and estimation of non-linear stochastic system, Int. J. Control 80, 1439 (2007).
  110. R. A. Heinonen, L. Biferale, A. Celani, and M. Vergassola, Optimal policies for Bayesian olfactory search in turbulent flows, Phys. Rev. E 107, 055105 (2023).
  111. K. V. B. Verano, E. Panizon, and A. Celani, Olfactory search with finite-state controllers, Proc. Natl. Acad. Sci. USA 120, e2304230120 (2023).
  112. T. Tottori and T. J. Kobayashi, companion paper, Resource limitations induce phase transitions in biological information processing, Phys. Rev. Res. 7, L042012 (2025).
  113. T. Tottori and T. J. Kobayashi, Memory-limited partially observable stochastic control and its mean-field control approach, Entropy 24, 1599 (2022).
  114. T. Tottori and T. J. Kobayashi, Forward-backward sweep method for the system of HJB-FP equations in memory-limited partially observable stochastic control, Entropy 25, 208 (2023).
  115. T. Tottori and T. J. Kobayashi, Decentralized stochastic control with finite-dimensional memories: A memory limitation approach, Entropy 25, 791 (2023).
  116. R. E. Kalman, A new approach to linear filtering and prediction problems, J. Basic Eng. 82, 35 (1960).
  117. R. E. Kalman and R. S. Bucy, New results in linear filtering and prediction theory, J. Basic Eng. 83, 95 (1961).
  118. C. K. Chui and G. Chen, Kalman Filtering (Springer International, Cham, 2017).
  119. A. Bensoussan, J. Frehse, and S. C. P. Yam, The Master equation in mean field theory, J. Math. Pures Appl. 103, 1441 (2015).
  120. A. Bensoussan, J. Frehse, and S. C. P. Yam, On the interpretation of the master equation, Stoch. Process. their Appl. 127, 2093 (2017).
  121. R. Carmona and F. Delarue, Probabilistic Theory of Mean Field Games with Applications I, Probability theory and Stochastic Modelling (Springer Nature, Cham, 2018), Vol. 83.
  122. R. Carmona and F. Delarue, Probabilistic Theory of Mean Field Games with Applications II, Probability Theory and Stochastic Modelling (Springer International Publishing, Cham, 2018), Vol. 84.
  123. C. Briat and M. Khammash, Continuous and sampled-data h control of linear stochastic reaction networks, in 2022 IEEE 61st Conference on Decision and Control (CDC) (IEEE, Piscataway, NJ, 2022), pp. 1924–1929.
  124. C. Briat and M. Khammash, Continuous-time and sampled-data optimal control of linear stochastic reaction networks, in 2022 IEEE 61st Conference on Decision and Control (CDC) (IEEE, Piscataway, NJ, 2022), pp. 3865–3870.
  125. C. Briat and M. Khammash, Optimal and H∞ control of stochastic reaction networks, arXiv:2111.14754 [cs, eess, math, q-bio].
  126. T. Toyoizumi, J.-P. Pfister, K. Aihara, and W. Gerstner, Optimality model of unsupervised spike-timing-dependent plasticity: Synaptic memory and weight distribution, Neural Comput. 19, 639 (2007).
  127. K. Yoshida and T. Toyoizumi, Information maximization explains state-dependent synaptic plasticity and memory reorganization during non-rapid eye movement sleep, PNAS Nexus 2, pgac286 (2023).
  128. S. Gu, R. F. Betzel, M. G. Mattar, M. Cieslak, P. R. Delio, S. T. Grafton, F. Pasqualetti, and D. S. Bassett, Optimal trajectories of brain state transitions, NeuroImage 148, 305 (2017).
  129. J. Z. Kim, J. M. Soffer, A. E. Kahn, J. M. Vettel, F. Pasqualetti, and D. S. Bassett, Role of graph architecture in controlling dynamical networks with applications to neural systems, Nat. Phys. 14, 91 (2018).
  130. M. F. Krummel, F. Bartumeus, and A. Grard, T cell migration, search strategies and mechanisms, Nat. Rev. Immunol. 16, 193 (2016).
  131. D. R. Sowinski, J. Carroll-Nellenback, R. N. Markwick, J. Piero, M. Gleiser, A. Kolchinsky, G. Ghoshal, and A. Frank, Semantic information in a model of resource gathering agents, PRX Life 1, 023003 (2023).
  132. A. Celani and E. Panizon, Olfactory search, arXiv:2405.03374 [physics].
  133. G. M. Viswanathan, S. V. Buldyrev, S. Havlin, M. G. E. da Luz, E. P. Raposo, and H. E. Stanley, Optimizing the success of random searches, Nature (London) 401, 911 (1999).
  134. O. Bénichou, M. Coppey, M. Moreau, P.-H. Suet, and R. Voituriez, Optimal search strategies for hidden targets, Phys. Rev. Lett. 94, 198101 (2005).
  135. G. M. Viswanathan, E. P. Raposo, and M. G. E. da Luz, Lévy flights and superdiffusion in the context of biological encounters and random searches, Phys. Life Rev. 5, 133 (2008).
  136. O. Bénichou, C. Loverdo, M. Moreau, and R. Voituriez, Intermittent search strategies, Rev. Mod. Phys. 83, 81 (2011).
  137. A. M. Hein, F. Carrara, D. R. Brumley, R. Stocker, and S. A. Levin, Natural search algorithms as a bridge between organisms, evolution, and ecology, Proc. Natl. Acad. Sci. USA 113, 9413 (2016).
  138. K. Friston, J. Kilner, and L. Harrison, A free energy principle for the brain, J. Physiol. Paris 100, 70 (2006).
  139. K. Friston, The free-energy principle: A unified brain theory? Nat. Rev. Neurosci. 11, 127 (2010).
  140. C. L. Buckley, C. S. Kim, S. McGregor, and A. K. Seth, The free energy principle for action and perception: A mathematical review, J. Math. Psychol. 81, 55 (2017).
  141. Y. Konaka and H. Naoki, Decoding rewardcuriosity conflict in decision-making from irrational behaviors, Nat. Comput. Sci. 3, 418 (2023).
  142. J. S. Li, A. A. Sarma, T. J. Sejnowski, and J. C. Doyle, Internal feedback in the cortical perceptionaction loop enables fast and accurate behavior, Proc. Natl. Acad. Sci. USA 120, e2300445120 (2023).
  143. J. J. Moore, A. Genkin, M. Tournoy, J. L. Pughe-Sanford, R. R. de Ruyter van Steveninck, and D. B. Chklovskii, The neuron as a direct data-driven controller, Proc. Natl. Acad. Sci. USA 121, e2311893121 (2024).
  144. L. Boominathan and X. Pitkow, Phase transitions in when feedback is useful, Adv. Neural Inf. Process. Syst. 35, 10849 (2022).
  145. G. Tavoni, T. Doi, C. Pizzica, V. Balasubramanian, and J. I. Gold, Human inference reflects a normative balance of complexity and accuracy, Nat. Hum. Behav. 6, 1153 (2022).
  146. C. H. Johnson, C. Zhao, Y. Xu, and T. Mori, Timing the day: What makes bacterial clocks tick? Nat. Rev. Microbiol. 15, 232 (2017).
  147. M. Monti, D. K. Lubensky, and P. R. ten Wolde, Robustness of clocks to input noise, Phys. Rev. Lett. 121, 078101 (2018).
  148. W. Pittayakanchit, Z. Lu, J. Chew, M. J. Rust, and A. Murugan, Biophysical clocks face a trade-off between internal and external noise resistance, eLife 7, e37624 (2018).
  149. M. Seki and H. Ito, Evolution of self-sustained circadian rhythms is facilitated by seasonal change of daylight, Proc. R. Soc. B: Biol. Sci. 289, 20220577 (2022).
  150. M. Ishiura, S. Kutsuna, S. Aoki, H. Iwasaki, C. R. Andersson, A. Tanabe, S. S. Golden, C. H. Johnson, and T. Kondo, Expression of a gene cluster kaiABC as a circadian feedback process in cyanobacteria, Science 281, 1519 (1998).
  151. H. Iwasaki, T. Nishiwaki, Y. Kitayama, M. Nakajima, and T. Kondo, KaiA-stimulated KaiC phosphorylation in circadian timing loops in cyanobacteria, Proc. Natl. Acad. Sci. USA 99, 15788 (2002).
  152. M. Nakajima, K. Imai, H. Ito, T. Nishiwaki, Y. Murayama, H. Iwasaki, T. Oyama, and T. Kondo, Reconstitution of circadian oscillation of cyanobacterial KaiC phosphorylation in vitro, Science 308, 414 (2005).
  153. J. Tomita, M. Nakajima, T. Kondo, and H. Iwasaki, No transcription-translation feedback in circadian Rhythm of KaiC phosphorylation, Science 307, 251 (2005).
  154. N. Kawamoto, H. Ito, I. T. Tokuda, and H. Iwasaki, Damped circadian oscillation in the absence of KaiA in Synechococcus, Nat. Commun. 11, 2242 (2020).
  155. V. Dvornyk, O. Vinogradova, and E. Nevo, Origin and evolution of circadian clock genes in prokaryotes, Proc. Natl. Acad. Sci. USA 100, 2495 (2003).
  156. J. Holtzendorff, F. Partensky, D. Mella, J.-F. Lennon, W. R. Hess, and L. Garczarek, Genome streamlining results in loss of robustness of the circadian clock in the marine cyanobacterium Prochlorococcus marinus PCC 9511, J. Biol. Rhythms 23, 187 (2008).
  157. I. M. Axmann, U. Dhring, L. Seeliger, A. Arnold, J. T. Vanselow, A. Kramer, and A. Wilde, Biochemical evidence for a timing mechanism in Prochlorococcus, J. Bacteriol. 191, 5342 (2009).
  158. C. W. Mullineaux and R. Stanewsky, The rolex and the hourglass: A simplified circadian clock in Prochlorococcus? J. Bacteriol. 191, 5333 (2009).
  159. P. Ma, T. Mori, C. Zhao, T. Thiel, and C. H. Johnson, Evolution of KaiC-dependent timekeepers: A proto-circadian timing mechanism confers adaptive fitness in the purple bacterium Rhodopseudomonas palustris, PLoS Genet. 12, e1005922 (2016).
  160. J. Chew, E. Leypunskiy, J. Lin, A. Murugan, and M. J. Rust, High protein copy number is required to suppress stochasticity in the cyanobacterial circadian clock, Nat. Commun. 9, 3004 (2018).
  161. P. Flombaum, J. L. Gallegos, R. A. Gordillo, J. Rincn, L. L. Zabala, N. Jiao, D. M. Karl, W. K. W. Li, M. W. Lomas, D. Veneziano, C. S. Vera, J. A. Vrugt, and A. C. Martiny, Present and future global distributions of the marine Cyanobacteria Prochlorococcus and Synechococcus, Proc. Natl. Acad. Sci. USA 110, 9824 (2013).
  162. S. Epstein, Integration of the cognitive and the psychodynamic unconscious, Am. Psychol. 49, 709 (1994).
  163. M. Muraven, D. M. Tice, and R. F. Baumeister, Self-control as a limited resource: Regulatory depletion patterns, J. Pers. Soc. Psychol. 74, 774 (1998).
  164. D. Kahneman, A perspective on judgment and choice: Mapping bounded rationality, Am. Psychol. 58, 697 (2003).
  165. K. E. Stanovich, Who Is Rational?: Studies of individual Differences in Reasoning (Psychology Press, New York, 1999).
  166. E. Masicampo and R. F. Baumeister, Toward a physiology of dual-process reasoning and judgment: Lemonade, willpower, and expensive rule-based analysis, Psychol. Sci. 19, 255 (2008).
  167. A. J. McMahon and M. H. Scheel, Glucose promotes controlled processing: Matching, maximizing, and root beer, Judgm. Decis. Mak. 5, 450 (2010).
  168. X. Wang and R. D. Dvorak, Sweet future: Fluctuating blood glucose levels affect future discounting, Psychol. Sci. 21, 183 (2010).
  169. L. Ruthotto, S. J. Osher, W. Li, L. Nurbekyan, and S. W. Fung, A machine learning framework for solving high-dimensional mean field game and mean field control problems, Proc. Natl. Acad. Sci. USA 117, 9183 (2020).
  170. A. T. Lin, S. W. Fung, W. Li, L. Nurbekyan, and S. J. Osher, Alternating the population and control neural networks to solve high-dimensional stochastic mean-field games, Proc. Natl. Acad. Sci. USA 118, e2024713118 (2021).
  171. H. Pham and X. Warin, Mean-field neural networks: Learning mappings on Wasserstein space, Neural Networks 168, 380 (2023).
  172. H. Cao, X. Guo, and M. Laurire, Connecting GANs, mean-field games, and optimal transport, SIAM J. Appl. Math. 84 1255 (2024).
  173. S. Sasagawa, Y.-I. Ozaki, K. Fujita, and S. Kuroda, Prediction and validation of the distinct dynamics of transient and sustained ERK activation, Nat. Cell Biol. 7, 365 (2005).
  174. M. W. Covert, T. H. Leung, J. E. Gaston, and D. Baltimore, Achieving stability of lipopolysaccharide-induced NF-κ B activation, Science 309, 1854 (2005).
  175. Y. Hasegawa, Multidimensional biochemical information processing of dynamical patterns, Phys. Rev. E 97, 022401 (2018).
  176. L. Hahn, A. M. Walczak, and T. Mora, Dynamical information synergy in biochemical signaling networks, Phys. Rev. Lett. 131, 128401 (2023).
  177. C. M. Bishop, Pattern Recognition and Machine Learning (Springer, New York, 2006), 1st ed.
  178. L. van der Maaten, E. Postma, and H. Herik, Dimensionality reduction: A comparative review, J. Mach. Learn. Res. 10, 66 (2007).
  179. J. A. Lee and M. Verleysen, Nonlinear Dimensionality Reduction (Springer, New York, 2007).
  180. S. Fancher and A. Mugler, Fundamental limits to collective concentration sensing in cell populations, Phys. Rev. Lett. 118, 078101 (2017).
  181. J. Varennes, S. Fancher, B. Han, and A. Mugler, Emergent versus individual-based multicellular chemotaxis, Phys. Rev. Lett. 119, 188101 (2017).
  182. A. Erez, T. A. Byrd, M. Vennettilli, and A. Mugler, Cell-to-cell information at a feedback-induced bifurcation point, Phys. Rev. Lett. 125, 048103 (2020).
  183. M. Vennettilli, A. Erez, and A. Mugler, Multicellular sensing at a feedback-induced critical point, Phys. Rev. E 102, 052411 (2020).
  184. L. Tweedy, P. A. Thomason, P. I. Paschke, K. Martin, L. M. Machesky, M. Zagnoni, and R. H. Insall, Seeing around corners: Cells solve mazes and respond at a distance using attractant breakdown, Science 369, eaay9792 (2020).
  185. A. Pezzotta, M. Adorisio, and A. Celani, Chemotaxis emerges as the optimal solution to cooperative search games, Phys. Rev. E 98, 042401 (2018).
  186. M. Durve, L. Piro, M. Cencini, L. Biferale, and A. Celani, Collective olfactory search in a turbulent environment, Phys. Rev. E 102, 012402 (2020).
  187. F. Borra, M. Cencini, and A. Celani, Optimal collision avoidance in swarms of active Brownian particles, J. Stat. Mech. (2021) 083401.
  188. R. Bellman, Dynamic programming and stochastic control processes, Inf. Control 1, 228 (1958).
  189. H. Kushner, Optimal stochastic control, IRE Trans. Autom. Control 7, 120 (1962).
  190. W. Fleming and R. Rishel, Deterministic and Stochastic Optimal Control (Springer New York, New York, NY, 1975).
  191. W. Hackbusch, A numerical method for solving parabolic equations with opposite orientations, Computing 20, 229 (1978).
  192. M. McAsey, L. Mou, and W. Han, Convergence of the forward-backward sweep method in optimal control, Comput. Optim. Appl. 53, 207 (2012).
  193. S. Lenhart and J. T. Workman, Optimal Control Applied to Biological Models (Chapman and Hall/CRC, New York, 2007).
  194. J. A. Sharp, K. Burrage, and M. J. Simpson, Implementation and acceleration of optimal control for systems biology, J. R. Soc. Interface. 18, 20210241 (2021).
  195. E. Carlini and F. J. Silva, Semi-Lagrangian schemes for mean field game models, in 52nd IEEE Conference on Decision and Control (IEEE, Piscataway, NJ, 2013), pp. 3115–3120.
  196. E. Carlini and F. J. Silva, A fully discrete semi-lagrangian scheme for a first order mean field game problem, SIAM J. Numer. Anal. 52, 45 (2014).
  197. E. Carlini and F. J. Silva, A semi-Lagrangian scheme for a degenerate second order mean field game system, Discrete Contin. Dyn. Syst. 35, 4269 (2015).
  198. M. Lauriere, Numerical methods for mean field games and mean field type control, arXiv:2106.06231 [cs, math].
  199. L. S. Pontryagin, Mathematical Theory of Optimal Processes (CRC Press, Boca Raton, Florida, 1987), google-Books-ID:kwzq0F4cBVAC.
  200. R. Vinter, Optimal Control (Birkhuser, Boston, 2010).
  201. F. L. Lewis, D. Vrabie, and V. L. Syrmos, Optimal Control (John Wiley & Sons, Hoboken, New Jersey, 2012).
  202. https://github.com/takehirotottori/Tottori2025-OMSC
  203. C. Gardiner, Stochastic Methods: A Handbook for the Natural and Social Sciences (Springer, Berlin, 2009), 4th ed.
  204. N. G. V. Kampen, Stochastic Processes in Physics and Chemistry (North Holland, 2011).

Outline

Information

Phys. Rev. Research 7, 043048– Published 14 October, 2025
  • Received 25 September 2024
  • Accepted 16 September 2025
Crossmark - Check for updates button
Creative Commons Logo

Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.

Published by the American Physical Society

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation