Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

When Many Noisy Genes Optimize Information Flow

Nicholas Lawson* and William Bialek†

  • Joseph Henry Laboratories of Physics and Lewis–Sigler Institute for Integrative Genomics, Princeton University, Princeton, New Jersey 08544, USA

  • *Contact author: nlawson@g.harvard.edu
  • †Contact author: wbialek@princeton.edu

PRX Life 4, 033025 – Published 8 September, 2026

DOI: https://doi.org/10.1103/f8vw-ddpv

Abstract

It often is emphasized that gene expression is noisy. A seemingly contradictory view is that control mechanisms have been optimized to squeeze as much information as possible out of a limited number of molecules. Here we revisit these issues in a simple model where a single transcription factor (TF) controls a large number of target genes. We include only the physically required noise sources—random arrival of TFs at their targets and counting noise in the synthesis and degradation of messenger RNA (mRNA). If the cell has a limited total number of mRNA molecules, then the capacity to transmit information about TF concentration is maximized when these resources are distributed across the largest possible number of target genes. To realize this capacity the distribution of TF concentrations must be biased toward smaller values. Thus, in some limits, information transmission is optimized when individual expression levels are noisy. In addition, the dependence of information transmission on the parameters of this multigene system has a “sloppy” spectrum, so that optimal performance can coexist with substantial variability.

View figure in article

Physics Subject Headings (PhySH)

Article Text

References (47)

  1. S. Hecht, S. Shlaer, and M. H. Pirenne, Energy, quanta and vision, J. Gen. Physiol. 25, 819 (1942).
  2. F. Rieke and D. A. Baylor, Single–photon detection by rod cells of the retina, Rev. Mod. Phys. 70, 1027 (1998).
  3. A. Roorda, A. B. Mehta, P. Lennie, and D. R. Williams, Packing arrangement of the three cone classes in primate retina, Vision Res. 41, 1291 (2001).
  4. E. Marder and J. M. Goaillard, Variability, compensation, and homeostasis in neuron and network function, Nat. Rev. Neurosci. 7, 563 (2006).
  5. J. M. Raser and E. K. O'Shea, Noise in gene expression: Origins, consequences, and control, Science 309, 2010 (2005).
  6. W. Bialek, Biophysics: Searching for Principles (Princeton University Press, Princeton, NJ, 2012).
  7. W. Bialek, Ambitions for theory in the physics of life, SciPost Phys. Lect. Notes 84 (2024).
  8. J. von Neumann, Probabilistic logics and the synthesis of reliable organisms from unreliable components, in Annals of Mathematics Studies, Number 34, edited by C. E. Shannon and J. McCarthy (Princeton University Press, Princeton, NJ, 1956), pp. 43–98.
  9. Z. F. Mainen and T. J. Sejnowski, Reliability of spike timing in neocortical neurons, Science 268, 1503 (1995).
  10. F. Rieke, D. Warland, R. de Ruyter van Steveninck, and W. Bialek, Spikes: Exploring the Neural Code (MIT Press, Cambridge, MA, 1997).
  11. S. A. Hires, D. A. Gutnisky, J. Yu, D. H. O'Connor, and K. Svoboda, Low-noise encoding of active touch by layer 4 in the somatosensory cortex, eLife 4, e06619 (2015).
  12. T. Gregor, D. W. Tank, E. F. Wieschaus, and W. Bialek, Probing the limits to positional information, Cell 130, 153 (2007).
  13. J. O. Dubuis, G. Tkačik, E. F. Wieschaus, T. Gregor, and W. Bialek, Positional information, in bits, Proc. Natl. Acad. Sci. USA 110, 16301 (2013).
  14. M. D. Petkova, G. Tkačik, W. Bialek, E. F. Wieschaus, and T. Gregor, Optimal decoding of cellular identities in a genetic network, Cell 176, 844 (2019).
  15. L. McGough, H. Casademunt, M. Nikolić, Z. Aridor, M. D. Petkova, T. Gregor, and W. Bialek, Finding the last bits of positional information, PRX Life 2, 013016 (2024).
  16. L. Bintu, N. E. Buchler, H. G. Garcia, U. Gerland, T. Hwa, J. Kondev, and R. Phillips, Transcriptional regulation by the numbers: Models, Curr. Opin. Genet. Dev. 15, 116 (2005).
  17. L. Bintu, N. E. Buchler, H. G. Garcia, U. Gerland, T. Hwa, J. Kondev, T. Kuhlman, and R. Phillips, Transcriptional regulation by the numbers: Applications, Curr. Opin. Genet. Dev. 15, 125 (2005).
  18. K. S. Brown and J. P. Sethna, Statistical mechanical approaches to models with many poorly known parameters, Phys. Rev. E 68, 021904 (2003).
  19. R. N. Gutenkunst, J. J. Waterfall, F. P. Casey, K. S. Brown, C. R. Myers, and J. P. Sethna, Universally sloppy parameter sensitivities in systems biology models, PLoS Comput. Biol. 3, e189 (2007).
  20. M. K. Transtrum, B. B. Machta, K. S. Brown, B. C. Daniels, C. R. Myers, and J. P. Sethna, Perspective: Sloppiness and emergent theories in physics, biology, and beyond, J. Chem. Phys. 143, 010901 (2015).
  21. K. N. Quinn, M. C. Abbott, M. K. Transtrum, B. B. Machta, and J. P. Sethna, Information geometry for multiparameter models: New perspectives on the origin of simplicity, Rep. Prog. Phys. 86, 035901 (2023).
  22. M. Bauer, W. Bialek, C. W. Goddard, C. M. Holmes, K. Krishnamurthy, S. E. Palmer, R. Pang, D. J. Schwab, and L. Susman, Optimization and variability can coexist, arXiv:2505.23398.
  23. S. Ohno, Major Sex-Determining Genes (Springer-Verlag, Berlin, 1979).
  24. K. Pougach, A. Voet, F. A. Kondrashov, K. Voordeckers, J. F. Christiaens, B. Baying, V. Benes, R. Sakai, J. Aerts, B. Zhu, P. Van Dijck, and K. J. Verstrepen, Duplication of a promiscuous transcription factor drives the emergence of a new regulatory network, Nat. Commun. 5, 4868 (2014).
  25. A. M. Walczak, G. Tkačik, and W. Bialek, Optimizing information flow in small genetic networks. II: Feed-forward interaction, Phys. Rev. E 81, 041905 (2010).
  26. H. C. Berg and E. M. Purcell, Physics of chemoreception, Biophys. J. 20, 193 (1977).
  27. W. Bialek and S. Setayeshgar, Physical limits to biochemical signaling, Proc. Natl. Acad. Sci. USA 102, 10040 (2005).
  28. J. Paulsson, Models of stochastic gene expression, Phys. Life Rev. 2, 157 (2005).
  29. G. Tkačik, A. M. Walczak, and W. Bialek, Optimizing information flow in small genetic networks, Phys. Rev. E 80, 031920 (2009).
  30. G. Tkačik, C. G. Callan, and W. Bialek, Information flow and optimization in transcriptional regulation, Proc. Natl. Acad. Sci. USA 105, 12265 (2008).
  31. G. Tkačik, C. G. Callan, and W. Bialek, Information capacity of genetic regulatory elements, Phys. Rev. E 78, 011910 (2008).
  32. T. M. Cover and J. A. Thomas, Elements of Information Theory (Wiley, New York, 1991).
  33. C. E. Shannon, A mathematical theory of communication, Bell Syst. Tech. J. 27, 379 (1948).
  34. P. R. Bevington and D. K. Robinson, Data Reduction and Error Analysis for the Physical Sciences, 3rd ed. (McGraw-Hill, New York, 2003).
  35. A. V. Hill, The possible effects of the aggregation of the molecules of haemoglobin on its dissociation curve, J. Physiol. 40, iv (1910).
  36. K. Kaizu, W. de Ronde, J. Paijmans, K. Takahashi, F. Tostevin, and P. R. ten Wolde, The Berg-Purcell limit revisited, Biophys. J. 106, 976 (2014).
  37. M. Bauer, M. D. Petkova, T. Gregor, E. F. Wieschaus, and W. Bialek, Trading bits in the readout from a genetic network, Proc. Natl. Acad. Sci. USA 118, e2109011118 (2021).
  38. S. F. Taylor, N. Tishby, and W. Bialek, Information and fitness, arXiv:0712.4382.
  39. K. Bod'ová, G. Tkačik, and N. H. Barton, A general approximation for the dynamics of quantitative traits, Genetics 202, 1523 (2016).
  40. K. Bod'ová, E. Szép, and N. H. Barton, Dynamic maximum entropy provides accurate approximation of structured population dynamics, PLoS Comput. Biol. 17, e1009661 (2021).
  41. D. De Martino, F. Capuani, and A. De Martino, Quantifying the entropic cost of cellular growth control, Phys. Rev. E 96, 010401(R) (2017).
  42. D. De Martino, A. M. Andersson, T. Bergmiller, C. C. Guet, and G. Tkačik, Statistical mechanics for metabolic networks during steady state growth, Nat. Commun. 9, 2988 (2018).
  43. W. Młynarski, M. Hledík, T. R. Sokolowski, and G. Tkačik, Statistical analysis and optimality of neural systems, Neuron 109, 1227 (2021).
  44. H. B. Barlow, Sensory mechanisms, the reduction of redundancy, and intelligence, in Proceedings of the Symposium on the Mechanisation of Thought Processes, Volume 2, edited by D. Blake and A. Uttley (HM Stationery Office, London, 1959), pp. 537–574.
  45. H. B. Barlow, Possible principles underlying the transformation of sensory messages, in Sensory Communication, edited by W. Rosenblith (MIT Press, Cambridge, MA, 1961), pp. 217–234.
  46. M. B. Manookin and F. Rieke, Two sides of the same coin: Efficient and predictive neural coding, Annu. Rev. Vis. Sci. 9, 293 (2023).
  47. G. Tkačik and P. R. ten Wolde, Information processing in biochemical networks, Annu. Rev. Biophys. 54, 249 (2025).

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation