- Physical Review Journals
All JournalsPhysics Magazine

PRX Life

Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

Strong, but not Weak, Noise Correlations are Beneficial for Population Coding

Gabriel Mahuas1,2, Thomas Buffet1, Olivier Marre1, Ulisse Ferrari1,*, and Thierry Mora2,*

  • *These authors contributed equally to this work.
PDF

PRX Life 3, 033012 – Published 14 August, 2025

DOI: https://doi.org/10.1103/nhvz-6grt

Abstract

Neural correlations play a critical role in sensory information coding. They are of two kinds: signal correlations, when neurons have overlapping sensitivities, and noise correlations from network effects and shared noise. In experiments from early sensory systems and cortexes, many pairs of neurons typically show both types of correlations to be positive and large, especially between nearby neurons with similar stimulus sensitivity. However, theoretical arguments have suggested that the stimulus and noise correlations should have opposite signs to improve coding, at odds with experimental observations. We analyze retinal recording in response to a large variety of stimuli and show that, contrary to common belief, large noise correlations are beneficial for coding, even if aligned with signal correlations. To understand this result, we develop a theory of visual information coding by correlated neurons, which resolves that paradox. We show that noise correlations are always beneficial if they are strong enough, unless neurons are perfectly correlated by the stimulus. Finally, using neuronal recordings and modeling, we show that for high-dimensional stimuli noise correlation benefits the encoding of fine-grained details of visual stimuli, at the expense of large-scale features, which are already well encoded.

View figure in article

Physics Subject Headings (PhySH)

Article Text

References (65)

  1. E. Zohary, M. N. Shadlen, and W. T. Newsome, Correlated neuronal discharge rate and its implications for psychophysical performance, Nature (London) 370, 140 (1994).
  2. M. Meister, L. Lagnado, and D. A. Baylor, Concerted signaling by retinal ganglion cells, Science 270, 1207 (1995).
  3. T. Gawne and B. Richmond, How independent are the messages carried by adjacent inferior temporal cortical neurons? J. Neurosci. 13, 2758 (1993).
  4. M. A. Smith and A. Kohn, Spatial and temporal scales of neuronal correlation in primary visual cortex, J. Neurosci. 28, 12591 (2008).
  5. S. B. Hofer, H. Ko, B. Pichler, J. Vogelstein, H. Ros, H. Zeng, E. Lein, N. A. Lesica, and T. D. Mrsic-Flogel, Differential connectivity and response dynamics of excitatory and inhibitory neurons in visual cortex, Nat. Neurosci. 14, 1045 (2011).
  6. M. R. Cohen and A. Kohn, Measuring and interpreting neuronal correlations, Nat. Neurosci. 14, 811 (2011).
  7. B. Averbeck, P. Latham, and A. Pouget, Neural correlations, population coding and computation, Nat. Rev. Neurosci. 7, 358 (2006).
  8. A. Kohn, R. Coen-Cagli, I. Kanitscheider, and A. Pouget, Correlations and neuronal population information, Annu. Rev. Neurosci. 39, 237 (2016).
  9. R. A. da Silveira and F. Rieke, The geometry of information coding in correlated neural populations, Annu. Rev. Neurosci. 44, 403 (2021).
  10. S. Panzeri, M. Moroni, H. Safaai, and C. D. Harvey, The structures and functions of correlations in neural population codes, Nat. Rev. Neurosci. 23, 551 (2022).
  11. D. H. Perkel, G. L. Gerstein, and G. P. Moore, Neuronal spike trains and stochastic point processes: II. Simultaneous spike trains, Biophys. J. 7, 419 (1967).
  12. D. N. Mastronarde, Correlated firing of retinal ganglion cells, Trends Neurosci. 12, 75 (1989).
  13. S. Nirenberg, S. M. Carcieri, A. L. Jacobs, and P. E. Latham, Retinal ganglion cells act largely as independent encoders, Nature (London) 411, 698 (2001).
  14. J. Shlens, F. Rieke, and E. Chichilnisky, Synchronized firing in the retina, Curr. Opin. Neurobiol. 18, 396 (2008).
  15. J. W. Pillow, J. Shlens, L. Paninski, A. Sher, A. M. Litke, E. J. Chichilnisky, and E. P. Simoncelli, Spatio-temporal correlations and visual signalling in a complete neuronal population, Nature (London) 454, 995 (2008).
  16. B. Völgyi, S. Chheda, and S. Bloomfield, Tracer coupling patterns of the ganglion cell subtypes in the mouse retina, J. Comp. Neurol. 512, 664 (2009).
  17. B. Völgyi, F. Pan, D. L. Paul, J. T. Wang, A. D. Huberman, and S. A. Bloomfield, Gap junctions are essential for generating the correlated spike activity of neighboring retinal ganglion cells, PLoS One 8, e69426 (2013).
  18. F. Franke, M. Fiscella, M. Sevelev, B. Roska, A. Hierlemann, and R. Azeredo da Silveira, Structures of neural correlation and how they favor coding, Neuron 89, 409 (2016).
  19. J. Zylberberg, J. Cafaro, M. Turner, E. Shea-Brown, and F. Rieke, Direction-selective circuits shape noise to ensure a precise population code, Neuron 89, 369 (2016).
  20. K. Ruda, J. Zylberberg, and G. D. Field, Ignoring correlated activity causes a failure of retinal population codes, Nat. Commun. 11, 4605 (2020).
  21. O. Sorochynskyi, S. Deny, O. Marre, and U. Ferrari, Predicting synchronous firing of large neural populations from sequential recordings, PLoS Comput. Biol. 17, e1008501 (2021).
  22. J. Fiser, C. Chiu, and M. Weliky, Small modulation of ongoing cortical dynamics by sensory input during natural vision, Nature (London) 431, 573 (2004).
  23. A. Kohn and M. A. Smith, Stimulus dependence of neuronal correlation in primary visual cortex of the macaque, J. Neurosci. 25, 3661 (2005).
  24. A. S. Ecker, P. Berens, G. A. Keliris, M. Bethge, N. K. Logothetis, and A. S. Tolias, Decorrelated neuronal firing in cortical microcircuits, Science 327, 584 (2010).
  25. I. C. Lin, M. Okun, M. Carandini, and K. Harris, The nature of shared cortical variability, Neuron 87, 644 (2015).
  26. W. M. Usrey and R. C. Reid, Synchronous activity in the visual system, Annu. Rev. Physiol. 61, 435 (1999).
  27. D. Lee, N. L. Port, W. Kruse, and A. P. Georgopoulos, Variability and correlated noise in the discharge of neurons in motor and parietal areas of the primate cortex, J. Neurosci. 18, 1161 (1998).
  28. W. Bair, E. Zohary, and W. T. Newsome, Correlated firing in macaque visual area MT: Time scales and relationship to behavior, J. Neurosci. 21, 1676 (2001).
  29. O. Hazon, V. H. Minces, D. P. Tomàs, S. Ganguli, M. J. Schnitzer, and P. E. Jercog, Noise correlations in neural ensemble activity limit the accuracy of hippocampal spatial representations, Nat. Commun. 13, 4276 (2022).
  30. D. N. Mastronarde, Correlated firing of cat retinal ganglion cells. I. Spontaneously active inputs to X- and Y-cells, J. Neurophysiol. 49, 303 (1983).
  31. D. A. Gutnisky and V. Dragoi, Adaptive coding of visual information in neural populations, Nature (London) 452, 220 (2008).
  32. B. B. Averbeck and D. Lee, Effects of noise correlations on information encoding and decoding, J. Neurophysiol. 95, 3633 (2006).
  33. N. Brunel and J. P. Nadal, Mutual information, Fisher information, and population coding, Neural Comput. 10, 1731 (1998).
  34. S. Panzeri, A. Treves, S. Schultz, and E. T. Rolls, On decoding the responses of a population of neurons from short time windows, Neural Comput. 11, 1553 (1999).
  35. G. Pola, A. Thiele, K. Hoffmann, and S. Panzeri, An exact method to quantify the information transmitted by different mechanisms of correlational coding, Network 14, 35 (2003).
  36. H. Sompolinsky, H. Yoon, K. Kang, and M. Shamir, Population coding in neuronal systems with correlated noise, Phys. Rev. E 64, 051904 (2001).
  37. Y. Hu, J. Zylberberg, and E. Shea-Brown, The sign rule and beyond: Boundary effects, flexibility, and noise correlations in neural population codes, PLoS Comput. Biol. 10, e1003469 (2014).
  38. R. Moreno-Bote, J. Beck, I. Kanitscheider, X. Pitkow, P. Latham, and A. Pouget, Information-limiting correlations, Nat. Neurosci. 17, 1410 (2014).
  39. L. F. Abbott and P. Dayan, The effect of correlated variability on the accuracy of a population code, Neural Comput. 11, 91 (1999).
  40. A. S. Ecker, P. Berens, A. S. Tolias, and M. Bethge, The effect of noise correlations in populations of diversely tuned neurons, J. Neurosci. 31, 14272 (2011).
  41. G. Tkačik, J. S. Prentice, V. Balasubramanian, and E. Schneidman, Optimal population coding by noisy spiking neurons, Proc. Natl. Acad. Sci. USA 107, 14419 (2010).
  42. M. Nardin, J. Csicsvari, G. Tkačik, and C. Savin, The structure of hippocampal CA1 interactions optimizes spatial coding across experience, J. Neurosci. 43, 8140 (2023).
  43. R. A. da Silveira and M. J. Berry, High-fidelity coding with correlated neurons, PLoS Comput. Biol. 10, e1003970 (2014).
  44. J. C. Boffi, B. Bathellier, H. Asari, and R. Prevedel, Noisy neuronal populations effectively encode sound localization in the dorsal inferior colliculus of awake mice, eLife 13, RP97598 (2024).
  45. A. B. Graf, A. Kohn, M. Jazayeri, and J. A. Movshon, Decoding the activity of neuronal populations in macaque primary visual cortex, Nat. Neurosci. 14, 239 (2011).
  46. G. Mahuas, O. Marre, T. Mora, and U. Ferrari, Small-correlation expansion to quantify information in noisy sensory systems, Phys. Rev. E 108, 024406 (2023).
  47. S. Deny, U. Ferrari, E. Macé, P. Yger, R. Caplette, S. Picaud, G. Tkačik, and O. Marre, Multiplexed computations in retinal ganglion cells of a single type, Nat. Commun. 8, 1964 (2017).
  48. V. Botella-Soler, S. Deny, G. Martius, O. Marre, and G. Tkačik, Nonlinear decoding of a complex movie from the mammalian retina, PLoS Comput. Biol. 14, e1006057 (2018).
  49. P. Yger, G. L. B. Spampinato, E. Esposito, B. Lefebvre, S. Deny, C. Gardella, M. Stimberg, F. Jetter, G. Zeck, S. Picaud et al., A spike sorting toolbox for up to thousands of electrodes validated with ground truth recordings in vitro and in vivo, eLife 7, e34518 (2018).
  50. G. Mahuas, G. Isacchini, O. Marre, U. Ferrari, and T. Mora, in Advances in Neural Information Processing Systems 33, edited by H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin (Curran, Red Hook, 2020), pp. 5070–5080.
  51. I. Brivanlou, D. Warland, and M. Meister, Mechanisms of concerted firing among retinal ganglion cells, Neuron 20, 527 (1998).
  52. I. Kanitscheider, R. Coen-Cagli, and A. Pouget, Origin of information-limiting noise correlations, Proc. Natl. Acad. Sci. USA 112, E6973 (2015).
  53. J. J. Atick and A. N. Redlich, Towards a theory of early visual processing, Neural Comput. 2, 308 (1990).
  54. L. McIntosh, N. Maheswaranathan, A. Nayebi, S. Ganguli, and S. Baccus, in Advances in Neural Information Processing Systems 29, edited by D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett (Curran, Red Hook, 2016), pp. 1369–1377.
  55. N. Maheswaranathan et al., Interpreting the retinal neural code for natural scenes: From computations to neurons, Neuron 111, 2742 (2023).
  56. X. Ding, D. Lee, J. Melander, G. Sivulka, S. Ganguli, and S. Baccus, in Advances in Neural Information Processing Systems 36, edited by A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine (Curran, Red Hook, 2023), pp. 44310–44322.
  57. S. Azeglio, V. C. Garcia, G. Glaziou, P. Neri, O. Marre, and U. Ferrri, Higher-order convolution improves neural predictivity in the retina, arXiv:2505.07620.
  58. M. A. Goldin, B. Lefebvre, S. Virgili, M. K. P. V. Cang, A. Ecker, T. Mora, U. Ferrri, and O. Marre, Context-dependent selectivity to natural images in the retina, Nat. Commun. 13, 5556 (2022).
  59. H. B. Barlow, Possible principles underlying the transformations of sensory messages, Sensory Communication, edited by W. A. Rosenblith (MIT Press, Cambridge, MA, 1961).
  60. S. Panzeri, S. R. Schultz, A. Treves, and E. T. Rolls, Correlations and the encoding of information in the nervous system, Proc. R. Soc. London B 266, 1001 (1999).
  61. J. J. Atick, Could information theory provide an ecological theory of sensory processing? Network 3, 213 (1992).
  62. X. Pitkow and M. Meister, Decorrelation and efficient coding by retinal ganglion cells, Nat. Neurosci. 15, 628 (2012).
  63. https://github.com/gmahuas/noisecorr.
  64. J. de la Rocha, B. Doiron, E. Shea-Brown, K. Josić, and A. Reyes, Correlation between neural spike trains increases with firing rate, Nature (London) 448, 802 (2007).
  65. S. Trenholm, A. J. McLaughlin, D. J. Schwab, M. H. Turner, R. G. Smith, F. Rieke, and G. B. Awatramani, Nonlinear dendritic integration of electrical and chemical synaptic inputs drives fine-scale correlations, Nat. Neurosci. 17, 1759 (2014).

Outline

Information

PRX Life 3, 033012– Published 14 August, 2025
  • Received 12 March 2025
  • Accepted 30 July 2025
Crossmark - Check for updates button
Creative Commons Logo

Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.

Published by the American Physical Society

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation