Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

One Nose but Two Nostrils: Learning to Align with Sparse Connections between Two Olfactory Cortices

Bo Liu1,2, Shanshan Qin3,*, Venkatesh N. Murthy1,2,†, and Yuhai Tu4,‡

  • 1Center for Brain Science and Department of Molecular and Cellular Biology, Harvard University, Cambridge, Massachusetts 02138, USA
  • 2Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University, Cambridge, Massachusetts 02138, USA
  • 3John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts 02138, USA
  • 4IBM Thomas J. Watson Research Center, Yorktown Heights, New York 10598, USA

  • *Present address: Center for Computational Neuroscience, Flatiron Institute, New York, New York 10010, USA.
  • †Contact author: vnmurthy@fas.harvard.edu
  • ‡Contact author: yuhai@us.ibm.com

PRX Life 2, 043016 – Published 2 December, 2024

DOI: https://doi.org/10.1103/PRXLife.2.043016

Abstract

The integration of neural representations in the two brain hemispheres has been studied extensively in vision, audition, and somatosensation, but less so in olfaction. Recent experiments have revealed that odor responses in cortical neurons driven by separate stimulation of the two nostrils are highly correlated. This bilateral alignment points to structured, nonrandom interhemispheric connections, but how this structure leads to alignment is unclear. Here, we hypothesized that continuous exposure to environmental odors shapes these projections and modeled it as online learning with a local Hebbian rule. We found that Hebbian learning with sparse connections achieves bilateral alignment, exhibiting a linear tradeoff between speed and accuracy (lower learning rate leads to higher alignment level but slower convergence). Furthermore, we identified an inverse scaling relationship between the number of cortical neurons and the interhemispheric projection density required for desired alignment accuracy. Thus, more cortical neurons allow sparser interhemispheric projections, which was explained analytically. We next compared the alignment performance of local Hebbian rule and the global stochastic gradient descent (SGD) learning rule used in artificial neural networks. We found that although SGD leads to the same alignment accuracy with a slightly reduced sparsity, the same inverse scaling relation holds. Our analysis showed that their similar performance originates from the fact that the update vectors of the two learning rules align with each other throughout the entire learning process. Our work suggests that a biologically plausible mechanism with sparse connections suffices for correlated bilateral responses. The quantitative comparison between the local Hebbian rule and the global SGD rule may inspire efficient sparse local learning algorithms for more complex problems.

View figure in article

Physics Subject Headings (PhySH)

Article Text

Supplemental Material

References (83)

  1. B. Grothe and M. Pecka, The natural history of sound localization in mammals-A story of neuronal inhibition, Front. Neural Circuits 8, 116 (2014).
  2. D. McAlpine, Binaural pathways and processing, in Encyclopedia of Neuroscience, edited by M. D. Binder, N. Hirokawa, and U. Windhorst (Springer, Berlin, Heidelberg, 2009), pp. 383–388.
  3. R. Blake and R. Fox, The psychophysical inquiry into binocular summation, Percept. Psychophys. 14, 161 (1973).
  4. B. G. Cumming and G. C. DeAngelis, The physiology of stereopsis, Annu. Rev. Neurosci. 24, 203 (2001).
  5. R. Rajan, J. P. Clement, and U. S. Bhalla, Rats smell in stereo, Science 311, 666 (2006).
  6. J. Porter, T. Anand, B. Johnson, R. M. Khan, and N. Sobel, Brain mechanisms for extracting spatial information from smell, Neuron 47, 581 (2005).
  7. J. D. Mainland, E. A. Bremner, N. Young, B. N. Johnson, R. M. Khan, M. Bensafi, and N. Sobel, One nostril knows what the other learns, Nature (London) 419, 802 (2002).
  8. J. E. Rabell, K. Mutlu, J. Noutel, P. M. Del Olmo, and S. Haesler, Spontaneous rapid odor source localization behavior requires interhemispheric communication, Curr. Biol. 27, 1542 (2017).
  9. T. Dalal, N. Gupta, and R. Haddad, Bilateral and unilateral odor processing and odor perception, Commun. Biol. 3, 150 (2020).
  10. S. Kikuta, H. Kashiwadani, and K. Mori, Compensatory rapid switching of binasal inputs in the olfactory cortex, J. Neurosci. 28, 11989 (2008).
  11. D. A. Wilson and R. M. Sullivan, Respiratory airflow pattern at the rat's snout and an hypothesis regarding its role in olfaction, Physiol. Behav. 66, 41 (1999).
  12. R. Eccles, Nasal airflow in health and disease, Acta Oto-Laryngol. 120, 580 (2000).
  13. K. C. Catania, Stereo and serial sniffing guide navigation to an odour source in a mammal, Nat. Commun. 4, 1441 (2013).
  14. D. H. Gire, V. Kapoor, A. Arrighi-Allisan, A. Seminara, and V. N. Murthy, Mice develop efficient strategies for foraging and navigation using complex natural stimuli, Curr. Biol. 26, 1261 (2016).
  15. U. Bhattacharyya and U. S. Bhalla, Robust and rapid air-borne odor tracking without casting, Eneuro 2, ENEURO.0102-15.2015 (2015).
  16. T. M. Findley, D. G. Wyrick, J. L. Cramer, M. A. Brown, B. Holcomb, R. Attey, D. Yeh, E. Monasevitch, N. Nouboussi, I. Cullen et al., Sniff-synchronized, gradient-guided olfactory search by freely moving mice, Elife 10, e58523 (2021).
  17. Y. Wu, K. Chen, Y. Ye, T. Zhang, and W. Zhou, Humans navigate with stereo olfaction, Proc. Natl. Acad. Sci. 117, 16065 (2020).
  18. D. Kucharski and W. Hall, New routes to early memories, Science 238, 786 (1987).
  19. D. Kucharski, N. Burka, and W. Hall, The anterior limb of the anterior commissure is an access route to contralateral stored olfactory preference memories, Psychobiology 18, 195 (1990).
  20. P. C. Brunjes, K. R. Illig, and E. A. Meyer, A field guide to the anterior olfactory nucleus (cortex), Brain Res. Rev. 50, 305 (2005).
  21. S. Kikuta, K. Sato, H. Kashiwadani, K. Tsunoda, T. Yamasoba, and K. Mori, Neurons in the anterior olfactory nucleus pars externa detect right or left localization of odor sources, Proc. Natl. Acad. Sci. USA 107, 12363 (2010).
  22. D. A. Wilson, Binaral interactions in the rat piriform cortex, J. Neurophysiol. 78, 160 (1997).
  23. Z. Yan, J. Tan, C. Qin, Y. Lu, C. Ding, and M. Luo, Precise circuitry links bilaterally symmetric olfactory maps, Neuron 58, 613 (2008).
  24. A. Hagiwara, S. K. Pal, T. F. Sato, M. Wienisch, and V. N. Murthy, Optophysiological analysis of associational circuits in the olfactory cortex, Front. Neural Circuits 6, 18 (2012).
  25. L. B. Haberly and J. L. Price, Association and commissural fiber systems of the olfactory cortex of the rat, I. Systems originating in the piriform cortex and adjacent areas, J. Comp. Neurol. 178, 711 (1978).
  26. M. J. Russo, K. M. Franks, R. Oghaz, R. Axel, and S. A. Siegelbaum, Synaptic organization of anterior olfactory nucleus inputs to piriform cortex, J. Neurosci. 40, 9414 (2020).
  27. E. Martin-Lopez, S. J. Meller, and C. A. Greer, Development of piriform cortex interhemispheric connections via the anterior commissure: Progressive and regressive strategies, Brain Struct. Funct. 223, 4067 (2018).
  28. G. N. Dikeçligil, A. I. Yang, N. Sanghani, T. Lucas, H. I. Chen, K. A. Davis, and J. A. Gottfried, Odor representations from the two nostrils are temporally segregated in human piriform cortex, Curr. Biol. 33, 5275 (2023).
  29. L. B. Haberly, Parallel-distributed processing in olfactory cortex: New insights from morphological and physiological analysis of neuronal circuitry, Chem. Senses 26, 551 (2001).
  30. D. L. Sosulski, M. L. Bloom, T. Cutforth, R. Axel, and S. R. Datta, Distinct representations of olfactory information in different cortical centres, Nature (London) 472, 213 (2011).
  31. K. Miyamichi, F. Amat, F. Moussavi, C. Wang, I. Wickersham, N. R. Wall, H. Taniguchi, B. Tasic, Z. J. Huang, Z. He et al., Cortical representations of olfactory input by trans-synaptic tracing, Nature (London) 472, 191 (2011).
  32. S. Ghosh, S. D. Larson, H. Hefzi, Z. Marnoy, T. Cutforth, K. Dokka, and K. K. Baldwin, Sensory maps in the olfactory cortex defined by long-range viral tracing of single neurons, Nature (London) 472, 217 (2011).
  33. E. S. Schaffer, D. D. Stettler, D. Kato, G. B. Choi, R. Axel, and L. Abbott, Odor perception on the two sides of the brain: Consistency despite randomness, Neuron 98, 736 (2018).
  34. A. Celani, E. Villermaux, and M. Vergassola, Odor landscapes in turbulent environments, Phys. Rev. X 4, 041015 (2014).
  35. G. Reddy, V. N. Murthy, and M. Vergassola, Olfactory sensing and navigation in turbulent environments, Annu. Rev. Condens. Matter Phys. 13, 191 (2022).
  36. J. Grimaud, W. Dorrell, S. Jayakumar, C. Pehlevan, and V. Murthy, Bilateral alignment of receptive fields in the olfactory cortex, eNeuro 11, ENEURO.0155-24.2024 (2024).
  37. S. Srinivasan and C. F. Stevens, Scaling principles of distributed circuits, Curr. Biol. 29, 2533 (2019).
  38. B. G. Cragg, The density of synapses and neurones in the motor and visual areas of the cerebral cortex, J. Anat. 101, 639 (1967).
  39. A. Schüz and G. Palm, Density of neurons and synapses in the cerebral cortex of the mouse, J. Comp. Neurol. 286, 442 (1989).
  40. L. Wang, Z. Zhang, J. Chen, A. Manyande, R. Haddad, Q. Liu, and F. Xu, Cell-type-specific whole-brain direct inputs to the anterior and posterior piriform cortex, Front. Neural Circuits 14, 4 (2020).
  41. V. N. Murthy, Olfactory maps in the brain, Annu. Rev. Neurosci. 34, 233 (2011).
  42. N. Uchida, C. Poo, and R. Haddad, Coding and transformations in the olfactory system, Annu. Rev. Neurosci. 37, 363 (2014).
  43. B. Babadi and H. Sompolinsky, Sparseness and expansion in sensory representations, Neuron 83, 1213 (2014).
  44. See Supplemental Material at http://link.aps.org/supplemental/10.1103/PRXLife.2.043016 for the derivations and methods (Secs. I - IX), parameters (Table I), and Figs. S1 - S12.
  45. G. E. Uhlenbeck and L. S. Ornstein, On the theory of the Brownian motion, Phys. Rev. 36, 823 (1930).
  46. S. Srinivasan and C. F. Stevens, The distributed circuit within the piriform cortex makes odor discrimination robust, J. Comp. Neurol. 526, 2725 (2018).
  47. M. B. Richard, S. R. Taylor, and C. A. Greer, Age-induced disruption of selective olfactory bulb synaptic circuits, Proc. Natl. Acad. Sci. 107, 15613 (2010).
  48. J. M. Bekkers and N. Suzuki, Neurons and circuits for odor processing in the piriform cortex, Trends Neurosci. 36, 429 (2013).
  49. H. Mizuno, T. Hirano, and Y. Tagawa, Evidence for activity-dependent cortical wiring: Formation of interhemispheric connections in neonatal mouse visual cortex requires projection neuron activity, J. Neurosci. 27, 6760 (2007).
  50. R. Suarez, L. R. Fenlon, R. Marek, L. Avitan, P. Sah, G. J. Goodhill, and L. J. Richards, Balanced interhemispheric cortical activity is required for correct targeting of the corpus callosum, Neuron 82, 1289 (2014).
  51. K.-S. Lee, K. Vandemark, D. Mezey, N. Shultz, and D. Fitzpatrick, Functional synaptic architecture of callosal inputs in mouse primary visual cortex, Neuron 101, 421 (2019).
  52. A. Caputi, X. Liu, E. C. Fuchs, Y.-C. Liu, and H. Monyer, Medial entorhinal cortex commissural input regulates the activity of spatially and object-tuned cells contributing to episodic memory, Neuron 110, 3389 (2022).
  53. N. Li, K. Daie, K. Svoboda, and S. Druckmann, Robust neuronal dynamics in premotor cortex during motor planning, Nature (London) 532, 459 (2016).
  54. G. Chen, B. Kang, J. Lindsey, S. Druckmann, and N. Li, Modularity and robustness of frontal cortical networks, Cell 184, 3717 (2021).
  55. H. K. Inagaki, L. Fontolan, S. Romani, and K. Svoboda, Discrete attractor dynamics underlies persistent activity in the frontal cortex, Nature (London) 566, 212 (2019).
  56. T. P. Lillicrap, D. Cownden, D. B. Tweed, and C. J. Akerman, Random synaptic feedback weights support error backpropagation for deep learning, Nat. Commun. 7, 13276 (2016).
  57. A. Nøkland, Direct feedback alignment provides learning in deep neural networks, NIPS'16: Proceedings of the 30th International Conference on Neural Information Processing Systems (ACM, New York, 2016), pp. 1045–1053.
  58. M. Refinetti, S. D'Ascoli, R. Ohana, and S. Goldt, Align, then memorise: The dynamics of learning with feedback alignment, in International Conference on Machine Learning (PMLR, 2021), Vol. 139, pp. 8925–8935.
  59. J. Launay, I. Poli, and F. Krzakala, Principled training of neural networks with direct feedback alignment, arXiv:1906.04554.
  60. D. Meunier, R. Lambiotte, and E. T. Bullmore, Modular and hierarchically modular organization of brain networks, Front. Neurosci. 4, 200 (2010).
  61. L. Pessoa, Understanding brain networks and brain organization, Phys. Life Rev. 11, 400 (2014).
  62. Sietsma and Dow, Neural net pruning—Why and how, in IEEE 1988 International Conference on Neural Networks (IEEE, Piscataway, NJ, 1988), pp. 325–333.
  63. Y. LeCun, J. Denker, and S. Solla, Optimal brain damage, Advances in Neural Information Processing Systems 2 (NIPS 1989) (ACM, New York, NY, 1989).
  64. B. Hassibi and D. G. Stork, Second order derivatives for network pruning: Optimal brain surgeon, Advances in Neural Information Processing Systems (ACM, New York, NY, 1992), Vol. 5.
  65. R. Reed, Pruning algorithms-a survey, IEEE Trans. Neural Networks 4, 740 (1993).
  66. S. Han, J. Pool, J. Tran, and W. Dally, Learning both weights and connections for efficient neural network, Advances in Neural Information Processing Systems (ACM, New York, NY, 2015), Vol. 28.
  67. J. Frankle and M. Carbin, The lottery ticket hypothesis: Finding sparse, trainable neural networks, arXiv:1803.03635.
  68. T. Hoefler, D. Alistarh, T. Ben-Nun, N. Dryden, and A. Peste, Sparsity in deep learning: Pruning and growth for efficient inference and training in neural networks, J. Mach. Learn. Res. 22, 1 (2021).
  69. X. Ma, G. Fang, and X. Wang, LLM-Pruner: On the structural pruning of large language models, Advances in Neural Information Processing Systems (ACM, New York, NY, 2023).
  70. M. Sun, Z. Liu, A. Bair, and J. Z. Kolter, A simple and effective pruning approach for large language models, arXiv:2306.11695.
  71. M. Xia, T. Gao, Z. Zeng, and D. Chen, Sheared LLaMA: Accelerating language model pre-training via structured pruning, arXiv:2310.06694.
  72. B. Liu and Y. Xu, Sparsity limit to prune large language models for on-device AI assistants: Llama-2 as an example, Preprints 202407.1568.v2 (2024).
  73. B. Liu, Comparing sparse Llama 3 and Llama 2 models for on-device AI assistants, Research Square rs.3.rs-4927672/v2 (2024).
  74. L. Ma, Q. Qiu, S. Gradwohl, A. Scott, E. Q. Yu, R. Alexander, W. Wiegraebe, and C. R. Yu, Distributed representation of chemical features and tunotopic organization of glomeruli in the mouse olfactory bulb, Proc. Natl. Acad. Sci. 109, 5481 (2012).
  75. J. C. Eccles, From electrical to chemical transmission in the central nervous system: The closing address of the Sir Henry Dale Centennial Symposium Cambridge, 19 September 1975, Notes Rec. R. Soc. Lond. 30, 219 (1976).
  76. K. M. Franks, M. J. Russo, D. L. Sosulski, A. A. Mulligan, S. A. Siegelbaum, and R. Axel, Recurrent circuitry dynamically shapes the activation of piriform cortex, Neuron 72, 49 (2011).
  77. M. Stern, K. A. Bolding, L. Abbott, and K. M. Franks, A transformation from temporal to ensemble coding in a model of piriform cortex, eLife 7, e34831 (2018).
  78. C. Poo and J. S. Isaacson, Odor representations in olfactory cortex: “Sparse” coding, global inhibition, and oscillations, Neuron 62, 850 (2009).
  79. Y. Chen, X. Chen, B. Baserdem, H. Zhan, Y. Li, M. B. Davis, J. M. Kebschull, A. M. Zador, A. A. Koulakov, and D. F. Albeanu, High-throughput sequencing of single neuron projections reveals spatial organization in the olfactory cortex, Cell 185, 4117 (2022).
  80. J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proc. Natl. Acad. Sci. 79, 2554 (1982).
  81. L. B. Haberly and J. M. Bower, Olfactory cortex: Model circuit for study of associative memory? Trends Neurosci. 12, 258 (1989).
  82. K. A. Bolding, S. Nagappan, B.-X. Han, F. Wang, and K. M. Franks, Recurrent circuitry is required to stabilize piriform cortex odor representations across brain states, Elife 9, e53125 (2020).
  83. S. L. Pashkovski, G. Iurilli, D. Brann, D. Chicharro, K. Drummey, K. M. Franks, S. Panzeri, and S. R. Datta, Structure and flexibility in cortical representations of odour space, Nature (London) 583, 253 (2020).

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation