- Open Access
Low-Dimensional Coexistence in Complex Microbial Ecosystems
PRX Life 4, 033026 – Published 15 September, 2026
DOI: https://doi.org/10.1103/rtht-q5dr
Abstract
The statistical physics view of microbial ecosystems often invokes random unstructured interactions, consistent with bacterial coexistence in very high-dimensional niche spaces. While this approach successfully reproduces broad community-level statistics, its central assumption of high-dimensional coexistence remains untested due to a lack of direct empirical estimates. Here we evaluate this assumption by inferring the effective niche dimensionality directly from abundance profile data using a joint species distribution model, a nonlinear low-rank matrix factorization approach. The inferred niche dimensionality, , tracks ecological expectations: It correlates significantly with the dimensionality of the metabolic environment across paired 16S-metabolomics datasets, supporting the abundance-only inference. Applying this framework across nearly 200 human gut microbiome studies, we find that the inferred dimensionality is consistently low (median ), markedly lower than median predicted by diversity-matched disordered consumer-resource models, directly contradicting the high-dimensional assumption underlying current theoretical models. Low dimensionality was associated with stronger interspecies competition and reduced biodiversity, consistent with the long-standing macroecological predictions. Consumer-resource simulations reproduced these empirical relationships only when extrinsic resource availability trade-offs were imposed, with species-intrinsic metabolic trade-offs contributing an additional reduction in the effective dimensionality. Together, our results challenge the high-dimensional assumption underlying current physics-based descriptions of microbiomes and identify low-dimensional coexistence as an essential feature of host associated microbiomes.
Physics Subject Headings (PhySH)
Article Text
References (114)
- P. J. Turnbaugh, R. E. Ley, M. Hamady, C. M. Fraser-Liggett, R. Knight, and J. I. Gordon, The human microbiome project, Nature (London) 449, 804 (2007).
- A. K. Nash, T. A. Auchtung, M. C. Wong, D. P. Smith, J. R. Gesell, M. C. Ross, C. J. Stewart, G. A. Metcalf, D. M. Muzny, R. A. Gibbs, et al., The gut mycobiome of the human microbiome project healthy cohort, Microbiome 5, 153 (2017).
- E. Schneidman, M. J. Berry, R. Segev, and W. Bialek, Weak pairwise correlations imply strongly correlated network states in a neural population, Nature (London) 440, 1007 (2006).
- W. Bialek, A. Cavagna, I. Giardina, T. Mora, E. Silvestri, M. Viale, and A. M. Walczak, Statistical mechanics for natural flocks of birds, Proc. Natl. Acad. Sci. USA 109, 4786 (2012).
- S. Cocco, C. Feinauer, M. Figliuzzi, R. Monasson, and M. Weigt, Inverse statistical physics of protein sequences: A key issues review, Rep. Prog. Phys. 81, 032601 (2018).
- K. Z. Coyte, J. Schluter, and K. R. Foster, The ecology of the microbiome: Networks, competition, and stability, Science 350, 663 (2015).
- M. Tikhonov and R. Monasson, Collective phase in resource competition in a highly diverse ecosystem, Phys. Rev. Lett. 118, 048103 (2017).
- R. Marsland, III, W. Cui, and P. Mehta, A minimal model for microbial biodiversity can reproduce experimentally observed ecological patterns, Sci. Rep. 10, 3308 (2020).
- W. Cui, R. Marsland III, and P. Mehta, Diverse communities behave like typical random ecosystems, Phys. Rev. E 104, 034416 (2021).
- J. Hu, D. R. Amor, M. Barbier, G. Bunin, and J. Gore, Emergent phases of ecological diversity and dynamics mapped in microcosms, Science 378, 85 (2022).
- P.-Y. Ho, B. H. Good, and K. C. Huang, Competition for fluctuating resources reproduces statistics of species abundance over time across wide-ranging microbiotas, eLife 11, e75168 (2022).
- J. Pasqualini, A. Maritan, A. Rinaldo, S. Facchin, E. V. Savarino, A. Altieri, and S. Suweis, Linking complex microbial interactions and dysbiosis through a disordered Lotka–Volterra model, eLife 14, RP105948 (2026).
- X.-W. Wang and Y.-Y. Liu, Origins of scaling laws in microbial dynamics, Phys. Rev. Res. 5, 013004 (2023).
- J. Camacho-Mateu, A. Lampo, M. Sireci, M. A. Muñoz, and J. A. Cuesta, Sparse species interactions reproduce abundance correlation patterns in microbial communities, Proc. Natl. Acad. Sci. USA 121, e2309575121 (2024).
- R. Maskawa, H. Takayasu, L. Takayasu, W. Suda, and M. Takayasu, Stochastic spatiotemporal growth model reproducing the universal statistical laws of the gut microbiome, Phys. Rev. Res. 7, 013269 (2025).
- G. E. Hutchinson, Concluding remarks, Cold Spring Harb. Symp. Quant. Biol. 22, 415 (1957).
- R. Macarthur and R. Levins, The limiting similarity, convergence, and divergence of coexisting species, Am. Nat. 101, 377 (1967).
- J. M. Chase and M. A. Leibold, Ecological Niches: Linking Classical and Contemporary Approaches (University of Chicago Press, Chicago, 2009).
- M. Leibold and V. F. Frans, Re-revisiting the niche concept, EcoEvoRixv (2025).
- R. D. Holt, Bringing the Hutchinsonian niche into the 21st century: Ecological and evolutionary perspectives, Proc. Natl. Acad. Sci. USA 106, 19659 (2009).
- H. K. Swanson, M. Lysy, M. Power, A. D. Stasko, J. D. Johnson, and J. D. Reist, A new probabilistic method for quantifying n-dimensional ecological niches and niche overlap, Ecology 96, 318 (2015).
- B. Blonder, C. B. Morrow, B. Maitner, D. J. Harris, C. Lamanna, C. Violle, B. J. Enquist, and A. J. Kerkhoff, New approaches for delineating n-dimensional hypervolumes, Methods Ecol. Evol. 9, 305 (2018).
- E. R. Pianka, Niche overlap and diffuse competition, Proc. Natl. Acad. Sci. USA 71, 2141 (1974).
- H. J. Morowitz, The dimensionality of niche space, J. Theor. Biol. 86, 259 (1980).
- R. H. MacArthur, Geographical Ecology: Patterns in the Distribution of Species (Princeton University Press, Princeton, NJ, 1984).
- R. MacArthur, Species packing and competitive equilibrium for many species, Theor. Popul Biol. 1, 1 (1970).
- R. M. Yoshiyama and J. Roughgarden, Species packing in two dimensions, Am. Nat. 111, 107 (1977).
- C. Rappoldt and P. Hogeweg, Niche packing and number of species, Am. Nat. 116, 480 (1980).
- T. J. Case, Niche packing and coevolution in competition communities, Proc. Natl. Acad. Sci. USA 78, 5021 (1981).
- E. R. Pianka, The structure of lizard communities, Annu. Rev. Ecol. Syst. 4, 53 (1973).
- R. Costa-Pereira, M. S. Araújo, F. L. Souza, and T. Ingram, Competition and resource breadth shape niche variation and overlap in multiple trophic dimensions, Proc. R. Soc. B 286, 20190369 (2019).
- W. S. Harpole and D. Tilman, Grassland species loss resulting from reduced niche dimension, Nature (London) 446, 791 (2007).
- W. S. Harpole, L. L. Sullivan, E. M. Lind, J. Firn, P. B. Adler, E. T. Borer, J. Chase, P. A. Fay, Y. Hautier, H. Hillebrand, et al., Addition of multiple limiting resources reduces grassland diversity, Nature (London) 537, 93 (2016).
- E. T. Borer, J. B. Grace, W. S. Harpole, A. S. MacDougall, and E. W. Seabloom, A decade of insights into grassland ecosystem responses to global environmental change, Nat. Ecol. Evol. 1, 0118 (2017).
- N. Eisenhauer, W. Schulz, S. Scheu, and A. Jousset, Niche dimensionality links biodiversity and invasibility of microbial communities, Funct. Ecol. 27, 282 (2013).
- P. Nosil and C. P. Sandoval, Ecological niche dimensionality and the evolutionary diversification of stick insects, PLoS ONE 3, e1907 (2008).
- M. J. Larcombe, G. J. Jordan, D. Bryant, and S. I. Higgins, The dimensionality of niche space allows bounded and unbounded processes to jointly influence diversification, Nat. Commun. 9, 4258 (2018).
- L.-M. Chevin, G. Decorzent, and T. Lenormand, Niche dimensionality and the genetics of ecological speciation, Evolution 68, 1244 (2014).
- J. E. Cohen, Food webs and the dimensionality of trophic niche space, Proc. Natl. Acad. Sci. USA 74, 4533 (1977).
- A. G. Rossberg, Food Webs and Biodiversity: Foundations, Models, Data (John Wiley & Sons, New York, 2013).
- R. J. Williams and D. W. Purves, The probabilistic niche model reveals substantial variation in the niche structure of empirical food webs, Ecology 92, 1849 (2011).
- A. Eklöf, U. Jacob, J. Kopp, J. Bosch, R. Castro-Urgal, N. P. Chacoff, B. Dalsgaard, C. de Sassi, M. Galetti, P. R. Guimarães, et al., The dimensionality of ecological networks, Ecol. Lett. 16, 577 (2013).
- D. B. Stouffer, O. Godoy, G. V. Dalla Riva, and M. M. Mayfield, The dimensionality of plant–plant competition, bioRxiv (2021).
- D. C. Laughlin, The intrinsic dimensionality of plant traits and its relevance to community assembly, J. Ecol. 102, 186 (2014).
- O. Ovaskainen and N. Abrego, Joint Species Distribution Modelling: With Applications in R (Cambridge University Press, Cambridge, UK, 2020).
- L. J. Pollock, R. Tingley, W. K. Morris, N. Golding, R. B. O'Hara, K. M. Parris, P. A. Vesk, and M. A. McCarthy, Understanding co-occurrence by modelling species simultaneously with a joint species distribution model (JSDM), Methods Ecol. Evol. 5, 397 (2014).
- F. K. C. Hui, S. Taskinen, S. Pledger, S. D. Foster, and D. I. Warton, Model-based approaches to unconstrained ordination, Methods Ecol. Evol. 6, 399 (2015).
- D. I. Warton, F. G. Blanchet, R. B. O'Hara, O. Ovaskainen, S. Taskinen, S. C. Walker, and F. K. C. Hui, So many variables: Joint modeling in community ecology, Trends Ecol. Evol. 30, 766 (2015).
- C. K. Fisher, T. Mora, and A. M. Walczak, Variable habitat conditions drive species covariation in the human microbiota, PLoS Comput. Biol. 13, e1005435 (2017).
- M. Shahin, B. Ji, and P. D. Dixit, Embed: Essential microbiome dynamics, a dimensionality reduction approach for longitudinal microbiome studies, npj Syst. Biol. Appl. 9, 26 (2023).
- G. Plata, K. Srinivasan, M. Krishnamurthy, L. Herron, and P. Dixit, Designing host-associated microbiomes using the consumer/resource model, mSystems 10, e01068-24 (2025).
- D. J. Schwab, I. Nemenman, and P. Mehta, Zipf's law and criticality in multivariate data without fine-tuning, Phys. Rev. Lett. 113, 068102 (2014).
- V. Thibeault, A. Allard, and P. Desrosiers, The low-rank hypothesis of complex systems, Nat. Phys. 20, 294 (2024).
- C. J. Russo, K. Husain, and A. Murugan, Soft modes as a predictive framework for low-dimensional biological systems across scales, Annu. Rev. Biophys. 54, 401 (2025).
- M. C. Morrell, A. J. Sederberg, and I. Nemenman, Latent dynamical variables produce signatures of spatiotemporal criticality in large biological systems, Phys. Rev. Lett. 126, 118302 (2021).
- X. Zhao, G. Plata, and P. D. Dixit, Sigmoid: A super-statistical generative model for binary data, PLoS Comput. Biol. 17, e1009275 (2021).
- H. Akl, B. Emison, X. Zhao, A. Mondal, A. Perez, and P. D. Dixit, Generalist: A latent space based generative model for protein sequence families, PLoS Comput. Biol. 19, e1011655 (2023).
- E. Muller, Y. M. Algavi, and E. Borenstein, The gut microbiome-metabolome dataset collection: A curated resource for integrative meta-analysis, npj Biofilms Microb. 8, 79 (2022).
- R. J. Abdill, S. P. Graham, V. Rubinetti, M. Ahmadian, P. Hicks, A. Chetty, D. McDonald, P. Ferretti, E. Gibbons, M. Rossi, et al., Integration of 168,000 samples reveals global patterns of the human gut microbiome, Cell 188, 1100 (2025).
- D. Tilman, Resource Competition and Community Structure (Princeton University Press, Princeton, NJ, 1982).
- I. Veseli, Y. T. Chen, M. S. Schechter, C. Vanni, E. C. Fogarty, A. R. Watson, B. Jabri, R. Blekhman, A. D. Willis, M. K. Yu, et al., Microbes with higher metabolic independence are enriched in human gut microbiomes under stress, eLife 12, RP89862 (2025).
- D. Vandeputte, G. Kathagen, K. D'hoe, S. Vieira-Silva, M. Valles-Colomer, J. Sabino, J. Wang, R. Y. Tito, L. De Commer, Y. Darzi, et al., Quantitative microbiome profiling links gut community variation to microbial load, Nature (London) 551, 507 (2017).
- C. Fraser, E. J. Alm, M. F. Polz, B. G. Spratt, and W. P. Hanage, The bacterial species challenge: Making sense of genetic and ecological diversity, Science 323, 741 (2009).
- P. D. Dixit, T. Y. Pang, and S. Maslov, Recombination-driven genome evolution and stability of bacterial species, Genetics 207, 281 (2017).
- B. J. Callahan, P. J. McMurdie, and S. P. Holmes, Exact sequence variants should replace operational taxonomic units in marker-gene data analysis, ISME J. 11, 2639 (2017).
- M. Blaxter, J. Mann, T. Chapman, F. Thomas, C. Whitton, R. Floyd, and E. Abebe, Defining operational taxonomic units using DNA barcode data, Philos. Trans. R. Soc. B 360, 1935 (2005).
- D. Gevers, F. M. Cohan, J. G. Lawrence, B. G. Spratt, T. Coenye, E. J. Feil, E. Stackebrandt, Y. V. De Peer, P. Vandamme, F. L. Thompson, et al., Re-evaluating prokaryotic species, Nat. Rev. Microbiol. 3, 733 (2005).
- M. Dal Bello, H. Lee, A. Goyal, and J. Gore, Resource–diversity relationships in bacterial communities reflect the network structure of microbial metabolism, Nat. Ecol. Evol. 5, 1424 (2021).
- P.-Y. Ho, T. H. Nguyen, J. M. Sanchez, B. C. DeFelice, and K. C. Huang, Resource competition predicts assembly of gut bacterial communities in vitro, Nat. Microbiol. 9, 1036 (2024).
- A. Heinken, J. Hertel, G. Acharya, D. A. Ravcheev, M. Nyga, O. E. Okpala, M. Hogan, S. Magnúsdóttir, F. Martinelli, B. Nap, et al., Genome-scale metabolic reconstruction of 7,302 human microorganisms for personalized medicine, Nat. Biotechnol. 41, 1320 (2023).
- J. D. Orth, I. Thiele, and B. Ø. Palsson, What is flux balance analysis?. Nat. Biotechnol. 28, 245 (2010).
- G. Plata, C. S. Henry, and D. Vitkup, Long-term phenotypic evolution of bacteria, Nature (London) 517, 369 (2015).
- X. He, M. Parenti, T. Grip, B. Lönnerdal, N. Timby, M. Domellöf, O. Hernell, and C. M. Slupsky, Fecal microbiome and metabolome of infants fed bovine MFGM supplemented formula or standard formula with breast-fed infants as reference: A randomized controlled trial, Sci. Rep. 9, 11589 (2019).
- A. Mira, H. Ochman, and N. A. Moran, Deletional bias and the evolution of bacterial genomes, Trends Genet. 17, 589 (2001).
- M. Basan, S. Hui, H. Okano, Z. Zhang, Y. Shen, J. R. Williamson, and T. Hwa, Overflow metabolism in Escherichia coli results from efficient proteome allocation, Nature (London) 528, 99 (2015).
- A. Posfai, T. Taillefumier, and N. S. Wingreen, Metabolic trade-offs promote diversity in a model ecosystem, Phys. Rev. Lett. 118, 028103 (2017).
- R. Caetano, Y. Ispolatov, and M. Doebeli, Evolution of diversity in metabolic strategies, eLife 10, e67764 (2021).
- Z. R. Miller and J. P. O'Dwyer, Metabolic trade-offs can reverse the resource-diversity relationship, Am. Nat. 204, E85 (2024).
- E. Blumenthal and P. Mehta, Geometry of ecological coexistence and niche differentiation, Phys. Rev. E 108, 044409 (2023).
- K. L. Keller, J. Kirzner, A. Pietrobelli, M.-P. St-Onge, and M. S. Faith, Increased sweetened beverage intake is associated with reduced milk and calcium intake in 3-to 7-year-old children at multi-item laboratory lunches, J. Am. Diet. Assoc. 109, 497 (2009).
- A. B. Bontrager Yoder and D. A. Schoeller, Fruits and vegetables displace, but do not decrease, total energy in school lunches, Childhood Obesity 10, 357 (2014).
- J. A. Gilbert, M. J. Blaser, J. G. Caporaso, J. K. Jansson, S. V. Lynch, and R. Knight, Current understanding of the human microbiome, Nat. Med. 24, 392 (2018).
- R. N. Carmody, G. K. Gerber, J. M. Luevano, D. M. Gatti, L. Somes, K. L. Svenson, and P. J. Turnbaugh, Diet dominates host genotype in shaping the murine gut microbiota, Cell Host Microbe 17, 72 (2015).
- L. A. David, C. F. Maurice, R. N. Carmody, D. B. Gootenberg, J. E. Button, B. E. Wolfe, A. V. Ling, A. S. Devlin, Y. Varma, M. A. Fischbach, et al., Diet rapidly and reproducibly alters the human gut microbiome, Nature (London) 505, 559 (2014).
- J. P. Jacobs, M. Goudarzi, N. Singh, M. Tong, I. H. McHardy, P. Ruegger, M. Asadourian, B.-H. Moon, A. Ayson, J. Borneman, et al., A disease-associated microbial and metabolomics state in relatives of pediatric inflammatory bowel disease patients, Cell. Molec. Gastroenterol. Hepatol. 2, 750 (2016).
- E. A. Franzosa, A. Sirota-Madi, J. Avila-Pacheco, N. Fornelos, H. J. Haiser, S. Reinker, T. Vatanen, A. B. Hall, H. Mallick, L. J. McIver, et al., Gut microbiome structure and metabolic activity in inflammatory bowel disease, Nat. Microbiol. 4, 293 (2019).
- R. Sinha, J. Ahn, J. N. Sampson, J. Shi, G. Yu, X. Xiong, R. B. Hayes, and J. J. Goedert, Fecal microbiota, fecal metabolome, and colorectal cancer interrelations, PLoS ONE 11, e0152126 (2016).
- M. Kim, E. Vogtmann, D. A. Ahlquist, M. E. Devens, J. B. Kisiel, W. R. Taylor, B. A. White, V. L. Hale, J. Sung, N. Chia, et al., Fecal metabolomic signatures in colorectal adenoma patients are associated with gut microbiota and early events of colorectal cancer pathogenesis, MBio 11, e03186 (2020).
- S. Nishijima, E. Stankevic, O. Aasmets, T. S. B. Schmidt, N. Nagata, M. I. Keller, P. Ferretti, H. B. Juel, A. Fullam, S. M. Robbani, et al., Fecal microbial load is a major determinant of gut microbiome variation and a confounder for disease associations, Cell 188, 222 (2025).
- M. Barbier, C. de Mazancourt, M. Loreau, and G. Bunin, Fingerprints of high-dimensional coexistence in complex ecosystems, Phys. Rev. X 11, 011009 (2021).
- M. Leibold and M. Barbier, Disordered and partially structured models in community ecology: What are they? And how do we use them? EcoEvoRxiv (2025).
- N. J. B. Kraft, O. Godoy, and J. M. Levine, Plant functional traits and the multidimensional nature of species coexistence, Proc. Natl. Acad. Sci. USA 112, 797 (2015).
- J. S. Clark, D. Bell, C. Chu, B. Courbaud, M. Dietze, M. Hersh, J. HilleRisLambers, I. Ibášez, S. LaDeau, S. McMahon, et al., High-dimensional coexistence based on individual variation: A synthesis of evidence, Ecol. Monogr. 80, 569 (2010).
- J. E. Goldford, N. Lu, D. Bajić, S. Estrela, M. Tikhonov, A. Sanchez-Gorostiaga, D. Segrè, P. Mehta, and A. Sanchez, Emergent simplicity in microbial community assembly, Science 361, 469 (2018).
- M. Gralka, R. Szabo, R. Stocker, and O. X. Cordero, Trophic interactions and the drivers of microbial community assembly, Curr. Biol. 30, R1176 (2020).
- S. Estrela, J. Diaz-Colunga, J. C. C. Vila, A. Sanchez-Gorostiaga, and A. Sanchez, Diversity begets diversity under microbial niche construction, bioRxiv (2022).
- J. B. Losos, Phylogenetic niche conservatism, phylogenetic signal and the relationship between phylogenetic relatedness and ecological similarity among species, Ecol. Lett. 11, 995 (2008).
- M. Sireci, M. A. Muñoz, and J. Grilli, Environmental fluctuations explain the universal decay of species-abundance correlations with phylogenetic distance, Proc. Natl. Acad. Sci. USA 120, e2217144120 (2023).
- Y. Himeoka and N. Mitarai, Dynamics of bacterial populations under the feast-famine cycles, Phys. Rev. Res. 2, 013372 (2020).
- A. Zarrinpar, A. Chaix, S. Yooseph, and S. Panda, Diet and feeding pattern affect the diurnal dynamics of the gut microbiome, Cell Metab. 20, 1006 (2014).
- A. L. Koch, The adaptive responses of Escherichia coli to a feast and famine existence, in Advances in Microbial Physiology (Elsevier, Amsterdam, 1971), Vol. 6, pp. 147–217.
- S. P. Mizrahi, H. Lee, A. Goyal, E. Owen, and J. Gore, Structured interactions explain the absence of keystone species in synthetic microcosms, ISME J. 19, wraf211 (2025).
- G. Biroli, G. Bunin, and C. Cammarota, Marginally stable equilibria in critical ecosystems, New J. Phys. 20, 083051 (2018).
- F. Roy, G. Biroli, G. Bunin, and C. Cammarota, Numerical implementation of dynamical mean field theory for disordered systems: Application to the Lotka–Volterra model of ecosystems, J. Phys. A: Math. Theor. 52, 484001 (2019).
- D. G. Clark, L. F. Abbott, and A. Litwin-Kumar, Dimension of activity in random neural networks, Phys. Rev. Lett. 131, 118401 (2023).
- J. Bergelson, M. Kreitman, D. A. Petrov, A. Sanchez, and M. Tikhonov, Functional biology in its natural context: A search for emergent simplicity, eLife 10, e67646 (2021).
- J. Moran and M. Tikhonov, Emergent predictability in microbial ecosystems, arXiv:2403.19372.
- K. K. Lee, S. Liu, K. Crocker, J. Wang, D. R. Huggins, M. Tikhonov, M. Mani, and S. Kuehn, Functional regimes define soil microbiome response to environmental change, Nature (London), 644, 1028 (2025).
- D. R. Hekstra and S. Leibler, Contingency and statistical laws in replicate microbial closed ecosystems, Cell 149, 1164 (2012).
- A. V. Narla, T. Hwa, and A. Murugan, Dynamic coexistence driven by physiological transitions in microbial communities, Proc. Natl. Acad. Sci. USA 122, e2405527122 (2025).
- B. W. Ji, R. U. Sheth, P. D. Dixit, Y. Huang, A. Kaufman, H. H. Wang, and D. Vitkup, Quantifying spatiotemporal variability and noise in absolute microbiota abundances using replicate sampling, Nat. Methods 16, 731 (2019).
- P. Gao, E. Trautmann, B. Yu, G. Santhanam, S. Ryu, K. Shenoy, and S. Ganguli, A theory of multineuronal dimensionality, dynamics and measurement, bioRxiv (2017).
- O. Roy and M. Vetterli, The effective rank: A measure of effective dimensionality, in Proceedings of the 15th European Signal Processing Conference (IEEE, New York, 2007), pp. 606–610.
- R. Marsland, W. Cui, J. Goldford, and P. Mehta, The community simulator: A Python package for microbial ecology, PLoS ONE 15, e0230430 (2020).