- Physical Review Journals
All JournalsPhysics Magazine

Physical Review Research

Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Letter
  • Open Access

Loss of material trainability through an unusual transition

Himangsu Bhaumik and Daniel Hexner*

  • Faculty of Mechanical Engineering, Technion, 320000 Haifa, Israel

  • *danielhe@me.technion.ac.il
PDF

Phys. Rev. Research 4, L042044 – Published 12 December, 2022

DOI: https://doi.org/10.1103/PhysRevResearch.4.L042044

Abstract

Material training is a method to endow materials with specific responses through external driving. We study the complexity of attainable responses, as expressed in the number of sites that are simultaneously controlled. With increased complexity, convergence to the desired response becomes very slow. The training error decays as a power law with an exponent that varies continuously and vanishes at a critical threshold, marking the limit of trainable responses. We study how the transition affects the vibrational properties. Approaching the critical threshold, low-frequency modes proliferate, approaching zero frequency. This implies that training causes material degradation and that training fails due to competing spurious low-frequency modes. We propose that the excess low-frequency spectrum is due to atypical local structures with bonds that nearly align. Our work explains how the presence of an exotic critical point affects the convergence of training, and could be relevant for understanding learning in physical systems.

View figure in article

Physics Subject Headings (PhySH)

Article Text

Supplemental Material

References (39)

  1. B. Barzel and A.-L. Barabási, Universality in network dynamics, Nat. Phys. 9, 673 (2013).
  2. D. S. Bassett and O. Sporns, Network neuroscience, Nat. Neurosci. 20, 353 (2017).
  3. S. B. Kotsiantis, Supervised machine learning: A review of classification techniques, in Emerging Artificial Intelligence Applications in Computer Engineering, edited by I. Maglogiannis, K. Karpouzis, B. A. Wallace, and J. Soldatos, Frontiers in Artificial Intelligence and Applications (IOS Press, Amsterdam, 2007), Vol. 160 , p. 3.
  4. P. Mehta, M. Bukov, C.-H. Wang, A. G. Day, C. Richardson, C. K. Fisher, and D. J. Schwab, A high-bias, low-variance introduction to machine learning for physicists, Phys. Rep. 810, 1 (2019).
  5. J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proc. Natl. Acad. Sci. USA 79, 2554 (1982).
  6. E. H. Davidson, The Regulatory Genome: Gene Regulatory Networks in Development and Evolution (Elsevier, Amsterdam, 2010).
  7. M. R. Mitchell, T. Tlusty, and S. Leibler, Strain analysis of protein structures and low dimensionality of mechanical allosteric couplings, Proc. Natl. Acad. Sci. USA 113, E5847 (2016).
  8. J. W. Rocks, N. Pashine, I. Bischofberger, C. P. Goodrich, A. J. Liu, and S. R. Nagel, Designing allostery-inspired response in mechanical networks, Proc. Natl. Acad. Sci. USA 114, 2520 (2017).
  9. L. Yan, R. Ravasio, C. Brito, and M. Wyart, Architecture and coevolution of allosteric materials, Proc. Natl. Acad. Sci. USA 114, 2526 (2017).
  10. J. W. Rocks, H. Ronellenfitsch, A. J. Liu, S. R. Nagel, and E. Katifori, Limits of multifunctionality in tunable networks, Proc. Natl. Acad. Sci. USA 116, 2506 (2019).
  11. D. Hexner, A. J. Liu, and S. R. Nagel, Periodic training of creeping solids, Proc. Natl. Acad. Sci. USA 117, 31690 (2020).
  12. T. Schoning, A probabilistic algorithm for k-SAT and constraint satisfaction problems, in 40th Annual Symposium on Foundations of Computer Science (Cat. No. 99CB37039) (IEEE, New York, 1999), pp. 410–414.
  13. N. Pashine, D. Hexner, A. J. Liu, and S. R. Nagel, Directed aging, memory, and nature's greed, Sci. Adv. 5, eaax4215 (2019).
  14. B. Scellier and Y. Bengio, Equilibrium propagation: Bridging the gap between energy-based models and backpropagation, Front. Comput. Neurosci. 11, 24 (2017).
  15. M. Stern, C. Arinze, L. Perez, S. E. Palmer, and A. Murugan, Supervised learning through physical changes in a mechanical system, Proc. Natl. Acad. Sci. USA 117, 14843 (2020).
  16. J. Kendall, R. Pantone, K. Manickavasagam, Y. Bengio, and B. Scellier, Training end-to-end analog neural networks with equilibrium propagation, arXiv:2006.01981.
  17. M. Stern, D. Hexner, J. W. Rocks, and A. J. Liu, Supervised Learning in Physical Networks: From Machine Learning to Learning Machines, Phys. Rev. X 11, 021045 (2021).
  18. A. J. Noest, New Universality for Spatially Disordered Cellular Automata and Directed Percolation, Phys. Rev. Lett. 57, 90 (1986).
  19. A. G. Moreira and R. Dickman, Critical dynamics of the contact process with quenched disorder, Phys. Rev. E 54, R3090 (1996).
  20. H. K. Janssen, Renormalized field theory of the Gribov process with quenched disorder, Phys. Rev. E 55, 6253 (1997).
  21. R. Dickman and A. G. Moreira, Violation of scaling in the contact process with quenched disorder, Phys. Rev. E 57, 1263 (1998).
  22. T. Vojta, Rare region effects at classical, quantum and nonequilibrium phase transitions, J. Phys. A: Math. Gen. 39, R143 (2006).
  23. D. Hexner, Adaptable materials via retraining, arXiv:2103.08235.
  24. J. C. Maxwell, L. On the calculation of the equilibrium and stiffness of frames, London, Edinburgh, Dublin Philos. Mag. J. Sci. 27, 294 (1864).
  25. C. Calladine, Buckminster Fuller's “'Tensegrity” structures and Clerk Maxwell's rules for the construction of stiff frames, Int. J. Solids Struct. 14, 161 (1978).
  26. S. Pellegrino, Structural computations with the singular value decomposition of the equilibrium matrix, Int. J. Solids Struct. 30, 3025 (1993).
  27. S. Alexander, Amorphous solids: Their structure, lattice dynamics and elasticity, Phys. Rep. 296, 65 (1998).
  28. D. Hexner, N. Pashine, A. J. Liu, and S. R. Nagel, Effect of directed aging on nonlinear elasticity and memory formation in a material, Phys. Rev. Res. 2, 043231 (2020).
  29. J. C. Maxwell, IV. On the dynamical theory of gases, Philos. Trans. R. Soc. London 157, 49 (1867).
  30. W. G. Ellenbroek, E. Somfai, M. van Hecke, and W. van Saarloos, Critical Scaling in Linear Response of Frictionless Granular Packings near Jamming, Phys. Rev. Lett. 97, 258001 (2006).
  31. E. Lerner, E. DeGiuli, G. Düring, and M. Wyart, Breakdown of continuum elasticity in amorphous solids, Soft Matter 10, 5085 (2014).
  32. H. Vogel, Das Temperaturabhaengigkeitsgesetz der Viskositaet von Fluessigkeiten, Phys. Z. 22, 645 (1921).
  33. G. S. Fulcher, Analysis of recent measurements of the viscosity of glasses, J. Am. Ceram. Soc. 8, 339 (1925).
  34. G. Tammann and W. Hesse, Die abhängigkeit der viscosität von der temperatur bie unterkühlten flüssigkeiten, Z. Anorg. Allg. Chem. 156, 245 (1926).
  35. P. Grassberger and A. de la Torre, Reggeon field theory (Schlögl's first model) on a lattice: Monte Carlo calculations of critical behaviour, Ann. Phys. 122, 373 (1979).
  36. H. Hinrichsen, Non-equilibrium critical phenomena and phase transitions into absorbing states, Adv. Phys. 49, 815 (2000).
  37. See Supplemental Material at http://link.aps.org/supplemental/10.1103/PhysRevResearch.4.L042044 for additional data on the generality of the results, degradation, and system size time scale.
  38. C. S. O'Hern, L. E. Silbert, A. J. Liu, and S. R. Nagel, Jamming at zero temperature and zero applied stress: The epitome of disorder, Phys. Rev. E 68, 011306 (2003).
  39. D. Hexner, Training nonlinear elastic functions: Nonmonotonic, sequence dependent and bifurcating, Soft Matter 17, 4407 (2021).

Outline

Information

Phys. Rev. Research 4, L042044– Published 12 December, 2022
  • Received 14 April 2022
  • Accepted 19 October 2022
Crossmark - Check for updates button
Creative Commons Logo

Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.

Published by the American Physical Society

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation