Perspective: Sloppiness and emergent theories in physics, biology, and beyond

Mark K. Transtrum, Benjamin B. Machta, Kevin S. Brown, BRYAN DANIELS, Christopher R. Myers, James P. Sethna

Research output: Contribution to journalArticle

89 Citations (Scopus)

Abstract

Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are "sloppy," i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher information matrix, which is interpreted as a Riemannian metric on a parameterized space of models. Distance in this space is a measure of how distinguishable two models are based on their predictions. Sloppy model manifolds are bounded with a hierarchy of widths and extrinsic curvatures. The manifold boundary approximation can extract the simple, hidden theory from complicated sloppy models. We attribute the success of simple effective models in physics as likewise emerging from complicated processes exhibiting a low effective dimensionality. We discuss the ramifications and consequences of sloppy models for biochemistry and science more generally. We suggest that the reason our complex world is understandable is due to the same fundamental reason: simple theories of macroscopic behavior are hidden inside complicated microscopic processes.

Original languageEnglish (US)
Article number010901
JournalJournal of Chemical Physics
Volume143
Issue number1
DOIs
StatePublished - Jan 1 2015
Externally publishedYes

Fingerprint

biology
Physics
physics
Fisher information
Fisher information matrix
biochemistry
Biochemistry
scale models
hierarchies
emerging
curvature
formalism
matrices
predictions
approximation

ASJC Scopus subject areas

  • Physics and Astronomy(all)
  • Physical and Theoretical Chemistry

Cite this

Transtrum, M. K., Machta, B. B., Brown, K. S., DANIELS, BRYAN., Myers, C. R., & Sethna, J. P. (2015). Perspective: Sloppiness and emergent theories in physics, biology, and beyond. Journal of Chemical Physics, 143(1), [010901]. https://doi.org/10.1063/1.4923066

Perspective : Sloppiness and emergent theories in physics, biology, and beyond. / Transtrum, Mark K.; Machta, Benjamin B.; Brown, Kevin S.; DANIELS, BRYAN; Myers, Christopher R.; Sethna, James P.

In: Journal of Chemical Physics, Vol. 143, No. 1, 010901, 01.01.2015.

Research output: Contribution to journalArticle

Transtrum, Mark K. ; Machta, Benjamin B. ; Brown, Kevin S. ; DANIELS, BRYAN ; Myers, Christopher R. ; Sethna, James P. / Perspective : Sloppiness and emergent theories in physics, biology, and beyond. In: Journal of Chemical Physics. 2015 ; Vol. 143, No. 1.
@article{ccd488a377934ef1b4f3fdf277b5896a,
title = "Perspective: Sloppiness and emergent theories in physics, biology, and beyond",
abstract = "Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are {"}sloppy,{"} i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher information matrix, which is interpreted as a Riemannian metric on a parameterized space of models. Distance in this space is a measure of how distinguishable two models are based on their predictions. Sloppy model manifolds are bounded with a hierarchy of widths and extrinsic curvatures. The manifold boundary approximation can extract the simple, hidden theory from complicated sloppy models. We attribute the success of simple effective models in physics as likewise emerging from complicated processes exhibiting a low effective dimensionality. We discuss the ramifications and consequences of sloppy models for biochemistry and science more generally. We suggest that the reason our complex world is understandable is due to the same fundamental reason: simple theories of macroscopic behavior are hidden inside complicated microscopic processes.",
author = "Transtrum, {Mark K.} and Machta, {Benjamin B.} and Brown, {Kevin S.} and BRYAN DANIELS and Myers, {Christopher R.} and Sethna, {James P.}",
year = "2015",
month = "1",
day = "1",
doi = "10.1063/1.4923066",
language = "English (US)",
volume = "143",
journal = "Journal of Chemical Physics",
issn = "0021-9606",
publisher = "American Institute of Physics Publising LLC",
number = "1",

}

TY - JOUR

T1 - Perspective

T2 - Sloppiness and emergent theories in physics, biology, and beyond

AU - Transtrum, Mark K.

AU - Machta, Benjamin B.

AU - Brown, Kevin S.

AU - DANIELS, BRYAN

AU - Myers, Christopher R.

AU - Sethna, James P.

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are "sloppy," i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher information matrix, which is interpreted as a Riemannian metric on a parameterized space of models. Distance in this space is a measure of how distinguishable two models are based on their predictions. Sloppy model manifolds are bounded with a hierarchy of widths and extrinsic curvatures. The manifold boundary approximation can extract the simple, hidden theory from complicated sloppy models. We attribute the success of simple effective models in physics as likewise emerging from complicated processes exhibiting a low effective dimensionality. We discuss the ramifications and consequences of sloppy models for biochemistry and science more generally. We suggest that the reason our complex world is understandable is due to the same fundamental reason: simple theories of macroscopic behavior are hidden inside complicated microscopic processes.

AB - Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are "sloppy," i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher information matrix, which is interpreted as a Riemannian metric on a parameterized space of models. Distance in this space is a measure of how distinguishable two models are based on their predictions. Sloppy model manifolds are bounded with a hierarchy of widths and extrinsic curvatures. The manifold boundary approximation can extract the simple, hidden theory from complicated sloppy models. We attribute the success of simple effective models in physics as likewise emerging from complicated processes exhibiting a low effective dimensionality. We discuss the ramifications and consequences of sloppy models for biochemistry and science more generally. We suggest that the reason our complex world is understandable is due to the same fundamental reason: simple theories of macroscopic behavior are hidden inside complicated microscopic processes.

UR - http://www.scopus.com/inward/record.url?scp=84942866194&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84942866194&partnerID=8YFLogxK

U2 - 10.1063/1.4923066

DO - 10.1063/1.4923066

M3 - Article

C2 - 26156455

AN - SCOPUS:84942866194

VL - 143

JO - Journal of Chemical Physics

JF - Journal of Chemical Physics

SN - 0021-9606

IS - 1

M1 - 010901

ER -