4.7 Article

Parsimony as the ultimate regularizer for physics-informed machine learning

Related references

Note: Only part of the references are listed.
Article Mathematics, Applied

Modern Koopman Theory for Dynamical Systems

Steven L. Brunton et al.

Summary: The field of dynamical systems is undergoing a transformation due to the emergence of mathematical tools and algorithms from modern computing and data science. Data-driven approaches that use operator-theoretic or probabilistic frameworks are replacing first-principles derivations and asymptotic reductions. The Koopman spectral theory, which represents nonlinear dynamics using an infinite-dimensional linear operator, has the potential to enable the prediction, estimation, and control of nonlinear systems with standard textbook methods developed for linear systems. However, a challenge remains in obtaining finite-dimensional coordinate systems and embeddings that approximately linearize the dynamics. The success of Koopman analysis is attributed to its rigorous theoretical connections, measurement-based approach suitable for leveraging big data and machine learning techniques, and the development of simple yet powerful numerical algorithms.

SIAM REVIEW (2022)

Article Multidisciplinary Sciences

Bagging, optimized dynamic mode decomposition for robust, stable forecasting with spatial and temporal uncertainty quantification

Diya Sashidhar et al.

Summary: Dynamic mode decomposition (DMD) is a regression framework for learning linear dynamics models from temporal or spatio-temporal data. The optimized DMD algorithm, improved by statistical bagging methods, provides a stable and robust model with spatial and temporal uncertainty quantification.

PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2022)

Article Mathematics, Applied

Deep learning models for global coordinate transformations that linearise PDEs

Craig Gin et al.

Summary: The study developed a deep autoencoder architecture that transforms non-linear PDEs into linear PDEs by utilizing a residual network architecture and intrinsic coordinates encoding. The resulting dynamics are given by a Koopman operator matrix, allowing for multiple time step prediction. Demonstrations on various examples show the robustness of the method in discovering linearizing transforms for non-linear PDEs.

EUROPEAN JOURNAL OF APPLIED MATHEMATICS (2021)

Article Mechanics

Sparse identification of multiphase turbulence closures for coupled fluid-particle flows

S. Beetham et al.

Summary: In this study, model closures for multiphase Reynolds-averaged Navier-Stokes (RANS) equations are developed using sparse regression and Eulerian-Lagrangian simulations to ensure accuracy and robustness of the models across different flow conditions. The focus is on capturing the dynamics of gas-particle flows, particularly the generation of particle clusters and interphase momentum exchange, in a compact and algebraic manner.

JOURNAL OF FLUID MECHANICS (2021)

Article Multidisciplinary Sciences

Learning dominant physical processes with data-driven balance models

Jared L. Callaham et al.

Summary: Traditional physics-based modeling relies on approximating observed dynamics as a balance between dominant processes within asymptotic regimes, but researchers have proposed a new approach using equation space to identify neglected terms in non-asymptotic regimes. Their data-driven balance models successfully delineate dominant physics in systems like turbulence, combustion, nonlinear optics, geophysical fluids, and neuroscience.

NATURE COMMUNICATIONS (2021)

Article Mechanics

Galerkin force model for transient and post-transient dynamics of the fluidic pinball

Nan Deng et al.

Summary: A novel aerodynamic force model associated with a Galerkin model was proposed for the unforced fluidic pinball, based on a derivation from first principles of the mode amplitudes. The model was successfully applied to transient and post-transient dynamics in different Reynolds number regimes, showing potential for applications in other bluff bodies and flow control.

JOURNAL OF FLUID MECHANICS (2021)

Article Multidisciplinary Sciences

Machine learning-accelerated computational fluid dynamics

Dmitrii Kochkov et al.

Summary: Numerical simulation of fluids is crucial in modeling physical phenomena like weather and aerodynamics, but solving the Navier-Stokes equations at scale remains challenging due to computational costs. This study uses end-to-end deep learning to improve approximations in computational fluid dynamics for modeling two-dimensional turbulent flows, achieving computational speedups and stability while generalizing well to different scenarios. Leveraging machine learning and hardware accelerators, this approach showcases the potential to enhance simulations without sacrificing accuracy or generalization.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2021)

Article Multidisciplinary Sciences

Nonlinear stochastic modelling with Langevin regression

J. L. Callaham et al.

Summary: The study introduces a framework for learning interpretable stochastic nonlinear dynamics from experimental data, enforcing statistical consistency using forward and adjoint Fokker-Planck equations. A simple sparsifying procedure can provide an appropriate functional form. Experimental results demonstrate the successful learning of stochastic models using this method.

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2021)

Article Multidisciplinary Sciences

Robust learning from noisy, incomplete, high-dimensional experimental data via physically constrained symbolic regression

Patrick A. K. Reinbold et al.

Summary: The study demonstrates that combining data-driven methods with physical principles can lead to the discovery of accurate models of non-equilibrium spatially extended systems from high-dimensional, noisy, and incomplete experimental data. This hybrid approach also allows for the reconstruction of inaccessible variables successfully.

NATURE COMMUNICATIONS (2021)

Article Multidisciplinary Sciences

Sparse nonlinear models of chaotic electroconvection

Yifei Guan et al.

Summary: This study developed a reduced-order model for chaotic electroconvection at high electric Rayleigh number, revealing its relationship with the standard Lorenz model. Coherent structures were extracted from charge density fields using POD, and a nonlinear model for the time evolution of these structures was developed using the SINDy algorithm while preserving the symmetries observed in the original system.

ROYAL SOCIETY OPEN SCIENCE (2021)

Article Physics, Fluids & Plasmas

Promoting global stability in data-driven models of quadratic nonlinear dynamics

Alan A. Kaptanoglu et al.

Summary: The work outlines necessary and sufficient conditions for global stability in energy-preserving, quadratic nonlinear systems, incorporating them into data-driven models obtained via machine learning. The objective function in machine learning algorithms is modified to promote globally stable models, with implications for fluid and plasma flow modeling. Specifically, a modified trapping SINDy algorithm enables the identification of models that only produce bounded trajectories.

PHYSICAL REVIEW FLUIDS (2021)

Article Physics, Fluids & Plasmas

Physics-constrained, low-dimensional models for magnetohydrodynamics: First-principles and data-driven approaches

Alan A. Kaptanoglu et al.

Summary: This study develops a reduced-order modeling framework for compressible plasmas, leveraging both projection-based and data-driven approaches to address the scarcity of lower fidelity plasma models. By formalizing projection-based model reduction for nonlinear MHD systems and utilizing techniques like Galerkin projection and energy inner product, the study demonstrates the effectiveness of this approach on high-fidelity numerical simulations of a three-dimensional spheromak experiment. This work builds a bridge between Galerkin literature in fluid mechanics and paves the way for future development of principled projection-based and data-driven models for plasmas.

PHYSICAL REVIEW E (2021)

Review Mechanics

Machine Learning for Fluid Mechanics

Steven L. Brunton et al.

ANNUAL REVIEW OF FLUID MECHANICS, VOL 52 (2020)

Article Computer Science, Interdisciplinary Applications

Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders

Kookjin Lee et al.

JOURNAL OF COMPUTATIONAL PHYSICS (2020)

Article Mathematics, Applied

Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systems

Elizabeth Qian et al.

PHYSICA D-NONLINEAR PHENOMENA (2020)

Article Multidisciplinary Sciences

Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations

Maziar Raissi et al.

SCIENCE (2020)

Article Mathematics, Applied

Physics-Informed Probabilistic Learning of Linear Embeddings of Nonlinear Dynamics with Guaranteed Stability

Shaowu Pan et al.

SIAM JOURNAL ON APPLIED DYNAMICAL SYSTEMS (2020)

Article Engineering, Multidisciplinary

Time -series machine -learning error models for approximate solutions to parameterized dynamical systems

Eric J. Parish et al.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2020)

Article Mechanics

Data-driven modeling of the chaotic thermal convection in an annular thermosyphon

Jean-Christophe Loiseau

THEORETICAL AND COMPUTATIONAL FLUID DYNAMICS (2020)

Article Physics, Fluids & Plasmas

Formulating turbulence closures using sparse regression with embedded form invariance

S. Beetham et al.

PHYSICAL REVIEW FLUIDS (2020)

Article Engineering, Multidisciplinary

Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms

Peter Benner et al.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2020)

Article Physics, Fluids & Plasmas

Using noisy or incomplete data to discover models of spatiotemporal dynamics

Patrick A. K. Reinbold et al.

PHYSICAL REVIEW E (2020)

Article Computer Science, Artificial Intelligence

Discovery of Physics From Data: Universal Laws and Discrepancies

Brian M. de Silva et al.

FRONTIERS IN ARTIFICIAL INTELLIGENCE (2020)

Review Mechanics

Turbulence Modeling in the Age of Data

Karthik Duraisamy et al.

ANNUAL REVIEW OF FLUID MECHANICS, VOL 51 (2019)

Article Computer Science, Interdisciplinary Applications

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

M. Raissi et al.

JOURNAL OF COMPUTATIONAL PHYSICS (2019)

Article Mathematics, Applied

Discovery of Nonlinear Multiscale Systems: Sampling Strategies and Embeddings

Kathleen P. Champion et al.

SIAM JOURNAL ON APPLIED DYNAMICAL SYSTEMS (2019)

Article Mathematics, Applied

Linearly Recurrent Autoencoder Networks for Learning Dynamics

Samuel E. Otto et al.

SIAM JOURNAL ON APPLIED DYNAMICAL SYSTEMS (2019)

Article Computer Science, Interdisciplinary Applications

Sparse identification of truncation errors

Stephan Thaler et al.

JOURNAL OF COMPUTATIONAL PHYSICS (2019)

Article Computer Science, Interdisciplinary Applications

Machine learning for fast and reliable solution of time-dependent differential equations

F. Regazzoni et al.

JOURNAL OF COMPUTATIONAL PHYSICS (2019)

Article Multidisciplinary Sciences

Learning data-driven discretizations for partial differential equations

Yohai Bar-Sinai et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2019)

Article Mathematics, Applied

Robust and optimal sparse regression for nonlinear PDE models

Daniel R. Gurevich et al.

CHAOS (2019)

Article Multidisciplinary Sciences

Data-driven discovery of coordinates and governing equations

Kathleen Champion et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2019)

Article Physics, Fluids & Plasmas

Perspective on machine learning for advancing fluid mechanics

M. P. Brenner et al.

PHYSICAL REVIEW FLUIDS (2019)

Article Mechanics

Subgrid modelling for two-dimensional turbulence using neural networks

R. Maulik et al.

JOURNAL OF FLUID MECHANICS (2019)

Article Computer Science, Information Systems

A Unified Framework for Sparse Relaxed Regularized Regression: SR3

Peng Zheng et al.

IEEE ACCESS (2019)

Article Chemistry, Physical

Sparse learning of stochastic dynamical equations

Lorenzo Boninsegna et al.

JOURNAL OF CHEMICAL PHYSICS (2018)

Article Mechanics

Sparse reduced-order modelling: sensor-based dynamics to full-state estimation

Jean-Christophe Loiseau et al.

JOURNAL OF FLUID MECHANICS (2018)

Article Mechanics

Constrained sparse Galerkin regression

Jean-Christophe Loiseau et al.

JOURNAL OF FLUID MECHANICS (2018)

Article Mathematics, Applied

Data-Driven Model Reduction and Transfer Operator Approximation

Stefan Klus et al.

JOURNAL OF NONLINEAR SCIENCE (2018)

Article Physics, Multidisciplinary

Model-Free Prediction of Large Spatiotemporally Chaotic Systems from Data: A Reservoir Computing Approach

Jaideep Pathak et al.

PHYSICAL REVIEW LETTERS (2018)

Article Multidisciplinary Sciences

Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks

Pantelis R. Vlachas et al.

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2018)

Article Physics, Fluids & Plasmas

Koopman analysis of Burgers equation

Jacob Page et al.

PHYSICAL REVIEW FLUIDS (2018)

Article Mathematics, Interdisciplinary Applications

Applied Koopman Theory for Partial Differential Equations and Data-Driven Modeling of Spatio-Temporal Systems

J. Nathan Kutz et al.

COMPLEXITY (2018)

Article Multidisciplinary Sciences

Deep learning for universal linear embeddings of nonlinear dynamics

Bethany Lusch et al.

NATURE COMMUNICATIONS (2018)

Correction Multidisciplinary Sciences

VAMPnets for deep learning of molecular kinetics (vol 9, 5, 2018)

Andreas Mardt et al.

NATURE COMMUNICATIONS (2018)

Article Physics, Fluids & Plasmas

Sparse identification of a predator-prey system from simulation data of a convection model

Magnus Dam et al.

PHYSICS OF PLASMAS (2017)

Article Multidisciplinary Sciences

Reconstruction of normal forms by learning informed observation geometries from data

Or Yair et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2017)

Article Multidisciplinary Sciences

Learning partial differential equations via data discovery and sparse optimization

Hayden Schaeffer

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2017)

Article Mathematics, Applied

Ergodic Theory, Dynamic Mode Decomposition, and Computation of Spectral Properties of the Koopman Operator

Hassan Arbabi et al.

SIAM JOURNAL ON APPLIED DYNAMICAL SYSTEMS (2017)

Article Multidisciplinary Sciences

Data-driven discovery of partial differential equations

Samuel H. Rudy et al.

SCIENCE ADVANCES (2017)

Article Physics, Fluids & Plasmas

Sparse model selection via integral terms

Hayden Schaeffer et al.

PHYSICAL REVIEW E (2017)

Article Mechanics

Deep earning in fluid dynamics

J. Nathan Kutz

JOURNAL OF FLUID MECHANICS (2017)

Article Engineering, Multidisciplinary

Data-driven operator inference for nonintrusive projection-based model reduction

Benjamin Peherstorfer et al.

COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING (2016)

Article Physics, Multidisciplinary

Observation of Gravitational Waves from a Binary Black Hole Merger

B. P. Abbott et al.

PHYSICAL REVIEW LETTERS (2016)

Article Multidisciplinary Sciences

Discovering governing equations from data by sparse identification of nonlinear dynamical systems

Steven L. Brunton et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2016)

Article Mechanics

On long-term boundedness of Galerkin models

Michael Schlegel et al.

JOURNAL OF FLUID MECHANICS (2015)

Article Mathematics, Applied

A Data-Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition

Matthew O. Williams et al.

JOURNAL OF NONLINEAR SCIENCE (2015)

Article Chemistry, Physical

Variational Approach to Molecular Kinetics

Feliks Nueske et al.

JOURNAL OF CHEMICAL THEORY AND COMPUTATION (2014)

Review Mechanics

Analysis of Fluid Flows via Spectral Properties of the Koopman Operator

Igor Mezic

ANNUAL REVIEW OF FLUID MECHANICS, VOL 45 (2013)

Article Mathematics, Interdisciplinary Applications

A VARIATIONAL APPROACH TO MODELING SLOW PROCESSES IN STOCHASTIC DYNAMICAL SYSTEMS

Frank Noe et al.

MULTISCALE MODELING & SIMULATION (2013)

Article Mathematics, Applied

Geometry of the ergodic quotient reveals coherent structures in flows

Marko Budisic et al.

PHYSICA D-NONLINEAR PHENOMENA (2012)

Article Multidisciplinary Sciences

Nonlinear Laplacian spectral analysis for time series with intermittency and low-frequency variability

Dimitrios Giannakis et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2012)

Article Mechanics

Dynamic mode decomposition of numerical and experimental data

Peter J. Schmid

JOURNAL OF FLUID MECHANICS (2010)

Article Mechanics

Spectral analysis of nonlinear flows

Clarence W. Rowley et al.

JOURNAL OF FLUID MECHANICS (2009)

Article Multidisciplinary Sciences

Distilling Free-Form Natural Laws from Experimental Data

Michael Schmidt et al.

SCIENCE (2009)

Article Multidisciplinary Sciences

Automated reverse engineering of nonlinear dynamical systems

Josh Bongard et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2007)

Article Engineering, Mechanical

Spectral properties of dynamical systems, model reduction and decompositions

I Mezic

NONLINEAR DYNAMICS (2005)

Article Mathematics, Applied

Comparison of systems with complex behavior

I Mezic et al.

PHYSICA D-NONLINEAR PHENOMENA (2004)

Article Statistics & Probability

Statistical modeling: The two cultures

L Breiman

STATISTICAL SCIENCE (2001)