4.2 Review

A Review of Data-Driven Discovery for Dynamic Systems

Related references

Note: Only part of the references are listed.
Editorial Material Geosciences, Multidisciplinary

Deep learning and spatial statistics

Christopher K. Wikle et al.

SPATIAL STATISTICS (2023)

Article Statistics & Probability

Deep Compositional Spatial Models

Andrew Zammit-Mangion et al.

Summary: The study proposes a method to model injective warping functions through a composition of multiple elemental injective functions in a deep-learning framework, which can better model and predict nonstationary, anisotropic spatial data.

JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION (2022)

Article Multidisciplinary Sciences

Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control

U. Fasel et al.

Summary: In this work, the authors propose an ensemble approach to improve the robustness of the sparse identification of nonlinear dynamics (SINDy) algorithm. The ensemble-SINDy (E-SINDy) algorithm is demonstrated to be able to discover accurate models from extremely noisy and limited data. The authors also show that the ensemble statistics from E-SINDy can be utilized for active learning and improved model predictive control.

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2022)

Article Multidisciplinary Sciences

Sparsifying priors for Bayesian uncertainty quantification in model discovery

Seth M. Hirsh et al.

Summary: In this study, we propose a probabilistic model discovery method based on the sparse identification of nonlinear dynamics (SINDy) framework for identifying ordinary differential equations describing the dynamics of observed multivariate data. Our method, uncertainty quantification SINDy (UQ-SINDy), not only quantifies the uncertainty in the SINDy coefficients but also estimates the probability of inclusion of each candidate function in the linear combination. UQ-SINDy demonstrates robustness against observation noise and limited data, and provides accurate and interpretable models with orders-of-magnitude less data compared to existing methods.

ROYAL SOCIETY OPEN SCIENCE (2022)

Article Multidisciplinary Sciences

Hierarchical deep learning of multiscale differential equation time-steppers

Yuying Liu et al.

Summary: Nonlinear differential equations are difficult to solve analytically, so numerical methods are needed. This work introduces a deep neural network time-stepping approach that approximates the dynamics of the system over various timescales. The method is data-driven, accurate, and efficient, and can be combined with classical numerical methods.

PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2022)

Article Multidisciplinary Sciences

Machine learning-based statistical closure models for turbulent dynamical systems

Di Qi et al.

Summary: This study proposes a machine learning closure modeling framework for predicting statistical responses of turbulent dynamical systems. The framework utilizes a Long-Short-Term-Memory architecture and performs well under various truncation scenarios.

PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2022)

Article Multidisciplinary Sciences

Gaussian processes meet NeuralODEs: a Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data

Mohamed Aziz Bhouri et al.

Summary: We present a machine learning framework (GP-NODE) for Bayesian model discovery from partial, noisy and irregular observations of nonlinear dynamical systems. The proposed method utilizes differentiable programming to propagate gradient information and performs Bayesian inference with Hamiltonian Monte Carlo sampling and Gaussian Process priors, allowing for the exploitation of temporal correlations in observed data and efficient inference of posterior distributions over plausible models.

PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2022)

Article Mathematics, Interdisciplinary Applications

Sparse dynamical system identification with simultaneous structural parameters and initial condition estimation

Baolei Wei

Summary: The study proposes an integral SINDy (ISINDy) method to identify the model structure and parameters of nonlinear ordinary differential equations (ODEs) from noisy time-series observations. The approach combines penalized spline smoothing and sequential threshold least squares to achieve sparse pseudo linear regression and extract the fewest active terms. The method shows accuracy and robustness to noise in various simulations.

CHAOS SOLITONS & FRACTALS (2022)

Article Mathematics, Applied

Solving parametric PDE problems with artificial neural networks

Yuehaw Khoo et al.

Summary: The curse of dimensionality is often encountered in numerical partial differential equations, especially when uncertainties are modeled as random coefficients. This study proposes using neural networks to parameterize physical quantities of interest in PDEs, and demonstrates the simplicity and accuracy of this approach through notable examples in engineering and physics. The neural network is viewed as performing time evolution to find solutions to the PDEs, showing the representability of physical quantities using this method.

EUROPEAN JOURNAL OF APPLIED MATHEMATICS (2021)

Article Computer Science, Interdisciplinary Applications

DeepMoD: Deep learning for model discovery in noisy data

Gert-Jan Both et al.

Summary: DeepMoD is a deep learning based model discovery algorithm that uses sparse regression to discover the underlying partial differential equation in a library of possible functions and their derivatives. It is robust to noise, applicable to small data sets, and does not require a training set. The algorithm has shown promising results in benchmark tests on physical problems and successfully discovered the advection-diffusion equation in noisy experimental time-series data.

JOURNAL OF COMPUTATIONAL PHYSICS (2021)

Article Mechanics

Deep-learning of parametric partial differential equations from sparse and noisy data

Hao Xu et al.

Summary: Data-driven methods have recently made great progress in discovering partial differential equations from spatial-temporal data. A new framework combining neural network, genetic algorithm, and stepwise methods is proposed to address challenges including sparse noisy data and incomplete library. The proposed algorithm is able to discover parametric PDEs with spatially or temporally varying coefficients on various equations.

PHYSICS OF FLUIDS (2021)

Article Physics, Mathematical

DL-PDE: Deep-Learning Based Data-Driven Discovery of Partial Differential Equations from Discrete and Noisy Data

Hao Xu et al.

Summary: In recent years, data-driven methods have been developed for learning dynamical systems and partial differential equations to discover unknown physics and corresponding equations. The proposed DL-PDE method combines deep learning through neural networks with data-driven discovery of PDE through sparse regressions.

COMMUNICATIONS IN COMPUTATIONAL PHYSICS (2021)

Article Computer Science, Artificial Intelligence

Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery

Samuel Kim et al.

Summary: This article introduces a neural network-based symbolic regression architecture called the equation learner (EQL) network, which can be trained end-to-end through backpropagation. The performance of this system on various tasks, including symbolic regression, MNIST arithmetic task, and dynamic system prediction, is demonstrated through experiments.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2021)

Article Physics, Multidisciplinary

SINDy-BVP: Sparse identification of nonlinear dynamics for boundary value problems

Daniel E. Shea et al.

Summary: The technique developed utilizes the SINDy algorithm and group sparse regression techniques to discover models for spatially-dependent boundary value problems, providing a parsimonious model of heterogeneous material systems. By leveraging data-driven modeling, it enables the characterization of various systems, including the discovery of anisotropic materials with heterogeneous variability.

PHYSICAL REVIEW RESEARCH (2021)

Article Statistics & Probability

Ensemble Kalman Methods for High-Dimensional Hierarchical Dynamic Space-Time Models

Matthias Katzfuss et al.

JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION (2020)

Article Multidisciplinary Sciences

Learning partial differential equations for biological transport models from noisy spatio-temporal data

John H. Lagergren et al.

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2020)

Article Multidisciplinary Sciences

Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations

Maziar Raissi et al.

SCIENCE (2020)

Article Computer Science, Interdisciplinary Applications

Data-driven deep learning of partial differential equations in modal space

Kailiang Wu et al.

JOURNAL OF COMPUTATIONAL PHYSICS (2020)

Article Computer Science, Interdisciplinary Applications

DLGA-PDE: Discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithm

Hao Xu et al.

JOURNAL OF COMPUTATIONAL PHYSICS (2020)

Article Multidisciplinary Sciences

Bayesian differential programming for robust systems identification under uncertainty

Yibo Yang et al.

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2020)

Article Computer Science, Information Systems

A Unified Sparse Optimization Framework to Learn Parsimonious Physics-Informed Models From Data

Kathleen Champion et al.

IEEE ACCESS (2020)

Article Computer Science, Interdisciplinary Applications

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

M. Raissi et al.

JOURNAL OF COMPUTATIONAL PHYSICS (2019)

Article Computer Science, Interdisciplinary Applications

Numerical aspects for approximating governing equations using data

Kailiang Wu et al.

JOURNAL OF COMPUTATIONAL PHYSICS (2019)

Article Materials Science, Multidisciplinary

Symbolic regression in materials science

Yiqun Wang et al.

MRS COMMUNICATIONS (2019)

Article Computer Science, Interdisciplinary Applications

Data driven governing equations approximation using deep neural networks

Tong Qin et al.

JOURNAL OF COMPUTATIONAL PHYSICS (2019)

Article Computer Science, Interdisciplinary Applications

Deep learning of dynamics and signal-noise decomposition with time-stepping constraints

Samuel H. Rudy et al.

JOURNAL OF COMPUTATIONAL PHYSICS (2019)

Article Multidisciplinary Sciences

Data-driven discovery of coordinates and governing equations

Kathleen Champion et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2019)

Article Computer Science, Interdisciplinary Applications

PDE-Net 2.0: Learning PDEs from data with a numeric-symbolic hybrid deep network

Zichao Long et al.

JOURNAL OF COMPUTATIONAL PHYSICS (2019)

Article Mathematics, Applied

Data-Driven Identification of Parametric Partial Differential Equations

Samuel Rudy et al.

SIAM JOURNAL ON APPLIED DYNAMICAL SYSTEMS (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Data-Driven Partial Derivative Equations Discovery with Evolutionary Approach

Mikhail Maslyaev et al.

COMPUTATIONAL SCIENCE - ICCS 2019, PT V (2019)

Article Computer Science, Information Systems

A Unified Framework for Sparse Relaxed Regularized Regression: SR3

Peng Zheng et al.

IEEE ACCESS (2019)

Article Mathematics, Interdisciplinary Applications

ON THE CONVERGENCE OF THE SINDy ALGORITHM

Linan Zhang et al.

MULTISCALE MODELING & SIMULATION (2019)

Article Chemistry, Physical

Sparse learning of stochastic dynamical equations

Lorenzo Boninsegna et al.

JOURNAL OF CHEMICAL PHYSICS (2018)

Article Meteorology & Atmospheric Sciences

A Bayesian Adaptive Ensemble Kalman Filter for Sequential State and Parameter Estimation

Jonathan R. Stroud et al.

MONTHLY WEATHER REVIEW (2018)

Article Multidisciplinary Sciences

VAMPnets for deep learning of molecular kinetics

Andreas Mardt et al.

NATURE COMMUNICATIONS (2018)

Article Meteorology & Atmospheric Sciences

Stochastic parameterization identification using ensemble Kalman filtering combined with maximum likelihood methods

Manuel Pulido et al.

TELLUS SERIES A-DYNAMIC METEOROLOGY AND OCEANOGRAPHY (2018)

Article Multidisciplinary Sciences

Robust data-driven discovery of governing physical laws with error bars

Sheng Zhang et al.

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2018)

Article Computer Science, Artificial Intelligence

Feature Selection to Improve Generalization of Genetic Programming for High-Dimensional Symbolic Regression

Qi Chen et al.

IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION (2017)

Article Mathematics, Interdisciplinary Applications

EXACT RECOVERY OF CHAOTIC SYSTEMS FROM HIGHLY CORRUPTED DATA

Giang Tran et al.

MULTISCALE MODELING & SIMULATION (2017)

Article Multidisciplinary Sciences

Learning partial differential equations via data discovery and sparse optimization

Hayden Schaeffer

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2017)

Article Statistics & Probability

Sparsity information and regularization in the horseshoe and other shrinkage priors

Juho Piironen et al.

ELECTRONIC JOURNAL OF STATISTICS (2017)

Article Multidisciplinary Sciences

Data-driven discovery of partial differential equations

Samuel H. Rudy et al.

SCIENCE ADVANCES (2017)

Article Computer Science, Artificial Intelligence

Statistical genetic programming for symbolic regression

Maryam Amir Haeri et al.

APPLIED SOFT COMPUTING (2017)

Article Multidisciplinary Sciences

Discovering governing equations from data by sparse identification of nonlinear dynamical systems

Steven L. Brunton et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2016)

Article Mathematics, Applied

Runge-Kutta pairs of order 5(4) satisfying only the first column simplifying assumption

Ch. Tsitouras

COMPUTERS & MATHEMATICS WITH APPLICATIONS (2011)

Article Mathematics, Interdisciplinary Applications

Polynomial nonlinear spatio-temporal integro-difference equation models

Christopher K. Wikle et al.

JOURNAL OF TIME SERIES ANALYSIS (2011)

Article Meteorology & Atmospheric Sciences

Ocean ensemble forecasting. Part I: Ensemble Mediterranean winds from a Bayesian hierarchical model

Ralph F. Milliff et al.

QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY (2011)

Article Biology

The horseshoe estimator for sparse signals

Carlos M. Carvalho et al.

BIOMETRIKA (2010)

Article Statistics & Probability

A general science-based framework for dynamical spatio-temporal models

Christopher K. Wikle et al.

Article Mathematics, Interdisciplinary Applications

The Bayesian Elastic Net

Qing Li et al.

BAYESIAN ANALYSIS (2010)

Article Multidisciplinary Sciences

Distilling Free-Form Natural Laws from Experimental Data

Michael Schmidt et al.

SCIENCE (2009)

Article Statistics & Probability

The Bayesian Lasso

Trevor Park et al.

JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION (2008)

Article Statistics & Probability

The group lasso for logistic regression

Lukas Meier et al.

JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY (2008)

Article Multidisciplinary Sciences

Automated reverse engineering of nonlinear dynamical systems

Josh Bongard et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2007)

Article Oceanography

Bayesian hierarchical modeling of air-sea interaction

LM Berliner et al.

JOURNAL OF GEOPHYSICAL RESEARCH-OCEANS (2003)

Article Statistics & Probability

Spatiotemporal hierarchical Bayesian modeling: Tropical ocean surface winds

CK Wikle et al.

JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION (2001)