4.7 Article

Equivalence of machine learning models in modeling chaos

Related references

Note: Only part of the references are listed.
Article Mathematics, Interdisciplinary Applications

Dynamical time series emb e ddings in recurrent neural networks

Gonzalo Uribarri et al.

Summary: Time series forecasting is a significant research problem in the fields of science and engineering, and machine learning algorithms have been proven successful in this area. This paper focuses on training Long Short Term Memory networks (LSTM), a type of Recurrent Neural Networks (RNNs), to predict time series data from a chaotic system. The study shows that LSTM networks can learn to generate a data embedding in their inner state that is topologically equivalent to the original strange attractor.

CHAOS SOLITONS & FRACTALS (2022)

Article Mathematics, Interdisciplinary Applications

Synchronization between two linearly coupled reservoir computers

Wancheng Hu et al.

Summary: This paper introduces both the significance of reservoir computing and the achievement of complete synchronization in reservoir computers based on coupling theory. The validity of the theory is verified through numerical experiments.

CHAOS SOLITONS & FRACTALS (2022)

Article Physics, Multidisciplinary

Synchronization of reservoir computing models via a nonlinear controller

Xiaolu Chen et al.

Summary: A drive-response scheme of reservoir computers coupled by a nonlinear controller is proposed for achieving lag synchronization. The numerical results on several typical chaotic systems have effectively demonstrated the effectiveness of this scheme. It does not require the computation of Lyapunov exponents and can be considered as a key step towards a new data-driven route for achieving lag synchronization.

PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS (2022)

Article Mathematics, Applied

Modeling chaotic systems: Dynamical equations vs machine learning approach

Tongfeng Weng et al.

Summary: Chaotic systems are common in the real world, but it is often difficult to obtain analytical models. We propose a machine-learning method called reservoir computing as an alternative approach to model chaotic systems, which is more feasible compared to conventional dynamical equations.

COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION (2022)

Article Mathematics, Applied

On explaining the surprising success of reservoir computing forecaster of chaos? The universal machine learning dynamical system with contrast to VAR and DMD

Erik Bollt

Summary: Machine learning, in particular the use of echo-state networks, has become popular for forecasting dynamical systems, despite the use of randomly selected weights. Simplified analysis of echo-state networks shows that they can produce high quality forecasts competitively with more complex training methods.

CHAOS (2021)

Article Physics, Multidisciplinary

Complex network perspective on modelling chaotic systems via machine learning*

Tong-Feng Weng et al.

Summary: Recent advancements have shown that reservoir computing is an effective method for modeling chaotic systems, preserving long-term behaviors and detecting dynamical transitions. A broad range of network statistics induced from the trained reservoir system closely matches that of the observed chaotic system. Network measurements of the trained reservoir system are sensitive to distinct dynamics, offering an alternative way to model chaotic systems.

CHINESE PHYSICS B (2021)

Article Physics, Applied

Synchronization of chaotic systems and long short-term memory networks by sharing a single variable

Kai Zhang et al.

Summary: By using LSTM networks instead of traditional dynamical equations, we demonstrate synchronization between chaotic systems and their learned LSTM networks, even when the transmitting signal is contaminated with white noise. This synchronization behavior proves to be robust in cascading synchronization among chaotic systems and their trained LSTM systems.

MODERN PHYSICS LETTERS B (2021)

Article Computer Science, Artificial Intelligence

PM2.5 concentration modeling and prediction by using temperature-based deep belief network

Haixia Xing et al.

Summary: Air quality prediction, specifically PM2.5, is a critical global issue. A novel deep learning model called temperature-based deep belief networks (TDBN) is proposed for PM2.5 prediction, outperforming similar models in terms of RMSE, MAE, and R-2.

NEURAL NETWORKS (2021)

Article Computer Science, Artificial Intelligence

New Results for Prediction of Chaotic Systems Using Deep Recurrent Neural Networks

Jose de Jesus Serrano-Perez et al.

Summary: The paper examines the application of neural network models in predicting chaotic systems, finding that the deep learning neural network model GRU-DRNN performs better in terms of loss and accuracy, while using fewer neurons and layers.

NEURAL PROCESSING LETTERS (2021)

Article Physics, Multidisciplinary

Synchronization of reservoir computers with applications to communications

Tongfeng Weng et al.

PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS (2020)

Article Mathematics, Applied

The structure of reconstructed flows in latent spaces

Gonzalo Uribarri et al.

CHAOS (2020)

Article Mathematics, Interdisciplinary Applications

Robustness of LSTM neural networks for multi-step forecasting of chaotic time series

Matteo Sangiorgio et al.

CHAOS SOLITONS & FRACTALS (2020)

Article Physics, Multidisciplinary

Long-term prediction of chaotic systems with machine learning

Huawei Fan et al.

PHYSICAL REVIEW RESEARCH (2020)

Article Physics, Multidisciplinary

Synchronizing hyperchaotic subsystems with a single variable: A reservoir computing approach

Xiaolu Chen et al.

PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS (2019)

Article Physics, Fluids & Plasmas

Synchronization of chaotic systems and their machine-learning models

Tongfeng Weng et al.

PHYSICAL REVIEW E (2019)

Article Mathematics, Applied

Attractor reconstruction by machine learning

Zhixin Lu et al.

CHAOS (2018)

Article Mathematics, Applied

Observing spatio-temporal dynamics of excitable media using reservoir computing

Roland S. Zimmermann et al.

CHAOS (2018)

Article Management

Deep learning with long short-term memory networks for financial market predictions

Thomas Fischer et al.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2018)

Article Physics, Multidisciplinary

Model-Free Prediction of Large Spatiotemporally Chaotic Systems from Data: A Reservoir Computing Approach

Jaideep Pathak et al.

PHYSICAL REVIEW LETTERS (2018)

Article Robotics

Forecasting Real Time Series Data using Deep Belief Net and Reinforcement Learning

Takaomi Hirata et al.

JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE (2018)

Article Computer Science, Artificial Intelligence

LSTM: A Search Space Odyssey

Klaus Greff et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2017)

Article Mathematics, Applied

Synchronization of chaotic systems

Louis M. Pecora et al.

CHAOS (2015)

Proceedings Paper Computer Science, Information Systems

Time Series Prediction using Restricted Boltzmann Machines and Backpropagation

Rafael Hraskoa et al.

3RD INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND QUANTITATIVE MANAGEMENT, ITQM 2015 (2015)

Article Computer Science, Artificial Intelligence

Time series forecasting using a deep belief network with restricted Boltzmann machines

Takashi Kuremoto et al.

NEUROCOMPUTING (2014)

Article Computer Science, Artificial Intelligence

Training restricted Boltzmann machines: An introduction

Asja Fischer et al.

PATTERN RECOGNITION (2014)

Article Computer Science, Artificial Intelligence

Echo State Property Linked to an Input: Exploring a Fundamental Characteristic of Recurrent Neural Networks

G. Manjunath et al.

NEURAL COMPUTATION (2013)

Article Multidisciplinary Sciences

Reducing the dimensionality of data with neural networks

G. E. Hinton et al.

SCIENCE (2006)

Article Computer Science, Artificial Intelligence

A fast learning algorithm for deep belief nets

Geoffrey E. Hinton et al.

NEURAL COMPUTATION (2006)

Article Physics, Fluids & Plasmas

Synchronized clusters in coupled map networks. I. Numerical studies

S Jalan et al.

PHYSICAL REVIEW E (2005)

Article Computer Science, Artificial Intelligence

Real-time computing without stable states:: A new framework for neural computation based on perturbations

W Maass et al.

NEURAL COMPUTATION (2002)

Article Computer Science, Artificial Intelligence

Training products of experts by minimizing contrastive divergence

GE Hinton

NEURAL COMPUTATION (2002)