Journal
CHAOS
Volume 31, Issue 9, Pages -Publisher
AIP Publishing
DOI: 10.1063/5.0060697
Keywords
-
Categories
Funding
- Advanced Research Projects Agency-Energy (ARPA-E), U.S. Department of Energy [DE-AR0001222]
Ask authors/readers for more resources
This research focuses on learning neural ODEs for stiff systems, showing successful applications in various fields and highlighting key techniques for learning stiff neural ODEs.
Neural Ordinary Differential Equations (ODEs) are a promising approach to learn dynamical models from time-series data in science and engineering applications. This work aims at learning neural ODEs for stiff systems, which are usually raised from chemical kinetic modeling in chemical and biological systems. We first show the challenges of learning neural ODEs in the classical stiff ODE systems of Robertson's problem and propose techniques to mitigate the challenges associated with scale separations in stiff systems. We then present successful demonstrations in stiff systems of Robertson's problem and an air pollution problem. The demonstrations show that the usage of deep networks with rectified activations, proper scaling of the network outputs as well as loss functions, and stabilized gradient calculations are the key techniques enabling the learning of stiff neural ODEs. The success of learning stiff neural ODEs opens up possibilities of using neural ODEs in applications with widely varying time-scales, such as chemical dynamics in energy conversion, environmental engineering, and life sciences. Published under an exclusive license by AIP Publishing.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available