4.7 Article

PDE-constrained models with neural network terms: Optimization and global convergence

期刊

JOURNAL OF COMPUTATIONAL PHYSICS
卷 481, 期 -, 页码 -

出版社

ACADEMIC PRESS INC ELSEVIER SCIENCE
DOI: 10.1016/j.jcp.2023.112016

关键词

Adjoint algorithms; Neural networks; PDE constrained optimization; Global convergence; RANS neural network

向作者/读者索取更多资源

Recent research has developed partial differential equation (PDE) models in science and engineering using deep learning. The PDE's functional form is determined by a neural network and calibrated to available data. Gradient descent is used to optimize the neural network parameters in the PDE, with the gradient evaluated using an adjoint PDE. As the number of parameters increases, the PDE and adjoint PDE converge to a non-local PDE system. The adjoint method is then used to train a neural network model for fluid mechanics, acting as a closure model for the Reynolds-averaged Navier-Stokes equations.
Recent research has used deep learning to develop partial differential equation (PDE) models in science and engineering. The functional form of the PDE is determined by a neural network, and the neural network parameters are calibrated to available data. Calibration of the embedded neural network can be performed by optimizing over the PDE. Motivated by these applications, we rigorously study the optimization of a class of linear elliptic PDEs with neural network terms. The neural network parameters in the PDE are optimized using gradient descent, where the gradient is evaluated using an adjoint PDE. As the number of parameters become large, the PDE and adjoint PDE converge to a non-local PDE system. Using this limit PDE system, we are able to prove convergence of the neural network-PDE to a global minimum during the optimization. Finally, we use this adjoint method to train a neural network model for an application in fluid mechanics, in which the neural network functions as a closure model for the Reynolds-averaged Navier- Stokes (RANS) equations. The RANS neural network model is trained on several datasets for turbulent channel flow and is evaluated out-of-sample at different Reynolds numbers. (c) 2023 Elsevier Inc. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据