4.5 Article

Deep reinforcement learning and adaptive policy transfer for generalizable well control optimization

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Energy & Fuels

Training effective deep reinforcement learning agents for real-time life-cycle production optimization

Kai Zhang et al.

Summary: The paper introduces a novel production optimization method that models the life-cycle production optimization problem as a finite-horizon Markov decision process. By training deep reinforcement learning agents, it achieves maximizing net present value and realtime adjustment of well control schemes.

JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING (2022)

Article Energy & Fuels

A comparative study to accelerate field development plan optimization

Ashish Kumar Loomba et al.

Summary: This study proposed and compared four workflows to optimize field development plans efficiently under uncertainty, resulting in significant reduction in computational time and cost. By considering various scenarios and employing predictive analytics, the study demonstrated improvements in field optimization within a shorter timeframe, providing practical solutions for field development while capturing associated uncertainty.

JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING (2022)

Article Energy & Fuels

A novel hybrid recurrent convolutional network for surrogate modeling of history matching and uncertainty quantification

Xiaopeng Ma et al.

Summary: This article studies a hybrid recurrent convolutional network (HRCN) model for surrogate modeling of numerical simulation used in automatic history matching (AHM). The HRCN model combines convolutional neural network (CNN) and recurrent neural network (RNN) to learn spatial and temporal features for predicting well production data and reduces computational cost.

JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING (2022)

Article Engineering, Petroleum

Deep Reinforcement Learning for Generalizable Field Development Optimization

Jincong He et al.

Summary: This study develops an artificial intelligence using deep reinforcement learning (DRL) to provide optimized field development plans for new scenarios within seconds. The AI is trained on a wide range of geological structures, rock and fluid properties, operational constraints, and economic conditions, making it highly applicable to different scenarios.

SPE JOURNAL (2022)

Article Energy & Fuels

A vector-to-sequence based multilayer recurrent network surrogate model for history matching of large-scale reservoir

Xiaopeng Ma et al.

Summary: This study focuses on utilizing recurrent neural networks (RNN) to construct a surrogate model for history matching. The proposed multilayer RNN surrogate model, MLGRU, is used to approximate the mapping from geological realizations to production data. The efficiency and effectiveness of the MLGRU model are analyzed and validated through numerical experiments on both 2D and large-scale 3D reservoir models.

JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING (2022)

Article Automation & Control Systems

Affine Transformation-Enhanced Multifactorial Optimization for Heterogeneous Problems

Xiaoming Xue et al.

Summary: Evolutionary multitasking (EMT) is a new research topic that aims to improve convergence across multiple optimization tasks by facilitating knowledge transfer. Existing EMT algorithms are limited to homogeneous problems, and little effort has been made to generalize EMT for solving heterogeneous problems. This article proposes a novel rank loss function to achieve superior intertask mapping and derive an analytical solution for affine transformation. The proposed technique can seamlessly integrate with EMT paradigms, and its effectiveness is demonstrated through experiments on synthetic multitasking and many-tasking benchmark problems.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Article Computer Science, Information Systems

Efficient hierarchical surrogate-assisted differential evolution for high-dimensional expensive optimization

Guodong Chen et al.

Summary: The study proposes a novel and efficient hierarchical surrogate-assisted differential evolution (EHSDE) algorithm for high-dimensional expensive optimization problems. By balancing exploration and exploitation using a hierarchical framework and utilizing global and local surrogate models to accelerate convergence speed, the algorithm demonstrates effectiveness and efficiency on benchmark functions and production optimization problems.

INFORMATION SCIENCES (2021)

Article Engineering, Petroleum

Multifidelity Genetic Transfer: An Efficient Framework for Production Optimization

Faliang Yin et al.

Summary: This paper presents a novel production optimization framework based on genetic transfer learning to accelerate convergence and improve the quality of optimal solution. By combining results from high- and low-fidelity tasks, a multifidelity optimization model is established, and the concept of relative fidelity is introduced. The framework includes multitasking and sequential transfer modes to balance computing resources for tasks with different fidelity levels.

SPE JOURNAL (2021)

Article Engineering, Petroleum

Data-Driven Niching Differential Evolution with Adaptive Parameters Control for History Matching and Uncertainty Quantification

Xiaopeng Ma et al.

Summary: The proposed algorithm effectively tackles the nonuniqueness of inversion by locating multiple solutions for complex multimodal problems within a limited computational budget. The integration of convolutional variational autoencoder for parameterization enhances the robustness of prediction results.

SPE JOURNAL (2021)

Article Engineering, Petroleum

Gradient-Enhanced Support Vector Regression for Robust Life-Cycle Production Optimization with Nonlinear-State Constraints

Zhe Liu et al.

Summary: This paper presents a method of using a proxy model to replace a reservoir simulator in order to calculate the optimal well controls in production optimization. By iteratively resampling, higher efficiency and more accurate results can be achieved.

SPE JOURNAL (2021)

Article Energy & Fuels

Self-adaptive multifactorial evolutionary algorithm for multitasking production optimization

Jun Yao et al.

Summary: The novel multifactorial evolutionary algorithm (MFEA) is introduced to address production optimization problems by treating them as multiple distinct tasks in a multitasking environment, utilizing latent similarities among them to improve overall optimization performance.

JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING (2021)

Article Engineering, Petroleum

A Recurrent Neural Network-Based Proxy Model for Well-Control Optimization with Nonlinear Output Constraints

Yong Do Kim et al.

Summary: In this study, a recurrent neural network (RNN)-based proxy model was developed for constrained production optimization problems, which was validated for 2D and 3D production optimization. By incorporating a few additional simulation-based iterations after proxy-based optimization, comparable net present values (NPVs) to simulation-based optimization were achieved with significant speedups. The RNN-based proxy provides full well-rate time sequences, allowing for flexibility in varying optimization constraints and economic parameters without the need for retraining.

SPE JOURNAL (2021)

Article Mathematics, Interdisciplinary Applications

Deep Reinforcement Learning for Constrained Field Development Optimization in Subsurface Two-phase Flow

Yusuf Nasir et al.

Summary: The research introduces a deep-reinforcement-learning-based artificial intelligence agent for optimizing oil and gas field development plans, utilizing a convolutional neural network to map the reservoir model state, constraints, and economic conditions to optimal decisions. The agent is trained through a feedback loop process with millions of flow simulations, providing instant optimized plans for new scenarios within a defined range of applicability.

FRONTIERS IN APPLIED MATHEMATICS AND STATISTICS (2021)

Article Energy & Fuels

Robust optimization of the locations and types of multiple wells using CNN based proxy models

Joonyi Kim et al.

JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING (2020)

Article Energy & Fuels

Surrogate-assisted differential evolution for production optimization with nonlinear state constraints

Xinggang Zhao et al.

JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING (2020)

Article Energy & Fuels

A comprehensive workflow for real time injection-production optimization based on equilibrium displacement

Huijiang Chang et al.

ADVANCES IN GEO-ENERGY RESEARCH (2020)

Article Automation & Control Systems

A reinforcement learning approach for waterflooding optimization in petroleum reservoirs

Farzad Hourfar et al.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2019)

Article Engineering, Petroleum

Robust Life-Cycle Production Optimization With a Support-Vector-Regression Proxy

Zhenyu Guo et al.

SPE JOURNAL (2018)

Article Multidisciplinary Sciences

Mastering the game of Go without human knowledge

David Silver et al.

NATURE (2017)

Article Multidisciplinary Sciences

Mastering the game of Go with deep neural networks and tree search

David Silver et al.

NATURE (2016)

Article Multidisciplinary Sciences

Human-level control through deep reinforcement learning

Volodymyr Mnih et al.

NATURE (2015)

Article Engineering, Petroleum

Closed-Loop Field Development Under Uncertainty by Use of Optimization With Sample Validation

Mehrdad G. Shirangi et al.

SPE JOURNAL (2015)

Article Computer Science, Artificial Intelligence

A Gaussian Process Surrogate Model Assisted Evolutionary Algorithm for Medium Scale Expensive Optimization Problems

Bo Liu et al.

IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION (2014)

Article Mechanics

Water flooding optimization with adjoint model under control constraints

Zhang Kai et al.

JOURNAL OF HYDRODYNAMICS (2014)

Article Geosciences, Multidisciplinary

The egg model - a geological ensemble for reservoir simulation

J. D. Jansen et al.

GEOSCIENCE DATA JOURNAL (2014)

Article Computer Science, Interdisciplinary Applications

Ensemble smoother with multiple data assimilation

Alexandre A. Emerick et al.

COMPUTERS & GEOSCIENCES (2013)

Article Computer Science, Artificial Intelligence

Differential Evolution: A Survey of the State-of-the-Art

Swagatam Das et al.

IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION (2011)

Article Engineering, Petroleum

Use of Reduced-Order Modeling Procedures for Production Optimization

M. A. Cardoso et al.

SPE JOURNAL (2010)

Article Energy & Fuels

Ensemble-Based Closed-Loop Optimization Applied to Brugge Field

Yan Chen et al.

SPE RESERVOIR EVALUATION & ENGINEERING (2010)

Article Engineering, Petroleum

Production Optimization in Closed-Loop Reservoir Management

Chunhong Wang et al.

SPE JOURNAL (2009)

Article Engineering, Petroleum

Efficient Ensemble-Based Closed-Loop Production Optimization

Yan Chen et al.

SPE JOURNAL (2009)