4.6 Article

Machine learning in process systems engineering: Challenges and opportunities

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Engineering, Environmental

A dynamic nonlinear optimization framework for learning data-driven reduced-order microkinetic models

Fernando Lejarza et al.

Summary: The use of kinetic models is crucial for the manufacturing of high value chemicals. This research introduces a nonlinear dynamic optimization framework for discovering governing reaction networks and learning model parameters from data. The proposed framework can produce accurate reduced-order microkinetic models that are computationally efficient. Numerical examples are provided to illustrate the key properties of the approach.

CHEMICAL ENGINEERING JOURNAL (2023)

Article Engineering, Chemical

Exploring the potential of time-series transformers for process modeling and control in chemical systems: An inevitable paradigm shift?

Niranjan Sitapure et al.

Summary: The past two years have witnessed groundbreaking advances in natural language processing, driven by the development of cutting-edge transformer models. Despite remarkable progress, there is still work to be done to fully apply transformers in chemical systems.

CHEMICAL ENGINEERING RESEARCH & DESIGN (2023)

Article Computer Science, Interdisciplinary Applications

Learning from flowsheets: A generative transformer model for autocompletion of flowsheets

Gabriel Vogel et al.

Summary: This research proposes a novel method for autocompletion of chemical flowsheets. By representing flowsheets as strings and utilizing a transformer-based language model, the grammatical structure of SFILES 2.0 language and common patterns in flowsheets can be learned. The proposed method has the potential to provide recommendations for chemical engineers during interactive flowsheet synthesis.

COMPUTERS & CHEMICAL ENGINEERING (2023)

Editorial Material Engineering, Chemical

Outlook: How I Learned to Love Machine Learning (A Personal Perspective on Machine Learning in Process Systems Engineering)

Victor M. Zavala

INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH (2023)

Article Chemistry, Physical

Machine Learning-Driven Multiscale Modeling: Bridging the Scales with a Next-Generation Simulation Infrastructure

Helgi I. Ingolfsson et al.

Summary: This study introduces a multiscale machine learning modeling infrastructure called MuMMI, which can simulate the process of RAS and RAF protein-membrane binding in a cancer signaling pathway, to address the interdependence across time and length scales in biology.

JOURNAL OF CHEMICAL THEORY AND COMPUTATION (2023)

Article Chemistry, Multidisciplinary

Generative Models as an Emerging Paradigm in the Chemical Sciences

Olexandr Isayev et al.

Summary: Traditional computational approaches to chemical species design are limited by the need to compute properties for a large number of candidates. Inverse design methods use generative modeling to optimize chemical structures based on desired properties. This article provides an overview and critical analysis of popular generative algorithms and discusses their potential applications in chemistry.

JOURNAL OF THE AMERICAN CHEMICAL SOCIETY (2023)

Article Computer Science, Interdisciplinary Applications

New paradigms for exploiting parallel experiments in Bayesian optimization

Leonardo D. Gonzalez et al.

Summary: Bayesian optimization is effective for closed-loop experimental design and black-box optimization, but it cannot directly exploit high-throughput experiments. In this work, we propose two new parallel BO algorithms that partition the design space based on the system structure and separable structure of the performance function. Numerical experiments show that our approaches significantly reduce search time and increase the probability of finding global solutions.

COMPUTERS & CHEMICAL ENGINEERING (2023)

Article Computer Science, Artificial Intelligence

A multi-modal pre-training transformer for universal transfer learning in metal-organic frameworks

Yeonghun Kang et al.

Summary: Metal-organic frameworks (MOFs) are crystalline porous materials with tunable building blocks. Machine learning approach can explore the vast chemical space of MOFs by predicting their properties. MOFTransformer, a pre-trained multi-modal transformer, achieves state-of-the-art results for property prediction and provides chemical insights through feature analysis.

NATURE MACHINE INTELLIGENCE (2023)

Article Automation & Control Systems

Large scale model predictive control with neural networks and primal active sets

Steven W. Chen et al.

Summary: This work presents an explicit-implicit procedure for computing a model predictive control (MPC) with guarantees on feasibility and stability. It combines an offline-trained neural network with an online primal active set solver, achieving efficiency and scalability.

AUTOMATICA (2022)

Article Engineering, Chemical

Architectures for neural networks as surrogates for dynamic systems in chemical engineering

Erik Esche et al.

Summary: The paper investigates the use of neural networks as surrogate models for dynamic systems in chemical engineering, particularly focusing on recurrent neural networks. Different types of data sets are used for training, and hyperparameter tuning is essential for rigorous investigation.

CHEMICAL ENGINEERING RESEARCH & DESIGN (2022)

Article Computer Science, Interdisciplinary Applications

A unifying modeling abstraction for infinite-dimensional optimization

Joshua L. Pulsipher et al.

Summary: Infinite-dimensional optimization problems involve modeling components defined over infinite-dimensional domains, requiring appropriate measures to properly pose the problem and often transforming into a finite dimensional representation for numerical solution. This work presents a unifying abstraction for modeling, analyzing, and solving InfiniteOpt problems, enabling technology transfer across disciplines and identifying new modeling paradigms.

COMPUTERS & CHEMICAL ENGINEERING (2022)

Review Chemistry, Multidisciplinary

A review of molecular representation in the age of machine learning

Daniel S. Wigh et al.

Summary: Interdisciplinary work in chemistry is becoming increasingly important due to advancements in computing, machine learning, and artificial intelligence. Understanding the representation of molecules in a machine-readable format is crucial for computational chemistry. This article introduces different representations of molecules and highlights three significant ones. Researchers often share their work on platforms like GitHub, but discussions on computation time and domain of applicability are often overlooked. The authors propose questions for further consideration to make chemical VAEs more accessible.

WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL MOLECULAR SCIENCE (2022)

Article Engineering, Chemical

Maximizing information from chemical engineering data sets: Applications to machine learning

Alexander Thebelt et al.

Summary: This review discusses the challenging data characteristics in chemical engineering applications and explores how current chemical engineering research is expanding the fields of data science and machine learning.

CHEMICAL ENGINEERING SCIENCE (2022)

Article Computer Science, Interdisciplinary Applications

Performance-oriented model learning for control via multi-objective Bayesian optimization *

Georgios Makrygiorgos et al.

Summary: This paper presents a strategy for performance-oriented, data-driven model adaptation for control, which aims to improve the model's control-oriented predictive quality for optimizing closed-loop performance measures. It leverages a composite model structure and multi-objective Bayesian optimization to systematically consider multiple performance measures and handle noisy observations.

COMPUTERS & CHEMICAL ENGINEERING (2022)

Article Biotechnology & Applied Microbiology

Autonomous chemical science and engineering enabled by self-driving laboratories

Jeffrey A. Bennett et al.

Summary: Recent advances in ML and AI have presented an exciting opportunity to computerize the study of complex reaction systems through self-driving laboratories. Autonomous robotic experimentation enables efficient exploration and optimization of high-dimensional reaction systems, while interpreting ML models trained on experimental data can unveil underlying reaction mechanisms.

CURRENT OPINION IN CHEMICAL ENGINEERING (2022)

Article Engineering, Chemical

Efficient machine learning based surrogate models for surface kinetics by approximating the rates of the rate-determining steps

Felix A. Doeppel et al.

Summary: Machine learning can accelerate simulations of catalytic systems by interpolating precomputed solutions of rate equations. Interpolation quality is improved when reaction rates are mapped using logarithmic scaling. However, this method is limited to reaction systems that strictly maintain positive or negative source terms throughout the relevant conditions. A new approach is proposed to overcome this limitation by interpolating the forward and reverse rates of rate-determining reactions. The new method achieves higher accuracy compared to established approaches and outperforms spline interpolation in terms of interpolation time, storage space, and required training data.

CHEMICAL ENGINEERING SCIENCE (2022)

Review Computer Science, Interdisciplinary Applications

Perspectives on the integration between first-principles and data-driven modeling

William Bradley et al.

Summary: This paper reviews the methods and challenges of embedding and integrating mechanistic information with data-driven models, and provides a comprehensive comparison and future outlook of these three research areas. Hybrid modeling, physics-informed Machine Learning (ML) and model calibration are applied and illustrated through a chemical reactor case study.

COMPUTERS & CHEMICAL ENGINEERING (2022)

Review Computer Science, Interdisciplinary Applications

A tutorial review of neural network modeling approaches for model predictive control

Yi Ming Ren et al.

Summary: This article presents an overview of recent developments in time-series neural network modeling and its use in model predictive control (MPC). A tutorial on constructing a neural network-based model is provided, along with discussion on key implementation issues. A nonlinear process example is introduced to demonstrate different neural network-based modeling approaches and evaluate their performance. Finally, future research directions on neural network modeling and its integration with MPC are briefly discussed.

COMPUTERS & CHEMICAL ENGINEERING (2022)

Article Biotechnology & Applied Microbiology

Recent progress toward catalyst properties, performance, and prediction with data-driven methods

Yu-Yen Chen et al.

Summary: Data-driven approaches are revolutionizing the field of heterogenous catalysis by utilizing machine learning, experimental data, and quantum mechanical calculations to advance catalyst design. This survey provides an overview of recent progress in catalysis informatics, discussing applications in experimental data analysis, prediction of catalytic properties, construction of reaction networks, and large-scale quantum mechanical simulations.

CURRENT OPINION IN CHEMICAL ENGINEERING (2022)

Review Management

Machine learning for combinatorial optimization: A methodological tour d'horizon

Yoshua Bengio et al.

Summary: This paper surveys recent attempts from the machine learning and operations research communities to leverage machine learning for solving combinatorial optimization problems, advocating for further integration and providing a methodology for doing so. The main point of the paper is to view generic optimization problems as data points to investigate the relevant distribution of problems for learning on a specific task.

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH (2021)

Article Engineering, Chemical

Predicting chemical reaction outcomes: A grammar ontology-based transformer framework

Vipul Mann et al.

Summary: This study reports an approach using context-free grammar-based representations of molecules in a neural machine translation framework to predict reaction outcomes, achieving high accuracy and syntactic validity. The model also uses a fraction of the training parameters compared to similar works in the field.

AICHE JOURNAL (2021)

Review Engineering, Chemical

Machine Learning in Chemical Engineering: A Perspective

Artur M. Schweidtmann et al.

Summary: The transformation of the chemical industry towards renewable energy and feedstock supply requires new paradigms for design. Recent breakthroughs in machine learning offer unique opportunities, but interdisciplinary research between machine learning and chemical engineering is essential to unlock the full potential. Six challenges have been identified to open up new methods in chemical engineering and formulate new problems for machine learning.

CHEMIE INGENIEUR TECHNIK (2021)

Article Computer Science, Interdisciplinary Applications

AI-DARWIN: A first principles-based model discovery engine using machine learning

Arijit Chakraborty et al.

Summary: Researchers have long been concerned about the limitations of AI-based black-box models in terms of reliability and interpretability, and have proposed hybrid models that combine first-principles with machine learning techniques as a solution. They have introduced a machine learning system that automatically discovers mechanism-based models for nonlinear parametric systems, leading to functionally traceable and explainable model forms.

COMPUTERS & CHEMICAL ENGINEERING (2021)

Article Automation & Control Systems

Dissipativity learning control (DLC): Theoretical foundations of input-output data-driven model-free control

Wentao Tang et al.

Summary: This study analyzes the statistical conditions for data-driven dissipativity learning control strategies to guarantee control performance, and establishes theoretical results on performance under nominal conditions and in the presence of statistical errors. The implementation of DLC is further formalized and demonstrated on a two-phase chemical reactor, along with a comparison to model identification-based LQG control.

SYSTEMS & CONTROL LETTERS (2021)

Article Chemistry, Multidisciplinary

Discovering Catalytic Reaction Networks Using Deep Reinforcement Learning from First-Principles

Tian Lan et al.

Summary: A novel artificial intelligence framework combining deep reinforcement learning techniques with density functional theory simulations has been developed to automate the search and evaluation of complex catalytic reaction networks. Demonstrated on the Haber-Bosch process, the framework shows outstanding capability in discovering complicated reaction paths.

JOURNAL OF THE AMERICAN CHEMICAL SOCIETY (2021)

Article Multidisciplinary Sciences

Bayesian reaction optimization as a tool for chemical synthesis

Benjamin J. Shields et al.

Summary: Reaction optimization and parameter optimization are crucial in synthetic chemistry and artificial intelligence, respectively. Bayesian optimization algorithm has shown exceptional performance in tuning machine learning models and has been applied in chemistry. However, its application in reaction optimization in synthetic chemistry has not been explored. Adopting Bayesian optimization methods into everyday laboratory practices could lead to more efficient synthesis of functional chemicals.

NATURE (2021)

Review Computer Science, Interdisciplinary Applications

Process systems engineering - The generation next?

E. N. Pistikopoulos et al.

Summary: Process Systems Engineering (PSE) is a scientific discipline that integrates scales and components to describe the behavior of physicochemical systems through mathematical modeling, data analytics, design, optimization, and control. It provides a scientific basis and computational tools to address contemporary and future challenges in energy, environment, future industries, and sustainability. This perspective article offers a guide to the next generation of PSE developments by examining its history, core competencies, current status, and ongoing trends.

COMPUTERS & CHEMICAL ENGINEERING (2021)

Review Computer Science, Interdisciplinary Applications

Recent trends on hybrid modeling for Industry 4.0

Joel Sansana et al.

Summary: This article discusses the chemical processing industry's reliance on modeling techniques and the impact of emerging data-driven frameworks on knowledge extraction, emphasizing the importance of integrating traditional mechanistic models with data-driven frameworks, and pointing out the need to incorporate process and phenomenological knowledge into big data and machine learning frameworks.

COMPUTERS & CHEMICAL ENGINEERING (2021)

Article Computer Science, Interdisciplinary Applications

Industrial, large-scale model predictive control with structured neural networks

Pratyush Kumar et al.

Summary: The study presents a neural network design for large, linear model predictive control applications, introduces a new feedforward network architecture, discusses data generation procedure and stability results, and demonstrates the advantages of the design approach through simulation studies.

COMPUTERS & CHEMICAL ENGINEERING (2021)

Article Multidisciplinary Sciences

Highly accurate protein structure prediction with AlphaFold

John Jumper et al.

Summary: Proteins are essential for life, and accurate prediction of their structures is a crucial research problem. Current experimental methods are time-consuming, highlighting the need for accurate computational approaches to address the gap in structural coverage. Despite recent progress, existing methods fall short of atomic accuracy in protein structure prediction.

NATURE (2021)

Review Automation & Control Systems

Reinforcement learning for batch process control: Review and perspectives

Haeun Yoo et al.

Summary: Batch or semi-batch processing in industrial chemical manufacturing is facing challenges in control technology. Reinforcement learning offers a potential alternative with significant improvements. This paper discusses the advantages of reinforcement learning over traditional control methods and its applications in industrial chemical process control.

ANNUAL REVIEWS IN CONTROL (2021)

Review Physics, Applied

Physics-informed machine learning

George Em Karniadakis et al.

Summary: Physics-informed learning seamlessly integrates data and mathematical models through neural networks or kernel-based regression networks for accurate inference of realistic and high-dimensional multiphysics problems. Challenges remain in incorporating noisy data seamlessly, complex mesh generation, and addressing high-dimensional problems.

NATURE REVIEWS PHYSICS (2021)

Article Materials Science, Multidisciplinary

A data fusion approach to optimize compositional stability of halide perovskites

Shijing Sun et al.

Summary: This study presents a physics-constrained learning framework to identify the most stable alloyed organic-inorganic perovskites. By sampling just 1.8% of the compositional space, compounds with excellent stability and performance were found. Using this approach, enhanced solar cell stability without compromising conversion efficiency was achieved.

MATTER (2021)

Article Computer Science, Artificial Intelligence

Mapping the space of chemical reactions using attention-based neural networks

Philippe Schwaller et al.

Summary: This study demonstrates how transformer-based models can infer reaction classes from non-annotated text-based representations of chemical reactions with an accuracy of 98.2%. The learned representations can be used as reaction fingerprints to capture fine-grained differences between reaction classes better than traditional fingerprints. Insights into chemical reaction space are illustrated through an interactive reaction atlas providing visual clustering and similarity searching.

NATURE MACHINE INTELLIGENCE (2021)

Article Computer Science, Interdisciplinary Applications

Reinforcement learning for batch bioprocess optimization

P. Petsagkourakis et al.

COMPUTERS & CHEMICAL ENGINEERING (2020)

Article Multidisciplinary Sciences

Inverse design of porous materials using artificial neural networks

Baekjun Kim et al.

SCIENCE ADVANCES (2020)

Review Computer Science, Interdisciplinary Applications

A review On reinforcement learning: Introduction and applications in industrial process control

Rui Nian et al.

COMPUTERS & CHEMICAL ENGINEERING (2020)

Article Multidisciplinary Sciences

Accelerated discovery of CO2 electrocatalysts using active machine learning

Miao Zhong et al.

NATURE (2020)

Article Computer Science, Interdisciplinary Applications

Stochastic data-driven model predictive control using gaussian processes

Eric Bradford et al.

COMPUTERS & CHEMICAL ENGINEERING (2020)

Article Engineering, Chemical

Synergistic and Intelligent Process Optimization: First Results and Open Challenges

Iiro Harjunkoski et al.

INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH (2020)

Article Chemistry, Medicinal

Uncertainty Quantification Using Neural Networks for Molecular Property Prediction

Lior Hirschfeld et al.

JOURNAL OF CHEMICAL INFORMATION AND MODELING (2020)

Review Chemistry, Multidisciplinary

Molecular representations in AI-driven drug discovery: a review and practical guide

Laurianne David et al.

JOURNAL OF CHEMINFORMATICS (2020)

Article Automation & Control Systems

Efficient Representation and Approximation of Model Predictive Control Laws via Deep Learning

Benjamin Karg et al.

IEEE TRANSACTIONS ON CYBERNETICS (2020)

Article Automation & Control Systems

Data Informativity: A New Perspective on Data-Driven Analysis and Control

Henk J. van Waarde et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2020)

Article Chemistry, Physical

Identification of optimally stable nanocluster geometries via mathematical optimization and density-functional theory

Natalie M. Isenberg et al.

MOLECULAR SYSTEMS DESIGN & ENGINEERING (2020)

Article Computer Science, Interdisciplinary Applications

Multi-timescale, multi-period decision-making model development by combining reinforcement learning and mathematical programming

Joohyun Shin et al.

COMPUTERS & CHEMICAL ENGINEERING (2019)

Article Computer Science, Interdisciplinary Applications

Reinforcement Learning - Overview of recent progress and implications for process control

Joohyun Shin et al.

COMPUTERS & CHEMICAL ENGINEERING (2019)

Article Engineering, Chemical

Toward self-driving processes: A deep reinforcement learning approach to control

Steven Spielberg et al.

AICHE JOURNAL (2019)

Article Computer Science, Interdisciplinary Applications

Advances and opportunities in machine learning for process data analytics

S. Joe Qin et al.

COMPUTERS & CHEMICAL ENGINEERING (2019)

Article Engineering, Chemical

110th Anniversary: Using Data to Bridge the Time and Length Scales of Process Systems

Calvin Tsay et al.

INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH (2019)

Article Chemistry, Multidisciplinary

Molecular Transformer: A Model for Uncertainty-Calibrated Chemical Reaction Prediction

Philippe Schwaller et al.

ACS CENTRAL SCIENCE (2019)

Article Chemistry, Physical

Optimization-Based Design of Active and Stable Nanostructured Surfaces

Christopher L. Hanselman et al.

JOURNAL OF PHYSICAL CHEMISTRY C (2019)

Article Engineering, Chemical

The promise of artificial intelligence in chemical engineering: Is it here, finally?

Venkat Venkatasubramanian

AICHE JOURNAL (2019)

Article Operations Research & Management Science

Deterministic Global Optimization with Artificial Neural Networks Embedded

Artur M. Schweidtmann et al.

JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS (2019)

Article Computer Science, Software Engineering

CasADi: a software framework for nonlinear optimization and optimal control

Joel A. E. Andersson et al.

MATHEMATICAL PROGRAMMING COMPUTATION (2019)

Review Computer Science, Interdisciplinary Applications

Advances in surrogate based modeling, feasibility analysis, and optimization: A review

Atharv Bhosekar et al.

COMPUTERS & CHEMICAL ENGINEERING (2018)

Article Computer Science, Interdisciplinary Applications

Machine learning: Overview of the recent progresses and implications for the process systems engineering field

Jay H. Lee et al.

COMPUTERS & CHEMICAL ENGINEERING (2018)

Article Chemistry, Physical

Sequential-Optimization-Based Framework for Robust Modeling and Design of Heterogeneous Catalytic Systems

Srinivas Rangarajan et al.

JOURNAL OF PHYSICAL CHEMISTRY C (2017)

Article Chemistry, Physical

Predicting Catalytic Activity of Nanoparticles by a DFT-Aided Machine-Learning Algorithm

Ryosuke Jinnouchi et al.

JOURNAL OF PHYSICAL CHEMISTRY LETTERS (2017)

Review Chemistry, Applied

Big Data Analytics in Chemical Engineering

Leo Chiang et al.

ANNUAL REVIEW OF CHEMICAL AND BIOMOLECULAR ENGINEERING, VOL 8 (2017)

Article Multidisciplinary Sciences

Discovering governing equations from data by sparse identification of nonlinear dynamical systems

Steven L. Brunton et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2016)

Article Engineering, Chemical

Bayesian inference of chemical kinetic models from proposed reactions

Nikhil Galagali et al.

CHEMICAL ENGINEERING SCIENCE (2015)

Article Engineering, Chemical

Learning surrogate models for simulation-based optimization

Alison Cozad et al.

AICHE JOURNAL (2014)

Article Multidisciplinary Sciences

Distilling Free-Form Natural Laws from Experimental Data

Michael Schmidt et al.

SCIENCE (2009)