Novel L1 Regularized Extreme Learning Machine for Soft-Sensing of an Industrial Process

Extreme learning machine (ELM) is suitable for nonlinear soft sensor development. Yet it faces an overfitting problem. To overcome it, this work integrates bound optimization theory with variational Bayesian (VB) inference to derive novel L1 norm-based ELMs. An L1 term is attached to the squared sum cost of prediction errors to formulate an objective function. Considering the nonconvexity and nonsmoothness of the objective function, this article uses bound optimization theory, and constructs a proper surrogate function to equivalently convert a challenging L1 norm-based optimization problem into easy one. Then, VB inference is adopted for optimizing the converted problem. Thus, an L1 norm-based ELM can be efficiently optimized by an alternating optimization algorithm with a proved convergence. Finally, a soft sensor is developed based on the proposed algorithm. An industrial case study is carried out to demonstrate that the proposed soft sensor is competitive against recent ones.

Automated summary

This article proposes a novel L1 norm-based extreme learning machine (ELM) by integrating bound optimization theory with variational Bayesian inference. The proposed method efficiently solves the overfitting problem and demonstrates competitive performance in an industrial case study.