Reinforcement learning-based cost-sensitive classifier for imbalanced fault classification

Fault classification plays a crucial role in the industrial process monitoring domain. In the datasets collected from real-life industrial processes, the data distribution is usually imbalanced. The datasets contain a large amount of normal data (majority) and only a small amount of faulty data (minority); this phenomenon is also known as the imbalanced fault classification problem. To solve the imbalanced fault classification problem, a novel reinforcement learning (RL)-based cost-sensitive classifier (RLCC) based on policy gradient is proposed in this paper. In RLCC, a novel cost-sensitive learning strategy based on policy gradient and the actor-critic of RL is developed. The novel cost-sensitive learning strategy can adaptively learn the cost matrix and dynamically yield the sample weights. In addition, RLCC uses a newly designed reward to train the sample weight learner and classifier using an alternating iterative approach. The alternating iterative approach makes RLCC highly flexible and effective in solving the imbalanced fault classification problem. The effectiveness and practicability of the proposed RLCC method are verified through its application in a real-world dataset and an industrial process benchmark.

Automated summary

Fault classification is crucial in industrial process monitoring, but the imbalanced distribution of real-life datasets poses challenges. This paper proposes a novel reinforcement learning-based cost-sensitive classifier (RLCC) for imbalanced fault classification. RLCC utilizes a cost-sensitive learning strategy and a newly designed reward, trained through an alternating iterative approach.