4.7 Article

A Maximally Split and Adaptive Relaxed Alternating Direction Method of Multipliers for Regularized Extreme Learning Machines

Related references

Note: Only part of the references are listed.
Article Computer Science, Artificial Intelligence

An Alternating-Direction-Method of Multipliers-Incorporated Approach to Symmetric Non-Negative Latent Factor Analysis

Xin Luo et al.

Summary: This study proposes an ASNL model for handling large-scale undirected networks, which can efficiently represent incomplete and imbalanced data of SHDI matrices, and has fast model convergence and high computational efficiency. Empirical studies on four SHDI matrices demonstrate that ASNL significantly outperforms other models in prediction accuracy and computational efficiency.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Review Mathematics

Matrix Factorization Techniques in Machine Learning, Signal Processing, and Statistics

Ke-Lin Du et al.

Summary: Compressed sensing is an alternative to Shannon/Nyquist sampling for acquiring sparse or compressible signals. Sparse coding represents a signal as a sparse linear combination of atoms, which are elementary signals derived from a predefined dictionary. Matrix completion is the process of recovering a data matrix from a subset of its entries, and it extends the principles of compressed sensing and sparse approximation.

MATHEMATICS (2023)

Article Automation & Control Systems

Novel L1 Regularized Extreme Learning Machine for Soft-Sensing of an Industrial Process

XuDong Shi et al.

Summary: This article proposes a novel L1 norm-based extreme learning machine (ELM) by integrating bound optimization theory with variational Bayesian inference. The proposed method efficiently solves the overfitting problem and demonstrates competitive performance in an industrial case study.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2022)

Article Computer Science, Artificial Intelligence

Mixture Correntropy-Based Kernel Extreme Learning Machines

Yunfei Zheng et al.

Summary: This article introduces the kernel-based extreme learning machine (KELM) and its outstanding performance in addressing regression and classification problems. To improve the robustness of KELM, a mixture correntropy-based KELM (MC-KELM) is proposed, which adopts a maximum mixture correntropy criterion as the optimization criterion. Additionally, an online sequential version of MC-KELM (MCOS-KELM) is developed to handle sequentially arriving data. Experimental results demonstrate the superior performance of the new methods.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Automation & Control Systems

New Results on the Local Linear Convergence of ADMM: A Joint Approach

Tomaso Erseghe

Summary: The ADMM method is widely used in solving convex problems in a distributed form, requiring fine-tuning of system parameters and a thorough understanding of the hidden mechanisms for efficient operation. The development of new theoretical insights strengthens the precision of speed estimates for ADMM's convergence.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2021)

Article Geochemistry & Geophysics

SAR Parametric Super-Resolution Image Reconstruction Methods Based on ADMM and Deep Neural Network

Yangkai Wei et al.

Summary: By introducing new scattering models, two SAR parametric super-resolution image reconstruction methods based on compressed sensing are proposed in this article, which handle the sparsity of point scatterers, line-segment scatterers, and rectangular-plate scatterers using different penalty terms, ultimately addressing the challenges in existing methods.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2021)

Article Engineering, Electrical & Electronic

A Two-Level ADMM Algorithm for AC OPF With Global Convergence Guarantees

Kaizhao Sun et al.

Summary: This paper proposes a two-level distributed algorithmic framework for solving the AC optimal power flow (OPF) problem with convergence guarantees. The proposed algorithm demonstrates global convergence and iteration complexity under mild assumptions, and outperforms existing ADMM variants in terms of convergence, scalability, and robustness through extensive numerical experiments. Furthermore, with appropriate parallel implementation, the algorithm exhibits fast convergence comparable to or even better than the state-of-the-art centralized solver.

IEEE TRANSACTIONS ON POWER SYSTEMS (2021)

Article Green & Sustainable Science & Technology

Hierarchical Optimal Control for Synthetic Inertial Response of Wind Farm Based on Alternating Direction Method of Multipliers

Sheng Huang et al.

Summary: The proposed HOAPC scheme aims to optimize the active power control in wind farms for synthetic inertial response, minimizing wind energy losses and ensuring rotor speed stability by coordinating the outputs of wind turbines. It utilizes model predictive control (MPC) based on local wind conditions, and a hierarchical solution method using ADMM to improve computational efficiency and information privacy protection.

IEEE TRANSACTIONS ON SUSTAINABLE ENERGY (2021)

Article Computer Science, Artificial Intelligence

A Minibatch Proximal Stochastic Recursive Gradient Algorithm Using a Trust-Region-Like Scheme and Barzilai-Borwein Stepsizes

Tengteng Yu et al.

Summary: The article introduces a algorithm called mSRGTR-BB for minimizing smooth and nonsmooth convex functions, demonstrating superior performance in experiments.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2021)

Article Automation & Control Systems

Asynchronous Distributed Optimization Over Lossy Networks via Relaxed ADMM: Stability and Linear Convergence

Nicola Bastianello et al.

Summary: This article focuses on minimizing convex cost functions in a distributed fashion over a peer-to-peer network, proposing a new algorithm based on operator theory and proving its convergence and convergence rate. Numerical results demonstrate the effectiveness of the method in different scenarios.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2021)

Article Automation & Control Systems

Distributed MPC for Reconfigurable Architecture Systems via Alternating Direction Method of Multipliers

Ting Bai et al.

Summary: This paper proposes a novel distributed model predictive control scheme based on ADMM to address the control problem of linear systems with changeable network topology. The scheme enables quick response when modifying network topology while maintaining satisfactory dynamic performance.

IEEE-CAA JOURNAL OF AUTOMATICA SINICA (2021)

Article Engineering, Electrical & Electronic

Data-Driven Sparse Sensor Selection Based on A-Optimal Design of Experiment With ADMM

Takayuki Nagata et al.

Summary: This study proposes a sensor selection method based on the proximal splitting algorithm and the ADMM algorithm, showing better performance than existing greedy and convex relaxation methods in terms of the A-optimality criterion. The proposed method requires longer computational time than the greedy method but is shorter than the convex relaxation method in large-scale problems.

IEEE SENSORS JOURNAL (2021)

Article Automation & Control Systems

A Distributed Dual Consensus ADMM Based on Partition for DC-DOPF With Carbon Emission Trading

Linfeng Yang et al.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2020)

Article Computer Science, Artificial Intelligence

A Maximally Split and Relaxed ADMM for Regularized Extreme Learning Machines

Xiaoping Lai et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2020)

Article Computer Science, Artificial Intelligence

Deep and wide feature based extreme learning machine for image classification

Yuanyuan Qing et al.

NEUROCOMPUTING (2020)

Proceedings Paper Acoustics

Low-bit Quantization of Recurrent Neural Network Language Models Using Alternating Direction Methods of Multipliers

Junhao Xu et al.

2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (2020)

Article Engineering, Electrical & Electronic

Relaxed Alternating Direction Method of Multipliers for Hedging Communication Packet Loss in Integrated Electrical and Heating System

Xinyu Liang et al.

JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY (2020)

Article Computer Science, Artificial Intelligence

ADMM-Based Algorithm for Training Fault Tolerant RBF Networks and Selecting Centers

Hao Wang et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2018)

Article Computer Science, Artificial Intelligence

A Parallel Multiclassification Algorithm for Big Data Using an Extreme Learning Machine

Mingxing Duan et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2018)

Article Mathematics

Convergence of ADMM for multi-block nonconvex separable optimization models

Ke Guo et al.

FRONTIERS OF MATHEMATICS IN CHINA (2017)

Article Computer Science, Artificial Intelligence

Distributed extreme learning machine with alternating direction method of multiplier

Minnan Luo et al.

NEUROCOMPUTING (2017)

Article Automation & Control Systems

Group-Based Alternating Direction Method of Multipliers for Distributed Linear Classification

Huihui Wang et al.

IEEE TRANSACTIONS ON CYBERNETICS (2017)

Article Automation & Control Systems

GPU-Accelerated Parallel Hierarchical Extreme Learning Machine on Flink for Big Data

Cen Chen et al.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Adaptive Relaxed ADMM: Convergence Theory and Practical Implementation

Zheng Xu et al.

30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017) (2017)

Article Computer Science, Artificial Intelligence

PR-ELM: Parallel regularized extreme learning machine based on cluster

Yueqing Wang et al.

NEUROCOMPUTING (2016)

Article Computer Science, Software Engineering

The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent

Caihua Chen et al.

MATHEMATICAL PROGRAMMING (2016)

Article Operations Research & Management Science

A Convergent 3-Block Semi-Proximal ADMM for Convex Minimization Problems with One Strongly Convex Block

Min Li et al.

ASIA-PACIFIC JOURNAL OF OPERATIONAL RESEARCH (2015)

Article Automation & Control Systems

Fast cross validation for regularized extreme learning machine

Yongping Zhao et al.

JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS (2014)

Article Operations Research & Management Science

An ADM-based splitting method for separable convex programming

Deren Han et al.

COMPUTATIONAL OPTIMIZATION AND APPLICATIONS (2013)

Article Computer Science, Artificial Intelligence

Extreme learning machine: Theory and applications

Guang-Bin Huang et al.

NEUROCOMPUTING (2006)