4.7 Article

Teacher-student knowledge distillation based on decomposed deep feature representation for intelligent mobile applications

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Biology

Overcoming limitation of dissociation between MD and MI classifications of breast cancer histopathological images through a novel decomposed feature-based knowledge distillation method

Majid Sepahvand et al.

Summary: This paper proposes a method based on knowledge distillation to overcome the dissociation between MI classification and MD classification in histopathological images of breast cancer. The experimental results show that the proposed method achieves high accuracy rates at different magnification factors.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Computer Science, Information Systems

A novel method for reducing arrhythmia classification from 12-lead ECG signals to single-lead ECG with minimal loss of accuracy through teacher-student knowledge distillation

Majid Sepahvand et al.

Summary: This paper proposes a method to bridge the gap between arrhythmia classification models using multi-lead ECG signals and those using single-lead ECG signals through knowledge distillation. The results show that the method successfully compresses the model size while maintaining a high level of accuracy.

INFORMATION SCIENCES (2022)

Article Computer Science, Artificial Intelligence

A novel representation in genetic programming for ensemble classification of human motions based on inertial signals

Majid Sepahvand et al.

Summary: The manuscript introduces a novel method for human motion detection based on inertial sensors and a new ensemble learning approach through genetic programing. The method utilizes spatial information of human motion for feature extraction and enhances classifier optimization through genetic programing.

EXPERT SYSTEMS WITH APPLICATIONS (2021)

Article Computer Science, Artificial Intelligence

A tucker decomposition based knowledge distillation for intelligent edge applications

Cheng Dai et al.

Summary: Knowledge distillation (KD) has been widely studied in recent deep learning research, but its effectiveness is compromised when there is a significant gap in strength between the teacher and student networks. To address this issue, the TDKD method is proposed to transfer complex mappings from cumbersome models to simpler ones by reducing capacity variance. This approach has been shown to effectively improve distillation performance and reactivate previously ineffective KD methods.

APPLIED SOFT COMPUTING (2021)

Article Engineering, Biomedical

A novel multi-lead ECG personal recognition based on signals functional and structural dependencies using time-frequency representation and evolutionary morphological CNN

Majid Sepahvand et al.

Summary: Biometric recognition systems can utilize physiological signals like electrocardiogram (ECG) for identification, and a personal biometric recognition system has been designed to estimate these medical variables.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2021)

Article Automation & Control Systems

Model Compression for IoT Applications in Industry 4.0 via Multiscale Knowledge Transfer

Shipeng Fu et al.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2020)

Article Computer Science, Artificial Intelligence

Packing Convolutional Neural Networks in the Frequency Domain

Yunhe Wang et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2019)

Article Computer Science, Artificial Intelligence

ADA-Tucker: Compressing deep neural networks via adaptive dimension adjustment tucker decomposition

Zhisheng Zhong et al.

NEURAL NETWORKS (2019)

Article Computer Science, Artificial Intelligence

Compressing CNN-DBLSTM models for OCR with teacher-student learning and Tucker decomposition

Haisong Ding et al.

PATTERN RECOGNITION (2019)

Article Engineering, Electrical & Electronic

Model Compression and Acceleration for Deep Neural Networks The principles, progress, and challenges

Yu Cheng et al.

IEEE SIGNAL PROCESSING MAGAZINE (2018)

Article Biology

A deep convolutional neural network model to classify heartbeats

U. Rajendra Acharya et al.

COMPUTERS IN BIOLOGY AND MEDICINE (2017)

Review Computer Science, Artificial Intelligence

Representation Learning: A Review and New Perspectives

Yoshua Bengio et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2013)

Article Computer Science, Artificial Intelligence

A fast learning algorithm for deep belief nets

Geoffrey E. Hinton et al.

NEURAL COMPUTATION (2006)

Article Mathematics, Applied

On the best rank-1 and rank-(R1,R2,...,RN) approximation of higher-order tensors

L De Lathauwer et al.

SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS (2000)