Related references
Note: Only part of the references are listed.Highlight Every Step: Knowledge Distillation via Collaborative Teaching
Haoran Zhao et al.
IEEE TRANSACTIONS ON CYBERNETICS (2022)
Joint architecture and knowledge distillation in CNN for Chinese text recognition
Zi-Rui Wang et al.
PATTERN RECOGNITION (2021)
Adversarial co-distillation learning for image recognition
Haoran Zhang et al.
PATTERN RECOGNITION (2021)
Residual error based knowledge distillation
Mengya Gao et al.
NEUROCOMPUTING (2021)
Probabilistic Knowledge Transfer for Lightweight Deep Representation Learning
Nikolaos Passalis et al.
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2021)
Data-free Knowledge Distillation for Object Detection
Akshay Chawla et al.
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021 (2021)
Effectiveness of Arbitrary Transfer Sets for Data-free Knowledge Distillation
Gaurav Kumar Nayak et al.
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021) (2021)
Learning an Evolutionary Embedding via Massive Knowledge Distillation
Xiang Wu et al.
INTERNATIONAL JOURNAL OF COMPUTER VISION (2020)
Reliable Data Distillation on Graph Convolutional Network
Wentao Zhang et al.
SIGMOD'20: PROCEEDINGS OF THE 2020 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (2020)
GAN Compression: Efficient Architectures for Interactive Conditional GANs
Muyang Li et al.
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2020)
Knowledge as Priors: Cross-Modal Knowledge Generalization for Datasets without Superior Knowledge
Long Zhao et al.
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2020)
A Multi-task Mean Teacher for Semi-supervised Shadow Detection
Zhihao Chen et al.
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2020)
Creating Something from Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing
Hengtong Hu et al.
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2020)
ADAPTIVE KNOWLEDGE DISTILLATION BASED ON ENTROPY
Kisoo Kwon et al.
2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (2020)
Adaptive multi-teacher multi-level knowledge distillation
Yuang Liu et al.
NEUROCOMPUTING (2020)
Knowledge Distillation-Based Representation Learning for Short-Utterance Spoken Language Identification
Peng Shen et al.
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING (2020)
Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System
Ze Yang et al.
PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING (WSDM '20) (2020)
Packing Convolutional Neural Networks in the Frequency Domain
Yunhe Wang et al.
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2019)
Spatiotemporal distilled dense-connectivity network for video action recognition
Wangli Hao et al.
PATTERN RECOGNITION (2019)
Adversarial Distillation for Efficient Recommendation with External Knowledge
Xu Chen et al.
ACM TRANSACTIONS ON INFORMATION SYSTEMS (2019)
A novel Enhanced Collaborative Autoencoder with knowledge distillation for top-N recommender systems
Yiteng Pan et al.
NEUROCOMPUTING (2019)
Improved Knowledge Distillation for Training Fast Low Resolution Face Recognition Model
Mengjiao Wang et al.
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW) (2019)
Spatial Knowledge Distillation to aid Visual Reasoning
Somak Aditya et al.
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV) (2019)
Teacher Guided Architecture Search
Pouya Bashivan et al.
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)
Teacher Supervises Students How to Learn From Partially Labeled Images for Facial Landmark Detection
Xuanyi Dong et al.
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)
Learning Lightweight Lane Detection CNNs by Self Attention Distillation
Yuenan Hou et al.
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)
UM-Adapt: Unsupervised Multi-Task Adaptation Using Adversarial Cross-Task Distillation
Jogendra Nath Kundu et al.
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)
Overcoming Catastrophic Forgetting with Unlabeled Data in the Wild
Kibok Lee et al.
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)
Distilling Knowledge From a Deep Pose Regressor Network
Muhamad Risqi U. Saputra et al.
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)
Customizing Student Networks From Heterogeneous Teachers via Adaptive Knowledge Amalgamation
Chengchao Shen et al.
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)
Compact Trilinear Interaction for Visual Question Answering
Tuong Do et al.
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)
Lifelong GAN: Continual Learning for Conditional Image Generation
Mengyao Zhai et al.
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)
TextKD-GAN: Text Generation Using Knowledge Distillation and Generative Adversarial Networks
Md. Akmal Haidar et al.
ADVANCES IN ARTIFICIAL INTELLIGENCE (2019)
Unifying Heterogeneous Classifiers with Distillation
Jayakorn Vongkulbhisal et al.
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) (2019)
Student Becoming the Master: Knowledge Amalgamation for Joint Scene Parsing, Depth Estimation, and More
Jingwen Ye et al.
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) (2019)
Fast Human Pose Estimation
Feng Zhang et al.
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) (2019)
Efficient Video Classification Using Fewer Frames
Shweta Bhardwaj et al.
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) (2019)
CONDITIONAL TEACHER-STUDENT LEARNING
Zhong Meng et al.
2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) (2019)
COGNI-NET: COGNITIVE FEATURE LEARNING THROUGH DEEP VISUAL PERCEPTION
Pranay Mukherjee et al.
2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) (2019)
CROSS-MODAL KNOWLEDGE DISTILLATION FOR ACTION RECOGNITION
Fida Mohammad Thoker et al.
2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) (2019)
Video Object Segmentation using Teacher-Student Adaptation in a Human Robot Interaction (HRI) Setting
Mennatullah Siam et al.
2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA) (2019)
An Adversarial Feature Distillation Method for Audio Classification
Liang Gao et al.
IEEE ACCESS (2019)
Learning without Forgetting
Zhizhong Li et al.
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2018)
Model Compression and Acceleration for Deep Neural Networks The principles, progress, and challenges
Yu Cheng et al.
IEEE SIGNAL PROCESSING MAGAZINE (2018)
Neural Compatibility Modeling with Attentive Knowledge Distillation
Xuemeng Song et al.
ACM/SIGIR PROCEEDINGS 2018 (2018)
Feature Representation of Short Utterances based on Knowledge Distillation for Spoken Language Identification
Peng Shen et al.
19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES (2018)
Knowledge Distillation for Sequence Model
Mingkun Huang et al.
19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES (2018)
Through-Wall Human Pose Estimation Using Radio Signals
Mingmin Zhao et al.
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2018)
Ranking Distillation: Learning Compact Ranking Models With High Performance for Recommender System
Jiaxi Tang et al.
KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING (2018)
Mimicking Very Efficient Network for Object Detection
Quanquan Li et al.
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017) (2017)
Densely Connected Convolutional Networks
Gao Huang et al.
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017) (2017)
Efficient Knowledge Distillation from an Ensemble of Teachers
Takashi Fukuda et al.
18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION (2017)
Xception: Deep Learning with Depthwise Separable Convolutions
Francois Chollet
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017) (2017)
Wise teachers train better DNN acoustic models
Ryan Price et al.
EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING (2016)
Distilling Word Embeddings: An Encoding Approach
Lili Mou et al.
CIKM'16: PROCEEDINGS OF THE 2016 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT (2016)
Distilling knowledge from ensembles of neural networks for speech recognition
Yevgen Chebotar et al.
17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES (2016)
Sequence Student-Teacher Training of Deep Neural Networks
Jeremy H. M. Wong et al.
17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES (2016)
Representation Learning: A Review and New Perspectives
Yoshua Bengio et al.
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2013)
Share Paper
