Leveraging logit uncertainty for better knowledge distillation by Zhen Guo, Dong Wang, Qiang He, Pengzhou Zhang

Subjects: “…Knowledge distillation…”
Get full text

Confidence-Based Knowledge Distillation to Reduce Training Costs and Carbon Footprint for Low-Resource Neural Machine Translation by Maria Zafar, Patrick J. Wall, Souhail Bakkali, Rejwanul Haque

Subjects: “…knowledge distillation…”
Get full text

Autocorrelation Matrix Knowledge Distillation: A Task-Specific Distillation Method for BERT Models by Kai Zhang, Jinqiu Li, Bingqian Wang, Haoran Meng

Subjects: Get full text

Pseudo Multi-Modal Approach to LiDAR Semantic Segmentation by Kyungmin Kim

Subjects: Get full text

Optimizing Deep Learning Models for Resource‐Constrained Environments With Cluster‐Quantized Knowledge Distillation by Niaz Ashraf Khan, A. M. Saadman Rafat

Subjects: Get full text

A Review of Knowledge Distillation in Object Detection by Shengjie Cheng, Qiuxia Zhao, Xinyun Zhang, Nurbiya Yadikar, Kurban Ubul

Subjects: Get full text

Code summarization based on large model knowledge distillation by YOU Gang, LIU Wenjie, LI Meipeng, SUN Liqun, WANG Lian, TIAN Tieku

Subjects: “…code summarization|large model|knowledge distillation…”
Get full text

Improving Low-Resource Neural Machine Translation With Teacher-Free Knowledge Distillation by Xinlu Zhang, Xiao Li, Yating Yang, Rui Dong

Subjects: Get full text

Prune and Distill: A Novel Knowledge Distillation Method for GCNs-Based Recommender Systems by Peng Yi, Zhaoxian Li, Lu Chen, Cheng Yang, Xiongcai Cai

Subjects: Get full text

Knowledge Distillation for Face Recognition Using Synthetic Data With Dynamic Latent Sampling by Hatef Otroshi Shahreza, Anjith George, Sebastien Marcel

Subjects: Get full text

Transformer-Guided Serial Knowledge Distillation for High-Precision Anomaly Detection by Danyang Wang, Bingyan Wang

Subjects: Get full text

Optimal Knowledge Distillation through Non-Heuristic Control of Dark Knowledge by Darian Onchis, Codruta Istin, Ioan Samuila

Subjects: Get full text

Predicting Subsurface Layer Thickness and Seismic Wave Velocity Using Deep Learning: Knowledge Distillation Approach by Amir Moslemi, Anna Briskina, Jason Li, Zubeka Dang, Peyman Moghaddam

Subjects: Get full text

Knowledge distillation with resampling for imbalanced data classification: Enhancing predictive performance and explainability stability by Kazuki Fujiwara

Subjects: Get full text

Knowledge Distillation with Geometry-Consistent Feature Alignment for Robust Low-Light Apple Detection by Yuanping Shi, Yanheng Ma, Liang Geng, Lina Chu, Bingxuan Li, Wei Li

Subjects: Get full text

M3AE-Distill: An Efficient Distilled Model for Medical Vision–Language Downstream Tasks by Xudong Liang, Jiang Xie, Mengfei Zhang, Zhuo Bi

Subjects: Get full text

Fully Quantized Neural Networks for Audio Source Separation by Elad Cohen, Hai Victor Habi, Reuven Peretz, Arnon Netzer

Subjects: Get full text

A Malware Classification Method Based on Knowledge Distillation and Feature Fusion by Xin Guan, Guodong Zhang

Subjects: Get full text

Exploring Synergy of Denoising and Distillation: Novel Method for Efficient Adversarial Defense by Inpyo Hong, Sokjoon Lee

Subjects: Get full text

Advancing Model Explainability: Visual Concept Knowledge Distillation for Concept Bottleneck Models by Ju-Hwan Lee, Dang Thanh Vu, Nam-Kyung Lee, Il-Hong Shin, Jin-Young Kim

Subjects: Get full text