Distilling Efficient Vision Transformers from CNNs for Semantic
SegmentationPattern Recognition (Pattern Recogn.), 2023 |
Hilbert Distillation for Cross-Dimensionality NetworksNeural Information Processing Systems (NeurIPS), 2022 |
Efficient Knowledge Distillation from Model CheckpointsNeural Information Processing Systems (NeurIPS), 2022 |
Learn From the Past: Experience Ensemble Knowledge DistillationInternational Conference on Pattern Recognition (ICPR), 2022 |
Compacting Deep Neural Networks for Internet of Things: Methods and
ApplicationsIEEE Internet of Things Journal (IEEE IoT Journal), 2021 |
Even your Teacher Needs Guidance: Ground-Truth Targets Dampen
Regularization Imposed by Self-DistillationNeural Information Processing Systems (NeurIPS), 2021 |