Papers citing 'Distilling BERT into Simple Neural Networks with Unlabeled Transfer Data'

Title
Logits of API-Protected LLMs Leak Proprietary Information Matthew Finlayson Xiang Ren Swabha Swayamdipta PILM 181 37 0 14 Mar 2024
How to Fine-Tune Vision Models with SGDInternational Conference on Learning Representations (ICLR), 2022 Ananya Kumar Ruoqi Shen Sébastien Bubeck Suriya Gunasekar VLM 225 35 0 17 Nov 2022
Surgical Fine-Tuning Improves Adaptation to Distribution ShiftsInternational Conference on Learning Representations (ICLR), 2022 Yoonho Lee Annie S. Chen Fahim Tajwar Ananya Kumar Huaxiu Yao Abigail Z. Jacobs Chelsea Finn OOD 274 250 0 20 Oct 2022
Sound Natural: Content Rephrasing in Dialog Systems Arash Einolghozati Anchit Gupta K. Diedrick S. Gupta 140 10 0 03 Nov 2020
Weight Squeezing: Reparameterization for Knowledge Transfer and Model Compression Artem Chumachenko Daniil Gavrilov Nikita Balagansky Pavel Kalaidin 151 1 0 14 Oct 2020
BERT-EMD: Many-to-Many Layer Mapping for BERT Compression with Earth Mover's Distance Jianquan Li Xiaokang Liu Honghong Zhao Ruifeng Xu Min Yang Yaohong Jin 194 57 0 13 Oct 2020
Adversarial Self-Supervised Data-Free Distillation for Text ClassificationConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Xinyin Ma Yongliang Shen Gongfan Fang Chen Chen Chenghao Jia Weiming Lu 244 26 0 10 Oct 2020
Deep Learning Meets Projective ClusteringInternational Conference on Learning Representations (ICLR), 2020 Alaa Maalouf Harry Lang Daniela Rus Dan Feldman 194 10 0 08 Oct 2020
Compressed Deep Networks: Goodbye SVD, Hello Robust Low-Rank Approximation M. Tukan Alaa Maalouf Matan Weksler Dan Feldman 177 9 0 11 Sep 2020
Extracurricular Learning: Knowledge Transfer Beyond Empirical Distribution Hadi Pouransari Mojan Javaheripi Vinay Sharma Oncel Tuzel 126 5 0 30 Jun 2020
Compressing Large-Scale Transformer-Based Models: A Case Study on BERTTransactions of the Association for Computational Linguistics (TACL), 2020 Prakhar Ganesh Yao Chen Xin Lou Mohammad Ali Khan Yifan Yang Hassan Sajjad Preslav Nakov Deming Chen Marianne Winslett AI4CE 373 213 0 27 Feb 2020