Born Again Neural Networks

12 May 2018

Papers citing "Born Again Neural Networks"

50 / 166 papers shown

Title
Boosting the Adversarial Transferability of Surrogate Models with Dark Knowledge Dingcheng Yang Zihao Xiao Wenjian Yu AAML 28 5 0 16 Jun 2022
POODLE: Improving Few-shot Learning via Penalizing Out-of-Distribution Samples Duong H. Le Khoi Duc Minh Nguyen Khoi Nguyen Quoc-Huy Tran Rang Nguyen Binh-Son Hua OODD 30 39 0 08 Jun 2022
A General Multiple Data Augmentation Based Framework for Training Deep Neural Networks Bin Hu Yu Sun •. A. K. Qin AI4CE 26 0 0 29 May 2022
Generalized Knowledge Distillation via Relationship Matching Han-Jia Ye Su Lu De-Chuan Zhan FedML 22 20 0 04 May 2022
Multimodal Adaptive Distillation for Leveraging Unimodal Encoders for Vision-Language Tasks Zhecan Wang Noel Codella Yen-Chun Chen Luowei Zhou Xiyang Dai ... Jianwei Yang Haoxuan You Kai-Wei Chang Shih-Fu Chang Lu Yuan VLM OffRL 23 22 0 22 Apr 2022
Localization Distillation for Object Detection Zhaohui Zheng Rongguang Ye Ping Wang Dongwei Ren Jun Wang W. Zuo Ming-Ming Cheng 19 64 0 12 Apr 2022
Universal Representations: A Unified Look at Multiple Task and Domain Learning Wei-Hong Li Xialei Liu Hakan Bilen SSL OOD 28 27 0 06 Apr 2022
Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation Manthan Thakker Sefik Emre Eskimez Takuya Yoshioka Huaming Wang 14 28 0 02 Apr 2022
Self-Distillation from the Last Mini-Batch for Consistency Regularization Yiqing Shen Liwu Xu Yuzhe Yang Yaqian Li Yandong Guo 15 60 0 30 Mar 2022
Reducing Flipping Errors in Deep Neural Networks Xiang Deng Yun Xiao Bo Long Zhongfei Zhang AAML 27 3 0 16 Mar 2022
Deep Class Incremental Learning from Decentralized Data Xiaohan Zhang Songlin Dong Jinjie Chen Qiaoling Tian Yihong Gong Xiaopeng Hong CLL 23 11 0 11 Mar 2022
Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective Quan Cui Bingchen Zhao Zhao-Min Chen Borui Zhao Renjie Song Jiajun Liang Boyan Zhou Osamu Yoshie 19 18 0 08 Mar 2022
Better Supervisory Signals by Observing Learning Paths Yi Ren Shangmin Guo Danica J. Sutherland 25 21 0 04 Mar 2022
A Semi-supervised Learning Approach with Two Teachers to Improve Breakdown Identification in Dialogues Qian Lin Hwee Tou Ng 22 4 0 22 Feb 2022
Transfer and Marginalize: Explaining Away Label Noise with Privileged Information Mark Collier Rodolphe Jenatton Efi Kokiopoulou Jesse Berent 25 13 0 18 Feb 2022
Iterative Self Knowledge Distillation -- From Pothole Classification to Fine-Grained and COVID Recognition Kuan-Chuan Peng 39 2 0 04 Feb 2022
Fortuitous Forgetting in Connectionist Networks Hattie Zhou Ankit Vani Hugo Larochelle Aaron Courville CLL 6 42 0 01 Feb 2022
CLIP-TD: CLIP Targeted Distillation for Vision-Language Tasks Zhecan Wang Noel Codella Yen-Chun Chen Luowei Zhou Jianwei Yang Xiyang Dai Bin Xiao Haoxuan You Shih-Fu Chang Lu Yuan CLIP VLM 22 39 0 15 Jan 2022
Class-Incremental Continual Learning into the eXtended DER-verse Matteo Boschini Lorenzo Bonicelli Pietro Buzzega Angelo Porrello Simone Calderara CLL BDL 21 128 0 03 Jan 2022
Static-Dynamic Co-Teaching for Class-Incremental 3D Object Detection Na Zhao G. Lee CLL 27 16 0 14 Dec 2021
Mutual Adversarial Training: Learning together is better than going alone Jiang-Long Liu Chun Pong Lau Hossein Souri S. Feizi Ramalingam Chellappa OOD AAML 29 24 0 09 Dec 2021
The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Image Yuki M. Asano Aaqib Saeed 30 7 0 01 Dec 2021
Multi-label Iterated Learning for Image Classification with Label Ambiguity Sai Rajeswar Pau Rodríguez López Soumye Singhal David Vazquez Aaron C. Courville VLM 11 30 0 23 Nov 2021
Unsupervised Time Series Outlier Detection with Diversity-Driven Convolutional Ensembles -- Extended Version David Campos Tung Kieu Chenjuan Guo Feiteng Huang Kai Zheng B. Yang Christian S. Jensen AI4TS 23 51 0 22 Nov 2021
Meta-Teacher For Face Anti-Spoofing Yunxiao Qin Zitong Yu Longbin Yan Zezheng Wang Chenxu Zhao Zhen Lei CVBM 25 61 0 12 Nov 2021
Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher Mehdi Rezagholizadeh A. Jafari Puneeth Salad Pranav Sharma Ali Saheb Pasand A. Ghodsi 71 17 0 16 Oct 2021
A Short Study on Compressing Decoder-Based Language Models Tianda Li Yassir El Mesbahi I. Kobyzev Ahmad Rashid A. Mahmud Nithin Anchuri Habib Hajimolahoseini Yang Liu Mehdi Rezagholizadeh 86 25 0 16 Oct 2021
Language Modelling via Learning to Rank A. Frydenlund Gagandeep Singh Frank Rudzicz 45 7 0 13 Oct 2021
Object DGCNN: 3D Object Detection using Dynamic Graphs Yue Wang Justin Solomon 3DPC 151 103 0 13 Oct 2021
Unsupervised Representation Learning Meets Pseudo-Label Supervised Self-Distillation: A New Approach to Rare Disease Classification Jinghan Sun Dong Wei Kai Ma Liansheng Wang Yefeng Zheng 14 8 0 09 Oct 2021
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks Rishabh Bhardwaj Tushar Vaidya Soujanya Poria OT FedML 55 7 0 06 Oct 2021
Spectral Bias in Practice: The Role of Function Frequency in Generalization Sara Fridovich-Keil Raphael Gontijo-Lopes Rebecca Roelofs 33 28 0 06 Oct 2021
Learning Sense-Specific Static Embeddings using Contextualised Word Embeddings as a Proxy Yi Zhou Danushka Bollegala 31 9 0 05 Oct 2021
One Timestep is All You Need: Training Spiking Neural Networks with Ultra Low Latency Sayeed Shafayet Chowdhury Nitin Rathi Kaushik Roy 21 40 0 01 Oct 2021
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Fangyu Liu Yunlong Jiao Jordan Massiah Emine Yilmaz Serhii Havrylov SSL 87 29 0 27 Sep 2021
Self Supervision to Distillation for Long-Tailed Visual Recognition Tianhao Li Limin Wang Gangshan Wu 42 101 0 09 Sep 2021
Dual Correction Strategy for Ranking Distillation in Top-N Recommender System Youngjune Lee Kee-Eung Kim 16 19 0 08 Sep 2021
Student Surpasses Teacher: Imitation Attack for Black-Box NLP APIs Qiongkai Xu Xuanli He Lingjuan Lyu Lizhen Qu Gholamreza Haffari MLAU 30 21 0 29 Aug 2021
Efficient training of lightweight neural networks using Online Self-Acquired Knowledge Distillation Maria Tzelepi Anastasios Tefas 11 6 0 26 Aug 2021
G-DetKD: Towards General Distillation Framework for Object Detectors via Contrastive and Semantic-guided Feature Imitation Lewei Yao Renjie Pi Hang Xu Wei Zhang Zhenguo Li Tong Zhang 29 34 0 17 Aug 2021
Linking Common Vulnerabilities and Exposures to the MITRE ATT&CK Framework: A Self-Distillation Approach Benjamin Ampel Sagar Samtani Steven Ullman Hsinchun Chen 25 35 0 03 Aug 2021
Open-Ended Learning Leads to Generally Capable Agents Open-Ended Learning Team Adam Stooke Anuj Mahajan Catarina Barros Charlie Deck ... Nicolas Porcel Roberta Raileanu Steph Hughes-Fitt Valentin Dalibard Wojciech M. Czarnecki 26 181 0 27 Jul 2021
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation Junnan Li Ramprasaath R. Selvaraju Akhilesh Deepak Gotmare Shafiq R. Joty Caiming Xiong S. Hoi FaML 51 1,884 0 16 Jul 2021
Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillation Bingchen Zhao Kai Han 15 106 0 07 Jul 2021
Knowledge Distillation for Quality Estimation Amit Gajbhiye M. Fomicheva Fernando Alva-Manchego Frédéric Blain A. Obamuyide Nikolaos Aletras Lucia Specia 16 11 0 01 Jul 2021
Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity Shiwei Liu Tianlong Chen Zahra Atashgahi Xiaohan Chen Ghada Sokar Elena Mocanu Mykola Pechenizkiy Zhangyang Wang D. Mocanu OOD 25 49 0 28 Jun 2021
R-Drop: Regularized Dropout for Neural Networks Xiaobo Liang Lijun Wu Juntao Li Yue Wang Qi Meng Tao Qin Wei Chen M. Zhang Tie-Yan Liu 33 424 0 28 Jun 2021
Co-advise: Cross Inductive Bias Distillation Sucheng Ren Zhengqi Gao Tianyu Hua Zihui Xue Yonglong Tian Shengfeng He Hang Zhao 42 53 0 23 Jun 2021
Knowledge Distillation via Instance-level Sequence Learning Haoran Zhao Xin Sun Junyu Dong Zihe Dong Qiong Li 26 23 0 21 Jun 2021
Generate, Annotate, and Learn: NLP with Synthetic Text Xuanli He Islam Nassar J. Kiros Gholamreza Haffari Mohammad Norouzi 31 51 0 11 Jun 2021