Bridging the Gap between Decision and Logits in Decision-based Knowledge
Distillation for Pre-trained Language Models

Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models

15 June 2023

Peng Li

Yang Liu

Papers citing "Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models"

3 / 3 papers shown

Title
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 313 11,915 0 04 Mar 2022
Delving into Data: Effectively Substitute Training for Black-box Attack Wenxuan Wang Bangjie Yin Taiping Yao Li Zhang Yanwei Fu Shouhong Ding Jilin Li Feiyue Huang Xiangyang Xue AAML 60 63 0 26 Apr 2021
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,956 0 20 Apr 2018