Contrastive Demonstration Tuning for Pre-trained Language Models

Contrastive Demonstration Tuning for Pre-trained Language Models

9 April 2022

Xiaozhuan Liang

Ningyu Zhang

Zhenru Zhang

Chuanqi Tan

Huajun Chen

Papers citing "Contrastive Demonstration Tuning for Pre-trained Language Models"

15 / 15 papers shown

Title
A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER Guanting Dong Zechen Wang Jinxu Zhao Gang Zhao Daichi Guo ... Keqing He Xuefeng Li Liwen Wang Xinyue Cui Weiran Xu 8 19 0 28 Aug 2023
Ontology-enhanced Prompt-tuning for Few-shot Learning Hongbin Ye Ningyu Zhang Shumin Deng Xiang Chen Hui Chen Feiyu Xiong Xi Chen Huajun Chen 104 44 0 27 Jan 2022
OntoProtein: Protein Pretraining With Gene Ontology Embedding Ningyu Zhang Zhen Bi Xiaozhuan Liang Shuyang Cheng Haosen Hong Shumin Deng J. Lian Qiang Zhang Huajun Chen 85 86 0 23 Jan 2022
Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER Dong-Ho Lee Akshen Kadakia Kangmin Tan Mahak Agarwal Xinyu Feng Takashi Shibuya Ryosuke Mitani Toshiyuki Sekiya Jay Pujara Xiang Ren 26 84 0 16 Oct 2021
SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer Tu Vu Brian Lester Noah Constant Rami Al-Rfou Daniel Matthew Cer VLM LRM 131 276 0 15 Oct 2021
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu Kaixuan Ji Yicheng Fu Weng Lam Tam Zhengxiao Du Zhilin Yang Jie Tang VLM 228 780 0 14 Oct 2021
MSP: Multi-Stage Prompting for Making Pre-trained Language Models Better Translators Zhixing Tan Xiangwen Zhang Shuo Wang Yang Liu VLM LRM 185 51 0 13 Oct 2021
Template-free Prompt Tuning for Few-shot NER Ruotian Ma Xin Zhou Tao Gui Y. Tan Linyang Li Qi Zhang Xuanjing Huang VLM 136 176 0 28 Sep 2021
NSP-BERT: A Prompt-based Few-Shot Learner Through an Original Pre-training Task--Next Sentence Prediction Yi Sun Yu Zheng Chao Hao Hangping Qiu VLM 19 35 0 08 Sep 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 275 3,784 0 18 Apr 2021
What Makes Good In-Context Examples for GPT- $3$ ? Jiachang Liu Dinghan Shen Yizhe Zhang Bill Dolan Lawrence Carin Weizhu Chen AAML RALM 275 1,296 0 17 Jan 2021
WARP: Word-level Adversarial ReProgramming Karen Hambardzumyan Hrant Khachatrian Jonathan May AAML 243 340 0 01 Jan 2021
Making Pre-trained Language Models Better Few-shot Learners Tianyu Gao Adam Fisch Danqi Chen 238 1,898 0 31 Dec 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference Timo Schick Hinrich Schütze 248 1,382 0 21 Jan 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,927 0 20 Apr 2018