DeepStruct: Pretraining of Language Models for Structure Prediction

DeepStruct: Pretraining of Language Models for Structure Prediction

21 May 2022

Xiao Liu

Papers citing "DeepStruct: Pretraining of Language Models for Structure Prediction"

9 / 9 papers shown

Title
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 192 1,436 0 15 Oct 2021
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu Kaixuan Ji Yicheng Fu Weng Lam Tam Zhengxiao Du Zhilin Yang Jie Tang VLM 206 604 0 14 Oct 2021
Zero-Shot Information Extraction as a Unified Text-to-Triple Translation Chenguang Wang Xiao Liu Zui Chen Haoyun Hong Jie Tang D. Song 159 28 0 23 Sep 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 254 2,999 0 18 Apr 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 202 1,508 0 31 Dec 2020
Blank Language Models T. Shen Victor Quach Regina Barzilay Tommi Jaakkola 160 67 0 08 Feb 2020
FewRel 2.0: Towards More Challenging Few-Shot Relation Classification Tianyu Gao Xu Han Hao Zhu Zhiyuan Liu Peng Li Maosong Sun Jie Zhou 180 221 0 16 Oct 2019
Span-based Joint Entity and Relation Extraction with Transformer Pre-training Markus Eberts A. Ulges LRM ViT 126 344 0 17 Sep 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 369 2,216 0 03 Sep 2019