GLM: General Language Model Pretraining with Autoregressive Blank
Infilling

GLM: General Language Model Pretraining with Autoregressive Blank Infilling

18 March 2021

Xiao Liu

Ming Ding

Papers citing "GLM: General Language Model Pretraining with Autoregressive Blank Infilling"

9 / 159 papers shown

Title
Towards Better Few-Shot and Finetuning Performance with Forgetful Causal Language Models Hao Liu Xinyang Geng Lisa Lee Igor Mordatch Sergey Levine Sharan Narang Pieter Abbeel KELM CLL 33 2 0 24 Oct 2022
Just ClozE! A Novel Framework for Evaluating the Factual Consistency Faster in Abstractive Summarization Yiyang Li Lei Li Marina Litvak N. Vanetik Dingxing Hu Yuze Li Yanquan Zhou HILM 30 0 0 06 Oct 2022
Pre-training General Trajectory Embeddings with Maximum Multi-view Entropy Coding Yan Lin Huaiyu Wan S. Guo Jilin Hu Christian S. Jensen Youfang Lin AI4TS 23 19 0 29 Jul 2022
CC-Riddle: A Question Answering Dataset of Chinese Character Riddles Fan Xu Yunxiang Zhang Xiao-Yi Wan 24 1 0 28 Jun 2022
Blank Language Models T. Shen Victor Quach Regina Barzilay Tommi Jaakkola 201 73 0 08 Feb 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference Timo Schick Hinrich Schütze 258 1,586 0 21 Jan 2020
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 243 1,817 0 17 Sep 2019
Text Summarization with Pretrained Encoders Yang Liu Mirella Lapata MILM 254 1,430 0 22 Aug 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,950 0 20 Apr 2018