GLM: General Language Model Pretraining with Autoregressive Blank Infilling

18 March 2021

Zhengxiao Du

Yujie Qian

Xiao Liu

Ming Ding

Papers citing "GLM: General Language Model Pretraining with Autoregressive Blank Infilling"

50 / 159 papers shown

Title
Building Open-Ended Embodied Agent via Language-Policy Bidirectional Adaptation Shaopeng Zhai Jie Wang Tianyi Zhang Fuxian Huang Qi Zhang Ming Zhou Jing Hou Yu Qiao Yu Liu LLMAG LM&Ro 26 1 0 12 Dec 2023
Predictive Chemistry Augmented with Text Retrieval Yujie Qian Zhening Li Zhengkai Tu Connor W. Coley Regina Barzilay 16 7 0 08 Dec 2023
Digital Life Project: Autonomous 3D Characters with Social Intelligence Zhongang Cai Jian-Dong Jiang Zhongfei Qing Xinying Guo Mingyuan Zhang ... Yukun Wei Xiaogang Wang Chen Change Loy Lei Yang Ziwei Liu VGen 28 24 0 07 Dec 2023
Analyzing the Inherent Response Tendency of LLMs: Real-World Instructions-Driven Jailbreak Yanrui Du Sendong Zhao Ming Ma Yuhan Chen Bing Qin 26 15 0 07 Dec 2023
ArcMMLU: A Library and Information Science Benchmark for Large Language Models Shitou Zhang Zuchao Li Xingshen Liu Liming Yang Ping Wang ELM 11 0 0 30 Nov 2023
TEA: Test-time Energy Adaptation Yige Yuan Bingbing Xu Liang Hou Fei Sun Huawei Shen Xueqi Cheng TTA VLM 26 7 0 24 Nov 2023
Soulstyler: Using Large Language Model to Guide Image Style Transfer for Target Object Junhao Chen Peng Rong Jingbo Sun Chao Li Xiang Li Hongwu Lv VLM 21 2 0 22 Nov 2023
ADriver-I: A General World Model for Autonomous Driving Fan Jia Weixin Mao Yingfei Liu Yucheng Zhao Yuqing Wen Chi Zhang Xiangyu Zhang Tiancai Wang 31 63 0 22 Nov 2023
Large Language Model as a Policy Teacher for Training Reinforcement Learning Agents Zihao Zhou Bin-Bin Hu Chenyang Zhao Pu Zhang Bin Liu LLMAG 25 8 0 22 Nov 2023
CoachLM: Automatic Instruction Revisions Improve the Data Quality in LLM Instruction Tuning Yilun Liu Shimin Tao Xiaofeng Zhao Ming Zhu Wenbing Ma ... Min Zhang Hongxia Ma Li Zhang Hao-Yu Yang Yanfei Jiang 26 10 0 22 Nov 2023
Fake Alignment: Are LLMs Really Aligned Well? Yixu Wang Yan Teng Kexin Huang Chengqi Lyu Songyang Zhang Wenwei Zhang Xingjun Ma Yu-Gang Jiang Yu Qiao Yingchun Wang 25 14 0 10 Nov 2023
Mirror: A Universal Framework for Various Information Extraction Tasks Tong Zhu Junfei Ren Zijian Yu Mengsong Wu Guoliang Zhang Xiaoye Qu Wenliang Chen Zhefeng Wang Baoxing Huai Min Zhang 29 14 0 09 Nov 2023
Cultural Adaptation of Recipes Yong Cao Yova Kementchedjhieva Ruixiang Cui Antonia Karamolegkou Li Zhou Megan Dare Lucia Donatelli Daniel Hershcovich 18 5 0 26 Oct 2023
SALMONN: Towards Generic Hearing Abilities for Large Language Models Changli Tang Wenyi Yu Guangzhi Sun Xianzhao Chen Tian Tan Wei Li Lu Lu Zejun Ma Chao Zhang LM&MA AuLLM 35 199 0 20 Oct 2023
KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models Yuyang Bai Shangbin Feng Vidhisha Balachandran Zhaoxuan Tan Shiqi Lou Tianxing He Yulia Tsvetkov ELM 40 2 0 15 Oct 2023
Qilin-Med: Multi-stage Knowledge Injection Advanced Medical Large Language Model Qichen Ye Junling Liu Dading Chong Peilin Zhou Yining Hua ... Meng Cao Ziming Wang Xuxin Cheng Andrew Liu Zhenhua Guo AI4MH LM&MA ELM 25 20 0 13 Oct 2023
Fine-grained Audio-Visual Joint Representations for Multimodal Large Language Models Guangzhi Sun Wenyi Yu Changli Tang Xianzhao Chen Tian Tan Wei Li Lu Lu Zejun Ma Chao Zhang 28 12 0 09 Oct 2023
LawBench: Benchmarking Legal Knowledge of Large Language Models Zhiwei Fei Xiaoyu Shen D. Zhu Fengzhe Zhou Zhuo Han Songyang Zhang Kai-xiang Chen Zongwen Shen Jidong Ge ELM AILaw 26 33 0 28 Sep 2023
InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Composition Pan Zhang Xiaoyi Wang Bin Wang Yuhang Cao Chao Xu ... Conghui He Xingcheng Zhang Yu Qiao Da Lin Jiaqi Wang MLLM 61 222 0 26 Sep 2023
LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models Yukang Chen Shengju Qian Haotian Tang Xin Lai Zhijian Liu Song Han Jiaya Jia 35 151 0 21 Sep 2023
Norm Tweaking: High-performance Low-bit Quantization of Large Language Models Liang Li Qingyuan Li Bo-Wen Zhang Xiangxiang Chu MQ 30 28 0 06 Sep 2023
GPT Can Solve Mathematical Problems Without a Calculator Z. Yang Ming Ding Qingsong Lv Zhihuan Jiang Zehai He Yuyi Guo Jinfeng Bai Jie Tang RALM LRM 31 52 0 06 Sep 2023
Exploring Large Language Models for Knowledge Graph Completion Liang Yao Jiazhen Peng Chengsheng Mao Yuan Luo 24 38 0 26 Aug 2023
LatEval: An Interactive LLMs Evaluation Benchmark with Incomplete Information from Lateral Thinking Puzzles Shulin Huang Shirong Ma Yinghui Li Mengzuo Huang Wuhe Zou Weidong Zhang Haitao Zheng LLMAG LRM 24 26 0 21 Aug 2023
SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understanding Tianyu Yu Chengyue Jiang Chao Lou Shen Huang Xiaobin Wang ... Haitao Zheng Ningyu Zhang Pengjun Xie Fei Huang Yong-jia Jiang LRM 46 17 0 21 Aug 2023
How Good Are LLMs at Out-of-Distribution Detection? Bo Liu Li-Ming Zhan Zexin Lu Yu Feng Lei Xue Xiao-Ming Wu OODD 22 8 0 20 Aug 2023
Large Language Models at Work in China's Labor Market Qin Chen Jinfeng Ge Huaqing Xie Xingcheng Xu Yanqing Yang 44 1 0 17 Aug 2023
Beyond Semantics: Learning a Behavior Augmented Relevance Model with Self-supervised Learning Ze-jie Chen Wei-Neng Chen Jia Xu Zhongyi Liu Wei Zhang RALM 21 4 0 10 Aug 2023
"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models Xinyue Shen Z. Chen Michael Backes Yun Shen Yang Zhang SILM 33 243 0 07 Aug 2023
On the (In)Effectiveness of Large Language Models for Chinese Text Correction Yinghui Li Haojing Huang Shirong Ma Yong-jia Jiang Y. Li F. Zhou Haitao Zheng Qingyu Zhou 31 43 0 18 Jul 2023
Mini-Giants: "Small" Language Models and Open Source Win-Win Zhengping Zhou Lezhi Li Xinxi Chen Andy Li SyDa ALM MoE 24 6 0 17 Jul 2023
Evaluating the Capability of Large-scale Language Models on Chinese Grammatical Error Correction Task Fanyi Qu Yunfang Wu Yunfang Wu ELM LRM 9 6 0 08 Jul 2023
GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest Shilong Zhang Pei Sun Shoufa Chen Min Xiao Wenqi Shao Wenwei Zhang Yu Liu Kai-xiang Chen Ping Luo VLM MLLM 83 224 0 07 Jul 2023
Enhancing LLM with Evolutionary Fine Tuning for News Summary Generation Le Xiao Xiaolin Chen 31 21 0 06 Jul 2023
LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streaming Jingsheng Gao Yixin Lian Ziyi Zhou Yuzhuo Fu Baoyuan Wang 24 16 0 14 Jun 2023
Valley: Video Assistant with Large Language model Enhanced abilitY Ruipu Luo Ziwang Zhao Min Yang Junwei Dong Da Li Pengcheng Lu Tao Wang Linmei Hu Ming-Hui Qiu MLLM 40 189 0 12 Jun 2023
ChatDB: Augmenting LLMs with Databases as Their Symbolic Memory Chenxu Hu Jie Fu Chenzhuang Du Simian Luo J. Zhao Hang Zhao KELM LLMAG 22 104 0 06 Jun 2023
NormMark: A Weakly Supervised Markov Model for Socio-cultural Norm Discovery Farhad Moghimifar Shilin Qu Tongtong Wu Yuan-Fang Li Gholamreza Haffari 26 4 0 26 May 2023
Enhancing Large Language Models Against Inductive Instructions with Dual-critique Prompting Rui Wang Hongru Wang Fei Mi Yi Chen Boyang Xue Kam-Fai Wong Rui-Lan Xu 29 13 0 23 May 2023
Making Language Models Better Tool Learners with Execution Feedback Shuofei Qiao Honghao Gui Chengfei Lv Qianghuai Jia Huajun Chen Ningyu Zhang LLMAG 34 46 0 22 May 2023
CodeGen2: Lessons for Training LLMs on Programming and Natural Languages Erik Nijkamp A. Ghobadzadeh Caiming Xiong Silvio Savarese Yingbo Zhou 147 164 0 03 May 2023
Measuring Massive Multitask Chinese Understanding Hui Zeng ALM ELM AILaw 17 27 0 25 Apr 2023
HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge Hao Wang Chi-Liang Liu Nuwa Xi Zewen Qiang Sendong Zhao Bing Qin Ting Liu LM&MA ALM 17 195 0 14 Apr 2023
Lformer: Text-to-Image Generation with L-shape Block Parallel Decoding Jiacheng Li Longhui Wei Zongyuan Zhan Xinfu He Siliang Tang Qi Tian Yueting Zhuang 19 4 0 07 Mar 2023
Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints Albert Lu Hongxin Zhang Yanzhe Zhang Xuezhi Wang Diyi Yang LRM 21 28 0 17 Feb 2023
Benchmarking Large Language Models for News Summarization Tianyi Zhang Faisal Ladhak Esin Durmus Percy Liang Kathleen McKeown Tatsunori B. Hashimoto ELM 18 476 0 31 Jan 2023
TikTalk: A Video-Based Dialogue Dataset for Multi-Modal Chitchat in Real World Hongpeng Lin Ludan Ruan Wenke Xia Peiyu Liu Jing Wen ... Di Hu Ruihua Song Wayne Xin Zhao Qin Jin Zhiwu Lu VGen 27 9 0 14 Jan 2023
Mask-then-Fill: A Flexible and Effective Data Augmentation Framework for Event Extraction Jun Gao Changlong Yu Wei Wang Huan Zhao Ruifeng Xu 18 33 0 06 Jan 2023
FewFedWeight: Few-shot Federated Learning Framework across Multiple NLP Tasks Weilong Dong Xinwei Wu Junzhuo Li Shuangzhi Wu Chao Bian Deyi Xiong FedML 26 6 0 16 Dec 2022
Large Language Models Are Human-Level Prompt Engineers Yongchao Zhou Andrei Ioan Muresanu Ziwen Han Keiran Paster Silviu Pitis Harris Chan Jimmy Ba ALM LLMAG 14 826 0 03 Nov 2022