LIMIT-BERT : Linguistic Informed Multi-Task BERT

31 October 2019

Papers citing "LIMIT-BERT : Linguistic Informed Multi-Task BERT"

24 / 24 papers shown

Title
Syntactic Inductive Bias in Transformer Language Models: Especially Helpful for Low-Resource Languages? Luke Gessler Nathan Schneider 11 1 0 01 Nov 2023
UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models Deming Ye Yankai Lin Zhengyan Zhang Maosong Sun KELM 11 0 0 02 May 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 26 27 0 14 Mar 2023
Towards Linguistically Informed Multi-Objective Pre-Training for Natural Language Inference Maren Pielka Svetlana Schmidt Lisa Pucknat R. Sifa CLIP AI4CE 17 2 0 14 Dec 2022
A Linguistic Investigation of Machine Learning based Contradiction Detection Models: An Empirical Analysis and Future Perspectives Maren Pielka F. Rode Lisa Pucknat Tobias Deuβer R. Sifa 9 2 0 19 Oct 2022
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 47 1,012 0 01 Nov 2021
Span Fine-tuning for Pre-trained Language Models Rongzhou Bao Zhuosheng Zhang Hai Zhao 12 1 0 29 Aug 2021
Improving Social Meaning Detection with Pragmatic Masking and Surrogate Fine-Tuning Chiyu Zhang Muhammad Abdul-Mageed ObjD AI4CE 6 6 0 01 Aug 2021
Dialogue-oriented Pre-training Yi Xu Hai Zhao 18 14 0 01 Jun 2021
CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations Changlong Yu Hongming Zhang Yangqiu Song Wilfred Ng 51 21 0 31 Dec 2020
Accurate Word Representations with Universal Visual Guidance Zhuosheng Zhang Haojie Yu Hai Zhao Rui-cang Wang Masao Utiyama 10 0 0 30 Dec 2020
SG-Net: Syntax Guided Transformer for Language Representation Zhuosheng Zhang Yuwei Wu Junru Zhou Sufeng Duan Hai Zhao Rui-cang Wang 38 36 0 27 Dec 2020
Cross-lingual Universal Dependency Parsing Only from One Monolingual Treebank Kailai Sun Z. Li Hai Zhao 16 0 0 24 Dec 2020
KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning Bin He Xin Jiang Jinghui Xiao Qun Liu 25 18 0 07 Dec 2020
Enhancing deep neural networks with morphological information Matej Klemen Luka Krsnik Marko Robnik-Šikonja 15 11 0 24 Nov 2020
Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialogue Longxiang Liu Zhuosheng Zhang Hai Zhao Xi Zhou Xiang Zhou 6 50 0 14 Sep 2020
Machine Reading Comprehension: The Role of Contextualized Language Models and Beyond Zhuosheng Zhang Hai Zhao Rui Wang 13 61 0 13 May 2020
Semantics-Aware Inferential Network for Natural Language Understanding Shuailiang Zhang Hai Zhao Junru Zhou LRM 13 4 0 28 Apr 2020
Meta Fine-Tuning Neural Language Models for Multi-Domain Text Mining Chengyu Wang Minghui Qiu Jun Huang Xiaofeng He AI4CE 18 23 0 29 Mar 2020
Retrospective Reader for Machine Reading Comprehension Zhuosheng Zhang Junjie Yang Hai Zhao RALM 15 226 0 27 Jan 2020
Do Attention Heads in BERT Track Syntactic Dependencies? Phu Mon Htut Jason Phang Shikha Bordia Samuel R. Bowman 14 134 0 27 Nov 2019
Semantics-aware BERT for Language Understanding Zhuosheng Zhang Yuwei Wu Zhao Hai Z. Li Shuailiang Zhang Xi Zhou Xiang Zhou 19 359 0 05 Sep 2019
SG-Net: Syntax-Guided Machine Reading Comprehension Zhuosheng Zhang Yuwei Wu Junru Zhou Sufeng Duan Hai Zhao Rui Wang 14 187 0 14 Aug 2019
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,724 0 26 Sep 2016