An Embarrassingly Simple Approach for Transfer Learning from Pretrained
Language Models

An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models

27 February 2019

Alexandra Chronopoulou

Christos Baziotis

Alexandros Potamianos

Papers citing "An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models"

11 / 11 papers shown

Title
Analysis of Climate Campaigns on Social Media using Bayesian Model Averaging Tunazzina Islam Ruqi Zhang Dan Goldwasser 21 3 0 06 May 2023
AF Adapter: Continual Pretraining for Building Chinese Biomedical Language Model Yongyu Yan Kui Xue Xiaoming Shi Qi Ye Jingping Liu Tong Ruan CLL 37 1 0 21 Nov 2022
Efficient Contrastive Learning via Novel Data Augmentation and Curriculum Learning Seonghyeon Ye Jiseon Kim Alice H. Oh CLL VLM 24 21 0 10 Sep 2021
Cross-lingual Transferring of Pre-trained Contextualized Language Models Zuchao Li Kevin Parnow Hai Zhao Zhuosheng Zhang Rui Wang Masao Utiyama Eiichiro Sumita 13 8 0 27 Jul 2021
Adaptive Transfer Learning on Graph Neural Networks Xueting Han Zhenhuan Huang Bang An Jing Bai 22 60 0 19 Jul 2021
Automated Source Code Generation and Auto-completion Using Deep Learning: Comparing and Discussing Current Language-Model-Related Approaches Juan Cruz-Benito Sanjay Vishwakarma Francisco Martín-Fernández Ismael Faro Ibm Quantum 22 30 0 16 Sep 2020
It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners Timo Schick Hinrich Schütze 15 950 0 15 Sep 2020
TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech Andy T. Liu Shang-Wen Li Hung-yi Lee SSL 11 355 0 12 Jul 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 241 1,444 0 18 Mar 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference Timo Schick Hinrich Schütze 258 1,584 0 21 Jan 2020
Learning ASR-Robust Contextualized Embeddings for Spoken Language Understanding Chao-Wei Huang Yun-Nung (Vivian) Chen 11 43 0 24 Sep 2019