Temporal Adaptation of BERT and Performance on Downstream Document
Classification: Insights from Social Media

Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media

16 April 2021

Paul Röttger

J. Pierrehumbert

Papers citing "Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media"

18 / 18 papers shown

Title
Enhancing Retrieval and Managing Retrieval: A Four-Module Synergy for Improved Quality and Efficiency in RAG Systems Yunxiao Shi Xing Zi Zijing Shi Haimin Zhang Qiang Wu Min Xu 39 7 0 15 Jul 2024
Hatred Stems from Ignorance! Distillation of the Persuasion Modes in Countering Conversational Hate Speech Ghadi Alyahya Abeer Aldayel 46 2 0 18 Mar 2024
Time is Encoded in the Weights of Finetuned Language Models Kai Nylund Suchin Gururangan Noah A. Smith AI4TS 36 18 0 20 Dec 2023
Not wacky vs. definitely wacky: A study of scalar adverbs in pretrained language models Isabelle Lorge J. Pierrehumbert 41 0 0 25 May 2023
On the Limitations of Simulating Active Learning Katerina Margatina Nikolaos Aletras 31 11 0 21 May 2023
Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views Katerina Margatina Shuai Wang Yogarshi Vyas Neha Ann John Yassine Benajiba Miguel Ballesteros 17 15 0 23 Feb 2023
Continual Learning of Natural Language Processing Tasks: A Survey Zixuan Ke Bin Liu KELM CLL VLM 37 69 0 23 Nov 2022
Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic Change Zhao-yu Su Zecheng Tang Xinyan Guan Juntao Li Lijun Wu Mengdi Zhang CLL AI4CE 32 22 0 31 Oct 2022
RealTime QA: What's the Answer Right Now? Jungo Kasai Keisuke Sakaguchi Yoichi Takahashi Ronan Le Bras Akari Asai Xinyan Velocity Yu Dragomir R. Radev Noah A. Smith Yejin Choi Kentaro Inui KELM 47 167 0 27 Jul 2022
Building for Tomorrow: Assessing the Temporal Persistence of Text Classifiers Rabab Alkhalifa E. Kochkina A. Zubiaga 24 25 0 11 May 2022
TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models Joel Jang Seonghyeon Ye Changho Lee Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Minjoon Seo CLL KELM 27 93 0 29 Apr 2022
Extracting Impact Model Narratives from Social Services' Text Bart Gajderowicz Daniela Rosu Mark S. Fox 26 1 0 04 Apr 2022
Geographic Adaptation of Pretrained Language Models Valentin Hofmann Goran Glavavs Nikola Ljubevsić J. Pierrehumbert Hinrich Schütze VLM 21 16 0 16 Mar 2022
Temporal Attention for Language Models Guy D. Rosin Kira Radinsky VLM 34 33 0 04 Feb 2022
Temporal Effects on Pre-trained Models for Language Processing Tasks Oshin Agarwal A. Nenkova VLM 28 53 0 24 Nov 2021
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora Xisen Jin Dejiao Zhang Henghui Zhu Wei Xiao Shang-Wen Li Xiaokai Wei Andrew O. Arnold Xiang Ren KELM CLL 31 112 0 16 Oct 2021
Time-Aware Language Models as Temporal Knowledge Bases Bhuwan Dhingra Jeremy R. Cole Julian Martin Eisenschlos D. Gillick Jacob Eisenstein William W. Cohen KELM 30 265 0 29 Jun 2021
Dynamic Contextualized Word Embeddings Valentin Hofmann J. Pierrehumbert Hinrich Schütze 39 51 0 23 Oct 2020