TimeLMs: Diachronic Language Models from Twitter

8 February 2022

Daniel Loureiro

Francesco Barbieri

Leonardo Neves

Luis Espinosa Anke

Jose Camacho-Collados

ArXiv PDF HTML

Papers citing "TimeLMs: Diachronic Language Models from Twitter"

50 / 107 papers shown

Title
$$\textit{Swap and Predict}$ -- Predicting the Semantic Changes in Words across Corpora by Context Swapping$ $\textit{Swap and Predict}$ -- Predicting the Semantic Changes in Words across Corpora by Context Swapping Taichi Aida Danushka Bollegala 21 4 0 16 Oct 2023
LEMON: Lossless model expansion Yite Wang Jiahao Su Hanlin Lu Cong Xie Tianyi Liu Jianbo Yuan Haibin Lin Ruoyu Sun Hongxia Yang 17 12 0 12 Oct 2023
Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systems Yixin Wan Jieyu Zhao Aman Chadha Nanyun Peng Kai-Wei Chang 32 22 0 08 Oct 2023
A Large Language Model Approach to Educational Survey Feedback Analysis Michael J. Parker Caitlin Anderson Claire Stone YeaRim Oh ELM LM&MA AI4Ed 19 10 0 29 Sep 2023
Keeping in Time: Adding Temporal Context to Sentiment Analysis Models Dean Ninalga 23 0 0 24 Sep 2023
Continual Pre-Training of Large Language Models: How to (re)warm your model? Kshitij Gupta Benjamin Thérien Adam Ibrahim Mats L. Richter Quentin G. Anthony Eugene Belilovsky Irina Rish Timothée Lesort KELM 22 99 0 08 Aug 2023
WIKITIDE: A Wikipedia-Based Timestamped Definition Pairs Dataset Hsuvas Borkakoty Luis Espinosa-Anke 15 0 0 07 Aug 2023
Tweet Insights: A Visualization Platform to Extract Temporal Insights from Twitter Daniel Loureiro Kiamehr Rezaee Talayeh Riahi Francesco Barbieri Leonardo Neves Luis Espinosa Anke Jose Camacho-Collados AI4TS 18 8 0 04 Aug 2023
Causal Influences over Social Learning Networks Mert Kayaalp A. H. Sayed CML 16 3 0 13 Jul 2023
Robust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluation Dimosthenis Antypas Jose Camacho-Collados 37 20 0 04 Jul 2023
A Massive Scale Semantic Similarity Dataset of Historical English Emily Silcock Melissa Dell 29 5 0 30 Jun 2023
Public Attitudes Toward ChatGPT on Twitter: Sentiments, Topics, and Occupations Ratanond Koonchanok Ya-Chen Pan Hyeju Jang AI4MH 12 8 0 22 Jun 2023
Unveiling Global Narratives: A Multilingual Twitter Dataset of News Media on the Russo-Ukrainian Conflict Sherzod Hakimov Gullal Singh Cheema 11 3 0 22 Jun 2023
Bias Against 93 Stigmatized Groups in Masked Language Models and Downstream Sentiment Classification Tasks Katelyn Mei Sonia Fereidooni Aylin Caliskan 14 45 0 08 Jun 2023
Unsupervised Semantic Variation Prediction using the Distribution of Sibling Embeddings Taichi Aida Danushka Bollegala 18 8 0 15 May 2023
Dynamic Graph Representation Learning for Depression Screening with Transformer Ai-Te Kuo Haiquan Chen Yu-Hsuan Kuo Wei-Shinn Ku 16 3 0 10 May 2023
Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarization C. Cheang Hou Pong Chan Derek F. Wong Xuebo Liu Zhao Li Yanming Sun Shudong Liu Lidia S. Chao 192 6 0 03 May 2023
The Emotions of the Crowd: Learning Image Sentiment from Tweets via Cross-modal Distillation Alessio Serra F. Carrara Maurizio Tesconi Fabrizio Falchi 43 3 0 28 Apr 2023
Transfer Learning for Low-Resource Sentiment Analysis Razhan Hameed Sina Ahmadi Fatemeh Daneshfar 22 5 0 10 Apr 2023
Federated Learning Based Multilingual Emoji Prediction In Clean and Attack Scenarios Karim Gamal A. Gaber Hossam Amer FedML 15 6 0 30 Mar 2023
Generate labeled training data using Prompt Programming and GPT-3. An example of Big Five Personality Classification Eason Chen 8 2 0 22 Mar 2023
Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views Katerina Margatina Shuai Wang Yogarshi Vyas Neha Ann John Yassine Benajiba Miguel Ballesteros 15 15 0 23 Feb 2023
ChatGPT: Jack of all trades, master of none Jan Kocoñ Igor Cichecki Oliwier Kaszyca Mateusz Kochanek Dominika Szydło ... Maciej Piasecki Lukasz Radliñski Konrad Wojtasik Stanislaw Wo'zniak Przemyslaw Kazienko AI4MH 15 526 0 21 Feb 2023
Hashtag-Guided Low-Resource Tweet Classification Shizhe Diao Sedrick Scott Keh Liangming Pan Zhiliang Tian Yan Song Tong Zhang VLM AI4TS 20 7 0 20 Feb 2023
TempEL: Linking Dynamically Evolving and Newly Emerging Entities Klim Zaporojets Lucie-Aimée Kaffee Johannes Deleu Thomas Demeester Chris Develder Isabelle Augenstein KELM 21 15 0 05 Feb 2023
TEDB System Description to a Shared Task on Euphemism Detection 2022 Peratham Wiriyathammabhum 15 4 0 16 Jan 2023
Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023? Shuheng Liu Alan Ritter AI4TS 28 12 0 19 Dec 2022
Using Two Losses and Two Datasets Simultaneously to Improve TempoWiC Accuracy Mohammad Javad Pirhadi Motahhare Mirzaei Sauleh Eetemadi 11 0 0 15 Dec 2022
Discovering Influencers in Opinion Formation over Social Graphs Valentina Shumovskaia Mert Kayaalp Mert Cemri A. H. Sayed 11 7 0 23 Nov 2022
Continual Learning of Natural Language Processing Tasks: A Survey Zixuan Ke Bin Liu KELM CLL VLM 19 68 0 23 Nov 2022
Using Deep Mixture-of-Experts to Detect Word Meaning Shift for TempoWiC Ze Chen Kangxu Wang Zijian Cai Jiewen Zheng Jiarong He Max Gao Jason Zhang MoE 14 3 0 07 Nov 2022
ModSandbox: Facilitating Online Community Moderation Through Error Prediction and Improvement of Automated Rules Jean Y. Song Sangwook Lee Jisoo Lee Mina Kim Juho Kim 18 11 0 18 Oct 2022
On the Impact of Temporal Concept Drift on Model Explanations Zhixue Zhao G. Chrysostomou Kalina Bontcheva Nikolaos Aletras 18 15 0 17 Oct 2022
Temporal Word Meaning Disambiguation using TimeLMs Mihir Godbole Parth Dandavate Aditya Kane 21 2 0 15 Oct 2022
Is It Worth the (Environmental) Cost? Limited Evidence for Temporal Adaptation via Continuous Training Giuseppe Attanasio Debora Nozza Federico Bianchi Dirk Hovy CLL 24 3 0 13 Oct 2022
Named Entity Recognition in Twitter: A Dataset and Analysis on Short-Term Temporal Shifts Asahi Ushio Leonardo Neves Vítor Silva Francesco Barbieri Jose Camacho-Collados 23 26 0 07 Oct 2022
Twitter Topic Classification Dimosthenis Antypas Asahi Ushio Jose Camacho-Collados Leonardo Neves Vítor Silva Francesco Barbieri 27 31 0 20 Sep 2022
TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations at Twitter Xinyang Zhang Yury Malkov Omar U. Florez Serim Park Brian McWilliams Jiawei Han Ahmed El-Kishky VLM 61 90 0 15 Sep 2022
TempoWiC: An Evaluation Benchmark for Detecting Meaning Shift in Social Media Daniel Loureiro Aminette D'Souza Areej Muhajab Isabella A. White Gabriel Wong Luis Espinosa Anke Leonardo Neves Francesco Barbieri Jose Camacho-Collados 27 25 0 15 Sep 2022
CommunityLM: Probing Partisan Worldviews from Language Models Hang Jiang Doug Beeferman Brandon Roy Dwaipayan Roy 89 31 0 15 Sep 2022
Non-Parametric Temporal Adaptation for Social Media Topic Classification Fatemehsadat Mireshghallah Nikolai Vogler Junxian He Omar U. Florez Ahmed El-Kishky Taylor Berg-Kirkpatrick TTA 9 0 0 13 Sep 2022
Learning Dynamic Contextualised Word Embeddings via Template-based Temporal Adaptation Xiaohang Tang Yi Zhou Danushka Bollegala 24 6 0 23 Aug 2022
TweetNLP: Cutting-Edge Natural Language Processing for Social Media Jose Camacho-Collados Kiamehr Rezaee Talayeh Riahi Asahi Ushio Daniel Loureiro ... Eugenio Martínez-Cámara Gonzalo Medina T. Buhrmann Leonardo Neves Francesco Barbieri VLM AI4MH 22 129 0 29 Jun 2022
Using Twitter Data to Understand Public Perceptions of Approved versus Off-label Use for COVID-19-related Medications Yining Hua Hang Jiang Shixu Lin Jie Yang Joseph M. Plasek D. Bates Li Zhou 38 37 0 29 Jun 2022
The Problem of Semantic Shift in Longitudinal Monitoring of Social Media: A Case Study on Mental Health During the COVID-19 Pandemic Keith Harrigian Mark Dredze 8 5 0 22 Jun 2022
Understanding Aesthetics with Language: A Photo Critique Dataset for Aesthetic Assessment Daniel Vera Nieto Luigi Celona Clara Fernandez-Labrador CoGe 36 11 0 17 Jun 2022
Continual Pre-Training Mitigates Forgetting in Language and Vision Andrea Cossu Tinne Tuytelaars Antonio Carta Lucia C. Passaro Vincenzo Lomonaco D. Bacciu KELM VLM CLL 14 67 0 19 May 2022
MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning Ehud D. Karpas Omri Abend Yonatan Belinkov Barak Lenz Opher Lieber ... Erez Schwartz Gal Shachaf Shai Shalev-Shwartz Amnon Shashua Moshe Tenenholtz LLMAG 12 68 0 01 May 2022
TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models Joel Jang Seonghyeon Ye Changho Lee Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Minjoon Seo CLL KELM 19 91 0 29 Apr 2022
A 23 MW data centre is all you need Samuel Albanie Dylan Campbell João F. Henriques 11 0 0 31 Mar 2022