ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks

27 March 2023

Papers citing "ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks"

50 / 489 papers shown

Title
HateCOT: An Explanation-Enhanced Dataset for Generalizable Offensive Speech Detection via Large Language Models H. Nghiem Hal Daumé 31 1 0 18 Mar 2024
Discovering Latent Themes in Social Media Messaging: A Machine-in-the-Loop Approach Integrating LLMs Tunazzina Islam Dan Goldwasser 54 5 0 15 Mar 2024
PERL: Parameter Efficient Reinforcement Learning from Human Feedback Hakim Sidahmed Samrat Phatale Alex Hutcheson Zhuonan Lin Zhan Chen ... Jessica Hoffmann Hassan Mansoor Wei Li Abhinav Rastogi Lucas Dixon 24 4 0 15 Mar 2024
FakeWatch: A Framework for Detecting Fake News to Ensure Credible Elections Shaina Raza Tahniat Khan Veronica Chatrath Drai Paulen-Patterson Mizanur Rahman Oluwanifemi Bamgbose 28 0 0 14 Mar 2024
AI on AI: Exploring the Utility of GPT as an Expert Annotator of AI Publications Autumn Toney-Wails C. Schoeberl James Dunham 22 3 0 14 Mar 2024
Harnessing Artificial Intelligence to Combat Online Hate: Exploring the Challenges and Opportunities of Large Language Models in Hate Speech Detection Tharindu Kumarage Amrita Bhattacharjee Joshua Garland 36 7 0 12 Mar 2024
Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation Juan Manuel Zambrano Chaves Shih-Cheng Huang Yanbo Xu Hanwen Xu Naoto Usuyama ... Akshay S. Chaudhari Serena Yeung-Levy Curtis P. Langlotz Sheng Wang Hoifung Poon VLM LM&MA 54 9 0 12 Mar 2024
Hybrid Human-LLM Corpus Construction and LLM Evaluation for Rare Linguistic Phenomena Leonie Weissweiler Abdullatif Köksal Hinrich Schütze 29 4 0 11 Mar 2024
Can LLM Substitute Human Labeling? A Case Study of Fine-grained Chinese Address Entity Recognition Dataset for UAV Delivery Yuxuan Yao Sichun Luo Haohan Zhao Guanzhi Deng Linqi Song 29 7 0 10 Mar 2024
MP2D: An Automated Topic Shift Dialogue Generation Framework Leveraging Knowledge Graphs Yerin Hwang Yongi-Mi Kim Yunah Jang Jeesoo Bang Hyunkyung Bae Kyomin Jung 35 2 0 09 Mar 2024
Generating Hard-Negative Out-of-Scope Data with ChatGPT for Intent Classification Zhijian Li Stefan Larson Kevin Leach OODD 19 1 0 08 Mar 2024
Towards a Psychology of Machines: Large Language Models Predict Human Memory Markus Huff Elanur Ulakçi 24 4 0 08 Mar 2024
Feast Your Eyes: Mixture-of-Resolution Adaptation for Multimodal Large Language Models Gen Luo Yiyi Zhou Yuxin Zhang Xiawu Zheng Xiaoshuai Sun Rongrong Ji VLM 28 53 0 05 Mar 2024
Data Augmentation using Large Language Models: Data Perspectives, Learning Paradigms and Challenges Bosheng Ding Chengwei Qin Ruochen Zhao Tianze Luo Xinze Li Guizhen Chen Wenhan Xia Junjie Hu A. Luu Shafiq R. Joty 29 18 0 05 Mar 2024
HINTs: Sensemaking on large collections of documents with Hypergraph visualization and INTelligent agents Sam Yu-Te Lee Kwan-Liu Ma 33 2 0 05 Mar 2024
Position: Insights from Survey Methodology can Improve Training Data Stephanie Eckman Barbara Plank Frauke Kreuter SyDa 28 3 0 02 Mar 2024
Leveraging Prompt-Based Large Language Models: Predicting Pandemic Health Decisions and Outcomes Through Social Media Language Xi Ding Buse Çarik U. Gunturi Valerie F. Reyna Eugenia H. Rho 20 7 0 01 Mar 2024
LLMs in Political Science: Heralding a New Era of Visual Analysis Yu Wang 16 1 0 29 Feb 2024
MEGAnno+: A Human-LLM Collaborative Annotation System H. Kim Kushan Mitra Rafael Li Chen Sajjadur Rahman Dan Zhang 28 23 0 28 Feb 2024
AmbigNLG: Addressing Task Ambiguity in Instruction for NLG Ayana Niwa Hayate Iso 18 4 0 27 Feb 2024
If in a Crowdsourced Data Annotation Pipeline, a GPT-4 Zeyu He Huang Chieh-Yang C. C. Ding Shaurya Rohatgi Ting-Hao 'Kenneth' Huang 22 30 0 26 Feb 2024
An Empirical Study of Challenges in Machine Learning Asset Management Zhimin Zhao Yihao Chen A. A. Bangash Bram Adams Ahmed E. Hassan 26 5 0 25 Feb 2024
IR2: Information Regularization for Information Retrieval Jianyou Wang Kaicheng Wang Xiaoyue Wang Weili Cao R. Paturi Leon Bergen 43 1 0 25 Feb 2024
NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data Sergei Bogdanov Alexandre Constantin Timothée Bernard Benoit Crabbé Etienne Bernard 34 19 0 23 Feb 2024
Qsnail: A Questionnaire Dataset for Sequential Question Generation Yan Lei Liang Pang Yuanzhuo Wang Huawei Shen Xueqi Cheng 27 0 0 22 Feb 2024
From Adoption to Adaption: Tracing the Diffusion of New Emojis on Twitter Yuhang Zhou Xuan Lu Wei Ai 27 1 0 22 Feb 2024
MM-Soc: Benchmarking Multimodal Large Language Models in Social Media Platforms Yiqiao Jin Minje Choi Gaurav Verma Jindong Wang Srijan Kumar 49 19 0 21 Feb 2024
SYNFAC-EDIT: Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarization Prakamya Mishra Zonghai Yao Parth Vashisht Feiyun Ouyang Beining Wang Vidhi Mody Hong-ye Yu SyDa MedIm 25 4 0 21 Feb 2024
Beyond Hate Speech: NLP's Challenges and Opportunities in Uncovering Dehumanizing Language Hezhao Zhang Lasana Harris N. Moosavi AILaw 36 1 0 21 Feb 2024
Infrastructure Ombudsman: Mining Future Failure Concerns from Structural Disaster Response Towhid Chowdhury Soumyajit Datta Naveen Sharma Ashiqur R. KhudaBukhsh AI4CE 34 4 0 21 Feb 2024
RITFIS: Robust input testing framework for LLMs-based intelligent software Ming-Ming Xiao Yan Xiao Hai Dong Shunhui Ji Pengcheng Zhang AAML 36 5 0 21 Feb 2024
EvoGrad: A Dynamic Take on the Winograd Schema Challenge with Human Adversaries Jing Han Sun Ali Emami 21 3 0 20 Feb 2024
A Survey on Knowledge Distillation of Large Language Models Xiaohan Xu Ming Li Chongyang Tao Tao Shen Reynold Cheng Jinyang Li Can Xu Dacheng Tao Tianyi Zhou KELM VLM 42 98 0 20 Feb 2024
Where It Really Matters: Few-Shot Environmental Conservation Media Monitoring for Low-Resource Languages Sameer Jain Sedrick Scott Keh Shova Chettri Karun Dewan Pablo R. Izquierdo ... Pooja Shreshtha Cesar Suarez Zheyuan Ryan Shi Lei Li Fei Fang 29 0 0 19 Feb 2024
Modelling Political Coalition Negotiations Using LLM-based Agents Farhad Moghimifar Yuan-Fang Li Robert Thomson Gholamreza Haffari LLMAG 27 5 0 18 Feb 2024
Exploring ChatGPT for Next-generation Information Retrieval: Opportunities and Challenges Yizheng Huang Jimmy X. Huang 33 8 0 17 Feb 2024
AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotators Jingwei Ni Minjing Shi Dominik Stammbach Mrinmaya Sachan Elliott Ash Markus Leippold HILM 10 11 0 16 Feb 2024
How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs? Ehsan Doostmohammadi Oskar Holmstrom Marco Kuhlmann 27 8 0 16 Feb 2024
I Am Not Them: Fluid Identities and Persistent Out-group Bias in Large Language Models Wenchao Dong Assem Zhunis Hyojin Chin Jiyoung Han Meeyoung Cha 13 2 0 16 Feb 2024
How to Discern Important Urgent News? Oleg V. Vasilyev John Bohannon 8 0 0 15 Feb 2024
BBox-Adapter: Lightweight Adapting for Black-Box Large Language Models Haotian Sun Yuchen Zhuang Wei Wei Chao Zhang Bo Dai 18 3 0 13 Feb 2024
Is it safe to cross? Interpretable Risk Assessment with GPT-4V for Safety-Aware Street Crossing Hochul Hwang Sunjae Kwon Yekyung Kim Donghyun Kim 27 11 0 09 Feb 2024
The Generative AI Paradox on Evaluation: What It Can Solve, It May Not Evaluate Juhyun Oh Eunsu Kim Inha Cha Alice H. Oh ELM 28 7 0 09 Feb 2024
FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs Eun Cheol Choi Emilio Ferrara HILM 34 24 0 08 Feb 2024
GPTs Are Multilingual Annotators for Sequence Generation Tasks Juhwan Choi Eunju Lee Kyohoon Jin Youngbin Kim 25 10 0 08 Feb 2024
Prompting Implicit Discourse Relation Annotation Frances Yung Mansoor Ahmad Merel C. J. Scholman Vera Demberg LRM 13 1 0 07 Feb 2024
Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs Simone Balloccu Patrícia Schmidtová Mateusz Lango Ondrej Dusek SILM ELM PILM 16 152 0 06 Feb 2024
Best Practices for Text Annotation with Large Language Models Petter Törnberg 65 17 0 05 Feb 2024
Graph-enhanced Large Language Models in Asynchronous Plan Reasoning Fangru Lin Emanuele La Malfa Valentin Hofmann Elle Michelle Yang Anthony Cohn J. Pierrehumbert LRM 48 16 0 05 Feb 2024
Probing Critical Learning Dynamics of PLMs for Hate Speech Detection Sarah Masud Mohammad Aflah Khan Vikram Goyal Md. Shad Akhtar Tanmoy Chakraborty 14 0 0 03 Feb 2024