ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks

27 March 2023

Papers citing "ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks"

50 / 489 papers shown

Title
ARAIDA: Analogical Reasoning-Augmented Interactive Data Annotation Chen Huang Yiping Jin Ilija Ilievski Wenqiang Lei Jiancheng Lv 35 3 0 20 May 2024
MBIAS: Mitigating Bias in Large Language Models While Retaining Context Shaina Raza Ananya Raval Veronica Chatrath 36 6 0 18 May 2024
Human-interpretable clustering of short-text using large language models Justin K. Miller Tristram J. Alexander VLM 22 3 0 12 May 2024
Quite Good, but Not Enough: Nationality Bias in Large Language Models -- A Case Study of ChatGPT Shucheng Zhu Weikang Wang Ying Liu 29 5 0 11 May 2024
"They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated Conversations Preetam Prabhu Srikar Dammu Hayoung Jung Anjali Singh Monojit Choudhury Tanushree Mitra 19 8 0 08 May 2024
Zero-shot LLM-guided Counterfactual Generation for Text Amrita Bhattacharjee Raha Moraffah Joshua Garland Huan Liu 38 3 0 08 May 2024
The high dimensional psychological profile and cultural bias of ChatGPT Hang Yuan Zhongyue Che Shao Li Yue Zhang Xiaomeng Hu Siyang Luo 22 2 0 06 May 2024
FairMonitor: A Dual-framework for Detecting Stereotypes and Biases in Large Language Models Yanhong Bai Jiabao Zhao Jinxin Shi Zhentao Xie Xingjiao Wu Liang He 27 3 0 06 May 2024
Can Large Language Models Make the Grade? An Empirical Study Evaluating LLMs Ability to Mark Short Answer Questions in K-12 Education Owen Henkel Adam Boxer Libby Hills Bill Roberts ELM AI4Ed 25 9 0 05 May 2024
Aloe: A Family of Fine-tuned Open Healthcare LLMs Ashwin Kumar Gururajan Enrique Lopez-Cuena Jordi Bayarri-Planas Adrián Tormos Daniel Hinjos ... Lucia Urcelay-Ganzabal Marta Gonzalez-Mallo Sergio Álvarez Napagao Eduard Ayguadé-Parra Ulises Cortés Dario Garcia-Gasulla ELM LM&MA 24 12 0 03 May 2024
The Effectiveness of LLMs as Annotators: A Comparative Overview and Empirical Analysis of Direct Representation Maja Pavlovic Massimo Poesio 32 17 0 02 May 2024
Distance Sampling-based Paraphraser Leveraging ChatGPT for Text Data Manipulation Yoori Oh Yoseob Han Kyogu Lee 32 1 0 01 May 2024
Human-in-the-Loop Synthetic Text Data Inspection with Provenance Tracking Hong Jin Kang Fabrice Harel-Canada Muhammad Ali Gulzar Violet Peng Miryung Kim 25 2 0 29 Apr 2024
Performance-Aligned LLMs for Generating Fast Code Daniel Nichols Pranav Polasam Harshitha Menon Aniruddha Marathe T. Gamblin A. Bhatele 27 7 0 29 Apr 2024
Detection of Conspiracy Theories Beyond Keyword Bias in German-Language Telegram Using Large Language Models Milena Pustet Elisabeth Steffen Helena Mihaljević 34 3 0 27 Apr 2024
Text Quality-Based Pruning for Efficient Training of Language Models Vasu Sharma Karthik Padthe Newsha Ardalani Kushal Tirumala Russell Howes ... Po-Yao Huang Shang-Wen Li Armen Aghajanyan Gargi Ghosh Luke Zettlemoyer 44 5 0 26 Apr 2024
CEval: A Benchmark for Evaluating Counterfactual Text Generation Van Bach Nguyen Jorg Schlotterer Christin Seifert 29 5 0 26 Apr 2024
Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents Giorgio Piatti Zhijing Jin Max Kleiman-Weiner Bernhard Schölkopf Mrinmaya Sachan Rada Mihalcea LLMAG 48 12 0 25 Apr 2024
Using Artificial Intelligence to Unlock Crowdfunding Success for Small Businesses Teng Ye Jingnan Zheng Junhui Jin Jingyi Qiu W. Ai Qiaozhu Mei HAI 16 1 0 24 Apr 2024
Using Adaptive Empathetic Responses for Teaching English Siyan Li Teresa Shao Zhou Yu Julia Hirschberg 16 3 0 21 Apr 2024
Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs Clemencia Siro Mohammad Aliannejadi Maarten de Rijke 16 1 0 19 Apr 2024
Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approaches Pablo Biedma Xiaoyuan Yi Linus Huang Maosong Sun Xing Xie PILM 32 3 0 19 Apr 2024
Data Authenticity, Consent, & Provenance for AI are all broken: what will it take to fix them? Shayne Longpre Robert Mahari Naana Obeng-Marnu William Brannon Tobin South Katy Gero Sandy Pentland Jad Kabbara 51 5 0 19 Apr 2024
"If the Machine Is As Good As Me, Then What Use Am I?" -- How the Use of ChatGPT Changes Young Professionals' Perception of Productivity and Accomplishment Charlotte Kobiella Yarhy Said Flores López Fiona Draxler Albrecht Schmidt AI4MH 32 18 0 19 Apr 2024
Are Large Language Models Reliable Argument Quality Annotators? Nailia Mirzakhmedova Marcel Gohsen Chia Hao Chang Benno Stein ALM 35 9 0 15 Apr 2024
rollama: An R package for using generative large language models through Ollama Johannes B. Gruber Maximilian Weber VLM 16 5 0 11 Apr 2024
Best Practices and Lessons Learned on Synthetic Data for Language Models Ruibo Liu Jerry W. Wei Fangyu Liu Chenglei Si Yanzhe Zhang ... Steven Zheng Daiyi Peng Diyi Yang Denny Zhou Andrew M. Dai SyDa EgoV 36 85 0 11 Apr 2024
Dynamic Generation of Personalities with Large Language Models Jianzhi Liu Hexiang Gu Tianyu Zheng Liuyu Xiang Huijia Wu Jie Fu Zhaofeng He 37 3 0 10 Apr 2024
Comparing Two Model Designs for Clinical Note Generation; Is an LLM a Useful Evaluator of Consistency? Nathan Brake Thomas Schaaf 22 3 0 09 Apr 2024
Apprentices to Research Assistants: Advancing Research with Large Language Models M. Namvarpour A. Razi 21 2 0 09 Apr 2024
Characterizing Multimodal Long-form Summarization: A Case Study on Financial Reports Tianyu Cao Natraj Raman Danial Dervovic Chenhao Tan 35 3 0 09 Apr 2024
Product Description and QA Assisted Self-Supervised Opinion Summarization Tejpalsingh Siledar Rupasai Rangaraju Sankara Sri Raghava Ravindra Muddu Suman Banerjee Amey Patil Sudhanshu Singh M. Chelliah Nikesh Garera Swaprava Nath Pushpak Bhattacharyya RALM 30 7 0 08 Apr 2024
SemEval-2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials Mael Jullien Marco Valentino André Freitas LM&MA 36 41 0 07 Apr 2024
Context versus Prior Knowledge in Language Models Kevin Du Vésteinn Snaebjarnarson Niklas Stoehr Jennifer C. White Aaron Schein Ryan Cotterell 28 9 0 06 Apr 2024
SELF-[IN]CORRECT: LLMs Struggle with Refining Self-Generated Responses Dongwei Jiang Jingyu Zhang Orion Weller Nathaniel Weir Benjamin Van Durme Daniel Khashabi 53 1 0 04 Apr 2024
LLMs in the Loop: Leveraging Large Language Model Annotations for Active Learning in Low-Resource Languages Nataliia Kholodna Sahib Julka Mohammad Khodadadi Muhammed Nurullah Gumus Michael Granitzer 27 9 0 02 Apr 2024
MotionChain: Conversational Motion Controllers via Multimodal Prompts Biao Jiang Xin Chen C. Zhang Fukun Yin Zhuoyuan Li Gang Yu Jiayuan Fan VGen LRM 29 10 0 02 Apr 2024
Automated Assessment of Encouragement and Warmth in Classrooms Leveraging Multimodal Emotional Features and ChatGPT Ruikun Hou Tim Fütterer B. Bühler Efe Bozkir Peter Gerjets Ulrich Trautwein Enkelejda Kasneci 22 7 0 01 Apr 2024
Query Performance Prediction using Relevance Judgments Generated by Large Language Models Chuan Meng Negar Arabzadeh Arian Askari Mohammad Aliannejadi Maarten de Rijke LRM 27 11 0 01 Apr 2024
LLM-RadJudge: Achieving Radiologist-Level Evaluation for X-Ray Report Generation Zilong Wang Xufang Luo Xinyang Jiang Dongsheng Li Lili Qiu LM&MA 19 8 0 01 Apr 2024
MLDT: Multi-Level Decomposition for Complex Long-Horizon Robotic Task Planning with Open-Source Large Language Model Yike Wu Jiatao Zhang Nan Hu LanLing Tang Guilin Qi Jun Shao Jie Ren Wei Song 57 10 0 27 Mar 2024
Leveraging Large Language Models for Relevance Judgments in Legal Case Retrieval Shengjie Ma Chong Chen Qi Chu Jiaxin Mao AILaw ELM 18 7 0 27 Mar 2024
Leveraging Large Language Models for Fuzzy String Matching in Political Science Yu Wang 24 0 0 27 Mar 2024
Large Language Models as Financial Data Annotators: A Study on Effectiveness and Efficiency Toyin Aguda S. Siddagangappa Elena Kochkina Simerjot Kaur Dongsheng Wang Charese Smiley Sameena Shah 14 8 0 26 Mar 2024
ChatGPT Rates Natural Language Explanation Quality Like Humans: But on Which Scales? Fan Huang Haewoon Kwak Kunwoo Park Jisun An ALM ELM AI4MH 16 12 0 26 Mar 2024
LlamBERT: Large-scale low-cost data annotation in NLP Bálint Csanády Lajos Muzsai Péter Vedres Zoltán Nádasdy András Lukács 42 6 0 23 Mar 2024
$$\nabla τ$: Gradient-based and Task-Agnostic machine Unlearning$ $\nabla τ$ : Gradient-based and Task-Agnostic machine Unlearning Daniel Trippa Cesare Campagnano Maria Sofia Bucarelli Gabriele Tolomei Fabrizio Silvestri MU BDL 14 3 0 21 Mar 2024
Multi-Level Feedback Generation with Large Language Models for Empowering Novice Peer Counselors Alicja Chaszczewicz Raj Sanjay Shah Ryan Louie B. Arnow Robert E. Kraut Diyi Yang OffRL 14 9 0 21 Mar 2024
Community Needs and Assets: A Computational Analysis of Community Conversations Towhid Chowdhury Naveen Sharma Ashiqur R. KhudaBukhsh 28 0 0 20 Mar 2024
TnT-LLM: Text Mining at Scale with Large Language Models Mengting Wan Tara Safavi S. Jauhar Yujin Kim Scott Counts ... Longqi Yang Reid Andersen Georg Buscher Dhruv Joshi N.Kasturi Rangan 22 19 0 18 Mar 2024