Can ChatGPT Reproduce Human-Generated Labels? A Study of Social Computing Tasks

20 April 2023

Papers citing "Can ChatGPT Reproduce Human-Generated Labels? A Study of Social Computing Tasks"

26 / 76 papers shown

Title
XAL: EXplainable Active Learning Makes Classifiers Better Low-resource Learners Yun Luo Zhen Yang Fandong Meng Yingjie Li Fang Guo Qinglin Qi Jie Zhou Yue Zhang 19 1 0 09 Oct 2023
Leveraging Large Language Models and Weak Supervision for Social Media data annotation: an evaluation using COVID-19 self-reported vaccination tweets Ramya Tekumalla Juan M. Banda 19 7 0 12 Sep 2023
Leveraging Large Language Models for Automated Dialogue Analysis Sarah E. Finch Ellie S. Paek Jinho D. Choi LLMAG 29 18 0 12 Sep 2023
AI in the Gray: Exploring Moderation Policies in Dialogic Large Language Models vs. Human Answers in Controversial Topics V. Ghafouri Vibhor Agarwal Yong Zhang Nishanth R. Sastry Jose Such Guillermo Suarez-Tangil AI4MH 10 21 0 28 Aug 2023
SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understanding Tianyu Yu Chengyue Jiang Chao Lou Shen Huang Xiaobin Wang ... Haitao Zheng Ningyu Zhang Pengjun Xie Fei Huang Yong-jia Jiang LRM 46 17 0 21 Aug 2023
Time Travel in LLMs: Tracing Data Contamination in Large Language Models Shahriar Golchin Mihai Surdeanu 25 91 0 16 Aug 2023
"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models Xinyue Shen Z. Chen Michael Backes Yun Shen Yang Zhang SILM 33 243 0 07 Aug 2023
Can Large Language Models Aid in Annotating Speech Emotional Data? Uncovering New Frontiers S. Latif Muhammad Usama Mohammad Ibrahim Malik Björn W. Schuller 22 17 0 12 Jul 2023
LLM-Assisted Content Analysis: Using Large Language Models to Support Deductive Coding Robert F. Chew John Bollenbacher Michael Wenger Jessica Speer Annice Kim ELM 19 58 0 23 Jun 2023
GPT Self-Supervision for a Better Data Annotator Xiaohuan Pei Yanxi Li Chang Xu 22 7 0 07 Jun 2023
Automated Annotation with Generative AI Requires Validation Nicholas Pangakis Samuel Wolken Neil Fasching SyDa 14 61 0 31 May 2023
ClusterLLM: Large Language Models as a Guide for Text Clustering Yuwei Zhang Zihan Wang Jingbo Shang 23 51 0 24 May 2023
Using Natural Language Explanations to Rescale Human Judgments Manya Wadhwa Jifan Chen Junyi Jessy Li Greg Durrett 31 8 0 24 May 2023
Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models Orevaoghene Ahia Sachin Kumar Hila Gonen Jungo Kasai David R. Mortensen Noah A. Smith Yulia Tsvetkov 34 80 0 23 May 2023
Evaluating ChatGPT's Performance for Multilingual and Emoji-based Hate Speech Detection Mithun Das Saurabh Kumar Pandey Animesh Mukherjee 41 10 0 22 May 2023
ChatGPT to Replace Crowdsourcing of Paraphrases for Intent Classification: Higher Diversity and Comparable Model Robustness Ján Cegin Jakub Simko Peter Brusilovsky 20 42 0 22 May 2023
SMILE: Single-turn to Multi-turn Inclusive Language Expansion via ChatGPT for Mental Health Support Huachuan Qiu Hongliang He Shuai Zhang Anqi Li Zhenzhong Lan AI4MH 103 26 0 30 Apr 2023
The Parrot Dilemma: Human-Labeled vs. LLM-augmented Data in Classification Tasks Anders Giovanni Møller Jacob Aarup Dalsgaard Arianna Pera L. Aiello 67 34 0 26 Apr 2023
AGI: Artificial General Intelligence for Education Ehsan Latif Gengchen Mai Matthew Nyaaba Xuansheng Wu Ninghao Liu Guoyu Lu Sheng R. Li Tianming Liu Xiaoming Zhai ELM AI4CE 24 22 0 24 Apr 2023
Can we trust the evaluation on ChatGPT? Rachith Aiyappa Jisun An Haewoon Kwak Yong-Yeol Ahn ELM ALM LLMAG AI4MH LRM 106 76 0 22 Mar 2023
A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need? Chaoning Zhang Chenshuang Zhang Sheng Zheng Yu Qiao Chenghao Li ... Lik-Hang Lee Yang Yang Heng Tao Shen In So Kweon Choong Seon Hong 75 157 0 21 Mar 2023
Can Generative Pre-trained Transformers (GPT) Pass Assessments in Higher Education Programming Courses? Jaromír Šavelka Arav Agarwal Chris Bogart Yifan Song M. Sakr ELM 26 96 0 16 Mar 2023
ChatGPT: Beginning of an End of Manual Linguistic Data Annotation? Use Case of Automatic Genre Identification Taja Kuzman I. Mozetič Nikola Ljubesic 49 91 0 07 Mar 2023
MiDe22: An Annotated Multi-Event Tweet Dataset for Misinformation Detection Cagri Toraman Oguzhan Ozcelik Furkan Şahinuç Fazli Can 17 12 0 11 Oct 2022
Fine-Grained Detection of Solidarity for Women and Migrants in 155 Years of German Parliamentary Debates Aida Kostikova Benjamin Paassen Dominik Beese Ole Putz Gregor Wiedemann Steffen Eger 27 3 0 09 Oct 2022
Latent Hatred: A Benchmark for Understanding Implicit Hate Speech Mai Elsherief Caleb Ziems D. Muchlinski Vaishnavi Anupindi Jordyn Seybolt M. D. Choudhury Diyi Yang 92 235 0 11 Sep 2021