v1v2 (latest)

ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks

Proceedings of the National Academy of Sciences of the United States of America (PNAS), 2023

27 March 2023

Papers citing "ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks"

50 / 294 papers shown

Title
How to Discern Important Urgent News? Oleg V. Vasilyev John Bohannon 102 1 0 15 Feb 2024
BBox-Adapter: Lightweight Adapting for Black-Box Large Language Models Haotian Sun Yuchen Zhuang Wei Wei Chao Zhang Bo Dai 283 6 0 13 Feb 2024
FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs Eun Cheol Choi Emilio Ferrara HILM 225 40 0 08 Feb 2024
Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMsConference of the European Chapter of the Association for Computational Linguistics (EACL), 2024 Simone Balloccu Patrícia Schmidtová Mateusz Lango Ondrej Dusek SILM ELM PILM 430 247 0 06 Feb 2024
LLM-based NLG Evaluation: Current Status and Challenges Mingqi Gao Xinyu Hu Jie Ruan Xiao Pu Xiaojun Wan ELM LM&MA 571 84 0 02 Feb 2024
APT-Pipe: A Prompt-Tuning Tool for Social Data Annotation using ChatGPTThe Web Conference (WWW), 2024 Yiming Zhu Zhizhuo Yin Gareth Tyson Ehsan-ul Haq Lik-Hang Lee Pan Hui ALM 305 13 0 24 Jan 2024
Cheap Learning: Maximising Performance of Language Models for Social Data Science Using Minimal Data Leonardo Castro-Gonzalez Yi-Ling Chung Hannak Rose Kirk John Francis Angus R. Williams Pica Johansson Jonathan Bright 238 2 0 22 Jan 2024
Finding a Needle in the Adversarial Haystack: A Targeted Paraphrasing Approach For Uncovering Edge Cases with Minimal Distribution DistortionConference of the European Chapter of the Association for Computational Linguistics (EACL), 2024 Aly M. Kassem Sherif Saad AAML 271 3 0 21 Jan 2024
FAIR Enough: How Can We Develop and Assess a FAIR-Compliant Dataset for Large Language Models' Training?Data Intelligence (DI), 2024 Shaina Raza Shardul Ghuge Chen Ding Elham Dolatabadi D. Pandya SyDa 492 19 0 19 Jan 2024
DepressionEmo: A novel dataset for multilabel classification of depression emotionsJournal of Affective Disorders (J Affect Disord), 2024 Abu Bakar Siddiqur Rahman Hoang-Thang Ta Lotfollah Najjar A. Azadmanesh A. Gonul AI4MH 264 20 0 09 Jan 2024
Visual Enumeration Remains Challenging for Multimodal Generative AIPLoS ONE (PLoS ONE), 2024 Alberto Testolin Kuinan Hou Marco Zorzi 223 2 0 09 Jan 2024
MULTI-CASE: A Transformer-based Ethics-aware Multimodal Investigative Intelligence Framework M. T. Fischer Yannick Metz Lucas Joos Matthias Miller Daniel A. Keim 217 3 0 03 Jan 2024
EHR Interaction Between Patients and AI: NoteAid EHR Interaction Xiaocheng Zhang Zonghai Yao Hong-ye Yu LM&MA 241 3 0 29 Dec 2023
Exploring news intent and its application: A theory-driven approach Zhengjia Wang Danding Wang Qiang Sheng Juan Cao Silong Su Yifan Sun 353 5 0 27 Dec 2023
Exploring the Capabilities of ChatGPT in Ancient Chinese Translation and Person Name Recognition Shijing Si Siqing Zhou Le Tang Xiaoqing Cheng Yugui Zhang 189 2 0 23 Dec 2023
In Generative AI we Trust: Can Chatbots Effectively Verify Political Information? Elizaveta Kuznetsova M. Makhortykh Victoria Vziatysheva Martha Stolze Ani Baghumyan Aleksandra Urman 158 20 0 20 Dec 2023
ALMANACS: A Simulatability Benchmark for Language Model Explainability Edmund Mills Shiye Su Stuart J. Russell Scott Emmons 473 9 0 20 Dec 2023
VQA4CIR: Boosting Composed Image Retrieval with Visual Question Answering Chun-Mei Feng Yang Bai Yaoyu Zhang Zhen Li Salman Khan Wangmeng Zuo Xinxing Xu Rick Siow Mong Goh Yong-Jin Liu 242 9 0 19 Dec 2023
Prompting Datasets: Data Discovery with Conversational Agents Johanna Walker Elisavet Koutsiana Joe Massey Gefion Thuermer Elena Simperl 114 5 0 15 Dec 2023
Detecting value-expressive text posts in Russian social media Maria A. Milkova Maksim Rudnev Lidia Okolskaya 160 0 0 14 Dec 2023
Fully Authentic Visual Question Answering Dataset from Online CommunitiesEuropean Conference on Computer Vision (ECCV), 2023 Chongyan Chen Xiyang Dai Noel Codella Yunsheng Li Lu Yuan Danna Gurari 321 9 0 27 Nov 2023
CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Weixiang Yan Haitian Liu Yunkun Wang Yunzhe Li Qian Chen ... Tingyu Lin Weishan Zhao Li Zhu Hari Sundaram Shuiguang Deng ELM LRM 393 50 0 14 Nov 2023
Large Language Models are Zero Shot Hypothesis Proposers Biqing Qi Kaiyan Zhang Haoxiang Li Kai Tian Sihang Zeng Zhang-Ren Chen Bowen Zhou 241 48 0 10 Nov 2023
Interpreting Pretrained Language Models via Concept Bottlenecks Zhen Tan Lu Cheng Song Wang Yuan Bo Wenlin Yao Huan Liu LRM 202 33 0 08 Nov 2023
MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment TasksNeural Information Processing Systems (NeurIPS), 2023 Allen Nie Yuhui Zhang Atharva Amdekar Chris Piech Tatsunori Hashimoto Tobias Gerstenberg 238 55 0 30 Oct 2023
Can LLMs Grade Short-Answer Reading Comprehension Questions : An Empirical Study with a Novel Dataset Owen Henkel Libby Hills Bill Roberts Joshua A. McGrane AI4Ed 241 3 0 26 Oct 2023
CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data AnnotationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Minzhi Li Taiwei Shi Caleb Ziems Min-Yen Kan Nancy F. Chen Zhengyuan Liu Diyi Yang 237 104 0 24 Oct 2023
Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversations Jihyoung Jang Minseong Boo Hyounghun Kim 212 37 0 20 Oct 2023
An Emulator for Fine-Tuning Large Language Models using Small Language Models Eric Mitchell Rafael Rafailov Archit Sharma Chelsea Finn Christopher D. Manning ALM 276 65 0 19 Oct 2023
Concept-Guided Chain-of-Thought Prompting for Pairwise Comparison Scoring of Texts with Large Language ModelsBigData Congress [Services Society] (BSS), 2023 Patrick Y. Wu Jonathan Nagler Joshua A. Tucker Solomon Messing LRM 353 4 0 18 Oct 2023
Utilising a Large Language Model to Annotate Subject Metadata: A Case Study in an Australian National Research Data Catalogue Shiwei Zhang Ming-Lun Wu Xiuzhen Zhang 144 7 0 17 Oct 2023
Automated Claim Matching with Large Language Models: Empowering Fact-Checkers in the Fight Against Misinformation Eun Cheol Choi Emilio Ferrara 201 29 0 13 Oct 2023
Multiclass Classification of Policy Documents with Large Language Models Erkan Gunes Christoffer Florczak 231 1 0 12 Oct 2023
LLM4Vis: Explainable Visualization Recommendation using ChatGPTConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Lei Wang Songheng Zhang Yun Wang Ee-Peng Lim Yong Wang LRM 203 61 0 11 Oct 2023
DORIS-MAE: Scientific Document Retrieval using Multi-level Aspect-based QueriesNeural Information Processing Systems (NeurIPS), 2023 Jianyou Wang Kaicheng Wang Xiaoyue Wang Prudhviraj Naidu Leon Bergen R. Paturi 412 14 0 07 Oct 2023
Label-free Node Classification on Graphs with Large Language Models (LLMS)International Conference on Learning Representations (ICLR), 2023 Zhikai Chen Haitao Mao Hongzhi Wen Haoyu Han Wei Jin Haiyang Zhang Hui Liu Shucheng Zhou 256 96 0 07 Oct 2023
The Anatomy of Deception: Technical and Human Perspectives on a Large-scale Phishing Campaign Anargyros Chrysanthou Yorgos Pantis Constantinos Patsakis 186 2 0 05 Oct 2023
Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous DrivingIEEE International Conference on Robotics and Automation (ICRA), 2023 Long Chen Oleg Sinavski Jan Hünermann Alice Karnsund Andrew James Willmott Danny Birch Daniel Maund Jamie Shotton MLLM 344 287 0 03 Oct 2023
A Large Language Model Approach to Educational Survey Feedback AnalysisInternational Journal of Artificial Intelligence in Education (IJAIED), 2023 Michael J. Parker Caitlin Anderson Claire Stone YeaRim Oh ELM LM&MA AI4Ed 288 33 0 29 Sep 2023
Using Large Language Models for Qualitative Analysis can Introduce Serious Bias Julian Ashwin Aditya Chhabra Vijayendra Rao 123 47 0 29 Sep 2023
Large language models can accurately predict searcher preferencesAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2023 Paul Thomas S. Spielman Nick Craswell Bhaskar Mitra ALM LRM 380 216 0 19 Sep 2023
Generative AIBusiness & Information Systems Engineering (BISE), 2023 Stefan Feuerriegel Jochen Hartmann Christian Janiesch Patrick Zschech 307 1,012 0 13 Sep 2023
Prompting a Large Language Model to Generate Diverse Motivational Messages: A Comparison with Human-Written MessagesInternational Conference on Human-Agent Interaction (HAI), 2023 Samuel Rhys Cox Ashraf Abdul Wei Tsang Ooi ALM 161 21 0 25 Aug 2023
GPTEval: A Survey on Assessments of ChatGPT and GPT-4International Conference on Language Resources and Evaluation (LREC), 2023 Rui Mao Guanyi Chen Xulang Zhang Frank Guerin Xiaoshi Zhong ELM LM&MA 173 143 0 24 Aug 2023
Revisiting Prompt Engineering via Declarative CrowdsourcingConference on Innovative Data Systems Research (CIDR), 2023 Aditya G. Parameswaran Shreya Shankar Parth Asawa Naman Jain Yujie Wang 210 23 0 07 Aug 2023
Fighting Fire with Fire: Can ChatGPT Detect AI-generated Text?SIGKDD Explorations (SIGKDD Explor.), 2023 Amrita Bhattacharjee Huang Liu DeLMO 252 80 0 02 Aug 2023
Wisdom of Instruction-Tuned Language Model Crowds. Exploring Model Label Variation Flor Miriam Plaza del Arco Debora Nozza Dirk Hovy ALM 203 10 0 24 Jul 2023
Towards a Neural Era in Dialogue Management for Collaboration: A Literature Survey Amogh Mannekote LLMAG 189 3 0 18 Jul 2023
AutoHint: Automatic Prompt Optimization with Hint Generation Hong Sun Xue Li Yi Xu Youkow Homma Qinhao Cao Ruibing Jin Jian Jiao Denis Xavier Charles 241 33 0 13 Jul 2023
Can Large Language Models Aid in Annotating Speech Emotional Data? Uncovering New FrontiersIEEE Computational Intelligence Magazine (IEEE CIM), 2023 S. Latif Muhammad Usama Mohammad Ibrahim Malik Björn W. Schuller 312 20 0 12 Jul 2023