Automated Annotation with Generative AI Requires Validation

31 May 2023

Papers citing "Automated Annotation with Generative AI Requires Validation"

36 / 36 papers shown

Title
Comparing LLM Text Annotation Skills: A Study on Human Rights Violations in Social Media Data Poli A. Nemkova S. Ubani Mark V. Albert AILaw 35 0 0 15 May 2025
A Simple Ensemble Strategy for LLM Inference: Towards More Stable Text Classification Junichiro Niimi 58 0 0 26 Apr 2025
A Comprehensive Survey of Synthetic Tabular Data Generation Ruxue Shi Yili Wang Mengnan Du Xu Shen Xin Wang 49 2 0 23 Apr 2025
Efficient Intent-Based Filtering for Multi-Party Conversations Using Knowledge Distillation from LLMs Reem Gody M. Abdelghaffar Mohammed Jabreel Ahmed Tawfik 44 0 0 21 Mar 2025
Biases in Large Language Model-Elicited Text: A Case Study in Natural Language Inference Grace Proebsting Adam Poliak 55 0 0 06 Mar 2025
Automated Collection of Evaluation Dataset for Semantic Search in Low-Resource Domain Language Anastasia Zhukova Christian E. Matt Bela Gipp 86 2 0 13 Dec 2024
Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluation Dongryeol Lee Yerin Hwang Yongil Kim Joonsuk Park Kyomin Jung ELM 72 5 0 28 Oct 2024
Enhancing Text Annotation through Rationale-Driven Collaborative Few-Shot Prompting Jianfei Wu Xubin Wang Weijia Jia 27 1 0 15 Sep 2024
Can LLMs Replace Manual Annotation of Software Engineering Artifacts? Toufique Ahmed Premkumar Devanbu Christoph Treude Michael Pradel 72 11 0 10 Aug 2024
Toward Automatic Relevance Judgment using Vision--Language Models for Image--Text Retrieval Evaluation Jheng-Hong Yang Jimmy Lin VLM 47 3 0 02 Aug 2024
Dynamic Sentiment Analysis with Local Large Language Models using Majority Voting: A Study on Factors Affecting Restaurant Evaluation Junichiro Niimi 35 3 0 18 Jul 2024
GPT Assisted Annotation of Rhetorical and Linguistic Features for Interpretable Propaganda Technique Detection in News Text Kyle Hamilton Luca Longo Bojan Bozic 39 1 0 16 Jul 2024
Can GPT-4 Help Detect Quit Vaping Intentions? An Exploration of Automatic Data Annotation Approach Sai Krishna Revanth Vuruma Dezhi Wu Saborny Sen Gupta Lucas Aust Valerie Lookingbill ... Erin Kasson Li-Shiun Chen Patricia Cavazos-Rehg Dian Hu Ming Huang 30 0 0 28 Jun 2024
Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels Nicholas Pangakis Samuel Wolken 37 15 0 25 Jun 2024
OATH-Frames: Characterizing Online Attitudes Towards Homelessness with LLM Assistants Jaspreet Ranjit Brihi Joshi Rebecca Dorn Laura Petry Olga Koumoundouros Jayne Bottarini Peichen Liu Eric Rice Swabha Swayamdipta 32 1 0 21 Jun 2024
On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey Lin Long Rui Wang Ruixuan Xiao Junbo Zhao Xiao Ding Gang Chen Haobo Wang SyDa 59 93 0 14 Jun 2024
Utilizing Large Language Models to Identify Reddit Users Considering Vaping Cessation for Digital Interventions Sai Krishna Revanth Vuruma Dezhi Wu Saborny Sen Gupta Lucas Aust Valerie Lookingbill ... Erin Kasson Li-Shiun Chen Patricia Cavazos-Rehg Dian Hu Ming Huang 29 0 0 25 Apr 2024
LLMs in the Loop: Leveraging Large Language Model Annotations for Active Learning in Low-Resource Languages Nataliia Kholodna Sahib Julka Mohammad Khodadadi Muhammed Nurullah Gumus Michael Granitzer 31 10 0 02 Apr 2024
Hybrid Human-LLM Corpus Construction and LLM Evaluation for Rare Linguistic Phenomena Leonie Weissweiler Abdullatif Köksal Hinrich Schütze 29 4 0 11 Mar 2024
LLMs for Targeted Sentiment in News Headlines: Exploring the Descriptive-Prescriptive Dilemma Jana Juros Laura Majer Jan Snajder 31 2 0 01 Mar 2024
Cross-domain Chinese Sentence Pattern Parsing Yingsi Yu Cunliang Kong Liner Yang Meishan Zhang Lin Zhu Yujie Wang Haozhe Lin Maosong Sun Erhong Yang 30 0 0 26 Feb 2024
Detecting Machine-Generated Texts by Multi-Population Aware Optimization for Maximum Mean Discrepancy Shuhai Zhang Yiliao Song Jiahao Yang Yuanqing Li Bo Han Mingkui Tan DeLMO 31 5 0 25 Feb 2024
AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotators Jingwei Ni Minjing Shi Dominik Stammbach Mrinmaya Sachan Elliott Ash Markus Leippold HILM 20 11 0 16 Feb 2024
Humans or LLMs as the Judge? A Study on Judgement Biases Guiming Hardy Chen Shunian Chen Ziche Liu Feng Jiang Benyou Wang 82 93 0 16 Feb 2024
Best Practices for Text Annotation with Large Language Models Petter Törnberg 67 18 0 05 Feb 2024
STICKERCONV: Generating Multimodal Empathetic Responses from Scratch Yiqun Zhang Fanheng Kong Peidong Wang Shuang Sun Lingshuai Wang Shi Feng Daling Wang Yifei Zhang Kaisong Song 28 10 0 20 Jan 2024
Evaluation is all you need. Prompting Generative Large Language Models for Annotation Tasks in the Social Sciences. A Primer using Open Models Maximilian Weber Merle Reichardt 71 9 0 30 Dec 2023
Understanding News Creation Intents: Frame, Dataset, and Method Zhengjia Wang Danding Wang Qiang Sheng Juan Cao Silong Su Yifan Sun Beizhe Hu Siyuan Ma 21 4 0 27 Dec 2023
Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matching Meng Chu Zhedong Zheng Wei Ji Tingyu Wang Tat-Seng Chua 21 9 0 21 Nov 2023
ContraDoc: Understanding Self-Contradictions in Documents with Large Language Models Jierui Li Vipul Raheja Dhruv Kumar SyDa 28 3 0 15 Nov 2023
LLM-enhanced Self-training for Cross-domain Constituency Parsing Jianling Li Meishan Zhang Peiming Guo Min Zhang Yue Zhang 13 6 0 05 Nov 2023
Label-free Node Classification on Graphs with Large Language Models (LLMS) Zhikai Chen Haitao Mao Hongzhi Wen Haoyu Han Wei-dong Jin Haiyang Zhang Hui Liu Jiliang Tang 30 72 0 07 Oct 2023
A Large Language Model Approach to Educational Survey Feedback Analysis Michael J. Parker Caitlin Anderson Claire Stone YeaRim Oh ELM LM&MA AI4Ed 25 10 0 29 Sep 2023
Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation? Rishav Hada Varun Gumma Adrian de Wynter Harshita Diddee Mohamed Ahmed Monojit Choudhury Kalika Bali Sunayana Sitaram ALM LM&MA ELM 32 61 0 14 Sep 2023
Embedding Democratic Values into Social Media AIs via Societal Objective Functions Chenyan Jia Michelle S. Lam Minh Chau Mai Jeffrey T. Hancock Michael S. Bernstein 21 27 0 26 Jul 2023
Fine-Grained Detection of Solidarity for Women and Migrants in 155 Years of German Parliamentary Debates Aida Kostikova Benjamin Paassen Dominik Beese Ole Putz Gregor Wiedemann Steffen Eger 35 3 0 09 Oct 2022