LLMaAA: Making Large Language Models as Active Annotators

30 October 2023

Papers citing "LLMaAA: Making Large Language Models as Active Annotators"

50 / 59 papers shown

Title
Have LLMs Made Active Learning Obsolete? Surveying the NLP Community Julia Romberg Christopher Schröder Julius Gonsior Katrin Tomanek Fredrik Olsson 57 0 0 12 Mar 2025
M-MAD: Multidimensional Multi-Agent Debate for Advanced Machine Translation Evaluation Zhaopeng Feng Jiayuan Su Jiamei Zheng Jiahan Ren Yan Zhang Jian Wu Hongwei Wang Zuozhu Liu ELM 198 0 0 21 Feb 2025
VilBias: A Study of Bias Detection through Linguistic and Visual Cues , presenting Annotation Strategies, Evaluation, and Key Challenges Shaina Raza Caesar Saleh Emrul Hasan Franklin Ogidi Maximus Powers Veronica Chatrath Marcelo Lotif Roya Javadi Anam Zahid Vahid Reza Khazaie 74 1 0 20 Feb 2025
From Selection to Generation: A Survey of LLM-based Active Learning Yu Xia Subhojyoti Mukherjee Zhouhang Xie Junda Wu Xintong Li ... Namyong Park T. Nguyen Jiebo Luo Ryan Rossi Julian McAuley 53 0 0 17 Feb 2025
Prompting in the Dark: Assessing Human Performance in Prompt Engineering for Data Labeling When Gold Labels Are Absent Zeyu He Saniya Naphade Ting-Hao 'Kenneth' Huang 33 0 0 16 Feb 2025
Can LLMs Rank the Harmfulness of Smaller LLMs? We are Not There Yet Berk Atil Vipul Gupta Sarkar Snigdha Sarathi Das R. Passonneau 83 0 0 07 Feb 2025
Hands-On Tutorial: Labeling with LLM and Human-in-the-Loop Ekaterina Artemova Akim Tsvigun Dominik Schlechtweg Natalia Fedorova Konstantin Chernyshev Sergei Tilga Boris Obmoroshev SyDa VLM 72 0 0 28 Jan 2025
Can AI Extract Antecedent Factors of Human Trust in AI? An Application of Information Extraction for Scientific Literature in Behavioural and Computer Sciences Melanie Mcgrath Harrison Bailey Necva Bölücü Xiang Dai Sarvnaz Karimi Cécile Paris 71 0 0 16 Dec 2024
Rethinking the Uncertainty: A Critical Review and Analysis in the Era of Large Language Models Mohammad Beigi Sijia Wang Ying Shen Zihao Lin Adithya Kulkarni ... Ming Jin Jin-Hee Cho Dawei Zhou Chang-Tien Lu Lifu Huang 21 1 0 26 Oct 2024
Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model Performance Omer Nahum Nitay Calderon Orgad Keller Idan Szpektor Roi Reichart 23 1 0 24 Oct 2024
LLM Chain Ensembles for Scalable and Accurate Data Annotation David Farr Nico Manzonelli Iain Cruickshank Kate Starbird Jevin West 24 3 0 16 Oct 2024
Language Model-Driven Data Pruning Enables Efficient Active Learning Abdul Hameed Azeemi I. Qazi Agha Ali Raza VLM 22 1 0 05 Oct 2024
Are Expert-Level Language Models Expert-Level Annotators? Yu-Min Tseng Wei-Lin Chen Chung-Chi Chen Hsin-Hsi Chen ALM 31 0 0 04 Oct 2024
Setting the AI Agenda -- Evidence from Sweden in the ChatGPT Era Bastiaan Bruinsma Annika Fredén Kajsa Hansson Moa Johansson Pasko Kisić-Merino Denitsa Saynova 28 0 0 25 Sep 2024
Text2Traj2Text: Learning-by-Synthesis Framework for Contextual Captioning of Human Movement Trajectories Hikaru Asano Ryo Yonetani Taiki Sekii Hiroki Ouchi 62 0 0 19 Sep 2024
What Is Wrong with My Model? Identifying Systematic Problems with Semantic Data Slicing Chenyang Yang Yining Hong Grace A. Lewis Tongshuang Wu Christian Kastner 36 1 0 14 Sep 2024
Can Unconfident LLM Annotations Be Used for Confident Conclusions? Kristina Gligorić Tijana Zrnic Cinoo Lee Emmanuel J. Candès Dan Jurafsky 61 4 0 27 Aug 2024
Towards Efficient Large Language Models for Scientific Text: A Review H. To Ming Liu Guangyan Huang 35 1 0 20 Aug 2024
RED-CT: A Systems Design Methodology for Using LLM-labeled Data to Train and Deploy Edge Classifiers for Computational Social Science David Farr Nico Manzonelli Iain Cruickshank Jevin West 28 1 0 15 Aug 2024
VolDoGer: LLM-assisted Datasets for Domain Generalization in Vision-Language Tasks Juhwan Choi Junehyoung Kwon Jungmin Yun Seunguk Yu Youngbin Kim 36 0 0 29 Jul 2024
GPT Assisted Annotation of Rhetorical and Linguistic Features for Interpretable Propaganda Technique Detection in News Text Kyle Hamilton Luca Longo Bojan Bozic 26 1 0 16 Jul 2024
ScoreFusion: Fusing Score-based Generative Models via Kullback-Leibler Barycenters Hao Liu Junze Tony Ye Ye Jose H. Blanchet DiffM FedML 32 1 0 28 Jun 2024
Retrieval Augmented Instruction Tuning for Open NER with Large Language Models Tingyu Xie Jian Zhang Yan Zhang Yuanyuan Liang Qi Li Hongwei Wang RALM 26 0 0 25 Jun 2024
The ALCHEmist: Automated Labeling 500x CHEaper Than LLM Data Annotators Tzu-Heng Huang Catherine Cao Vaishnavi Bhargava Frederic Sala 26 3 0 25 Jun 2024
$USDC: A Dataset of $\underline{U}$ser $\underline{S}$tance and $\underline{D}$ogmatism in Long $\underline{C}$onversations$ USDC: A Dataset of $\underline{U}$ ser $\underline{S}$ tance and $\underline{D}$ ogmatism in Long $\underline{C}$ onversations Mounika Marreddy S. Oota Venkata Charan Chinni Manish Gupta Lucie Flek 43 0 0 24 Jun 2024
Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation Yuhang Zhou Jing Zhu Paiheng Xu Xiaoyu Liu Xiyao Wang Danai Koutra Wei Ai Furong Huang 61 4 0 19 Jun 2024
Enhancing Text Classification through LLM-Driven Active Learning and Human Annotation Hamidreza Rouzegar Masoud Makrehchi 22 9 0 17 Jun 2024
Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness Maximilian Spliethover Sai Nikhil Menon Henning Wachsmuth 36 2 0 14 Jun 2024
On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey Lin Long Rui Wang Ruixuan Xiao Junbo Zhao Xiao Ding Gang Chen Haobo Wang SyDa 45 88 0 14 Jun 2024
Développement automatique de lexiques pour les concepts émergents : une exploration méthodologique Revekka Kyriakoglou Anna Pappa Jilin He A. Schoen P. Laurens Markarit Vartampetian P. Larédo Tita Kyriacopoulou 25 0 0 10 Jun 2024
ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models Yuanyi Ren Haoran Ye Hanjun Fang Xin Zhang Guojie Song LLMAG ELM 29 3 0 06 Jun 2024
HORAE: A Domain-Agnostic Language for Automated Service Regulation Yutao Sun Mingshuai Chen Tiancheng Zhao Kangjia Zhao He Li ... Zhongyi Wang Liqiang Lu Shuiguang Deng Jianwei Yin Jianwei Yin 54 0 0 06 Jun 2024
Cocktail: A Comprehensive Information Retrieval Benchmark with LLM-Generated Documents Integration Sunhao Dai Weihao Liu Yuqi Zhou Liang Pang Rongju Ruan Gang Wang Zhenhua Dong Jun Xu Jirong Wen 37 7 0 26 May 2024
MBIAS: Mitigating Bias in Large Language Models While Retaining Context Shaina Raza Ananya Raval Veronica Chatrath 34 6 0 18 May 2024
The Effectiveness of LLMs as Annotators: A Comparative Overview and Empirical Analysis of Direct Representation Maja Pavlovic Massimo Poesio 32 17 0 02 May 2024
CMNEE: A Large-Scale Document-Level Event Extraction Dataset based on Open-Source Chinese Military News Mengna Zhu Zijie Xu Kaisheng Zeng Kaiming Xiao Mao Wang Wenjun Ke Hongbin Huang 22 1 0 18 Apr 2024
Multi-News+: Cost-efficient Dataset Cleansing via LLM-based Data Annotation Juhwan Choi Jungmin Yun Kyohoon Jin Youngbin Kim 27 3 0 15 Apr 2024
A Two Dimensional Feature Engineering Method for Relation Extraction Hao Wang Yanping Chen Weizhe Yang Yongbin Qin Ruizhang Huang 33 1 0 07 Apr 2024
LLMs in the Loop: Leveraging Large Language Model Annotations for Active Learning in Low-Resource Languages Nataliia Kholodna Sahib Julka Mohammad Khodadadi Muhammed Nurullah Gumus Michael Granitzer 19 9 0 02 Apr 2024
FoC: Figure out the Cryptographic Functions in Stripped Binaries with LLMs Guoqiang Chen Xiuwei Shang Shaoyin Cheng Yanming Zhang Weiming Zhang Neng H. Yu N. Yu 92 2 0 27 Mar 2024
STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models Linhai Zhang Jialong Wu Deyu Zhou Guoqiang Xu 25 4 0 02 Mar 2024
TELEClass: Taxonomy Enrichment and LLM-Enhanced Hierarchical Text Classification with Minimal Supervision Yunyi Zhang Ruozhen Yang Xueqiang Xu Rui Li Jinfeng Xiao Jiaming Shen Jiawei Han 33 9 0 29 Feb 2024
GPTs Are Multilingual Annotators for Sequence Generation Tasks Juhwan Choi Eunju Lee Kyohoon Jin Youngbin Kim 25 10 0 08 Feb 2024
Large Language Models for Generative Information Extraction: A Survey Derong Xu Wei-neng Chen Wenjun Peng Chao Zhang Tong Bill Xu Xiangyu Zhao Xian Wu Yefeng Zheng Yang Wang Enhong Chen 38 137 0 29 Dec 2023
Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matching Meng Chu Zhedong Zheng Wei Ji Tingyu Wang Tat-Seng Chua 18 9 0 21 Nov 2023
Large Language Models are Few-Shot Training Example Generators: A Case Study in Fallacy Recognition Tariq Alhindi Smaranda Muresan Preslav Nakov HILM LRM 35 4 0 16 Nov 2023
Self-Improving for Zero-Shot Named Entity Recognition with Large Language Models Tingyu Xie Qi Li Yan Zhang Zuozhu Liu Hongwei Wang 30 18 0 15 Nov 2023
gBuilder: A Scalable Knowledge Graph Construction System for Unstructured Corpus Yanzeng Li Lei Zou 25 5 0 20 Aug 2022
A Survey on Open Information Extraction from Rule-based Model to Large Language Model Pai Liu Wenya Gao Wenjie Dong Lin Ai Wen Dong Songfang Huang Zongsheng Li Ehsan Hoque Julia Hirschberg Yue Zhang 21 2 0 18 Aug 2022
Large Language Models are Few-Shot Clinical Information Extractors Monica Agrawal S. Hegselmann Hunter Lang Yoon Kim David Sontag BDL LM&MA 154 327 0 25 May 2022