MEGAnno+: A Human-LLM Collaborative Annotation System

MEGAnno+: A Human-LLM Collaborative Annotation System

28 February 2024

Sajjadur Rahman

Dan Zhang

Papers citing "MEGAnno+: A Human-LLM Collaborative Annotation System"

18 / 18 papers shown

Title
Can Third-parties Read Our Emotions? Jiayi Li Yingfan Zhou Pranav Narayanan Venkit Halima Binte Islam Sneha Arya Shomir Wilson Sarah Rajtmajer 44 0 0 25 Apr 2025
A Short Survey on Small Reasoning Models: Training, Inference, Applications and Research Directions Chengyu Wang Taolin Zhang Richang Hong Jun Huang ReLM LRM 37 1 0 12 Apr 2025
CoLa -- Learning to Interactively Collaborate with Large LMs Abhishek Sharma Dan Goldwasser LLMAG SyDa 58 0 0 03 Apr 2025
SPHERE: An Evaluation Card for Human-AI Systems Qianou Ma Dora Zhao Xinran Zhao Chenglei Si Chenyang Yang Ryan Louie Ehud Reiter Diyi Yang Tongshuang Wu ALM 50 0 0 24 Mar 2025
Stay Focused: Problem Drift in Multi-Agent Debate Jonas Becker Lars Benedikt Kaesberg Andreas Stephan Jan Philip Wahle Terry Ruas Bela Gipp 57 1 0 26 Feb 2025
Prompting in the Dark: Assessing Human Performance in Prompt Engineering for Data Labeling When Gold Labels Are Absent Zeyu He Saniya Naphade Ting-Hao 'Kenneth' Huang 33 0 0 16 Feb 2025
Can LLMs Rank the Harmfulness of Smaller LLMs? We are Not There Yet Berk Atil Vipul Gupta Sarkar Snigdha Sarathi Das R. Passonneau 115 0 0 07 Feb 2025
Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertise Rose E. Wang Ana T. Ribeiro Carly Robinson Susanna Loeb Dora Demszky 60 11 0 28 Jan 2025
Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model Performance Omer Nahum Nitay Calderon Orgad Keller Idan Szpektor Roi Reichart 23 1 0 24 Oct 2024
Model-in-the-Loop (MILO): Accelerating Multimodal AI Data Annotation with LLMs Yifan Wang David Stevens Pranay Shah Wenwen Jiang Miao Liu ... Boying Gong Daniel Lee Jiabo Hu Ning Zhang Bob Kamma 30 1 0 16 Sep 2024
Can Unconfident LLM Annotations Be Used for Confident Conclusions? Kristina Gligorić Tijana Zrnic Cinoo Lee Emmanuel J. Candès Dan Jurafsky 66 4 0 27 Aug 2024
Automating Knowledge Discovery from Scientific Literature via LLMs: A Dual-Agent Approach with Progressive Ontology Prompting Yuting Hu Dancheng Liu Qingyun Wang Charles Yu Heng Ji Jinjun Xiong LLMAG 33 0 0 20 Aug 2024
Can LLMs Replace Manual Annotation of Software Engineering Artifacts? Toufique Ahmed Premkumar Devanbu Christoph Treude Michael Pradel 68 10 0 10 Aug 2024
An Empirical Study of Validating Synthetic Data for Formula Generation Usneek Singh J. Cambronero Sumit Gulwani Aditya Kanade Anirudh Khatry Vu Le Mukul Singh Gust Verbruggen SyDa 25 0 0 15 Jul 2024
Scaling Technology Acceptance Analysis with Large Language Model (LLM) Annotation Systems P. Smolinski Joseph Januszewicz J. Winiarski 21 0 0 30 Jun 2024
Investigating Low-Cost LLM Annotation for~Spoken Dialogue Understanding Datasets Lucas Druart Valentin Vielzeuf Yannick Esteve 28 0 0 19 Jun 2024
ChatGPT: Beginning of an End of Manual Linguistic Data Annotation? Use Case of Automatic Genre Identification Taja Kuzman I. Mozetič Nikola Ljubesic 49 91 0 07 Mar 2023
Self-Consistency Improves Chain of Thought Reasoning in Language Models Xuezhi Wang Jason W. Wei Dale Schuurmans Quoc Le Ed H. Chi Sharan Narang Aakanksha Chowdhery Denny Zhou ReLM BDL LRM AI4CE 297 3,217 0 21 Mar 2022