Controlled Crowdsourcing for High-Quality QA-SRL Annotation

8 November 2019

Gabriel Stanovsky

Luke Zettlemoyer

Ido Dagan

ArXiv PDF HTML

Papers citing "Controlled Crowdsourcing for High-Quality QA-SRL Annotation"

33 / 33 papers shown

Title
QAPyramid: Fine-grained Evaluation of Content Selection for Text Summarization Shiyue Zhang David Wan Arie Cattan Ayal Klein Ido Dagan Joey Tianyi Zhou 86 0 0 10 Dec 2024
Explicating the Implicit: Argument Detection Beyond Sentence Boundaries Paul Roit Aviv Slobodkin Eran Hirsch Arie Cattan Ayal Klein Valentina Pyatkin Ido Dagan 52 1 0 08 Aug 2024
OMoS-QA: A Dataset for Cross-Lingual Extractive Question Answering in a German Migration Context Steffen Kleinle Jakob Prange Annemarie Friedrich RALM 35 0 0 22 Jul 2024
The Power of Summary-Source Alignments Ori Ernst Ori Shapira Aviv Slobodkin Sharon Adar Mohit Bansal Jacob Goldberger Ran Levy Ido Dagan 70 2 0 02 Jun 2024
Attribute First, then Generate: Locally-attributable Grounded Text Generation Aviv Slobodkin Eran Hirsch Arie Cattan Tal Schuster Ido Dagan 71 20 0 25 Mar 2024
Multi-Review Fusion-in-Context Aviv Slobodkin Ori Shapira Ran Levy Ido Dagan 87 1 0 22 Mar 2024
OpenAsp: A Benchmark for Multi-document Open Aspect-based Summarization Shmuel Amar Liat Schiff Ori Ernst Asi Shefer Ori Shapira Ido Dagan 30 11 0 07 Dec 2023
GPQA: A Graduate-Level Google-Proof Q&A Benchmark David Rein Betty Li Hou Asa Cooper Stickland Jackson Petty Richard Yuanzhe Pang Julien Dirani Julian Michael Samuel R. Bowman AI4MH ELM 31 460 0 20 Nov 2023
CHAMP: Efficient Annotation and Consolidation of Cluster Hierarchies Arie Cattan Tom Hope Doug Downey Roy Bar-Haim Lilach Eden Yoav Kantor Ido Dagan 23 0 0 19 Nov 2023
Conjunct Resolution in the Face of Verbal Omissions Royi Rassin Yoav Goldberg Reut Tsarfaty CVBM 24 0 0 26 May 2023
Revisiting Sentence Union Generation as a Testbed for Text Consolidation Eran Hirsch Valentina Pyatkin Ruben Wolhandler Avi Caciularu Asi Shefer Ido Dagan MoMe 23 6 0 24 May 2023
Modeling Complex Event Scenarios via Simple Entity-focused Questions Mahnaz Koupaee Greg Durrett Nathanael Chambers Niranjan Balasubramanian 22 1 0 14 Feb 2023
PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognition Sihao Chen S. Buthpitiya Alex Fabrikant Dan Roth Tal Schuster 17 23 0 21 Dec 2022
Human in the loop approaches in multi-modal conversational task guidance system development R. Manuvinakurike Sovan Biswas G. Raffa R. Beckwith A. Rhodes Meng Shi Gesem Gudino Mejia Saurav Sahay L. Nachman 38 2 0 03 Nov 2022
Controlled Text Reduction Aviv Slobodkin Paul Roit Eran Hirsch Ori Ernst Ido Dagan 47 10 0 24 Oct 2022
Lexical Generalization Improves with Larger Models and Longer Training Elron Bandel Yoav Goldberg Yanai Elazar 55 6 0 23 Oct 2022
Life is a Circus and We are the Clowns: Automatically Finding Analogies between Situations and Processes Oren Sultan Dafna Shahaf 38 27 0 21 Oct 2022
QASem Parsing: Text-to-text Modeling of QA-based Semantics Ayal Klein Eran Hirsch Ron Eliav Valentina Pyatkin Avi Caciularu Ido Dagan 36 12 0 23 May 2022
QuALITY: Question Answering with Long Input Texts, Yes! Richard Yuanzhe Pang Alicia Parrish Nitish Joshi Nikita Nangia Jason Phang ... Vishakh Padmakumar Johnny Ma Jana Thompson He He Sam Bowman RALM 27 141 0 16 Dec 2021
LMTurk: Few-Shot Learners as Crowdsourcing Workers in a Language-Model-as-a-Service Framework Mengjie Zhao Fei Mi Yasheng Wang Minglei Li Xin Jiang Qun Liu Hinrich Schütze RALM 40 11 0 14 Dec 2021
QA-Align: Representing Cross-Text Content Overlap by Aligning Question-Answer Propositions Daniel Weiss Paul Roit Ayal Klein Ori Ernst Ido Dagan 28 18 0 26 Sep 2021
Text-based NP Enrichment Yanai Elazar Victoria Basmov Yoav Goldberg Reut Tsarfaty 57 15 0 24 Sep 2021
Asking It All: Generating Contextualized Questions for any Semantic Role Valentina Pyatkin Paul Roit Julian Michael Reut Tsarfaty Yoav Goldberg Ido Dagan 13 35 0 10 Sep 2021
Draw Me a Flower: Processing and Grounding Abstraction in Natural Language R. Lachmy Valentina Pyatkin Avshalom Manevich Reut Tsarfaty 23 18 0 27 Jun 2021
What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks? Nikita Nangia Saku Sugawara H. Trivedi Alex Warstadt Clara Vania Sam Bowman 14 35 0 01 Jun 2021
Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violence Andrew Halterman Katherine A. Keith Sheikh Muhammad Sarwar Brendan O'Connor 22 27 0 27 May 2021
Quantifying and Avoiding Unfair Qualification Labour in Crowdsourcing Jonathan K. Kummerfeld 25 16 0 26 May 2021
Does Putting a Linguist in the Loop Improve NLU Data Collection? Alicia Parrish William Huang Omar Agha Soo-hwan Lee Nikita Nangia Alex Warstadt Karmanya Aggarwal Emily Allaway Tal Linzen Samuel R. Bowman 25 40 0 15 Apr 2021
Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processing Sarah Wiegreffe Ana Marasović XAI 11 141 0 24 Feb 2021
The Extraordinary Failure of Complement Coercion Crowdsourcing Yanai Elazar Victoria Basmov Shauli Ravfogel Yoav Goldberg Reut Tsarfaty 19 6 0 12 Oct 2020
CoRefi: A Crowd Sourcing Suite for Coreference Annotation A. Bornstein Arie Cattan Ido Dagan 32 18 0 06 Oct 2020
Evaluating Interactive Summarization: an Expansion-Based Framework Ori Shapira Ramakanth Pasunuru H. Ronen Joey Tianyi Zhou Yael Amsterdamer Ido Dagan 14 2 0 17 Sep 2020
Summary-Source Proposition-level Alignment: Task, Datasets and Supervised Baseline Ori Ernst Ori Shapira Ramakanth Pasunuru Michael Lepioshkin Jacob Goldberger Joey Tianyi Zhou Ido Dagan 14 28 0 01 Sep 2020