Measuring the Measuring Tools: An Automatic Evaluation of Semantic
Metrics for Text Corpora

Measuring the Measuring Tools: An Automatic Evaluation of Semantic Metrics for Text Corpora

29 November 2022

Samuel Ackerman

Ateret Anaby-Tavor

Papers citing "Measuring the Measuring Tools: An Automatic Evaluation of Semantic Metrics for Text Corpora"

10 / 10 papers shown

Title
Controlled Automatic Task-Specific Synthetic Data Generation for Hallucination Detection Yong Xie Karan Aggarwal Aitzaz Ahmad Stephen Lau 32 0 0 16 Oct 2024
Improving and Assessing the Fidelity of Large Language Models Alignment to Online Communities Minh Duc Hoang Chu Zihao He Rebecca Dorn Kristina Lerman 33 2 0 18 Aug 2024
Depth $F_1$ : Improving Evaluation of Cross-Domain Text Classification by Measuring Semantic Generalizability Parker Seegmiller Joseph Gatto S. Preum VLM 27 0 0 20 Jun 2024
Large Language Models Help Reveal Unhealthy Diet and Body Concerns in Online Eating Disorders Communities Minh Duc Hoang Chu Zihao He Rebecca Dorn Kristina Lerman 16 0 0 17 Jan 2024
A ModelOps-based Framework for Intelligent Medical Knowledge Extraction Hongxin Ding Peinie Zou Zhiyuan Wang Junfeng Zhao Yasha Wang Qiang Zhou 16 0 0 04 Oct 2023
Harnessing large-language models to generate private synthetic text Alexey Kurakin Natalia Ponomareva Umar Syed Liam MacDermed Andreas Terzis SILM SyDa 20 34 0 02 Jun 2023
Reliable and Interpretable Drift Detection in Streams of Short Texts Ella Rabinovich Matan Vetzler Samuel Ackerman Ateret Anaby-Tavor AI4TS 34 2 0 28 May 2023
MAUVE Scores for Generative Models: Theory and Practice Krishna Pillutla Lang Liu John Thickstun Sean Welleck Swabha Swayamdipta Rowan Zellers Sewoong Oh Yejin Choi Zaïd Harchaoui EGVM 23 21 0 30 Dec 2022
Efficient Intent Detection with Dual Sentence Encoders I. Casanueva Tadas Temvcinas D. Gerz Matthew Henderson Ivan Vulić VLM 176 450 0 10 Mar 2020
Revisiting Classifier Two-Sample Tests David Lopez-Paz Maxime Oquab 65 389 0 20 Oct 2016