Evaluating the Evaluation Metrics for Style Transfer: A Case Study in
Multilingual Formality Transfer

Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfer

20 October 2021

Eleftheria Briakou

Joel R. Tetreault

Papers citing "Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfer"

19 / 19 papers shown

Title
A Meta-Evaluation of Style and Attribute Transfer Metrics Amalie Brogaard Pauli Isabelle Augenstein Ira Assent 64 0 0 20 Feb 2025
ValueScope: Unveiling Implicit Norms and Values via Return Potential Model of Social Interactions Chan Young Park Shuyue Stella Li Hayoung Jung Svitlana Volkova Tanushree Mitra David Jurgens Yulia Tsvetkov 47 5 0 02 Jul 2024
Is Knowledge All Large Language Models Needed for Causal Reasoning? Hengrui Cai Shengjie Liu Rui Song LRM ELM 12 6 0 30 Dec 2023
Text Style Transfer Evaluation Using Large Language Models Phil Ostheimer M. Nagda Marius Kloft Sophie Fellenz 9 9 0 25 Aug 2023
A Call for Standardization and Validation of Text Style Transfer Evaluation Phil Ostheimer M. Nagda Marius Kloft Sophie Fellenz 29 14 0 01 Jun 2023
Responsibility Perspective Transfer for Italian Femicide News Gosse Minnema Huiyuan Lai Benedetta Muscato Malvina Nissim 8 3 0 01 Jun 2023
Multidimensional Evaluation for Text Style Transfer Using ChatGPT Huiyuan Lai Antonio Toral Malvina Nissim 10 17 0 26 Apr 2023
In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languages Asim Ersoy Gerson Vizcarra T. Mayeesha Benjamin Muller 11 1 0 23 Feb 2023
Learning a Formality-Aware Japanese Sentence Representation Henry Li Xinyuan Ray Lee Jerry Chen Kelly Marchisio CVBM AI4TS 11 0 0 17 Jan 2023
Studying the role of named entities for content preservation in text style transfer N. Babakov David Dale V. Logacheva I. Krotova Alexander Panchenko 8 1 0 20 Jun 2022
Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models Mirac Suzgun Luke Melas-Kyriazi Dan Jurafsky VLM 77 64 0 23 May 2022
Controlling Translation Formality Using Pre-trained Multilingual Language Models Elijah Matthew Rippeth Sweta Agrawal Marine Carpuat AI4CE 42 14 0 13 May 2022
Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer Huiyuan Lai Jiali Mao Antonio Toral Malvina Nissim 12 13 0 15 Apr 2022
Challenges and Strategies in Cross-Cultural NLP Daniel Hershcovich Stella Frank Heather Lent Miryam de Lhoneux Mostafa Abdou ... Ruixiang Cui Constanza Fierro Katerina Margatina Phillip Rust Anders Søgaard 38 161 0 18 Mar 2022
Multilingual Pre-training with Language and Task Adaptation for Multilingual Text Style Transfer Huiyuan Lai Antonio Toral Malvina Nissim 6 13 0 16 Mar 2022
Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text Sebastian Gehrmann Elizabeth Clark Thibault Sellam ELM AI4CE 47 182 0 14 Feb 2022
From Theories on Styles to their Transfer in Text: Bridging the Gap with a Hierarchical Survey Enrica Troiano Aswathy Velutharambath Roman Klinger 22 9 0 29 Oct 2021
Exploring Contextual Word-level Style Relevance for Unsupervised Style Transfer Chulun Zhou Liangyu Chen Jiachen Liu Xinyan Xiao Jinsong Su Sheng Guo Hua-Hong Wu 40 33 0 05 May 2020
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 228 29,632 0 16 Jan 2013