Tackling Ambiguity with Images: Improved Multimodal Machine Translation
and Contrastive Evaluation

Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation

20 December 2022

Matthieu Futeral

Cordelia Schmid

Papers citing "Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation"

15 / 15 papers shown

Title
Memory Reviving, Continuing Learning and Beyond: Evaluation of Pre-trained Encoders and Decoders for Multimodal Machine Translation Zhuang Yu Shiliang Sun Jing Zhao Tengfei Song Hao-Yu Yang 48 0 0 25 Apr 2025
Who Relies More on World Knowledge and Bias for Syntactic Ambiguity Resolution: Humans or LLMs? So Young Lee Russell Scheinberg Amber Shore Ameeta Agrawal 46 1 0 13 Mar 2025
Florenz: Scaling Laws for Systematic Generalization in Vision-Language Models Julian Spravil Sebastian Houben Sven Behnke VLM 68 0 0 12 Mar 2025
Quantifying the Gaps Between Translation and Native Perception in Training for Multimodal, Multilingual Retrieval Kyle Buettner Adriana Kovashka VLM 15 4 0 02 Oct 2024
Can visual language models resolve textual ambiguity with visual cues? Let visual puns tell you! Jiwan Chung Seungwon Lim Jaehyun Jeon Seungbeen Lee Youngjae Yu 20 0 0 01 Oct 2024
Plug, Play, and Fuse: Zero-Shot Joint Decoding via Word-Level Re-ranking Across Diverse Vocabularies Sai Koneru Matthias Huck M. Exel Jan Niehues 27 0 0 21 Aug 2024
Towards Zero-Shot Multimodal Machine Translation Matthieu Futeral Cordelia Schmid Benoît Sagot Rachel Bawden 30 3 0 18 Jul 2024
mOSCAR: A Large-scale Multilingual and Multimodal Document-level Corpus Matthieu Futeral A. Zebaze Pedro Ortiz Suarez Julien Abadji Rémi Lacroix Cordelia Schmid Rachel Bawden Benoît Sagot 39 3 0 13 Jun 2024
A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges Huangjun Shen Liangying Shao Wenbo Li Zhibin Lan Zhanyu Liu Jinsong Su 34 2 0 21 May 2024
Detecting Concrete Visual Tokens for Multimodal Machine Translation Braeden Bowen Vipin Vijayan Scott Grigsby Timothy Anderson Jeremy Gwinnup 26 2 0 05 Mar 2024
Adding Multimodal Capabilities to a Text-only Translation Model Vipin Vijayan Braeden Bowen Scott Grigsby Timothy Anderson Jeremy Gwinnup LRM 14 5 0 05 Mar 2024
The Case for Evaluating Multimodal Translation Models on Text Datasets Vipin Vijayan Braeden Bowen Scott Grigsby Timothy Anderson Jeremy Gwinnup 25 3 0 05 Mar 2024
Benchmarking and Improving Text-to-SQL Generation under Ambiguity Adithya Bhaskar Tushar Tomar Ashutosh Sathe Sunita Sarawagi 33 17 0 20 Oct 2023
Rephrase, Augment, Reason: Visual Grounding of Questions for Vision-Language Models Archiki Prasad Elias Stengel-Eskin Mohit Bansal ReLM LRM 28 8 0 09 Oct 2023
Zero and Few-shot Semantic Parsing with Ambiguous Inputs Elias Stengel-Eskin Kyle Rawlins Benjamin Van Durme 23 14 0 01 Jun 2023