Papers citing 'Imagination improves Multimodal Translation'

Title
IndicVisionBench: Benchmarking Cultural and Multilingual Understanding in VLMs Ali Faraz Akash Shaharukh Khan Raja Kolla Akshat Patidar Suranjan Goswami Abhinav Ravi Chandra Khatri Shubham Agarwal VLM 148 0 0 06 Nov 2025
FOSSIL: Harnessing Feedback on Suboptimal Samples for Data-Efficient Generalisation with Imitation Learning for Embodied Vision-and-Language Tasks Sabrina McCallum Amit Parekh Alessandro Suglia LM&Ro 116 0 0 13 Oct 2025
Multimodal Machine Translation with Visual Scene Graph Pruning Chenyu Lu Shiliang Sun Jing Zhao N. Zhang Tengfei Song Hao Yang 406 1 0 26 May 2025
TopicVD: A Topic-Based Dataset of Video-Guided Multimodal Machine Translation for DocumentariesInternational Conference on Applications of Natural Language to Data Bases (NLDB), 2025 Jinze Lv Jian Chen Zi Long Xianghua Fu Yin Chen VGen 281 0 0 09 May 2025
Chitranuvad: Adapting Multi-Lingual LLMs for Multimodal TranslationConference on Machine Translation (WMT), 2025 Shaharukh Khan Ayush Tarun Ali Faraz Palash Kamble Vivek Dahiya Praveen Kumar Pokala Ashish Kulkarni Chandra Khatri Abhinav Ravi Shubham Agarwal 854 6 0 27 Feb 2025
Towards Zero-Shot Multimodal Machine Translation Matthieu Futeral Cordelia Schmid Benoît Sagot Rachel Bawden 357 5 0 18 Jul 2024
AnyTrans: Translate AnyText in the Image with Large Scale Models Zhipeng Qian Pei Zhang Baosong Yang Kai Fan Yiwei Ma Yang Li Xiaoshuai Sun Rongrong Ji VLM 216 3 0 17 Jun 2024
A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges Huangjun Shen Liangying Shao Wenbo Li Zhibin Lan Zhanyu Liu Jinsong Su 290 4 0 21 May 2024
3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset Xinyu Ma Xuebo Liu Yang Li Jun Rao Bei Li Liang Ding Lidia S. Chao Dacheng Tao Min Zhang 154 5 0 29 Apr 2024
Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering PairsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Yuxin Zuo Bei Li Chuanhao Lv Tong Zheng Tong Xiao Jingbo Zhu 119 7 0 26 Oct 2023
Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation Wenyu Guo Qingkai Fang Dong Yu Yang Feng 212 15 0 20 Oct 2023
Impact of Visual Context on Noisy Multimodal NMT: An Empirical Study for English to Indian Languages Baban Gain Dibyanayan Bandyopadhyay Subhabrata Mukherjee Chandranath Adak Asif Ekbal 252 3 0 30 Aug 2023
Towards Unseen Triples: Effective Text-Image-joint Learning for Scene Graph Generation Qianji Di Wenxing Ma Chen Ma Tianxiang Hou Ying Shan Hanzi Wang 107 1 0 23 Jun 2023
Modality Influence in Multimodal Machine Learning Abdelhamid Haouhat Slimane Bellaouar A. Nehar H. Cherroun 203 3 0 10 Jun 2023
Exploring Better Text Image Translation with Multimodal CodebookAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Zhibin Lan Jiawei Yu Xiang-Yang Li Wen Zhang Jian Luan Bin Wang Degen Huang Jinsong Su 182 18 0 27 May 2023
BigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Liyan Kang Luyang Huang Ningxin Peng Peihao Zhu Zewei Sun Shanbo Cheng Mingxuan Wang Degen Huang Jinsong Su 313 15 0 23 May 2023
Large Scale Multi-Lingual Multi-Modal Summarization DatasetConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 Yash Verma Anubhav Jangra Raghvendra Kumar S. Saha 68 22 0 13 Feb 2023
Beyond Triplet: Leveraging the Most Data for Multimodal Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Yaoming Zhu Zewei Sun Shanbo Cheng Yuyang Huang Liwei Wu Mingxuan Wang 242 20 0 20 Dec 2022
Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Matthieu Futeral Cordelia Schmid Ivan Laptev Benoît Sagot Rachel Bawden 282 46 0 20 Dec 2022
LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine TranslationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Hongcheng Guo Jiaheng Liu Haoyang Huang Jian Yang Zhoujun Li Dongdong Zhang Zheng Cui Furu Wei 149 24 0 19 Oct 2022
Increasing Visual Awareness in Multimodal Neural Machine Translation from an Information Theoretic PerspectiveConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Baijun Ji Tong Zhang Yicheng Zou Bojie Hu Sitian Shen 164 17 0 16 Oct 2022
Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine TranslationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Ru Peng Yawen Zeng Jiaqi Zhao 189 24 0 10 Oct 2022
Cross-Lingual Cross-Modal Retrieval with Noise-Robust LearningACM Multimedia (ACM MM), 2022 Yabing Wang Jianfeng Dong Tianxiang Liang Minsong Zhang Rui Cai Xun Wang 254 27 0 26 Aug 2022
Neural Machine Translation with Phrase-Level Universal Visual RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Qingkai Fang Yang Feng 140 53 0 19 Mar 2022
Supervised Visual Attention for Simultaneous Multimodal Machine TranslationJournal of Artificial Intelligence Research (JAIR), 2022 Veneta Haralampieva Ozan Caglayan Lucia Specia LRM 200 4 0 23 Jan 2022
Transferring Knowledge from Vision to Language: How to Achieve it and how to Measure it?BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2021 Tobias Norlund Lovisa Hagström Richard Johansson 237 25 0 23 Sep 2021
Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-trainingACM Multimedia (ACM MM), 2021 Yuqing Song Shizhe Chen Qin Jin Wei Luo Jun Xie Fei Huang 190 25 0 25 Aug 2021
A Survey on Low-Resource Neural Machine TranslationInternational Joint Conference on Artificial Intelligence (IJCAI), 2021 Rui Wang Xu Tan Renqian Luo Tao Qin Tie-Yan Liu 3DV 181 68 0 09 Jul 2021
Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Zhiyong Wu Lingpeng Kong W. Bi Xiang Li B. Kao LRM 97 97 0 30 May 2021
UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-trainingComputer Vision and Pattern Recognition (CVPR), 2021 Mingyang Zhou Luowei Zhou Shuohang Wang Yu Cheng Linjie Li Zhou Yu Jingjing Liu MLLM VLM 209 103 0 01 Apr 2021
Exploiting Multimodal Reinforcement Learning for Simultaneous Machine TranslationConference of the European Chapter of the Association for Computational Linguistics (EACL), 2021 Julia Ive A. Li Yishu Miao Ozan Caglayan Pranava Madhyastha Lucia Specia 158 12 0 22 Feb 2021
Cross-lingual Visual Pre-training for Multimodal Machine TranslationConference of the European Chapter of the Association for Computational Linguistics (EACL), 2021 Ozan Caglayan Menekse Kuyu Mustafa Sercan Amac Pranava Madhyastha Erkut Erdem Aykut Erdem Lucia Specia VLM 151 53 0 25 Jan 2021
Efficient Object-Level Visual Context Modeling for Multimodal Machine Translation: Masking Irrelevant Objects Helps GroundingAAAI Conference on Artificial Intelligence (AAAI), 2020 Dexin Wang Deyi Xiong 78 44 0 18 Dec 2020
MSVD-Turkish: A Comprehensive Multimodal Dataset for Integrated Vision and Language Research in TurkishMachine Translation (MT), 2020 Begum Citamak Ozan Caglayan Menekse Kuyu Erkut Erdem Aykut Erdem Pranava Madhyastha Lucia Specia 186 9 0 13 Dec 2020
Imagining Grounded Conceptual Representations from Perceptual Information in Situated Guessing Games Alessandro Suglia Antonio Vergari Ioannis Konstas Yonatan Bisk E. Bastianelli Andrea Vanzo Oliver Lemon OCL 149 11 0 05 Nov 2020
Emergent Communication Pretraining for Few-Shot Machine TranslationInternational Conference on Computational Linguistics (COLING), 2020 Yaoyiran Li Edoardo Ponti Ivan Vulić Anna Korhonen 207 20 0 02 Nov 2020
Generative Imagination Elevates Machine TranslationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2020 Quanyu Long Mingxuan Wang Lei Li 148 44 0 21 Sep 2020
Simultaneous Machine Translation with Visual ContextConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Ozan Caglayan Julia Ive Veneta Haralampieva Pranava Madhyastha Loïc Barrault Lucia Specia 117 31 0 15 Sep 2020
Dynamic Context-guided Capsule Network for Multimodal Machine TranslationACM Multimedia (ACM MM), 2020 Huan Lin Fandong Meng Jinsong Su Yongjing Yin Zhengyuan Yang Yubin Ge Jie Zhou Jiebo Luo 193 91 0 04 Sep 2020
A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Yongjing Yin Fandong Meng Jinsong Su Chulun Zhou Zhengyuan Yang Jie Zhou Jiebo Luo 164 160 0 17 Jul 2020
M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training Minheng Ni Haoyang Huang Lin Su Edward Cui Taroon Bharti Lijuan Wang Jianfeng Gao Dongdong Zhang Nan Duan 244 7 0 04 Jun 2020
CompGuessWhat?!: A Multi-task Evaluation Framework for Grounded Language LearningAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Alessandro Suglia Ioannis Konstas Andrea Vanzo E. Bastianelli Desmond Elliott Stella Frank Oliver Lemon 131 17 0 03 Jun 2020
Unsupervised Multimodal Neural Machine Translation with Pseudo Visual PivotingAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Po-Yao (Bernie) Huang Junjie Hu Xiaojun Chang Alexander G. Hauptmann 164 55 0 06 May 2020
Experience Grounds Language Yonatan Bisk Ari Holtzman Jesse Thomason Jacob Andreas Yoshua Bengio ... Angeliki Lazaridou Jonathan May Aleksandr Nisnevich Nicolas Pinto Joseph P. Turian 435 395 0 21 Apr 2020
Neural Machine Translation: Challenges, Progress and FutureScience China Technological Sciences (Sci China Technol Sci), 2020 Jiajun Zhang Chengqing Zong 146 58 0 13 Apr 2020
Towards Multimodal Simultaneous Neural Machine TranslationConference on Machine Translation (WMT), 2020 Aizhan Imankulova Masahiro Kaneko Tosho Hirasawa Mamoru Komachi 160 15 0 07 Apr 2020
Visual Agreement Regularized Training for Multi-Modal Machine TranslationAAAI Conference on Artificial Intelligence (AAAI), 2019 Pengcheng Yang Boxing Chen Pei Zhang Xu Sun 211 34 0 27 Dec 2019
Multimodal Machine Translation through Visuals and SpeechMachine Translation (MT), 2019 U. Sulubacak Ozan Caglayan Stig-Arne Gronroos Aku Rouhe Desmond Elliott Lucia Specia Jörg Tiedemann 188 86 0 28 Nov 2019
Bootstrapping Disjoint Datasets for Multilingual Multimodal Representation Learning Ákos Kádár Grzegorz Chrupała Afra Alishahi Desmond Elliott 172 1 0 09 Nov 2019
Predicting the Politics of an Image Using Webly Supervised DataNeural Information Processing Systems (NeurIPS), 2019 Christopher Thomas Adriana Kovashka SSL 195 24 0 31 Oct 2019

IndicVisionBench: Benchmarking Cultural and Multilingual Understanding in VLMs

148

0

06 Nov 2025

FOSSIL: Harnessing Feedback on Suboptimal Samples for Data-Efficient Generalisation with Imitation Learning for Embodied Vision-and-Language Tasks

116

0

13 Oct 2025

Multimodal Machine Translation with Visual Scene Graph Pruning

406

1

0

26 May 2025

TopicVD: A Topic-Based Dataset of Video-Guided Multimodal Machine Translation for DocumentariesInternational Conference on Applications of Natural Language to Data Bases (NLDB), 2025

281

0

09 May 2025

Chitranuvad: Adapting Multi-Lingual LLMs for Multimodal TranslationConference on Machine Translation (WMT), 2025

854

6

0

27 Feb 2025

Towards Zero-Shot Multimodal Machine Translation

357

5

0

18 Jul 2024

AnyTrans: Translate AnyText in the Image with Large Scale Models

Xiaoshuai Sun

Rongrong Ji

VLM

216

3

0

17 Jun 2024

A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges

290

4

0

21 May 2024

3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset

Liang Ding

Min Zhang

154

5

0

29 Apr 2024

Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering PairsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023

Jingbo Zhu

119

7

0

26 Oct 2023

Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation

212

15

0

20 Oct 2023

Impact of Visual Context on Noisy Multimodal NMT: An Empirical Study for English to Indian Languages

Baban Gain

Dibyanayan Bandyopadhyay

Subhabrata Mukherjee

Chandranath Adak

Asif Ekbal

252

3

0

30 Aug 2023

Towards Unseen Triples: Effective Text-Image-joint Learning for Scene Graph Generation

Ying Shan

107

1

0

23 Jun 2023

Modality Influence in Multimodal Machine Learning

203

3

0

10 Jun 2023

Exploring Better Text Image Translation with Multimodal CodebookAnnual Meeting of the Association for Computational Linguistics (ACL), 2023

182

18

0

27 May 2023

BigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2023

313

15

0

23 May 2023

Large Scale Multi-Lingual Multi-Modal Summarization DatasetConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023

68

22

0

13 Feb 2023