v1v2v3v4 (latest)

Improved Image Captioning via Policy Gradient optimization of SPIDEr

1 December 2016

Papers citing "Improved Image Captioning via Policy Gradient optimization of SPIDEr"

50 / 232 papers shown

Title
Listening without Looking: Modality Bias in Audio-Visual Captioning Yuchi Ishikawa Toranosuke Manabe Tatsuya Komatsu Y. Aoki 48 0 0 28 Oct 2025
Diffusion-Link: Diffusion Probabilistic Model for Bridging the Audio-Text Modality Gap KiHyun Nam J. Choi Hyeongkeun Lee Jungwoo Heo Joon Son Chung 44 0 0 13 Oct 2025
AURA Score: A Metric For Holistic Audio Question Answering Evaluation Satvik Dixit Soham Deshmukh Bhiksha Raj 92 0 0 06 Oct 2025
Spatial-CLAP: Learning Spatially-Aware audio--text Embeddings for Multi-Source Conditions Kentaro Seki Yuki Okamoto Kouei Yamaoka Yuki Saito Shinnosuke Takamichi Hiroshi Saruwatari 73 0 0 18 Sep 2025
Landsat30-AU: A Vision-Language Dataset for Australian Landsat Imagery Sai Ma Zhuang Li John A Taylor 146 0 0 05 Aug 2025
From Contrast to Commonality: Audio Commonality Captioning for Enhanced Audio-Text Cross-modal Understanding in Multimodal LLMs Yuhang Jia Xu Zhang Yong Qin Yang Chen Shiwan Zhao VLM 139 0 0 03 Aug 2025
CLAP-ART: Automated Audio Captioning with Semantic-rich Audio Representation Tokenizer Daiki Takeuchi Binh Thien Nguyen Masahiro Yasuda Yasunori Ohishi Daisuke Niizumi Noboru Harada VLM 140 1 0 01 Jun 2025
Discrete Audio Representations for Automated Audio Captioning Jingguang Tian Haoqin Sun Xinhui Hu Xinkang Xu 190 1 0 21 May 2025
Solla: Towards a Speech-Oriented LLM That Hears Acoustic Context Junyi Ao Dekun Chen Xiaohai Tian Wenjie Feng Jing Zhang Lu Lu Longji Xu Haizhou Li Zhizheng Wu AuLLM 206 1 0 19 Mar 2025
Mellow: a small audio language model for reasoning Soham Deshmukh Satvik Dixit Rita Singh Bhiksha Raj AuLLM ReLM LRM 231 16 0 11 Mar 2025
Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Mohammad Mahdi Abootorabi Amirhosein Zobeiri Mahdi Dehghani Mohammadali Mohammadkhani Bardia Mohammadi Omid Ghahroodi M. Baghshah Ehsaneddin Asgari RALM 643 27 0 12 Feb 2025
Unbiased Sliced Wasserstein Kernels for High-Quality Audio Captioning Manh Luong Khai Nguyen Dinh Q. Phung Gholamreza Haffari Zhuang Li OT 223 0 0 08 Feb 2025
MACE: Leveraging Audio for Evaluating Audio Captioning Systems Satvik Dixit Soham Deshmukh Bhiksha Raj 209 4 0 01 Nov 2024
EmotionCaps: Enhancing Audio Captioning Through Emotion-Augmented Data Generation Mithun Manivannan Vignesh Nethrapalli Mark Cartwright 132 2 0 15 Oct 2024
Enhancing Robustness in Deep Reinforcement Learning: A Lyapunov Exponent ApproachNeural Information Processing Systems (NeurIPS), 2024 Rory Young Nicolas Pugeault AAML 302 20 0 14 Oct 2024
SLAM-AAC: Enhancing Audio Captioning with Paraphrasing Augmentation and CLAP-Refine through LLMsIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024 Wenxi Chen Ziyang Ma Xiquan Li Xuenan Xu Yuzhe Liang Zhisheng Zheng Kai Yu Xie Chen 221 10 0 12 Oct 2024
DRCap: Decoding CLAP Latents with Retrieval-Augmented Generation for Zero-shot Audio CaptioningIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024 Xiquan Li Wenxi Chen Ziyang Ma Xuenan Xu Yuzhe Liang Zhisheng Zheng Qiuqiang Kong Xie Chen VLM 271 12 0 12 Oct 2024
Audio Description Generation in the Era of LLMs and VLMs: A Review of Transferable Generative AI TechnologiesNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Yingqiang Gao Lukas Fischer Alexa Lintner Sarah Ebling 178 4 0 11 Oct 2024
An Eye for an Ear: Zero-shot Audio Description Leveraging an Image Captioner using Audiovisual Distribution Alignment Hugo Malard Michel Olvera Stéphane Lathuilière S. Essid VLM 149 0 0 08 Oct 2024
CLAIR-A: Leveraging Large Language Models to Judge Audio Captions Tsung-Han Wu Joseph E. Gonzalez Trevor Darrell David M. Chan 186 3 0 19 Sep 2024
Towards Diverse and Efficient Audio Captioning via Diffusion Models Manjie Xu Chenxing Li Xinyi Tu Yong Ren Ruibo Fu Wei Liang Dong Yu DiffM 239 5 0 14 Sep 2024
Revisiting Image Captioning Training Paradigm via Direct CLIP-based OptimizationBritish Machine Vision Conference (BMVC), 2024 Nicholas Moratelli Davide Caffagni Marcella Cornia Lorenzo Baraldi Rita Cucchiara CLIP 208 6 0 26 Aug 2024
Surveying the Landscape of Image Captioning Evaluation: A Comprehensive Taxonomy, Trends and Metrics Analysis Uri Berger Gabriel Stanovsky Omri Abend Lea Frermann 252 0 0 09 Aug 2024
video-SALMONN: Speech-Enhanced Audio-Visual Large Language Models Guangzhi Sun Wenyi Yu Changli Tang Xianzhao Chen Tian Tan Wei Li Lu Lu Zejun Ma Yuxuan Wang Chao Zhang 185 60 0 22 Jun 2024
Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio EncodingInterspeech (Interspeech), 2024 Jizhong Liu Gang Li Junbo Zhang Heinrich Dinkel Yongqing Wang Zhiyong Yan Yujun Wang Bin Wang AuLLM 275 10 0 19 Jun 2024
Zero-Shot Audio Captioning Using Soft and Hard Prompts Yiming Zhang Xuenan Xu Ruoyi Du Haohe Liu Yuan Dong Zheng-Hua Tan Wenwu Wang Zhanyu Ma VLM 197 6 0 10 Jun 2024
Sentiment-oriented Transformer-based Variational Autoencoder Network for Live Video Commenting Fengyi Fu Shancheng Fang Weidong Chen Zhendong Mao ViT VGen 135 5 0 19 Apr 2024
LocCa: Visual Pretraining with Location-aware Captioners Bo Wan Michael Tschannen Yongqin Xian Filip Pavetić Ibrahim Alabdulmohsin Xiao Wang André Susano Pinto Andreas Steiner Lucas Beyer Xiao-Qi Zhai VLM 300 19 0 28 Mar 2024
ACES: Evaluating Automated Audio Captioning Models on the Semantics of Sounds Gijs Wijngaard Elia Formisano Bruno L. Giordano M. Dumontier 163 5 0 27 Mar 2024
Improved Baselines for Data-efficient Perceptual Augmentation of LLMs Théophane Vallaeys Mustafa Shukor Matthieu Cord Jakob Verbeek 261 16 0 20 Mar 2024
EDTC: enhance depth of text comprehension in automated audio captioning Liwen Tan Yin Cao Yi Zhou 159 0 0 27 Feb 2024
Intensive Vision-guided Network for Radiology Report GenerationPhysics in Medicine and Biology (PMB), 2023 Fudan Zheng Mengfei Li Ying Wang Weijiang Yu Ruixuan Wang Zhiguang Chen Nong Xiao Yutong Lu 215 1 0 06 Feb 2024
EnCLAP: Combining Neural Audio Codec and Audio-Text Joint Embedding for Automated Audio Captioning Jaeyeon Kim Jaeyoon Jung Jinjoo Lee Sang Hoon Woo CLIP VLM 158 38 0 31 Jan 2024
Audio-Visual LLM for Video Understanding Fangxun Shu Lei Zhang Hao Jiang Cihang Xie VLM MLLM 213 60 0 11 Dec 2023
X-InstructBLIP: A Framework for aligning X-Modal instruction-aware representations to LLMs and Emergent Cross-modal Reasoning Artemis Panagopoulou Le Xue Ning Yu Junnan Li Dongxu Li Shafiq Joty Ran Xu Silvio Savarese Caiming Xiong Juan Carlos Niebles VLM MLLM 236 68 0 30 Nov 2023
C3Net: Compound Conditioned ControlNet for Multimodal Content GenerationComputer Vision and Pattern Recognition (CVPR), 2023 Juntao Zhang Yuehuai Liu Yu-Wing Tai Chi-Keung Tang DiffM 187 8 0 29 Nov 2023
Radiology-Aware Model-Based Evaluation Metric for Report Generation Amos Calamida Farhad Nooralahzadeh Morteza Rohanian Koji Fujimoto Mizuho Nishio Michael Krauthammer 99 7 0 28 Nov 2023
Zero-shot audio captioning with audio-language model guidance and audio context keywords Leonard Salewski Stefan Fauth A. Sophia Koepke Zeynep Akata 143 14 0 14 Nov 2023
Fine-grained Audio-Visual Joint Representations for Multimodal Large Language Models Guangzhi Sun Wenyi Yu Changli Tang Xianzhao Chen Tian Tan Wei Li Lu Lu Zejun Ma Chao Zhang 204 14 0 09 Oct 2023
ContextRef: Evaluating Referenceless Metrics For Image Description GenerationInternational Conference on Learning Representations (ICLR), 2023 Elisa Kreiss E. Zelikman Christopher Potts Nick Haber 209 5 0 21 Sep 2023
A Large-scale Dataset for Audio-Language Representation LearningACM Multimedia (ACM MM), 2023 Luoyi Sun Xuenan Xu Mengyue Wu Weidi Xie 291 44 0 20 Sep 2023
Synth-AC: Enhancing Audio Captioning with Synthetic Supervision Feiyang Xiao Qiaoxi Zhu Jian Guan Xubo Liu Haohe Liu Kejia Zhang Wenwu Wang 151 2 0 18 Sep 2023
CoNeTTE: An efficient Audio Captioning system leveraging multiple datasets with Task Embedding Etienne Labbé Thomas Pellegrini J. Pinquier 217 20 0 01 Sep 2023
Killing two birds with one stone: Can an audio captioning system also be used for audio-text retrieval? Etienne Labbé Thomas Pellegrini J. Pinquier 124 5 0 29 Aug 2023
Audio Difference Captioning Utilizing Similarity-Discrepancy Disentanglement Daiki Takeuchi Yasunori Ohishi Daisuke Niizumi Noboru Harada K. Kashino 176 10 0 23 Aug 2023
DRL4Route: A Deep Reinforcement Learning Framework for Pick-up and Delivery Route PredictionKnowledge Discovery and Data Mining (KDD), 2023 Xiaowei Mao Haomin Wen Hengrui Zhang Huaiyu Wan Lixia Wu Jianbin Zheng Haoyuan Hu Youfang Lin AI4TS 204 16 0 30 Jul 2023
Improving Reference-based Distinctive Image Captioning with Contrastive Rewards Yangjun Mao Jun Xiao Dong Zhang Meng Cao Jian Shao Yueting Zhuang Long Chen EGVM 140 9 0 25 Jun 2023
Learning to Generate Better Than Your LLM Jonathan D. Chang Kianté Brantley Rajkumar Ramamurthy Dipendra Kumar Misra Wen Sun 204 54 0 20 Jun 2023
Adapting a ConvNeXt model to audio classification on AudioSetInterspeech (Interspeech), 2023 Thomas Pellegrini Ismail Khalfaoui-Hassani Etienne Labbé T. Masquelier 143 27 0 01 Jun 2023
Dual Transformer Decoder based Features Fusion Network for Automated Audio CaptioningInterspeech (Interspeech), 2023 Jianyuan Sun Xubo Liu Xinhao Mei V. Kılıç Mark D. Plumbley Wenwu Wang 139 4 0 30 May 2023