Zero-shot Translation of Attention Patterns in VQA Models to Natural
Language

Zero-shot Translation of Attention Patterns in VQA Models to Natural Language

8 November 2023

Leonard Salewski

A. Sophia Koepke

Hendrik P. A. Lensch

Papers citing "Zero-shot Translation of Attention Patterns in VQA Models to Natural Language"

5 / 5 papers shown

Title
Unlocking Open-Set Language Accessibility in Vision Models Fawaz Sammani Jonas Fischer Nikos Deligiannis VLM 47 0 0 14 Mar 2025
Zero-shot audio captioning with audio-language model guidance and audio context keywords Leonard Salewski Stefan Fauth A. Sophia Koepke Zeynep Akata 8 10 0 14 Nov 2023
DeCap: Decoding CLIP Latents for Zero-Shot Captioning via Text-Only Training Wei Li Linchao Zhu Longyin Wen Yi Yang VLM 40 81 0 06 Mar 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
HIVE: Evaluating the Human Interpretability of Visual Explanations Sunnie S. Y. Kim Nicole Meister V. V. Ramaswamy Ruth C. Fong Olga Russakovsky 49 112 0 06 Dec 2021