Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2109.11321
Cited By
v1
v2 (latest)
Transferring Knowledge from Vision to Language: How to Achieve it and how to Measure it?
BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2021
23 September 2021
Tobias Norlund
Lovisa Hagström
Richard Johansson
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Transferring Knowledge from Vision to Language: How to Achieve it and how to Measure it?"
18 / 18 papers shown
MIB: A Mechanistic Interpretability Benchmark
Aaron Mueller
Atticus Geiger
Sarah Wiegreffe
Dana Arad
Iván Arcuschin
...
Alessandro Stolfo
Martin Tutek
Amir Zur
David Bau
Yonatan Belinkov
732
17
0
17 Apr 2025
Improving the Efficiency of Visually Augmented Language Models
International Conference on Computational Linguistics (COLING), 2024
Paula Ontalvilla
Aitor Ormazabal
Gorka Azkune
VLM
226
0
0
17 Sep 2024
Answer, Assemble, Ace: Understanding How LMs Answer Multiple Choice Questions
Sarah Wiegreffe
Oyvind Tafjord
Yonatan Belinkov
Hanna Hajishirzi
Ashish Sabharwal
240
3
0
21 Jul 2024
Improving Visual Commonsense in Language Models via Multiple Image Generation
Guy Yariv
Idan Schwartz
Yossi Adi
Sagie Benaim
VLM
LRM
175
1
0
19 Jun 2024
Template-Based Probes Are Imperfect Lenses for Counterfactual Bias Evaluation in LLMs
Farnaz Kohankhaki
D. B. Emerson
David B. Emerson
Laleh Seyyed-Kalantari
Faiza Khan Khattak
453
2
0
04 Apr 2024
Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Models
Neural Information Processing Systems (NeurIPS), 2024
Yang Jiao
Shaoxiang Chen
Zequn Jie
Wenke Huang
Lin Ma
Yueping Jiang
MLLM
335
26
0
12 Mar 2024
WinoViz: Probing Visual Properties of Objects Under Different States
Woojeong Jin
Tejas Srinivasan
Jesse Thomason
Xiang Ren
257
1
0
21 Feb 2024
The Effect of Scaling, Retrieval Augmentation and Form on the Factual Consistency of Language Models
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Lovisa Hagström
Denitsa Saynova
Tobias Norlund
Moa Johansson
Richard Johansson
KELM
HILM
180
14
0
02 Nov 2023
ImageNetVC: Zero- and Few-Shot Visual Commonsense Evaluation on 1000 ImageNet Categories
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Heming Xia
Qingxiu Dong
Lei Li
Jingjing Xu
Tianyu Liu
Ziwei Qin
Zhifang Sui
MLLM
VLM
189
4
0
24 May 2023
Towards Versatile and Efficient Visual Knowledge Integration into Pre-trained Language Models with Cross-Modal Adapters
Xinyun Zhang
Haochen Tan
Han Wu
Bei Yu
KELM
264
2
0
12 May 2023
Language Is Not All You Need: Aligning Perception with Language Models
Neural Information Processing Systems (NeurIPS), 2023
Shaohan Huang
Li Dong
Wenhui Wang
Y. Hao
Saksham Singhal
...
Johan Bjorck
Vishrav Chaudhary
Subhojit Som
Xia Song
Furu Wei
VLM
LRM
MLLM
358
706
0
27 Feb 2023
Controlling for Stereotypes in Multimodal Language Model Evaluation
BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2023
Manuj Malik
Richard Johansson
339
1
0
03 Feb 2023
Visualizing the Obvious: A Concreteness-based Ensemble Model for Noun Property Prediction
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Yue Yang
Artemis Panagopoulou
Marianna Apidianaki
Mark Yatskar
Chris Callison-Burch
268
2
0
24 Oct 2022
How to Adapt Pre-trained Vision-and-Language Models to a Text-only Input?
International Conference on Computational Linguistics (COLING), 2022
Lovisa Hagström
Richard Johansson
VLM
145
4
0
19 Sep 2022
VALHALLA: Visual Hallucination for Machine Translation
Computer Vision and Pattern Recognition (CVPR), 2022
Yi Li
Yikang Shen
Yoon Kim
Chun-Fu Chen
Rogerio Feris
David D. Cox
Nuno Vasconcelos
MLLM
494
52
0
31 May 2022
Visually-Augmented Language Modeling
International Conference on Learning Representations (ICLR), 2022
Weizhi Wang
Li Dong
Hao Cheng
Haoyu Song
Xiaodong Liu
Xifeng Yan
Jianfeng Gao
Furu Wei
VLM
266
22
0
20 May 2022
What do Models Learn From Training on More Than Text? Measuring Visual Commonsense Knowledge
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Lovisa Hagström
Richard Johansson
VLM
206
3
0
14 May 2022
TraVLR: Now You See It, Now You Don't! A Bimodal Dataset for Evaluating Visio-Linguistic Reasoning
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2021
Keng Ji Chow
Samson Tan
MingSung Kan
LRM
280
5
0
21 Nov 2021
1
Page 1 of 1
