What is Learned in Visually Grounded Neural Syntax Acquisition

v1v2 (latest)

What is Learned in Visually Grounded Neural Syntax Acquisition

4 May 2020

Noriyuki Kojima

Hadar Averbuch-Elor

Alexander M. Rush

ArXiv (abs)PDF HTML

Papers citing "What is Learned in Visually Grounded Neural Syntax Acquisition"

13 / 13 papers shown

Title
Learning Language Structures through Grounding Freda Shi 80 2 0 14 Jun 2024
A Surprising Failure? Multimodal LLMs and the NLVR Challenge Anne Wu Kianté Brantley Yoav Artzi 46 5 0 26 Feb 2024
Mitigating Open-Vocabulary Caption Hallucinations Assaf Ben-Kish Moran Yanuka Morris Alper Raja Giryes Hadar Averbuch-Elor MLLM VLM 123 6 0 06 Dec 2023
A Joint Study of Phrase Grounding and Task Performance in Vision and Language Models Noriyuki Kojima Hadar Averbuch-Elor Yoav Artzi 76 2 0 06 Sep 2023
Re-evaluating the Need for Multimodal Signals in Unsupervised Grammar Induction Boyi Li Rodolfo Corona K. Mangalam Catherine Chen Daniel Flaherty Serge Belongie Kilian Q. Weinberger Jitendra Malik Trevor Darrell Dan Klein 86 1 0 20 Dec 2022
Vision-Language Intelligence: Tasks, Representation Learning, and Large Models Feng Li Hao Zhang Yi-Fan Zhang Shixuan Liu Jian Guo L. Ni Pengchuan Zhang Lei Zhang AI4TS VLM 83 37 0 03 Mar 2022
Dependency Induction Through the Lens of Visual Perception Ruisi Su Shruti Rijhwani Hao Zhu Junxian He Xinyu Wang Yonatan Bisk Graham Neubig 70 3 0 20 Sep 2021
Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal Vision Xiaoshi Wu Hadar Averbuch-Elor J. Sun Noah Snavely 84 20 0 12 Aug 2021
Neural Abstructions: Abstractions that Support Construction for Grounded Language Learning Kaylee Burns Christopher D. Manning Li Fei-Fei 56 0 0 20 Jul 2021
Video-aided Unsupervised Grammar Induction Songyang Zhang Linfeng Song Lifeng Jin Kun Xu Dong Yu Jiebo Luo 63 27 0 09 Apr 2021
KANDINSKYPatterns -- An experimental exploration environment for Pattern Analysis and Machine Intelligence Andreas Holzinger Anna Saranti Heimo Mueller 114 10 0 28 Feb 2021
Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded Supervision Hao Tan Joey Tianyi Zhou CLIP 89 121 0 14 Oct 2020
Visually Grounded Compound PCFGs Yanpeng Zhao Ivan Titov 80 45 0 25 Sep 2020