Title
Summarizing a virtual robot's past actions in natural language Chad DeChant Daniel Bauer LM&Ro 116 4 0 13 Mar 2022
Contextualized Sensorimotor Norms: multi-dimensional measures of sensorimotor strength for ambiguous English words, in context Sean Trott Benjamin Bergen 106 5 0 10 Mar 2022
Exploring Multi-Modal Representations for Ambiguity Detection & Coreference Resolution in the SIMMC 2.0 Challenge Javier Chiyah-Garcia Alessandro Suglia José Lopes Arash Eshghi Helen F. Hastie 115 8 0 25 Feb 2022
A Review on Methods and Applications in Multimodal Deep Learning Summaira Jabeen Xi Li Muhammad Shoib Amin Abdul Jabbar VLM HAI 117 126 0 18 Feb 2022
Language Model-Based Paired Variational Autoencoders for Robotic Language LearningIEEE Transactions on Cognitive and Developmental Systems (IEEE TCDS), 2022 Ozan Ozdemir Matthias Kerzel C. Weber Jae Hee Lee S. Wermter LM&Ro 179 9 0 17 Jan 2022
Discrete and continuous representations and processing in deep learning: Looking forwardAI Open (AO), 2022 Ruben Cartuyvels Graham Spinks Marie-Francine Moens OCL 157 25 0 04 Jan 2022
Building Human-like Communicative Intelligence: A Grounded PerspectiveCognitive Systems Research (CSR), 2021 M. Dubova 117 13 0 02 Jan 2022
AI and the Everything in the Whole Wide World Benchmark Inioluwa Deborah Raji Emily M. Bender Amandalynne Paullada Emily L. Denton A. Hanna 184 378 0 26 Nov 2021
Explainable Semantic Space by Grounding Language to Vision with Cross-Modal Contrastive LearningNeural Information Processing Systems (NeurIPS), 2021 Yizhen Zhang Minkyu Choi Kuan Han Zhongming Liu VLM 91 19 0 13 Nov 2021
A Systematic Investigation of Commonsense Knowledge in Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Xiang Lorraine Li A. Kuncoro Jordan Hoffmann Cyprien de Masson dÁutume Phil Blunsom Aida Nematzadeh LRM 149 71 0 31 Oct 2021
Deep Transfer Learning & Beyond: Transformer Language Models in Information Systems Research Ross Gruetzemacher D. Paradice 159 44 0 18 Oct 2021
The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color Cory Paik Stéphane Aroca-Ouellette Alessandro Roncone Katharina Kann 129 38 0 15 Oct 2021
FILM: Following Instructions in Language with Modular MethodsInternational Conference on Learning Representations (ICLR), 2021 So Yeon Min Devendra Singh Chaplot Pradeep Ravikumar Yonatan Bisk Ruslan Salakhutdinov LM&Ro 438 180 0 12 Oct 2021
Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied AgentsIEEE International Conference on Computer Vision (ICCV), 2021 Shivansh Patel Saim Wani Unnat Jain Alex Schwing Svetlana Lazebnik Manolis Savva Angel X. Chang LM&Ro 117 29 0 12 Oct 2021
Situated Dialogue Learning through Procedural Environment Generation Prithviraj Ammanabrolu Renee Jia Mark O. Riedl 253 14 0 07 Oct 2021
TEACh: Task-driven Embodied Agents that Chat Aishwarya Padmakumar Jesse Thomason Ayush Shrivastava P. Lange Anjali Narayan-Chen Spandana Gella Robinson Piramithu Gokhan Tur Dilek Z. Hakkani-Tür LM&Ro 493 217 0 01 Oct 2021
Grounding Predicates through Actions Toki Migimatsu Jeannette Bohg 294 38 0 29 Sep 2021
Transferring Knowledge from Vision to Language: How to Achieve it and how to Measure it?BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2021 Tobias Norlund Lovisa Hagström Richard Johansson 185 25 0 23 Sep 2021
Does Vision-and-Language Pretraining Improve Lexical Grounding? Tian Yun Chen Sun Ellie Pavlick VLM CoGe 170 36 0 21 Sep 2021
Dependency Induction Through the Lens of Visual Perception Ruisi Su Shruti Rijhwani Hao Zhu Junxian He Xinyu Wang Yonatan Bisk Graham Neubig 110 3 0 20 Sep 2021
Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysis Saif M. Mohammad 166 84 0 17 Sep 2021
What Vision-Language Models `See' when they See Scenes Michele Cafagna Kees van Deemter Albert Gatt VLM 169 13 0 15 Sep 2021
Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color Mostafa Abdou Artur Kulmizev Daniel Hershcovich Stella Frank Ellie Pavlick Anders Søgaard 136 152 0 13 Sep 2021
We went to look for meaning and all we got were these lousy representations: aspects of meaning representation for computational semantics Simon Dobnik R. Cooper Adam Ek Bill Noble Staffan Larsson N. Ilinykh Vladislav Maraev Vidya Somashekarappa 86 0 0 10 Sep 2021
Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language UnderstandingConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Shane Storks Qiaozi Gao Yichi Zhang J. Chai ReLM LRM 179 23 0 10 Sep 2021
Modular Framework for Visuomotor Language Grounding Kolby Nottingham Litian Liang Daeyun Shin Charless C. Fowlkes Roy Fox Sameer Singh 125 12 0 05 Sep 2021
WebQA: Multihop and Multimodal QAComputer Vision and Pattern Recognition (CVPR), 2021 Yingshan Chang M. Narang Hisami Suzuki Guihong Cao Jianfeng Gao Yonatan Bisk LRM 250 109 0 01 Sep 2021
TACo: Token-aware Cascade Contrastive Learning for Video-Text AlignmentIEEE International Conference on Computer Vision (ICCV), 2021 Jianwei Yang Yonatan Bisk Jianfeng Gao 153 152 0 23 Aug 2021
Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completion Alessandro Suglia Qiaozi Gao Jesse Thomason Govind Thattai Gaurav Sukhatme LM&Ro 192 82 0 10 Aug 2021
QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading ComprehensionACM Computing Surveys (CSUR), 2021 Anna Rogers Matt Gardner Isabelle Augenstein 222 181 0 27 Jul 2021
Language Grounding with 3D ObjectsConference on Robot Learning (CoRL), 2021 Jesse Thomason Mohit Shridhar Yonatan Bisk Chris Paxton Luke Zettlemoyer LM&Ro 158 54 0 26 Jul 2021
Theoretical foundations and limits of word embeddings: what types of meaning can they capture?Sociological Methods & Research (SMR), 2021 Alina Arseniev-Koehler 111 29 0 22 Jul 2021
Neural Variational Learning for Grounded Language AcquisitionIEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), 2021 Nisha Pillai Cynthia Matuszek Francis Ferraro VLM SSL GAN DRL 154 2 0 20 Jul 2021
A Systematic Survey of Text Worlds as Embodied Natural Language Environments Peter Alexander Jansen LM&Ro 138 25 0 08 Jul 2021
VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfer Zineng Tang Jaemin Cho Hao Tan Joey Tianyi Zhou VLM 106 30 0 06 Jul 2021
SocialAI: Benchmarking Socio-Cognitive Abilities in Deep Reinforcement Learning Agents Grgur Kovač Rémy Portelas Katja Hofmann Pierre-Yves Oudeyer ALM 140 6 0 02 Jul 2021
Core Challenges in Embodied Vision-Language PlanningJournal of Artificial Intelligence Research (JAIR), 2021 Jonathan M Francis Nariaki Kitamura Felix Labelle Xiaopeng Lu Ingrid Navarro Jean Oh LM&Ro 256 55 0 26 Jun 2021
PROST: Physical Reasoning of Objects through Space and TimeFindings (Findings), 2021 Stéphane Aroca-Ouellette Cory Paik Alessandro Roncone Katharina Kann LRM 116 53 0 07 Jun 2021
Grounding 'Grounding' in NLPFindings (Findings), 2021 Khyathi Chandu Yonatan Bisk A. Black 129 57 0 04 Jun 2021
Uncovering Constraint-Based Behavior in Neural Models via Targeted Fine-TuningAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Forrest Davis Marten van Schijndel AI4CE 100 7 0 02 Jun 2021
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D WorldAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Rowan Zellers Ari Holtzman Matthew E. Peters Roozbeh Mottaghi Aniruddha Kembhavi Ali Farhadi Yejin Choi 175 74 0 01 Jun 2021
RAW-C: Relatedness of Ambiguous Words--in Context (A New Lexical Resource for English)Annual Meeting of the Association for Computational Linguistics (ACL), 2021 Sean Trott Benjamin Bergen 172 20 0 27 May 2021
Maria: A Visual Experience Powered Conversational AgentAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Zujie Liang Huang Hu Can Xu Chongyang Tao Xiubo Geng Yining Chen Fan Liang Daxin Jiang 145 33 0 27 May 2021
Recent Advances and Trends in Multimodal Deep Learning: A Review Jabeen Summaira Xi Li Amin Muhammad Shoib Songyuan Li Abdul Jabbar HAI 303 68 0 24 May 2021
Cross-Modal Generative Augmentation for Visual Question AnsweringBritish Machine Vision Conference (BMVC), 2021 Zixu Wang Yishu Miao Lucia Specia 136 11 0 11 May 2021
Language Acquisition is Embodied, Interactive, Emotive: a Research Proposal C. Kennington LM&Ro 88 0 0 10 May 2021
SocialAI 0.1: Towards a Benchmark to Stimulate Research on Socio-Cognitive Abilities in Deep Reinforcement Learning Agents Grgur Kovač Rémy Portelas Katja Hofmann Pierre-Yves Oudeyer ALM LM&Ro 151 2 0 27 Apr 2021
Language in a (Search) Box: Grounding Language Learning in Real-World Human-Machine InteractionNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Federico Bianchi C. Greco Jacopo Tagliabue 125 9 0 18 Apr 2021
Frequency-based Distortions in Contextualized Word Embeddings Kaitlyn Zhou Kawin Ethayarajh Dan Jurafsky 100 23 0 17 Apr 2021
Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World KnowledgeNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Canwen Xu Wangchunshu Zhou Tao Ge Ke Xu Julian McAuley Furu Wei 102 16 0 06 Apr 2021