Semantic Audio-Visual Navigation

21 December 2020

Papers citing "Semantic Audio-Visual Navigation"

50 / 62 papers shown

Title
UWAV: Uncertainty-weighted Weakly-supervised Audio-Visual Video Parsing Yung-Hsuan Lai Janek Ebbers Yu-Chiang Frank Wang François Germain Michael Jeffrey Jones Moitreya Chatterjee 26 0 0 14 May 2025
Multimodal Perception for Goal-oriented Navigation: A Survey I-Tak Ieong Hao Tang LM&Ro LRM 33 0 0 22 Apr 2025
HomeEmergency -- Using Audio to Find and Respond to Emergencies in the Home James F. Mullen Jr Dhruva Kumar Xuewei Qi R. Madhivanan Arnie Sen Dinesh Manocha Richard Kim 38 0 0 01 Apr 2025
MO-DDN: A Coarse-to-Fine Attribute-based Exploration Agent for Multi-object Demand-driven Navigation Hongcheng Wang Peiqi Liu Wenzhe Cai Mingdong Wu Zhengyu Qian Hao Dong 26 0 0 04 Oct 2024
Disentangled Acoustic Fields For Multimodal Physical Scene Understanding Jie Yin Andrew F. Luo Yilun Du A. Cherian Tim K. Marks Jonathan Le Roux Chuang Gan 52 0 0 16 Jul 2024
SOAF: Scene Occlusion-aware Neural Acoustic Field Huiyu Gao Jiahao Ma David Ahmedt-Aristizabal Chuong H. Nguyen Miaomiao Liu 31 2 0 02 Jul 2024
Sim2Real Transfer for Audio-Visual Navigation with Frequency-Adaptive Acoustic Field Prediction Changan Chen Jordi Ramos Anshul Tomar Kristen Grauman 28 3 0 05 May 2024
ActiveRIR: Active Audio-Visual Exploration for Acoustic Environment Modeling Arjun Somayazulu Sagnik Majumder Changan Chen Kristen Grauman 32 1 0 24 Apr 2024
Leveraging Large Language Model-based Room-Object Relationships Knowledge for Enhancing Multimodal-Input Object Goal Navigation Leyuan Sun Asako Kanezaki Guillaume Caron Yusuke Yoshiyasu LM&Ro 28 2 0 21 Mar 2024
Dual Mean-Teacher: An Unbiased Semi-Supervised Framework for Audio-Visual Source Localization Yuxin Guo Shijie Ma Hu Su Zhiqing Wang Yuhao Zhao Wei Zou Siyang Sun Yun Zheng SSL 51 12 0 05 Mar 2024
Disentangled Counterfactual Learning for Physical Audiovisual Commonsense Reasoning Changsheng Lv Shuai Zhang Yapeng Tian Mengshi Qi Huadong Ma CML 44 16 0 30 Oct 2023
Measuring Acoustics with Collaborative Multiple Agents Yinfeng Yu Changan Chen Lele Cao Fangkai Yang Gang Hua 25 1 0 09 Oct 2023
XVO: Generalized Visual Odometry via Cross-Modal Self-Training Tohida Rehman Ronit Mandal Jimuyang Zhang Debarshi Kumar Sanyal SSL 33 17 0 28 Sep 2023
Find What You Want: Learning Demand-conditioned Object Attribute Space for Demand-driven Navigation Hongchen Wang Andy Guan Hong Chen Xiaoqi Li Mingdong Wu Hao Dong 26 14 0 15 Sep 2023
AdVerb: Visually Guided Audio Dereverberation Sanjoy Chowdhury Sreyan Ghosh Subhrajyoti Dasgupta Anton Ratnarajah Utkarsh Tyagi Tianyi Zhou 30 11 0 23 Aug 2023
Audio-Visual Class-Incremental Learning Weiguo Pian Shentong Mo Yunhui Guo Yapeng Tian CLL VLM 33 28 0 21 Aug 2023
Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigation Jinyu Chen Wenguan Wang Siying Liu Hongsheng Li Yi Yang 20 8 0 20 Aug 2023
Multi-goal Audio-visual Navigation using Sound Direction Map Haruo Kondoh Asako Kanezaki 17 6 0 01 Aug 2023
Multi-Spectral Image Stitching via Spatial Graph Reasoning Zhiying Jiang Zengxi Zhang Jinyuan Liu Xin-Yue Fan Risheng Liu 14 8 0 31 Jul 2023
Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear Ruohan Gao Hao Li Gokul Dharan Zhuzhu Wang Chengshu Li Fei Xia Silvio Savarese Li Fei-Fei Jiajun Wu 34 11 0 01 Jun 2023
Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parser Yun-hsuan Lai Yen-Chun Chen Y. Wang 23 10 0 27 May 2023
Learning Semantic-Agnostic and Spatial-Aware Representation for Generalizable Visual-Audio Navigation Hongchen Wang Yuxuan Wang Fangwei Zhong Min-Yu Wu Jianwei Zhang Yizhou Wang Hao Dong 34 6 0 21 Apr 2023
Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation Ziyang Chen Shengyi Qian Andrew Owens 26 12 0 20 Mar 2023
CASP-Net: Rethinking Video Saliency Prediction from an Audio-VisualConsistency Perceptual Perspective Jun Xiong Gang Wang Peng Zhang Wei Huang Yufei Zha Guangtao Zhai 29 14 0 11 Mar 2023
AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis Susan Liang Chao Huang Yapeng Tian Anurag Kumar Chenliang Xu VGen 40 27 0 04 Feb 2023
Chat2Map: Efficient Scene Mapping from Multi-Ego Conversations Sagnik Majumder Hao Jiang Pierre Moulon E. Henderson P. Calamia Kristen Grauman V. Ithapu EgoV 35 7 0 04 Jan 2023
On Transforming Reinforcement Learning by Transformer: The Development Trajectory Shengchao Hu Li Shen Ya-Qin Zhang Yixin Chen Dacheng Tao OffRL 27 25 0 29 Dec 2022
Knowledge-driven Scene Priors for Semantic Audio-Visual Embodied Navigation Gyan Tatiya Jonathan M Francis Luca Bondi Ingrid Navarro Eric Nyberg Jivko Sinapov Jean Oh 30 8 0 21 Dec 2022
Towards Versatile Embodied Navigation H. Wang Wei Liang Luc Van Gool Wenguan Wang LM&Ro 47 20 0 30 Oct 2022
AVLEN: Audio-Visual-Language Embodied Navigation in 3D Environments Sudipta Paul A. Roy-Chowdhury A. Cherian 33 23 0 14 Oct 2022
Learning Active Camera for Multi-Object Navigation Peihao Chen Dongyu Ji Kun-Li Channing Lin Weiwen Hu Wenbing Huang Thomas H. Li Ming Tan Chuang Gan 33 24 0 14 Oct 2022
Retrospectives on the Embodied AI Workshop Matt Deitke Dhruv Batra Yonatan Bisk Tommaso Campari Angel X. Chang ... Jesse Thomason Alexander Toshev Joanne Truong Luca Weihs Jiajun Wu LM&Ro 37 51 0 13 Oct 2022
Pay Self-Attention to Audio-Visual Navigation Yinfeng Yu Lele Cao Gang Hua Xiaohong Liu Liejun Wang 27 4 0 04 Oct 2022
Learning in Audio-visual Context: A Review, Analysis, and New Perspective Yake Wei Di Hu Yapeng Tian Xuelong Li 46 55 0 20 Aug 2022
Finding Fallen Objects Via Asynchronous Audio-Visual Integration Chuang Gan Yi Gu Siyuan Zhou Jeremy Schwartz S. Alter James Traer Dan Gutfreund J. Tenenbaum Josh H. McDermott Antonio Torralba 50 19 0 07 Jul 2022
Beyond Visual Field of View: Perceiving 3D Environment with Echoes and Vision Lingyu Zhu Esa Rahtu Hang Zhao MDE 46 5 0 03 Jul 2022
What do navigation agents learn about their environment? Kshitij Dwivedi Gemma Roig Aniruddha Kembhavi Roozbeh Mottaghi 44 11 0 17 Jun 2022
SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning Changan Chen Carl Schissler Sanchit Garg Philip Kobernik Alexander Clegg P. Calamia Dhruv Batra Philip Robinson Kristen Grauman 3DGS 33 79 0 16 Jun 2022
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation Matt Deitke Eli VanderBilt Alvaro Herrasti Luca Weihs Jordi Salvador ... Winson Han Eric Kolve Ali Farhadi Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 44 235 0 14 Jun 2022
Multimodal Learning with Transformers: A Survey P. Xu Xiatian Zhu David A. Clifton ViT 72 527 0 13 Jun 2022
Imagination-augmented Navigation Based on 2D Laser Sensor Observations Zhengcheng Shen Linh Kästner Magdalena Yordanova Jens Lambrecht 10 1 0 12 Jun 2022
Human-Following and -guiding in Crowded Environments using Semantic Deep-Reinforcement-Learning for Mobile Service Robots Linh Kästner Bassel Fatloun Zhengcheng Shen Daniel P Gawrisch Jens Lambrecht HAI 11 14 0 12 Jun 2022
Few-Shot Audio-Visual Learning of Environment Acoustics Sagnik Majumder Changan Chen Ziad Al-Halah Kristen Grauman 30 50 0 08 Jun 2022
Towards Generalisable Audio Representations for Audio-Visual Navigation Shunqi Mao Chaoyi Zhang Heng Wang Weidong (Tom) Cai 14 0 0 01 Jun 2022
A Deep Reinforcement Learning Blind AI in DareFightingICE Thai Van Nguyen Xincheng Dai Ibrahim Khan R. Thawonmas H. V. Pham VLM 23 7 0 16 May 2022
Online No-regret Model-Based Meta RL for Personalized Navigation Yuda Song Ye Yuan Wen Sun Kris M. Kitani 38 0 0 05 Apr 2022
Sound Adversarial Audio-Visual Navigation Yinfeng Yu Wenbing Huang Gang Hua Changan Chen Yikai Wang Xiaohong Liu AAML 24 29 0 22 Feb 2022
Visual Acoustic Matching Changan Chen Ruohan Gao P. Calamia Kristen Grauman 21 56 0 14 Feb 2022
Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigation Ziad Al-Halah Santhosh Kumar Ramakrishnan Kristen Grauman VLM 23 80 0 05 Feb 2022
Active Audio-Visual Separation of Dynamic Sound Sources Sagnik Majumder Kristen Grauman 24 21 0 02 Feb 2022