SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning

16 June 2022

Alexander William Clegg

Papers citing "SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning"

50 / 64 papers shown

Title
Differentiable Room Acoustic Rendering with Multi-View Vision Priors Derong Jin Ruohan Gao 39 0 0 30 Apr 2025
Multimodal Perception for Goal-oriented Navigation: A Survey I-Tak Ieong Hao Tang LM&Ro LRM 21 0 0 22 Apr 2025
Hearing Anywhere in Any Environment Xiulong Liu Anurag Kumar P. Calamia Sebastia V. Amengual Calvin Murdock Ishwarya Ananthabhotla Philip Robinson Eli Shlizerman V. Ithapu Ruohan Gao 19 0 0 14 Apr 2025
Audio-Language Datasets of Scenes and Events: A Survey Gijs Wijngaard Elia Formisano Michele Esposito M. Dumontier 70 2 0 10 Jan 2025
SoundLoc3D: Invisible 3D Sound Source Localization and Classification Using a Multimodal RGB-D Acoustic Camera Yuhang He Sangyun Shin Anoop Cherian Niki Trigoni Andrew Markham 70 0 0 31 Dec 2024
The Sound of Water: Inferring Physical Properties from Pouring Liquids Piyush Bagad Makarand Tapaswi Cees G. M. Snoek Andrew Zisserman 37 0 0 18 Nov 2024
Acoustic Volume Rendering for Neural Impulse Response Fields Zitong Lan Chenhao Zheng Zhiwei Zheng Mingmin Zhao 21 4 0 09 Nov 2024
3D Audio-Visual Segmentation Artem Sokolov Swapnil Bhosale Xiatian Zhu VOS 31 0 0 04 Nov 2024
Aligning Audio-Visual Joint Representations with an Agentic Workflow Shentong Mo Yibing Song 21 0 0 30 Oct 2024
ANAVI: Audio Noise Awareness using Visuals of Indoor environments for NAVIgation Vidhi Jain Rishi Veerapaneni Yonatan Bisk 24 0 0 24 Oct 2024
SonicSim: A customizable simulation platform for speech processing in moving sound source scenarios Kai Li Wendi Sang Chang Zeng Runxuan Yang Guo Chen Xiaolin Hu 18 2 0 02 Oct 2024
TIGER: Time-frequency Interleaved Gain Extraction and Reconstruction for Efficient Speech Separation Mohan Xu Kai Li Guo Chen Xiaolin Hu 39 0 0 02 Oct 2024
ReALFRED: An Embodied Instruction Following Benchmark in Photo-Realistic Environments Taewoong Kim Cheolhong Min Byeonghwi Kim Jinyeon Kim Wonje Jeung Jonghyun Choi LM&Ro 16 4 0 26 Jul 2024
Computer Audition: From Task-Specific Machine Learning to Foundation Models Andreas Triantafyllopoulos Iosif Tsangko Alexander Gebhard A. Mesaros Tuomas Virtanen Björn Schuller 39 4 0 22 Jul 2024
Audio-visual Generalized Zero-shot Learning the Easy Way Shentong Mo Pedro Morgado 20 1 0 18 Jul 2024
Modeling and Driving Human Body Soundfields through Acoustic Primitives Chao Huang Dejan Marković Chenliang Xu Alexander Richard 18 4 0 18 Jul 2024
SOAF: Scene Occlusion-aware Neural Acoustic Field Huiyu Gao Jiahao Ma David Ahmedt-Aristizabal Chuong H. Nguyen Miaomiao Liu 21 2 0 02 Jul 2024
SPEAR: Receiver-to-Receiver Acoustic Neural Warping Field Yuhang He Shitong Xu Jia-Xing Zhong Sangyun Shin Niki Trigoni Andrew Markham 24 0 0 16 Jun 2024
Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos Changan Chen Puyuan Peng Ami Baid Zihui Xue Wei-Ning Hsu David F. Harwath Kristen Grauman VGen 37 7 0 13 Jun 2024
Can Large Language Models Understand Spatial Audio? Changli Tang Wenyi Yu Guangzhi Sun Xianzhao Chen Tian Tan ... Jun Zhang Lu Lu Zejun Ma Yuxuan Wang Chao Zhang 31 4 0 12 Jun 2024
Hearing Anything Anywhere Mason Wang Ryosuke Sawata Samuel Clarke Ruohan Gao Shangzhe Wu Jiajun Wu 18 5 0 11 Jun 2024
SEE-2-SOUND: Zero-Shot Spatial Environment-to-Spatial Sound Rishit Dagli Shivesh Prakash Robert Wu H. Khosravani 18 0 0 06 Jun 2024
NeRAF: 3D Scene Infused Neural Radiance and Acoustic Fields Amandine Brunetto Sascha Hornauer Fabien Moutarde 39 1 0 28 May 2024
MAGIC: Map-Guided Few-Shot Audio-Visual Acoustics Modeling Diwei Huang Kun-Li Channing Lin Peihao Chen Qing Du Mingkui Tan VGen 14 0 0 22 May 2024
EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Views Yuhang Yang Wei Zhai Chengfeng Wang Chengjun Yu Yang Cao Zheng-jun Zha 30 5 0 22 May 2024
Sim2Real Transfer for Audio-Visual Navigation with Frequency-Adaptive Acoustic Field Prediction Changan Chen Jordi Ramos Anshul Tomar Kristen Grauman 23 1 0 05 May 2024
ActiveRIR: Active Audio-Visual Exploration for Acoustic Environment Modeling Arjun Somayazulu Sagnik Majumder Changan Chen Kristen Grauman 16 1 0 24 Apr 2024
SPMamba: State-space model is all you need in speech separation Kai Li Guo Chen Mamba 45 26 0 02 Apr 2024
Audio Simulation for Sound Source Localization in Virtual Evironment Yidi Yuan Swee Liang Wong Jonathan Pan 22 0 0 02 Apr 2024
Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark Ziyang Chen I. D. Gebru Christian Richardt Anurag Kumar William Laney Andrew Owens Alexander Richard 28 17 0 27 Mar 2024
KITchen: A Real-World Benchmark and Dataset for 6D Object Pose Estimation in Kitchen Environments Abdelrahman Younes Tamim Asfour 16 3 0 24 Mar 2024
Overview of the L3DAS23 Challenge on Audio-Visual Extended Reality Christian Marinoni R. F. Gramaccioni Changan Chen A. Uncini Danilo Comminiello 11 4 0 14 Feb 2024
BAT: Learning to Reason about Spatial Sounds with Large Language Models Zhisheng Zheng Puyuan Peng Ziyang Ma Xie Chen Eunsol Choi David F. Harwath LRM 28 13 0 02 Feb 2024
MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World Yining Hong Zishuo Zheng Peihao Chen Yian Wang Junyan Li Chuang Gan 8 31 0 16 Jan 2024
Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World Kiana Ehsani Tanmay Gupta Rose Hendrix Jordi Salvador Luca Weihs ... Alvaro Herrasti Ranjay Krishna Dustin Schwenk Eli VanderBilt Aniruddha Kembhavi 17 12 0 05 Dec 2023
Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling Shentong Mo Pedro Morgado 11 13 0 02 Dec 2023
AV-RIR: Audio-Visual Room Impulse Response Estimation Anton Ratnarajah Sreyan Ghosh Sonal Kumar Purva Chiniya Dinesh Manocha 23 14 0 30 Nov 2023
Novel-View Acoustic Synthesis from 3D Reconstructed Rooms Byeongjoo Ahn Karren D. Yang Brian Hamilton Jonathan Sheaffer Anurag Ranjan Miguel Sarabia Oncel Tuzel Jen-Hao Rick Chang 17 9 0 23 Oct 2023
AdVerb: Visually Guided Audio Dereverberation Sanjoy Chowdhury Sreyan Ghosh Subhrajyoti Dasgupta Anton Ratnarajah Utkarsh Tyagi Dinesh Manocha 14 7 0 23 Aug 2023
Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigation Jinyu Chen Wenguan Wang Siying Liu Hongsheng Li Yi Yang 11 4 0 20 Aug 2023
Multi-goal Audio-visual Navigation using Sound Direction Map Haruo Kondoh Asako Kanezaki 12 6 0 01 Aug 2023
Self-Supervised Visual Acoustic Matching Arjun Somayazulu Changan Chen Kristen Grauman SSL 17 11 0 27 Jul 2023
Learning Spatial Features from Audio-Visual Correspondence in Egocentric Videos Sagnik Majumder Ziad Al-Halah Kristen Grauman SSL EgoV 16 4 0 10 Jul 2023
STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events Kazuki Shimada A. Politis Parthasaarathy Sudarsanam D. Krause Kengo Uchida ... Yuichiro Koyama Naoya Takahashi Shusuke Takahashi Tuomas Virtanen Yuki Mitsufuji 45 36 0 15 Jun 2023
Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear Ruohan Gao Hao Li Gokul Dharan Zhuzhu Wang Chengshu Li Fei Xia Silvio Savarese Li Fei-Fei Jiajun Wu 18 7 0 01 Jun 2023
A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition Shentong Mo Pedro Morgado 17 21 0 30 May 2023
Bayesian inference and neural estimation of acoustic wave propagation Yongchao Huang Yuhang He Hong Ge 19 0 0 28 May 2023
ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes Ran Gong Jiangyong Huang Yizhou Zhao Haoran Geng Xiaofeng Gao ... Ziheng Zhou D. Terzopoulos Song-Chun Zhu Baoxiong Jia Siyuan Huang LM&Ro 29 45 0 09 Apr 2023
Audio-Visual Grouping Network for Sound Localization from Mixtures Shentong Mo Yapeng Tian 27 40 0 29 Mar 2023
Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation Ziyang Chen Shengyi Qian Andrew Owens 11 12 0 20 Mar 2023