The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects

1 June 2023

Yunzhu Li

Li Fei-Fei

Jiajun Wu

ArXiv PDF HTML

Papers citing "The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects"

26 / 26 papers shown

Title
SToLa: Self-Adaptive Touch-Language Framework with Tactile Commonsense Reasoning in Open-Ended Scenarios Ning Cheng Jinan Xu Jialing Chen Wenjuan Han LRM 31 0 0 07 May 2025
Modality Selection and Skill Segmentation via Cross-Modality Attention Jiawei Jiang Kei Ota Devesh K. Jha Asako Kanezaki 24 0 0 20 Apr 2025
X-Capture: An Open-Source Portable Device for Multi-Sensory Learning Samuel Clarke Suzannah Wistreich Yanjie Ze Jiajun Wu 35 0 0 03 Apr 2025
Visual Acoustic Fields Yuelei Li Hyunjin Kim Fangneng Zhan Ri-Zhao Qiu Mazeyu Ji Xiaojun Shan Xueyan Zou Paul Liang Hanspeter Pfister Xiaolong Wang 47 0 0 31 Mar 2025
TacCap: A Wearable FBG-Based Tactile Sensor for Seamless Human-to-Robot Skill Transfer Chengyi Xing Hao Li Yi-Lin Wei Tian-Ao Ren Tianyu Tu Yuhao Lin Elizabeth Schumann Wei-Shi Zheng M. Cutkosky 69 0 0 03 Mar 2025
AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensors Ruoxuan Feng Jiangyu Hu Wenke Xia Tianci Gao Ao Shen Yuhao Sun Bin Fang Di Hu 47 5 0 15 Feb 2025
Sparsh: Self-supervised touch representations for vision-based tactile sensing Carolina Higuera Akash Sharma Chaithanya Krishna Bodduluri Taosha Fan Patrick E. Lancaster ... Michael Kaess Byron Boots Mike Lambeta Tingfan Wu Mustafa Mukadam 42 12 0 31 Oct 2024
Contrastive Touch-to-Touch Pretraining Samanta Rodriguez Yiming Dou W. V. D. Bogert Miquel Oller Kevin So Andrew Owens Nima Fazeli 24 0 0 15 Oct 2024
Touch2Touch: Cross-Modal Tactile Generation for Object Manipulation Samanta Rodriguez Yiming Dou Miquel Oller Andrew Owens Nima Fazeli DiffM 41 7 0 12 Sep 2024
HyperTaxel: Hyper-Resolution for Taxel-Based Tactile Signals Through Contrastive Learning Hongyu Li Snehal Dikhale Jinda Cui Soshi Iba Nawid Jamali 40 3 0 15 Aug 2024
Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI Yang Liu Weixing Chen Yongjie Bai Xiaodan Liang Guanbin Li Wen Gao Liang Lin LM&Ro SyDa AI4CE 51 50 0 09 Jul 2024
RoboPack: Learning Tactile-Informed Dynamics Models for Dense Packing Bo Ai Stephen Tian Haochen Shi Yixuan Wang Cheston Tan Yunzhu Li Jiajun Wu 52 12 0 01 Jul 2024
ManiWAV: Learning Robot Manipulation from In-the-Wild Audio-Visual Data Zeyi Liu Cheng Chi Eric A. Cousineau Naveen Kuppuswamy Benjamin Burchfiel Shuran Song VGen 41 23 0 27 Jun 2024
SonicSense: Object Perception from In-Hand Acoustic Vibration Jiaxun Liu Boyuan Chen 39 2 0 25 Jun 2024
Touch100k: A Large-Scale Touch-Language-Vision Dataset for Touch-Centric Multimodal Representation Ning Cheng Changhao Guan Jing Gao Weihao Wang You Li Fandong Meng Jie Zhou Bin Fang Jinan Xu Wenjuan Han VLM 41 9 0 06 Jun 2024
Tactile-Augmented Radiance Fields Yiming Dou Fengyu Yang Yi Liu Antonio Loquercio Andrew Owens 36 18 0 07 May 2024
Octopi: Object Property Reasoning with Large Tactile-Language Models Samson Yu Kelvin Lin Anxing Xiao Jiafei Duan Harold Soh LRM 36 26 0 05 May 2024
Snap-it, Tap-it, Splat-it: Tactile-Informed 3D Gaussian Splatting for Reconstructing Challenging Surfaces Mauro Comi Alessio Tonioni Max Yang Jonathan Tremblay Valts Blukis Yijiong Lin Nathan Lepora Laurence Aitchison 3DGS 23 8 0 29 Mar 2024
Towards Comprehensive Multimodal Perception: Introducing the Touch-Language-Vision Dataset Ning Cheng You Li Jing Gao Bin Fang Jinan Xu Wenjuan Han 51 4 0 14 Mar 2024
Binding Touch to Everything: Learning Unified Multimodal Tactile Representations Fengyu Yang Chao Feng Ziyang Chen Hyoungseob Park Daniel Wang ... Ziyao Zeng Xien Chen Rit Gangopadhyay Andrew Owens Alex Wong 38 55 0 31 Jan 2024
MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World Yining Hong Zishuo Zheng Peihao Chen Yian Wang Junyan Li Chuang Gan 21 33 0 16 Jan 2024
Generating Visual Scenes from Touch Fengyu Yang Jiacheng Zhang Andrew Owens DiffM 24 24 0 26 Sep 2023
Visually-Guided Sound Source Separation with Audio-Visual Predictive Coding Zengjie Song Zhaoxiang Zhang 19 1 0 19 Jun 2023
ABO: Dataset and Benchmarks for Real-World 3D Object Understanding Jasmine Collins Shubham Goel Kenan Deng Achleshwar Luthra Leon L. Xu ... T. F. Y. Vicente T. Dideriksen H. Arora M. Guillaumin Jitendra Malik 154 217 0 12 Oct 2021
ShapeMap 3-D: Efficient shape mapping through dense touch and vision Sudharshan Suresh Zilin Si Joshua G. Mangelson Wenzhen Yuan Michael Kaess 77 56 0 20 Sep 2021
Image-to-Image Translation with Conditional Adversarial Networks Phillip Isola Jun-Yan Zhu Tinghui Zhou Alexei A. Efros SSeg 212 19,450 0 21 Nov 2016