The Power of the Senses: Generalizable Manipulation from Vision and
Touch through Masked Multimodal Learning

The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learning

2 November 2023

Carmelo Sferrazza

Pieter Abbeel

Papers citing "The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learning"

13 / 13 papers shown

Title
Zero-shot Sim2Real Transfer for Magnet-Based Tactile Sensor on Insertion Tasks Beining Han Abhishek Joshi Jia Deng 21 0 0 05 May 2025
ViTaMIn: Learning Contact-Rich Tasks Through Robot-Free Visuo-Tactile Manipulation Interface Fangchen Liu Chuanyu Li Yihua Qin Ankit Shaw J. Xu Pieter Abbeel Rui Chen 31 1 0 08 Apr 2025
Canonical Representation and Force-Based Pretraining of 3D Tactile for Dexterous Visuo-Tactile Policy Learning Tianhao Wu Jinzhou Li Jiyao Zhang Mingdong Wu Hao Dong SSL 25 4 0 26 Sep 2024
Low Fidelity Visuo-Tactile Pretraining Improves Vision-Only Manipulation Performance Selam Gano Abraham George A. Farimani OnRL 33 0 0 21 Jun 2024
You've Got to Feel It To Believe It: Multi-Modal Bayesian Inference for Semantic and Property Prediction Parker Ewen Hao Chen Yuzhen Chen Anran Li Anup Bagali Gitesh Gunjal Ram Vasudevan 11 5 0 08 Feb 2024
Real-World Robot Learning with Masked Visual Pre-training Ilija Radosavovic Tete Xiao Stephen James Pieter Abbeel Jitendra Malik Trevor Darrell SSL 141 238 0 06 Oct 2022
Masked World Models for Visual Control Younggyo Seo Danijar Hafner Hao Liu Fangchen Liu Stephen James Kimin Lee Pieter Abbeel OffRL 71 144 0 28 Jun 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 255 7,337 0 11 Nov 2021
Ego4D: Around the World in 3,000 Hours of Egocentric Video Kristen Grauman Andrew Westbury Eugene Byrne Zachary Chavis Antonino Furnari ... Mike Zheng Shou Antonio Torralba Lorenzo Torresani Mingfei Yan Jitendra Malik EgoV 212 682 0 13 Oct 2021
Active Extrinsic Contact Sensing: Application to General Peg-in-Hole Insertion Sangwoon Kim Alberto Rodriguez 41 63 0 07 Oct 2021
Zero-shot sim-to-real transfer of tactile control policies for aggressive swing-up manipulation Thomas Bi Carmelo Sferrazza Raffaello DÁndrea 85 26 0 07 Jan 2021
Tactile Dexterity: Manipulation Primitives with Tactile Feedback F. Hogan José Ballester Siyuan Dong Alberto Rodriguez 94 96 0 08 Feb 2020
Tactile-Based Insertion for Dense Box-Packing Siyuan Dong Alberto Rodriguez 81 43 0 12 Sep 2019