More Than a Feeling: Learning to Grasp and Regrasp using Vision and Touch

28 May 2018

Papers citing "More Than a Feeling: Learning to Grasp and Regrasp using Vision and Touch"

50 / 136 papers shown

Title
Self-supervised perception for tactile skin covered dexterous hands Akash Sharma Carolina Higuera Chaithanya Krishna Bodduluri Z. Liu Taosha Fan ... Byron Boots Michael Kaess Tingfan Wu Francois Hogan Mustafa Mukadam SSL 22 0 0 16 May 2025
VTLA: Vision-Tactile-Language-Action Model with Preference Learning for Insertion Manipulation Chaofan Zhang Peng Hao Xiaoge Cao Xiaoshuai Hao Shaowei Cui Shuo Wang 32 0 0 14 May 2025
Zero-shot Sim2Real Transfer for Magnet-Based Tactile Sensor on Insertion Tasks Beining Han Abhishek Joshi Jia Deng 34 0 0 05 May 2025
Grasping Deformable Objects via Reinforcement Learning with Cross-Modal Attention to Visuo-Tactile Inputs Yonghyun Lee Sungeun Hong Min-gu Kim Gyeonghwan Kim Changjoo Nam 24 0 0 22 Apr 2025
A Modularized Design Approach for GelSight Family of Vision-based Tactile Sensors A. Agarwal Mohammad Amin Mirzaee Xiping Sun Wenzhen Yuan 31 0 0 20 Apr 2025
Taccel: Scaling Up Vision-based Tactile Robotics via High-performance GPU Simulation Y. Li Wenxin Du Chang Yu Puhao Li Zihang Zhao Tengyu Liu Chenfanfu Jiang Y. Zhu Siyuan Huang 34 0 0 17 Apr 2025
DoorBot: Closed-Loop Task Planning and Manipulation for Door Opening in the Wild with Haptic Feedback Zhi Wang Yuchen Mo Shengmiao Jin Wenzhen Yuan 34 1 0 12 Apr 2025
TLA: Tactile-Language-Action Model for Contact-Rich Manipulation Peng Hao Chaofan Zhang Dingzhe Li Xiaoge Cao Xiaoshuai Hao Shaowei Cui Shuo Wang LM&Ro 52 7 0 11 Mar 2025
Learning Gentle Grasping Using Vision, Sound, and Touch Ken Nakahara Roberto Calandra 58 0 0 11 Mar 2025
Towards Generalization of Tactile Image Generation: Reference-Free Evaluation in a Leakage-Free Setting Cagri Gungor Derek Eppinger Adriana Kovashka 56 0 0 10 Mar 2025
Sensor-Invariant Tactile Representation Harsh Gupta Yuchen Mo Shengmiao Jin Wenzhen Yuan 65 2 0 27 Feb 2025
Soft Vision-Based Tactile-Enabled SixthFinger: Advancing Daily Objects Manipulation for Stroke Survivors Basma B. Hasanen Mashood M. Mohsan Abdulaziz Alkayas F. Renda Irfan Hussain 36 0 0 12 Jan 2025
TextToucher: Fine-Grained Text-to-Touch Generation Jiahang Tu Hao Fu Fengyu Yang Hanbin Zhao Chao Zhang Hui Qian VLM DiffM 78 8 0 10 Jan 2025
GelBelt: A Vision-based Tactile Sensor for Continuous Sensing of Large Surfaces Mohammad Amin Mirzaee Hung-Jui Huang Wenzhen Yuan 47 2 0 09 Jan 2025
3D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensing Binghao Huang Yixuan Wang Xinyi Yang Yiyue Luo Yunzhu Li 43 15 0 08 Jan 2025
Learning Visuotactile Estimation and Control for Non-prehensile Manipulation under Occlusions Juan Del Aguila Ferrandis João Moura S. Vijayakumar 73 4 0 17 Dec 2024
Analysing the Interplay of Vision and Touch for Dexterous Insertion Tasks Janis Lenz Theo Gruner Daniel Palenicek Tim Schneider Jan Peters 33 3 0 31 Oct 2024
Tactile Functasets: Neural Implicit Representations of Tactile Datasets Sikai Li Samanta Rodriguez Yiming Dou Andrew Owens Nima Fazeli 23 0 0 22 Sep 2024
Touch2Touch: Cross-Modal Tactile Generation for Object Manipulation Samanta Rodriguez Yiming Dou M. Oller Andrew Owens Nima Fazeli DiffM 39 7 0 12 Sep 2024
RoboPack: Learning Tactile-Informed Dynamics Models for Dense Packing Bo Ai Stephen Tian Haochen Shi Yixuan Wang Cheston Tan Yunzhu Li Jiajun Wu 49 12 0 01 Jul 2024
Stable Tool-Use with Flexible Musculoskeletal Hands by Learning the Predictive Model of Sensor State Transition Kento Kawaharazuka Kei Tsuzuki Moritaka Onitsuka Yuki Asano Kei Okada Koji Kawasaki Masayuki Inaba 25 4 0 24 Jun 2024
Transferable Tactile Transformers for Representation Learning Across Diverse Sensors and Tasks Jialiang Zhao Yuxiang Ma Lirui Wang Edward H. Adelson 29 17 0 19 Jun 2024
When Vision Meets Touch: A Contemporary Review for Visuotactile Sensors from the Signal Processing Perspective Shoujie Li Zihan Wang Changsheng Wu Xiang Li Shan Luo Bin Fang Fuchun Sun Xiao-Ping Zhang Wenbo Ding AI4TS 30 11 0 18 Jun 2024
RoTipBot: Robotic Handling of Thin and Flexible Objects using Rotatable Tactile Sensors Jiaqi Jiang Xuyang Zhang D. F. Gomes Thanh-Toan Do Shan Luo 47 7 0 13 Jun 2024
Hearing Touch: Audio-Visual Pretraining for Contact-Rich Manipulation Jared Mejia Victoria Dean Tess Hellebrekers Abhinav Gupta 37 12 0 14 May 2024
Tactile-Augmented Radiance Fields Yiming Dou Fengyu Yang Yi Liu Antonio Loquercio Andrew Owens 33 18 0 07 May 2024
Simulation of Optical Tactile Sensors Supporting Slip and Rotation using Path Tracing and IMPM Zirong Shen Yuhao Sun Shixin Zhang Zixi Chen Heyi Sun Fuchun Sun Bin Fang 25 2 0 05 May 2024
Learning Visuotactile Skills with Two Multifingered Hands Toru Lin Yu Zhang Qiyang Li Haozhi Qi Brent Yi Sergey Levine Jitendra Malik 42 52 0 25 Apr 2024
LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Grasping Zhengtong Xu Yu She 30 6 0 07 Mar 2024
A Touch, Vision, and Language Dataset for Multimodal Alignment Letian Fu Gaurav Datta Huang Huang Will Panitch Jaimyn Drake Joseph Ortiz Mustafa Mukadam Mike Lambeta Roberto Calandra Ken Goldberg VLM 27 32 0 20 Feb 2024
Predicting Maximum Permitted Process Forces for Object Grasping and Manipulation Using a Deep Learning Regression Model S. Wucherer R. McMurray K. Y. Ng F. Kerber 28 1 0 18 Feb 2024
Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling Raunaq M. Bhirangi Chenyu Wang Venkatesh Pattabiraman Carmel Majidi Abhinav Gupta Tess Hellebrekers Lerrel Pinto 53 11 0 15 Feb 2024
Binding Touch to Everything: Learning Unified Multimodal Tactile Representations Fengyu Yang Chao Feng Ziyang Chen Hyoungseob Park Daniel Wang ... Ziyao Zeng Xien Chen Rit Gangopadhyay Andrew Owens Alex Wong 38 55 0 31 Jan 2024
M2CURL: Sample-Efficient Multimodal Reinforcement Learning via Self-Supervised Representation Learning for Robotic Manipulation Fotios Lygerakis Vedant Dave Elmar Rueckert SSL 27 2 0 30 Jan 2024
MResT: Multi-Resolution Sensing for Real-Time Control with Vision-Language Models Saumya Saxena Mohit Sharma Oliver Kroemer 26 4 0 25 Jan 2024
Multimodal Visual-Tactile Representation Learning through Self-Supervised Contrastive Pre-Training Vedant Dave Fotios Lygerakis Elmar Rueckert SSL 25 17 0 22 Jan 2024
MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World Yining Hong Zishuo Zheng Peihao Chen Yian Wang Junyan Li Chuang Gan 21 32 0 16 Jan 2024
Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensing Ying Yuan Haichuan Che Yuzhe Qin Binghao Huang Zhao-Heng Yin Kang-Won Lee Yi Wu Soo-Chul Lim Xiaolong Wang 45 40 0 04 Dec 2023
A model-free approach to fingertip slip and disturbance detection for grasp stability inference Dounia Kitouni Mahdi Khoramshahi V. Perdereau 21 4 0 22 Nov 2023
Force-Constrained Visual Policy: Safe Robot-Assisted Dressing via Multi-Modal Sensing Zhanyi Sun Yufei Wang David Held Zackory M. Erickson 24 4 0 07 Nov 2023
MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulation Kelin Yu Yunhai Han Matthew Zhu Vaibhav Saxena Danfei Xu Ye Zhao 16 12 0 25 Oct 2023
See to Touch: Learning Tactile Dexterity through Visual Incentives Irmak Güzey Yinlong Dai Ben Evans Soumith Chintala Lerrel Pinto 23 30 0 21 Sep 2023
General In-Hand Object Rotation with Vision and Touch Haozhi Qi Brent Yi Sudharshan Suresh Mike Lambeta Y. Ma Roberto Calandra Jitendra Malik 58 81 0 18 Sep 2023
Haptic search with the Smart Suction Cup on adversarial objects Jungpyo Lee Sebastian D. Lee Tae Myung Huh Hannah S. Stuart 16 5 0 14 Sep 2023
Grasp Stability Assessment Through Attention-Guided Cross-Modality Fusion and Transfer Learning Zhuangzhuang Zhang Zhenning Zhou Haili Wang Zhinan Zhang Huang Huang Q. Cao 21 7 0 02 Aug 2023
Enabling Robot Manipulation of Soft and Rigid Objects with Vision-based Tactile Sensors Michael C. Welle M. Lippi Haofei Lu Jens Lundell Andrea Gasparri Danica Kragic 19 9 0 09 Jun 2023
The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects Ruohan Gao Yiming Dou Hao Li Tanmay Agarwal Jeannette Bohg Yunzhu Li Li Fei-Fei Jiajun Wu 16 29 0 01 Jun 2023
Beyond Flat GelSight Sensors: Simulation of Optical Tactile Sensors of Complex Morphologies for Sim2Real Learning D. F. Gomes Paolo Paoletti Shan Luo 14 12 0 21 May 2023
Controllable Visual-Tactile Synthesis Ruihan Gao Wenzhen Yuan Jun-Yan Zhu DiffM 22 5 0 04 May 2023
Dexterous In-Hand Manipulation of Slender Cylindrical Objects through Deep Reinforcement Learning with Tactile Sensing Wenbin Hu Bidan Huang Wang Wei Lee Sibei Yang Yu Zheng Zhibin Li 8 9 0 11 Apr 2023