Tactile Sim-to-Real Policy Transfer via Real-to-Sim Image Translation

16 June 2021

Papers citing "Tactile Sim-to-Real Policy Transfer via Real-to-Sim Image Translation"

35 / 35 papers shown

Title
On the Importance of Tactile Sensing for Imitation Learning: A Case Study on Robotic Match Lighting Niklas Funk Changqi Chen Tim Schneider Georgia Chalvatzaki Roberto Calandra Jan Peters 23 0 0 18 Apr 2025
HydroelasticTouch: Simulation of Tactile Sensors with Hydroelastic Contact Surfaces David P. Leins Florian Patzelt R. Haschke 61 0 0 14 Jan 2025
3D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensing Binghao Huang Yixuan Wang Xinyi Yang Yiyue Luo Yunzhu Li 38 15 0 08 Jan 2025
TacEx: GelSight Tactile Simulation in Isaac Sim -- Combining Soft-Body and Visuotactile Simulators Duc Huy Nguyen Tim Schneider Guillaume Duret Alap Kshirsagar Boris Belousov Jan Peters 35 1 0 07 Nov 2024
Fine Manipulation Using a Tactile Skin: Learning in Simulation and Sim-to-Real Transfer Ulf Kasolowsky Berthold Bäuml 31 0 0 19 Sep 2024
TacSL: A Library for Visuotactile Sensor Simulation and Learning Iretiayo Akinola Jie Xu Jan Carius Dieter Fox Yashraj S. Narang 41 6 0 12 Aug 2024
ClutterGen: A Cluttered Scene Generator for Robot Learning Yinsen Jia Boyuan Chen 22 4 0 07 Jul 2024
When Vision Meets Touch: A Contemporary Review for Visuotactile Sensors from the Signal Processing Perspective Shoujie Li Zihan Wang Changsheng Wu Xiang Li Shan Luo Bin Fang Fuchun Sun Xiao-Ping Zhang Wenbo Ding AI4TS 30 11 0 18 Jun 2024
AnyRotate: Gravity-Invariant In-Hand Object Rotation with Sim-to-Real Touch Max Yang Chenghua Lu Alex Church Yijiong Lin Christopher J. Ford Haoran Li Efi Psomopoulou David A.W. Barton Nathan Lepora 52 14 0 12 May 2024
Soft Contact Simulation and Manipulation Learning of Deformable Objects with Vision-based Tactile Sensor Jianhua Shan Yuhao Sun Shixin Zhang Fuchun Sun Zixi Chen Zirong Shen Cesare Stefanini Yiyong Yang Shan Luo Bin Fang 35 1 0 12 May 2024
FOTS: A Fast Optical Tactile Simulator for Sim2Real Learning of Tactile-motor Robot Manipulation Skills Yongqiang Zhao Kun Qian Boyi Duan Shan Luo 21 7 0 30 Apr 2024
Sim2Real Manipulation on Unknown Objects with Tactile-based Reinforcement Learning Entong Su Chengzhe Jia Yuzhe Qin Wenxuan Zhou Annabella Macaluso Binghao Huang Xiaolong Wang 38 4 0 18 Mar 2024
DIFFTACTILE: A Physics-based Differentiable Tactile Simulator for Contact-rich Robotic Manipulation Zilin Si Gu Zhang Qingwei Ben Branden Romero Zhou Xian Chao Liu Chuang Gan 33 17 0 13 Mar 2024
Tactile-Informed Action Primitives Mitigate Jamming in Dense Clutter Dane Brouwer Joshua Citron Hojung Choi Marion Lepert Michael Lin Jeannette Bohg M. Cutkosky 11 1 0 14 Feb 2024
Binding Touch to Everything: Learning Unified Multimodal Tactile Representations Fengyu Yang Chao Feng Ziyang Chen Hyoungseob Park Daniel Wang ... Ziyao Zeng Xien Chen Rit Gangopadhyay Andrew Owens Alex Wong 36 53 0 31 Jan 2024
TouchSDF: A DeepSDF Approach for 3D Shape Reconstruction using Vision-Based Tactile Sensing Mauro Comi Yijiong Lin Alex Church Alessio Tonioni Laurence Aitchison Nathan Lepora 27 16 0 21 Nov 2023
Bio-Inspired Grasping Controller for Sensorized 2-DoF Grippers Luca Lach Séverin Lemaignan Francesco Ferro Helge J. Ritter R. Haschke 11 3 0 13 Nov 2023
Towards Transferring Tactile-based Continuous Force Control Policies from Simulation to Robot Luca Lach R. Haschke Davide Tateo Jan Peters Helge J. Ritter Júlia Borràs Sol Carme Torras 21 0 0 13 Nov 2023
Slip Detection and Surface Prediction Through Bio-Inspired Tactile Feedback Dexter R. Shepherd Phil Husbands Andy Philippides Chris Johnson 9 1 0 12 Oct 2023
Augmenting Tactile Simulators with Real-like and Zero-Shot Capabilities Osher Azulay Alon Mizrahi Nimrod Curtis A. Sintov GAN 27 1 0 19 Sep 2023
9DTact: A Compact Vision-Based Tactile Sensor for Accurate 3D Shape Reconstruction and Generalizable 6D Force Estimation Chan-Yu Lin H. Zhang Jikai Xu Lei Wu Huazhe Xu 17 41 0 28 Aug 2023
Attention for Robot Touch: Tactile Saliency Prediction for Robust Sim-to-Real Tactile Control Yijiong Lin Mauro Comi Alex Church Dandan Zhang Nathan Lepora 11 2 0 26 Jul 2023
Sim-to-Real Model-Based and Model-Free Deep Reinforcement Learning for Tactile Pushing Max Yang Yijiong Lin Alex Church John Lloyd Dandan Zhang David A.W. Barton Nathan Lepora OffRL 23 11 0 26 Jul 2023
Bi-Touch: Bimanual Tactile Manipulation with Sim-to-Real Deep Reinforcement Learning Yijiong Lin Alex Church Max Yang Haoran Li John Lloyd Dandan Zhang Nathan Lepora 17 27 0 12 Jul 2023
Crossing the Reality Gap in Tactile-Based Learning Ya-Yen Tsai Bidan Huang Yu Zheng Lei Han Wang Wei Lee Edward Johns 14 0 0 17 May 2023
Learning to Read Braille: Bridging the Tactile Reality Gap with Diffusion Models Carolina Higuera Byron Boots Mustafa Mukadam DiffM 33 26 0 03 Apr 2023
Rotating without Seeing: Towards In-hand Dexterity through Touch Zhao-Heng Yin Binghao Huang Yuzhe Qin Qifeng Chen Xiaolong Wang 96 91 0 20 Mar 2023
Tactile-Filter: Interactive Tactile Perception for Part Mating Keita Ota Devesh K. Jha H. Tung J. Tenenbaum 20 7 0 10 Mar 2023
Self-Supervised Visuo-Tactile Pretraining to Locate and Follow Garment Features J. Kerr Huang Huang Albert Wilcox Ryan Hoque Jeffrey Ichnowski Roberto Calandra Ken Goldberg 54 28 0 26 Sep 2022
Grasp Stability Prediction with Sim-to-Real Transfer from Tactile Sensing Zilin Si Zirui Zhu Arpit Agarwal Stuart Anderson Wenzhen Yuan 19 33 0 04 Aug 2022
Tactile Gym 2.0: Sim-to-real Deep Reinforcement Learning for Comparing Low-cost High-Resolution Robot Touch Yijiong Lin John Lloyd Alex Church Nathan Lepora 26 44 0 21 Jul 2022
DigiTac: A DIGIT-TacTip Hybrid Tactile Sensor for Comparing Low-Cost High-Resolution Robot Touch Nathan Lepora Yijiong Lin Ben Money-Coomes John Lloyd 17 58 0 27 Jun 2022
One-Shot Domain-Adaptive Imitation Learning via Progressive Learning Dandan Zhang Wen Fan John Lloyd Chenguang Yang Nathan Lepora 17 17 0 24 Apr 2022
Zero-shot sim-to-real transfer of tactile control policies for aggressive swing-up manipulation Thomas Bi Carmelo Sferrazza Raffaello DÁndrea 99 35 0 07 Jan 2021
Learning the sense of touch in simulation: a sim-to-real strategy for vision-based tactile sensing Carmelo Sferrazza Thomas Bi Raffaello DÁndrea DiffM 86 41 0 05 Mar 2020