Generation of GelSight Tactile Images for Sim2Real Learning

18 January 2021

Shan Luo

Papers citing "Generation of GelSight Tactile Images for Sim2Real Learning"

43 / 43 papers shown

Title
Taccel: Scaling Up Vision-based Tactile Robotics via High-performance GPU Simulation Yongqian Li Wenxin Du Chang Yu Puhao Li Zihang Zhao Tengyu Liu Chenfanfu Jiang Y. Zhu Siyuan Huang 39 0 0 17 Apr 2025
Tacchi 2.0: A Low Computational Cost and Comprehensive Dynamic Contact Simulator for Vision-based Tactile Sensors Yuhao Sun Shixin Zhang Wenzhuang Li Jiaqi Zhao Jianhua Shan Zirong Shen Zixi Chen F. Sun Di Guo Bin Fang 56 0 0 12 Mar 2025
ThinTact:Thin Vision-Based Tactile Sensor by Lensless Imaging Jinfeng Xu Weihang Chen Hongyu Qian Dan Wu Rui Chen 56 1 0 17 Jan 2025
Design and Benchmarking of A Multi-Modality Sensor for Robotic Manipulation with GAN-Based Cross-Modality Interpretation Dandan Zhang Wen Fan Jialin Lin Haoran Li Qingzheng Cong Weiru Liu Nathan Lepora Shan Luo 51 0 0 04 Jan 2025
Fine Manipulation Using a Tactile Skin: Learning in Simulation and Sim-to-Real Transfer Ulf Kasolowsky Berthold Bäuml 43 0 0 19 Sep 2024
Marker or Markerless? Mode-Switchable Optical Tactile Sensing for Diverse Robot Tasks Ni Ou Zhuo Chen Shan Luo 43 3 0 15 Aug 2024
TacSL: A Library for Visuotactile Sensor Simulation and Learning Iretiayo Akinola Jie Xu Jan Carius Dieter Fox Yashraj S. Narang 51 6 0 12 Aug 2024
When Vision Meets Touch: A Contemporary Review for Visuotactile Sensors from the Signal Processing Perspective Shoujie Li Zihan Wang Changsheng Wu Xiang Li Shan Luo Bin Fang Fuchun Sun Xiao-Ping Zhang Wenbo Ding AI4TS 41 11 0 18 Jun 2024
Touch100k: A Large-Scale Touch-Language-Vision Dataset for Touch-Centric Multimodal Representation Ning Cheng Changhao Guan Jing Gao Weihao Wang You Li Fandong Meng Jie Zhou Bin Fang Jinan Xu Wenjuan Han VLM 41 10 0 06 Jun 2024
AnyRotate: Gravity-Invariant In-Hand Object Rotation with Sim-to-Real Touch Max Yang Chenghua Lu Alex Church Yijiong Lin Christopher J. Ford Haoran Li Efi Psomopoulou David A.W. Barton Nathan Lepora 64 16 0 12 May 2024
Soft Contact Simulation and Manipulation Learning of Deformable Objects with Vision-based Tactile Sensor Jianhua Shan Yuhao Sun Shixin Zhang Gang Hua Zixi Chen Zirong Shen Cesare Stefanini Yiyong Yang Shan Luo Bin Fang 51 1 0 12 May 2024
Simulation of Optical Tactile Sensors Supporting Slip and Rotation using Path Tracing and IMPM Zirong Shen Yuhao Sun Shixin Zhang Zixi Chen Heyi Sun Gang Hua Bin Fang 30 2 0 05 May 2024
FOTS: A Fast Optical Tactile Simulator for Sim2Real Learning of Tactile-motor Robot Manipulation Skills Yongqiang Zhao Kun Qian Boyi Duan Shan Luo 31 8 0 30 Apr 2024
Sim2Real Manipulation on Unknown Objects with Tactile-based Reinforcement Learning Entong Su Chengzhe Jia Yuzhe Qin Wenxuan Zhou Annabella Macaluso Binghao Huang Xiaolong Wang 42 4 0 18 Mar 2024
Towards Comprehensive Multimodal Perception: Introducing the Touch-Language-Vision Dataset Ning Cheng You Li Jing Gao Bin Fang Jinan Xu Wenjuan Han 51 5 0 14 Mar 2024
DIFFTACTILE: A Physics-based Differentiable Tactile Simulator for Contact-rich Robotic Manipulation Zilin Si Gu Zhang Qingwei Ben Branden Romero Zhou Xian Chao Liu Chuang Gan 46 18 0 13 Mar 2024
Generating Future Observations to Estimate Grasp Success in Cluttered Environments D. F. Gomes Wenxuan Mou Paolo Paoletti Shan Luo 30 0 0 18 Dec 2023
TouchSDF: A DeepSDF Approach for 3D Shape Reconstruction using Vision-Based Tactile Sensing Mauro Comi Yijiong Lin Alex Church Alessio Tonioni Laurence Aitchison Nathan Lepora 48 17 0 21 Nov 2023
TacIPC: Intersection- and Inversion-free FEM-based Elastomer Simulation For Optical Tactile Sensors Wenxin Du Wenqiang Xu Jieji Ren Zhenjun Yu Cewu Lu 17 10 0 10 Nov 2023
Sim2Real Bilevel Adaptation for Object Surface Classification using Vision-Based Tactile Sensors G. Caddeo Andrea Maracani P. D. Alfano Nicola A. Piga Lorenzo Rosasco Lorenzo Natale DiffM 19 4 0 02 Nov 2023
Augmenting Tactile Simulators with Real-like and Zero-Shot Capabilities Osher Azulay Alon Mizrahi Nimrod Curtis A. Sintov GAN 34 1 0 19 Sep 2023
9DTact: A Compact Vision-Based Tactile Sensor for Accurate 3D Shape Reconstruction and Generalizable 6D Force Estimation Chan-Yu Lin H. Zhang Jikai Xu Lei Wu Huazhe Xu 29 41 0 28 Aug 2023
Grasp Stability Assessment Through Attention-Guided Cross-Modality Fusion and Transfer Learning Zhuangzhuang Zhang Zhenning Zhou Haili Wang Zhinan Zhang Huang Huang Q. Cao 33 8 0 02 Aug 2023
Sim-to-Real Model-Based and Model-Free Deep Reinforcement Learning for Tactile Pushing Max Yang Yijiong Lin Alex Church John Lloyd Dandan Zhang David A.W. Barton Nathan Lepora OffRL 38 12 0 26 Jul 2023
Multimodal Zero-Shot Learning for Tactile Texture Recognition G. Cao Jiaqi Jiang Danushka Bollegala Min Li Shan Luo 18 12 0 22 Jun 2023
Beyond Flat GelSight Sensors: Simulation of Optical Tactile Sensors of Complex Morphologies for Sim2Real Learning D. F. Gomes Paolo Paoletti Shan Luo 22 12 0 21 May 2023
Crossing the Reality Gap in Tactile-Based Learning Ya-Yen Tsai Bidan Huang Yu Zheng Lei Han Wang Wei Lee Edward Johns 26 0 0 17 May 2023
Learning to Read Braille: Bridging the Tactile Reality Gap with Diffusion Models Carolina Higuera Byron Boots Mustafa Mukadam DiffM 41 26 0 03 Apr 2023
Tacchi: A Pluggable and Low Computational Cost Elastomer Deformation Simulator for Optical Tactile Sensors Zixi Chen Shixin Zhang Shan Luo Gang Hua Bin Fang 21 36 0 19 Jan 2023
Self-Supervised Visuo-Tactile Pretraining to Locate and Follow Garment Features Justin Kerr Huang Huang Albert Wilcox Ryan Hoque Jeffrey Ichnowski Roberto Calandra Ken Goldberg 69 32 0 26 Sep 2022
Where Shall I Touch? Vision-Guided Tactile Poking for Transparent Object Grasping Jiaqi Jiang G. Cao Aaron Butterworth Thanh-Toan Do Shan Luo 23 27 0 20 Aug 2022
Object Detection Using Sim2Real Domain Randomization for Robotic Applications Dániel Horváth Gábor Erdös Z. Istenes Tomáš Horváth S. Földi 37 41 0 08 Aug 2022
Grasp Stability Prediction with Sim-to-Real Transfer from Tactile Sensing Zilin Si Zirui Zhu Arpit Agarwal Stuart Anderson Wenzhen Yuan 32 33 0 04 Aug 2022
Tactile Gym 2.0: Sim-to-real Deep Reinforcement Learning for Comparing Low-cost High-Resolution Robot Touch Yijiong Lin John Lloyd Alex Church Nathan Lepora 36 44 0 21 Jul 2022
Visual-Tactile Multimodality for Following Deformable Linear Objects Using Reinforcement Learning Leszek Pecyna Siyuan Dong Shan Luo 19 21 0 31 Mar 2022
Learning to Synthesize Volumetric Meshes from Vision-based Tactile Imprints Xinghao Zhu Siddarth Jain Masayoshi Tomizuka J. Baar 3DH 8 11 0 29 Mar 2022
Multimodal perception for dexterous manipulation G. Cao Shan Luo 28 2 0 28 Dec 2021
Robotic Perception of Object Properties using Tactile Sensing Jiaqi Jiang Shan Luo 22 14 0 28 Dec 2021
GelTip Tactile Sensor for Dexterous Manipulation in Clutter D. F. Gomes Shan Luo 18 11 0 03 Dec 2021
Reducing Tactile Sim2Real Domain Gaps via Deep Texture Generation Networks Tudor Jianu D. F. Gomes Shan Luo 41 22 0 03 Dec 2021
Taxim: An Example-based Simulation Model for GelSight Tactile Sensors Zilin Si Wenzhen Yuan 15 95 0 09 Sep 2021
Tactile Sim-to-Real Policy Transfer via Real-to-Sim Image Translation Alex Church John Lloyd R. Hadsell Nathan Lepora 35 50 0 16 Jun 2021
Learning the sense of touch in simulation: a sim-to-real strategy for vision-based tactile sensing Carmelo Sferrazza Thomas Bi Raffaello DÁndrea DiffM 99 41 0 05 Mar 2020