Binding Touch to Everything: Learning Unified Multimodal Tactile Representations

31 January 2024

Ziyang Chen

Papers citing "Binding Touch to Everything: Learning Unified Multimodal Tactile Representations"

21 / 21 papers shown

Title
Zero-shot Sim2Real Transfer for Magnet-Based Tactile Sensor on Insertion Tasks Beining Han Abhishek Joshi Jia Deng 24 0 0 05 May 2025
VGLD: Visually-Guided Linguistic Disambiguation for Monocular Depth Scale Recovery Bojin Wu Jing Chen MDE 35 0 0 05 May 2025
ViTa-Zero: Zero-shot Visuotactile Object 6D Pose Estimation Hongyu Li James Akl Srinath Sridhar Tye Brady Taskin Padir 35 0 0 17 Apr 2025
Sensor-Invariant Tactile Representation Harsh Gupta Yuchen Mo Shengmiao Jin Wenzhen Yuan 60 2 0 27 Feb 2025
AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensors Ruoxuan Feng Jiangyu Hu Wenke Xia Tianci Gao Ao Shen Yuhao Sun Bin Fang Di Hu 42 2 0 15 Feb 2025
TextToucher: Fine-Grained Text-to-Touch Generation Jiahang Tu Hao Fu Fengyu Yang Hanbin Zhao Chao Zhang Hui Qian VLM DiffM 70 6 0 10 Jan 2025
PriorDiffusion: Leverage Language Prior in Diffusion Models for Monocular Depth Estimation Ziyao Zeng Jingcheng Ni Daniel Wang Patrick Rim Younjoon Chung Fengyu Yang Byung-Woo Hong A. Wong DiffM MDE 88 2 0 24 Nov 2024
Next Best Sense: Guiding Vision and Touch with FisherRF for 3D Gaussian Splatting Matthew Strong Boshu Lei Aiden Swann Wen Jiang Kostas Daniilidis Monroe Kennedy III 3DGS 38 3 0 07 Oct 2024
RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptions Ziyao Zeng Yangchao Wu Hyoungseob Park Daniel Wang Fengyu Yang Stefano Soatto Dong Lao Byung-Woo Hong Alex Wong MDE 13 7 0 03 Oct 2024
PseudoTouch: Efficiently Imaging the Surface Feel of Objects for Robotic Manipulation Adrian Rofer Nick Heppert Abdallah Ayman Eugenio Chisari Abhinav Valada 16 1 0 22 Mar 2024
Investigating Vision Foundational Models for Tactile Representation Learning Ben Zandonati Ruohan Wang Ruihan Gao Y. Wu 26 4 0 30 Apr 2023
Gradient-less Federated Gradient Boosting Trees with Learnable Learning Rates Chenyang Ma Xinchi Qiu Daniel J. Beutel Nicholas D. Lane FedML 8 12 0 15 Apr 2023
Visual-Tactile Sensing for In-Hand Object Reconstruction Wenqiang Xu Zhenjun Yu Han Xue Ruolin Ye Siqiong Yao Cewu Lu 37 17 0 25 Mar 2023
Rotating without Seeing: Towards In-hand Dexterity through Touch Zhao-Heng Yin Binghao Huang Yuzhe Qin Qifeng Chen Xiaolong Wang 96 53 0 20 Mar 2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 244 4,186 0 30 Jan 2023
Self-Supervised Visuo-Tactile Pretraining to Locate and Follow Garment Features J. Kerr Huang Huang Albert Wilcox Ryan Hoque Jeffrey Ichnowski Roberto Calandra Ken Goldberg 54 27 0 26 Sep 2022
PointCLIP: Point Cloud Understanding by CLIP Renrui Zhang Ziyu Guo Wei Zhang Kunchang Li Xupeng Miao Bin Cui Yu Qiao Peng Gao Hongsheng Li VLM 3DPC 158 428 0 04 Dec 2021
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding Hu Xu Gargi Ghosh Po-Yao (Bernie) Huang Dmytro Okhonko Armen Aghajanyan Florian Metze Luke Zettlemoyer Florian Metze Luke Zettlemoyer Christoph Feichtenhofer CLIP VLM 242 554 0 28 Sep 2021
ShapeMap 3-D: Efficient shape mapping through dense touch and vision Sudharshan Suresh Zilin Si Joshua G. Mangelson Wenzhen Yuan Michael Kaess 69 56 0 20 Sep 2021
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval Huaishao Luo Lei Ji Ming Zhong Yang Chen Wen Lei Nan Duan Tianrui Li CLIP VLM 301 771 0 18 Apr 2021
Image-to-Image Translation with Conditional Adversarial Networks Phillip Isola Jun-Yan Zhu Tinghui Zhou Alexei A. Efros SSeg 203 19,191 0 21 Nov 2016