Reconstructing Hands in 3D with Transformers

8 December 2023

Papers citing "Reconstructing Hands in 3D with Transformers"

50 / 85 papers shown

Title
DexWild: Dexterous Human Interactions for In-the-Wild Robot Policies Tony Tao M. K. Srirama Jason Jingzhou Liu Kenneth Shaw Deepak Pathak 18 0 0 12 May 2025
X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Real Prithwish Dan K. Kedia Angela Chao Edward Weiyi Duan Maximus Adrian Pace Wei-Chiu Ma Sanjiban Choudhury 18 0 0 11 May 2025
Hand-Shadow Poser Hao Xu Yinqiao Wang Niloy J. Mitra Shuaicheng Liu Pheng-Ann Heng Chi-Wing Fu 3DH 24 0 0 11 May 2025
Web2Grasp: Learning Functional Grasps from Web Images of Hand-Object Interactions Hongyi Chen Yunchao Yao Yufei Ye Zhixuan Xu Homanga Bharadhwaj Jiashun Wang Shubham Tulsiani Zackory Erickson Jeffrey Ichnowski 24 0 0 07 May 2025
SignSplat: Rendering Sign Language via Gaussian Splatting Maksym Ivashechkin Oscar Mendez Richard Bowden 3DGS 38 0 0 04 May 2025
Dietary Intake Estimation via Continuous 3D Reconstruction of Food Wallace Lee YuHao Chen 26 0 0 01 May 2025
ReVision: High-Quality, Low-Cost Video Generation with Explicit 3D Physics Modeling for Complex Motion and Interaction Qihao Liu Ju He Qihang Yu Liang-Chieh Chen Alan Yuille DiffM VGen 75 0 0 30 Apr 2025
RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learning Haoran Geng Feishi Wang Songlin Wei Y. Li Bangjun Wang ... Hao Dong Siyuan Huang Yue Wang Jitendra Malik Pieter Abbeel 73 2 0 26 Apr 2025
Predict-Optimize-Distill: A Self-Improving Cycle for 4D Object Understanding Mingxuan Wu Huang Huang Justin Kerr C. Kim Anthony Zhang Brent Yi Angjoo Kanazawa 48 0 0 24 Apr 2025
RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wild Jingkai Zhou Yifan Wu Shikai Li Min Wei Chao Fan Weihua Chen Wei Jiang Fan Wang VGen 37 1 0 21 Apr 2025
Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generation Chenjie Cao Jingkai Zhou Shikai Li Jingyun Liang Chaohui Yu Fan Wang Xiangyang Xue Yanwei Fu DiffM VGen 61 0 0 21 Apr 2025
Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models Chen Wang Fei Xia Wenhao Yu Tingnan Zhang Ruohan Zhang Ce Liu Li Fei-Fei Jie Tan Jacky Liang 31 0 0 17 Apr 2025
Crossing the Human-Robot Embodiment Gap with Sim-to-Real RL using One Human Demonstration Tyler Ga Wei Lum Olivia Y. Lee C. Karen Liu Jeannette Bohg 33 0 0 17 Apr 2025
How Do I Do That? Synthesizing 3D Hand Motion and Contacts for Everyday Interactions Aditya Prakash Benjamin Lundell Dmitry Andreychuk David Forsyth Saurabh Gupta H. Sawhney 29 0 0 16 Apr 2025
BIGS: Bimanual Category-agnostic Interaction Reconstruction from Monocular Videos via 3D Gaussian Splatting Jeongwan On Kyeonghwan Gwak Gunyoung Kang Junuk Cha Soohyun Hwang Hyein Hwang Seungryul Baek 29 0 0 12 Apr 2025
The Invisible EgoHand: 3D Hand Forecasting through EgoBody Pose Estimation Masashi Hatano Zhifan Zhu Hideo Saito Dima Damen EgoV 24 0 0 11 Apr 2025
Hands-On: Segmenting Individual Signs from Continuous Sequences Low Jian He Harry Walsh Ozge Mercanoglu Sincan Richard Bowden SLR 48 0 0 11 Apr 2025
MAPLE: Encoding Dexterous Robotic Manipulation Priors Learned From Egocentric Videos Alexey Gavryushin Xi Wang Robert J. S. Malate Chenyu Yang X. Jia Shubh Goel Davide Liconti René Zurbrugg Robert K. Katzschmann Marc Pollefeys 34 0 0 08 Apr 2025
Direction-Aware Hybrid Representation Learning for 3D Hand Pose and Shape Estimation Shiyong Liu Zhihao Li Xiao Tang Jianzhuang Liu 3DH 44 0 0 02 Apr 2025
DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance Yuxuan Luo Zhengkun Rong Lizhen Wang Longhao Zhang Tianshu Hu Yongming Zhu VGen 57 0 0 02 Apr 2025
ZeroMimic: Distilling Robotic Manipulation Skills from Web Videos Junyao Shi Zhuolun Zhao Tianyou Wang Ian Pedroza Amy Luo Jie Wang Jason Ma Dinesh Jayaraman LM&Ro 43 0 0 31 Mar 2025
Reconstructing Humans with a Biomechanically Accurate Skeleton Yan Xia Xiaowei Zhou E. Vouga Qixing Huang Georgios Pavlakos 3DH 41 0 0 27 Mar 2025
ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learning Kailin Li Puhao Li Tengyu Liu Yuyang Li Siyuan Huang 48 3 0 27 Mar 2025
HORT: Monocular Hand-held Objects Reconstruction with Transformers Zerui Chen Rolandos Alexandros Potamias Shizhe Chen Cordelia Schmid 3DH 48 0 0 27 Mar 2025
AudCast: Audio-Driven Human Video Generation by Cascaded Diffusion Transformers Jiazhi Guan Kaisiyuan Wang Zhiliang Xu Quanwei Yang Yasheng Sun ... Errui Ding J. Wang Youjian Zhao Hang Zhou Ziwei Liu VGen 42 0 0 25 Mar 2025
Aligning Foundation Model Priors and Diffusion-Based Hand Interactions for Occlusion-Resistant Two-Hand Reconstruction Gaoge Han Yongkang Cheng Zhe Chen Shaoli Huang Tongliang Liu 39 0 0 22 Mar 2025
Re-HOLD: Video Hand Object Interaction Reenactment via adaptive Layout-instructed Diffusion Model Yingying Fan Quanwei Yang Kaisiyuan Wang Hang Zhou Yingying Li Haocheng Feng Errui Ding Y. Wu J. Wang DiffM 42 0 0 21 Mar 2025
Cosh-DiT: Co-Speech Gesture Video Synthesis via Hybrid Audio-Visual Diffusion Transformers Yasheng Sun Zhiliang Xu Hang Zhou Jiazhi Guan Quanwei Yang ... Yingying Li Haocheng Feng J. Wang Ziwei Liu Koike Hideki VGen 54 0 0 13 Mar 2025
GAT-Grasp: Gesture-Driven Affordance Transfer for Task-Aware Robotic Grasping Ruixiang Wang Huayi Zhou Xinyue Yao Guiliang Liu K. Jia 34 0 0 08 Mar 2025
ReJSHand: Efficient Real-Time Hand Pose Estimation and Mesh Reconstruction Using Refined Joint and Skeleton Features Shan An Shipeng Dai Mahrukh Ansari Yu Liang Ming Zeng Konstantinos A. Tsintotas Changhong Fu H. Zhang 3DH 38 0 0 08 Mar 2025
HanDrawer: Leveraging Spatial Information to Render Realistic Hands Using a Conditional Diffusion Model in Single Stage Qifan Fu Xu Chen Muhammad Asad Shanxin Yuan Changjae Oh Gregory Slabaugh DiffM 58 0 0 03 Mar 2025
Phantom: Training Robots Without Robots Using Only Human Videos Marion Lepert Jiaying Fang Jeannette Bohg OffRL 40 5 0 02 Mar 2025
HGDiffuser: Efficient Task-Oriented Grasp Generation via Human-Guided Grasp Diffusion Models Dehao Huang Wenlong Dong Chao Tang Hong Zhang 37 1 0 01 Mar 2025
Towards Semantic 3D Hand-Object Interaction Generation via Functional Text Guidance Yongqi Tian Xueyu Sun Haoyuan He Linji Hao Ning Ding Caigui Jiang 79 1 0 28 Feb 2025
QORT-Former: Query-optimized Real-time Transformer for Understanding Two Hands Manipulating Objects Elkhan Ismayilzada MD Khalequzzaman Chowdhury Sayem Yihalem Yimolal Tiruneh Mubarrat Chowdhury Muhammadjon Boboev Seungryul Baek ViT 65 1 0 27 Feb 2025
Point Policy: Unifying Observations and Actions with Key Points for Robot Manipulation Siddhant Haldar Lerrel Pinto 3DPC 58 2 0 27 Feb 2025
Design of a low-cost and lightweight 6 DoF bimanual arm for dynamic and contact-rich manipulation Jaehyung Kim Jiho Kim Dongryung Lee Yujin Jang Beomjoon Kim 38 0 0 24 Feb 2025
RHINO: Learning Real-Time Humanoid-Human-Object Interaction from Human Demonstrations Jingxiao Chen Xinyao Li Jiahang Cao Zhengbang Zhu Wentao Dong Minghuan Liu Ying Wen Yong Yu L. Zhang Weinan Zhang 80 0 0 18 Feb 2025
Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learning Juntao Ren Priya Sundaresan Dorsa Sadigh Sanjiban Choudhury Jeannette Bohg 37 10 0 13 Jan 2025
Learning to Transfer Human Hand Skills for Robot Manipulations S. Park Seungho Lee M. Choi Jiye Lee Jeonghwan Kim Jisoo Kim Hanbyul Joo 33 1 0 07 Jan 2025
HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videos Jinglei Zhang Jiankang Deng Chao Ma Rolandos Alexandros Potamias 30 3 0 06 Jan 2025
HandsOnVLM: Vision-Language Models for Hand-Object Interaction Prediction Chen Bao Jiarui Xu Xiaolong Wang Abhinav Gupta Homanga Bharadhwaj 68 2 0 17 Dec 2024
FoundHand: Large-Scale Domain-Specific Learning for Controllable Hand Image Generation Kefan Chen Chaerin Min Linguang Zhang Shreyas Hampali Cem Keskin Srinath Sridhar 75 0 0 03 Dec 2024
HandOS: 3D Hand Reconstruction in One Stage Xingyu Chen Zhuheng Song Xiaoke Jiang Yaoqing Hu Junzhi Yu Lei Zhang 3DH HAI 69 0 0 02 Dec 2024
Bimanual Dexterity for Complex Tasks Kenneth Shaw Yulong Li Jiahui Yang M. K. Srirama Ray Liu Haoyu Xiong Russell Mendonca Deepak Pathak 68 19 0 20 Nov 2024
OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitation Jinhan Li Yifeng Zhu Yuqi Xie Zhenyu Jiang Mingyo Seo Georgios Pavlakos Yuke Zhu LM&Ro 23 31 0 15 Oct 2024
FürElise: Capturing and Physically Synthesizing Hand Motions of Piano Performance Ruocheng Wang Pei Xu Haochen Shi Elizabeth Schumann C. Karen Liu 17 3 0 08 Oct 2024
Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progress Christopher Agia Rohan Sinha Jingyun Yang Zi-ang Cao Rika Antonova Marco Pavone Jeannette Bohg 26 6 0 06 Oct 2024
Estimating Body and Hand Motion in an Ego-sensed World Brent Yi Vickie Ye Maya Zheng Lea Müller Georgios Pavlakos Yi Ma Jitendra Malik Angjoo Kanazawa DiffM 42 6 0 04 Oct 2024
Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstruction Justin Kerr C. Kim Mingxuan Wu Brent Yi Qianqian Wang Ken Goldberg Angjoo Kanazawa 18 12 0 26 Sep 2024