Diffusion-Guided Reconstruction of Everyday Hand-Object Interaction Clips

11 September 2023

Papers citing "Diffusion-Guided Reconstruction of Everyday Hand-Object Interaction Clips"

40 / 40 papers shown

Title
Web2Grasp: Learning Functional Grasps from Web Images of Hand-Object Interactions Hongyi Chen Yunchao Yao Yufei Ye Zhixuan Xu Homanga Bharadhwaj Jiashun Wang Shubham Tulsiani Zackory Erickson Jeffrey Ichnowski 24 0 0 07 May 2025
Foundation Model-Driven Framework for Human-Object Interaction Prediction with Segmentation Mask Integration Juhan Park Kyungjae Lee Hyung Jin Chang Jungchan Cho VLM 66 0 0 28 Apr 2025
How Do I Do That? Synthesizing 3D Hand Motion and Contacts for Everyday Interactions Aditya Prakash Benjamin Lundell Dmitry Andreychuk David Forsyth Saurabh Gupta H. Sawhney 31 0 0 16 Apr 2025
BIGS: Bimanual Category-agnostic Interaction Reconstruction from Monocular Videos via 3D Gaussian Splatting Jeongwan On Kyeonghwan Gwak Gunyoung Kang Junuk Cha Soohyun Hwang Hyein Hwang Seungryul Baek 29 0 0 12 Apr 2025
Novel Diffusion Models for Multimodal 3D Hand Trajectory Prediction Junyi Ma Wentao Bao Jingyi Xu Guanzhong Sun Xieyuanli Chen Hesheng Wang 30 0 0 10 Apr 2025
ZeroMimic: Distilling Robotic Manipulation Skills from Web Videos Junyao Shi Zhuolun Zhao Tianyou Wang Ian Pedroza Amy Luo Jie Wang Jason Ma Dinesh Jayaraman LM&Ro 43 0 0 31 Mar 2025
SIGHT: Single-Image Conditioned Generation of Hand Trajectories for Hand-Object Interaction Alexey Gavryushin Florian Redhardt Gaia Di Lorenzo Luc Van Gool Marc Pollefeys Kaichun Mo Xi Wang 34 0 0 28 Mar 2025
HORT: Monocular Hand-held Objects Reconstruction with Transformers Zerui Chen Rolandos Alexandros Potamias Shizhe Chen Cordelia Schmid 3DH 48 0 0 27 Mar 2025
Zero-Shot Human-Object Interaction Synthesis with Multimodal Priors Yuke Lou Yiming Wang Zhen Wu Rui Zhao Wenjia Wang Mingyi Shi Taku Komura 37 0 0 25 Mar 2025
Re-HOLD: Video Hand Object Interaction Reenactment via adaptive Layout-instructed Diffusion Model Yingying Fan Quanwei Yang Kaisiyuan Wang Hang Zhou Yingying Li Haocheng Feng Errui Ding Y. Wu J. Wang DiffM 42 0 0 21 Mar 2025
Towards Semantic 3D Hand-Object Interaction Generation via Functional Text Guidance Yongqi Tian Xueyu Sun Haoyuan He Linji Hao Ning Ding Caigui Jiang 102 1 0 28 Feb 2025
Collaborative Learning for 3D Hand-Object Reconstruction and Compositional Action Recognition from Egocentric RGB Videos Using Superquadrics Tze Ho Elden Tse Runyang Feng Linfang Zheng Jiho Park Yixing Gao Jihie Kim A. Leonardis H. Chang 40 0 0 13 Jan 2025
Human Grasp Generation for Rigid and Deformable Objects with Decomposed VQ-VAE Mengshi Qi Zhe Zhao Huadong Ma 40 1 0 08 Jan 2025
InterDyn: Controllable Interactive Dynamics with Video Diffusion Models Rick Akkerman Haiwen Feng M. Black Dimitrios Tzionas Victoria Fernandez-Abrevaya VGen AI4CE 100 3 0 16 Dec 2024
Multi-Modal Diffusion for Hand-Object Grasp Generation Jinkun Cao Jingyuan Liu Kris M. Kitani Yi Zhou 23 3 0 06 Sep 2024
InterTrack: Tracking Human Object Interaction without Object Templates Xianghui Xie J. E. Lenssen Gerard Pons-Moll 33 6 0 25 Aug 2024
Controlling the World by Sleight of Hand Sruthi Sudhakar Ruoshi Liu Basile Van Hoorick Carl Vondrick Richard Zemel 30 4 0 13 Aug 2024
NL2Contact: Natural Language Guided 3D Hand-Object Contact Modeling with Diffusion Model Zhongqun Zhang Hengfei Wang Ziwei Yu Yihua Cheng Angela Yao Hyung Jin Chang DiffM 41 4 0 17 Jul 2024
EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting Daiwei Zhang Gengyan Li Jiajie Li Mickael Bressieux Otmar Hilliges Marc Pollefeys Luc Van Gool Xi Wang 35 9 0 28 Jun 2024
DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image Qingxuan Wu Zhiyang Dou Sirui Xu Soshi Shimada Chen Wang ... Taku Komura Vladislav Golyanik Christian Theobalt Wenping Wang Lingjie Liu CVBM 3DH 66 4 0 26 Jun 2024
HOI-Swap: Swapping Objects in Videos with Hand-Object Interaction Awareness Zihui Xue Mi Luo Changan Chen Kristen Grauman DiffM 22 6 0 11 Jun 2024
Physics-based Scene Layout Generation from Human Motion Jianan Li Tao Huang Qingxu Zhu Tien-Tsin Wong 39 2 0 21 May 2024
Diff-IP2D: Diffusion-Based Hand-Object Interaction Prediction on Egocentric Videos Junyi Ma Jingyi Xu Xieyuanli Chen Hesheng Wang VGen 27 7 0 07 May 2024
Sparse multi-view hand-object reconstruction for unseen environments Yik Lung Pang Changjae Oh Andrea Cavallaro 33 1 0 02 May 2024
G-HOP: Generative Hand-Object Prior for Interaction Reconstruction and Grasp Synthesis Yufei Ye Abhinav Gupta Kris M. Kitani Shubham Tulsiani 24 16 0 18 Apr 2024
HandBooster: Boosting 3D Hand-Mesh Reconstruction by Conditional Synthesis and Sampling of Hand-Object Interactions Hao Xu Haipeng Li Yinqiao Wang Shuaicheng Liu Chi-Wing Fu 3DH 29 7 0 27 Mar 2024
DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptions Sammy Christen Shreyas Hampali Fadime Sener Edoardo Remelli Tomás Hodan Eric Sauser Shugao Ma Bugra Tekin 41 18 0 26 Mar 2024
Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects Zicong Fan Takehiko Ohkawa Linlin Yang Nie Lin Zhishan Zhou ... Kun He Yoichi Sato Otmar Hilliges Hyung Jin Chang Angela Yao 39 14 0 25 Mar 2024
GeneOH Diffusion: Towards Generalizable Hand-Object Interaction Denoising via Denoising Diffusion Xueyi Liu Li Yi DiffM 31 19 0 22 Feb 2024
RHOBIN Challenge: Reconstruction of Human Object Interaction Xianghui Xie Xi Wang Nikos Athanasiou Bharat Lal Bhatnagar Chun-Hao P. Huang ... Daniel Sungho Jung Kihoon Kim Kyoung Mu Lee Otmar Hilliges Gerard Pons-Moll 31 3 0 07 Jan 2024
Get a Grip: Reconstructing Hand-Object Stable Grasps in Egocentric Videos Zhifan Zhu Dima Damen 19 7 0 25 Dec 2023
HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Video Zicong Fan Maria Parelli Maria Eleni Kadoglou Muhammed Kocabas Xu Chen Michael J. Black Otmar Hilliges 3DH 18 28 0 30 Nov 2023
MOHO: Learning Single-view Hand-held Object Reconstruction with Multi-view Occlusion-Aware Supervision Chenyangguang Zhang Guanlong Jiao Yan Di Gu Wang Ziqin Huang Ruida Zhang Fabian Manhardt Bowen Fu F. Tombari Xiangyang Ji 17 6 0 18 Oct 2023
Shap-E: Generating Conditional 3D Implicit Functions Heewoo Jun Alex Nichol DiffM 192 309 0 03 May 2023
Putting People in Their Place: Affordance-Aware Human Insertion into Scenes Sumith Kulal Tim Brooks A. Aiken Jiajun Wu Jimei Yang Jingwan Lu Alexei A. Efros Krishna Kumar Singh DiffM 37 42 0 27 Apr 2023
BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects Bowen Wen Jonathan Tremblay Valts Blukis Stephen Tyree Thomas Müller Alex Evans D. Fox Jan Kautz Stan Birchfield 3DH 78 125 0 24 Mar 2023
RealFusion: 360° Reconstruction of Any Object from a Single Image Luke Melas-Kyriazi Christian Rupprecht Iro Laina Andrea Vedaldi 85 290 0 21 Feb 2023
Scene Synthesis from Human Motion Sifan Ye Yixing Wang Jiaman Li Dennis Park C. Karen Liu Huazhe Xu Jiajun Wu 3DH 69 19 0 04 Jan 2023
Self-supervised Neural Articulated Shape and Appearance Models Fangyin Wei Rohan Chabra Lingni Ma Christoph Lassner Michael Zollhofer Szymon Rusinkiewicz Chris Sweeney Richard A. Newcombe Miroslava Slavcheva SSL 60 37 0 17 May 2022
BANMo: Building Animatable 3D Neural Models from Many Casual Videos Gengshan Yang Minh Vo Natalia Neverova Deva Ramanan Andrea Vedaldi Hanbyul Joo 3DH 118 183 0 23 Dec 2021