Learning Motion Priors for 4D Human Body Capture in 3D Scenes

23 August 2021

Siwei Zhang

Yan Zhang

Federica Bogo

Marc Pollefeys

Siyu Tang

3DH

ArXiv PDF HTML

Papers citing "Learning Motion Priors for 4D Human Body Capture in 3D Scenes"

50 / 84 papers shown

Title
Visual Imitation Enables Contextual Humanoid Control Arthur Allshire Hongsuk Choi Junyi Zhang David McAllister Anthony Zhang C. Kim Trevor Darrell Pieter Abbeel Jitendra Malik Angjoo Kanazawa LM&Ro 36 0 0 06 May 2025
GROVE: A Generalized Reward for Learning Open-Vocabulary Physical Skill Jieming Cui Tengyu Liu Ziyu Meng Jiale Yu Ran Song Wei Zhang Yixin Zhu Siyuan Huang VLM 33 1 0 05 Apr 2025
Jointly Understand Your Command and Intention:Reciprocal Co-Evolution between Scene-Aware 3D Human Motion Synthesis and Analysis Xuehao Gao Yang Yang Shaoyi Du Guo-Jun Qi Junwei Han 34 1 0 01 Mar 2025
Semantics-aware Test-time Adaptation for 3D Human Pose Estimation Qiuxia Lin Rongyu Chen Kerui Gu Angela Yao 3DH TTA 67 0 0 15 Feb 2025
A Plug-and-Play Physical Motion Restoration Approach for In-the-Wild High-Difficulty Motions Youliang Zhang Ronghui Li Yachao Zhang Liang Pan Jingbo Wang Yebin Liu Xiu Li 32 0 0 23 Dec 2024
Recovering Complete Actions for Cross-dataset Skeleton Action Recognition Hanchao Liu Yujiang Li Tai-Jiang Mu Shi-Min Hu 25 0 0 31 Oct 2024
Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patterns Ronghui Li Hongwen Zhang Yachao Zhang Yuxiang Zhang Youliang Zhang Jie Guo Yan Zhang Xiu Li Yebin Liu 20 2 0 27 Oct 2024
MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifolds Ziqiang Dang Tianxing Fan Boming Zhao Xujie Shen Lei Wang Guofeng Zhang Zhaopeng Cui 3DH 21 0 0 01 Sep 2024
COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation Jiefeng Li Ye Yuan Davis Rempe Haotian Zhang Pavlo Molchanov Cewu Lu Jan Kautz Umar Iqbal DiffM VGen 29 2 0 29 Aug 2024
F-HOI: Toward Fine-grained Semantic-Aligned 3D Human-Object Interactions Jie-jin Yang Xuesong Niu Nan Jiang Ruimao Zhang Siyuan Huang 19 9 0 17 Jul 2024
CLHOP: Combined Audio-Video Learning for Horse 3D Pose and Shape Estimation Ci Li Elin Hernlund Hedvig Kjellström Silvia Zuffi 3DH 23 2 0 01 Jul 2024
DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image Qingxuan Wu Zhiyang Dou Sirui Xu Soshi Shimada Chen Wang ... Taku Komura Vladislav Golyanik Christian Theobalt Wenping Wang Lingjie Liu CVBM 3DH 58 4 0 26 Jun 2024
Diverse 3D Human Pose Generation in Scenes based on Decoupled Structure Bowen Dang Xi Zhao 3DH 25 0 0 09 Jun 2024
Degrees of Freedom Matter: Inferring Dynamics from Point Trajectories Yan Zhang Sergey Prokudin Marko Mihajlovic Qianli Ma Siyu Tang 19 1 0 05 Jun 2024
Programmable Motion Generation for Open-Set Motion Control Tasks Hanchao Liu Xiaohang Zhan Shaoli Huang Tai-Jiang Mu Ying Shan 22 5 0 29 May 2024
Synergistic Global-space Camera and Human Reconstruction from Videos Yizhou Zhao Tuanfeng Y. Wang Bhiksha Raj Min Xu Jimei Yang Chun-Hao Paul Huang 3DGS 3DH 25 1 0 23 May 2024
Purposer: Putting Human Motion Generation in Context Nicolas Ugrinovic Thomas Lucas Fabien Baradel Philippe Weinzaepfel Grégory Rogez Francesc Moreno-Noguer DiffM 28 2 0 19 Apr 2024
Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaption Buzhen Huang Chen Li Chongyang Xu Liang Pan Yangang Wang Gim Hee Lee 22 2 0 17 Apr 2024
MoCap-to-Visual Domain Adaptation for Efficient Human Mesh Estimation from 2D Keypoints Bedirhan Uguz Ozhan Suat Batuhan Karagöz Emre Akbas 19 0 0 10 Apr 2024
A Unified Diffusion Framework for Scene-aware Human Motion Estimation from Sparse Signals Jiangnan Tang Jingya Wang Kaiyang Ji Lan Xu Jingyi Yu Ye-ling Shi 18 5 0 07 Apr 2024
PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos Yufei Zhang Jeffrey O. Kephart Zijun Cui Qiang Ji ViT 16 6 0 05 Apr 2024
MMVP: A Multimodal MoCap Dataset with Vision and Pressure Sensors He Zhang Shenghao Ren Haolei Yuan Jianhui Zhao Fan Li Shuangpeng Sun Zhenghao Liang Tao Yu Qiu Shen Xun Cao 14 4 0 26 Mar 2024
Contact-aware Human Motion Generation from Textual Descriptions Sihan Ma Qiong Cao Jing Zhang Dacheng Tao 18 7 0 23 Mar 2024
Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitives Ronghui Li YuXiang Zhang Yachao Zhang Hongwen Zhang Jie Guo Yan Zhang Yebin Liu Xiu Li DiffM 31 28 0 15 Mar 2024
NRDF: Neural Riemannian Distance Fields for Learning Articulated Pose Priors Yannan He Garvita Tiwari Tolga Birdal J. E. Lenssen Gerard Pons-Moll 17 7 0 05 Mar 2024
DEMOS: Dynamic Environment Motion Synthesis in 3D Scenes via Local Spherical-BEV Perception Jing-yu Gong Min Wang Wentao Liu Chao Qian Zhizhong Zhang Yuan Xie Lizhuang Ma 24 0 0 04 Mar 2024
RoHM: Robust Human Motion Reconstruction via Diffusion Siwei Zhang Bharat Lal Bhatnagar Yuanlu Xu Alexander Winkler Petr Kadlecek Siyu Tang Federica Bogo DiffM 9 4 0 16 Jan 2024
HMP: Hand Motion Priors for Pose and Shape Estimation from Video Enes Duran Muhammed Kocabas Vasileios Choutas Zicong Fan Michael J. Black 3DH 24 7 0 27 Dec 2023
Optimizing Diffusion Noise Can Serve As Universal Motion Priors Korrawe Karunratanakul Konpat Preechakul Emre Aksan Thabo Beeler Supasorn Suwajanakorn Siyu Tang DiffM 8 37 0 19 Dec 2023
Ins-HOI: Instance Aware Human-Object Interactions Recovery Jiajun Zhang Yuxiang Zhang Hongwen Zhang Xiao Zhou Boyao Zhou Ruizhi Shao Zonghai Hu Yebin Liu 21 4 0 15 Dec 2023
I'M HOI: Inertia-aware Monocular Capture of 3D Human-Object Interactions Chengfeng Zhao Juze Zhang Jiashen Du Ziwei Shan Junye Wang Jingyi Yu Jingya Wang Lan Xu 13 18 0 10 Dec 2023
HandDiffuse: Generative Controllers for Two-Hand Interactions via Diffusion Models Pei-Ying Lin Sihang Xu Hongdi Yang Yiran Liu Xin Chen Jingya Wang Jingyi Yu Lan Xu 23 9 0 08 Dec 2023
BundleMoCap: Efficient, Robust and Smooth Motion Capture from Sparse Multiview Videos G. Albanis N. Zioulis Kostas Kolomvatsos 20 1 0 21 Nov 2023
PACE: Human and Camera Motion Estimation from in-the-wild Videos Muhammed Kocabas Ye Yuan Pavlo Molchanov Yunrong Guo Michael J. Black Otmar Hilliges Jan Kautz Umar Iqbal 3DH 21 14 0 20 Oct 2023
Reconstructing 3D Human Pose from RGB-D Data with Occlusions Bowen Dang Xi Zhao Bowen Zhang He Wang 3DH 23 1 0 02 Oct 2023
DECO: Dense Estimation of 3D Human-Scene Contact In The Wild Shashank Tripathi Agniv Chatterjee Jean-Claude Passy Hongwei Yi Dimitrios Tzionas Michael J. Black 3DH 14 20 0 26 Sep 2023
Cyclic Test-Time Adaptation on Monocular Video for 3D Human Mesh Reconstruction Hyeongjin Nam Daniel Sungho Jung Y. Oh Kyoung Mu Lee 3DH 29 16 0 12 Aug 2023
Human Motion Generation: A Survey Wentao Zhu Xiaoxuan Ma Dongwoo Ro Hai Ci Jinlu Zhang Jiaxin Shi Feng Gao Qi Tian Yizhou Wang VGen 19 50 0 20 Jul 2023
ProxyCap: Real-time Monocular Full-body Capture in World Space via Human-Centric Proxy-to-Motion Learning Yuxiang Zhang Hongwen Zhang Liangxiao Hu Jiajun Zhang Hongwei Yi Shengping Zhang Yebin Liu 3DH 20 4 0 03 Jul 2023
GraMMaR: Ground-aware Motion Model for 3D Human Motion Reconstruction Sihan Ma Qiong Cao Hongwei Yi Jing Zhang Dacheng Tao 3DH 11 3 0 29 Jun 2023
Learning Human Mesh Recovery in 3D Scenes Zehong Shen Z. Cen Sida Peng Qing Shuai Hujun Bao Xiaowei Zhou 3DH 11 14 0 06 Jun 2023
Object pop-up: Can we infer 3D objects and their poses from human interactions alone? Ilya A. Petrov R. Marin Julian Chibane Gerard Pons-Moll 23 25 0 01 Jun 2023
Guided Motion Diffusion for Controllable Human Motion Synthesis Korrawe Karunratanakul Konpat Preechakul Supasorn Suwajanakorn Siyu Tang DiffM 16 118 0 21 May 2023
Synthesizing Diverse Human Motions in 3D Indoor Scenes Kaifeng Zhao Yan Zhang Shaofei Wang Thabo Beeler Siyu Tang 20 64 0 21 May 2023
Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Views Siwei Zhang Qianli Ma Yan Zhang S. Aliakbarian Darren Cosker Siyu Tang EgoV 12 13 0 12 Apr 2023
3D Human Pose Estimation via Intuitive Physics Shashank Tripathi Lea Müller C. Huang Omid Taheri Michael J. Black Dimitrios Tzionas 3DH 10 68 0 31 Mar 2023
CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactions Ming Yan Xin Wang Yudi Dai Siqiu Shen Chenglu Wen Lan Xu Yuexin Ma Cheng-i Wang 11 20 0 31 Mar 2023
Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations Quanzhou Li Jingbo Wang Chen Change Loy Bo Dai 17 26 0 23 Mar 2023
Detecting Human-Object Contact in Images Yixin Chen Sai Kumar Dwivedi Michael J. Black Dimitrios Tzionas 3DH 47 32 0 06 Mar 2023
Decoupling Human and Camera Motion from Videos in the Wild Vickie Ye Georgios Pavlakos Jitendra Malik Angjoo Kanazawa 3DH 10 82 0 24 Feb 2023