Physics-based Human Motion Estimation and Synthesis from Videos

21 September 2021

Sanja Fidler

Papers citing "Physics-based Human Motion Estimation and Synthesis from Videos"

49 / 49 papers shown

Title
BioMoDiffuse: Physics-Guided Biomechanical Diffusion for Controllable and Authentic Human Motion Synthesis Zixi Kang Xinghan Wang Yadong Mu VGen 84 0 0 08 Mar 2025
A Plug-and-Play Physical Motion Restoration Approach for In-the-Wild High-Difficulty Motions Youliang Zhang Ronghui Li Yachao Zhang Liang Pan Jingbo Wang Yebin Liu Xiu Li 32 0 0 23 Dec 2024
Social EgoMesh Estimation Luca Scofano Alessio Sampieri Edoardo De Matteis Indro Spinelli Fabio Galasso EgoV 25 0 0 07 Nov 2024
Focused ReAct: Improving ReAct through Reiterate and Early Stop Shuoqiu Li Han Xu Haipeng Chen ReLM LRM 30 6 0 14 Oct 2024
COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation Jiefeng Li Ye Yuan Davis Rempe Haotian Zhang Pavlo Molchanov Cewu Lu Jan Kautz Umar Iqbal DiffM VGen 32 2 0 29 Aug 2024
Occlusion-Aware 3D Motion Interpretation for Abnormal Behavior Detection Su Li Wang Liang Jianye Wang Ziheng Zhang Lei Zhang 40 0 0 23 Jul 2024
F-HOI: Toward Fine-grained Semantic-Aligned 3D Human-Object Interactions Jie-jin Yang Xuesong Niu Nan Jiang Ruimao Zhang Siyuan Huang 30 9 0 17 Jul 2024
Physics-based Scene Layout Generation from Human Motion Jianan Li Tao Huang Qingxu Zhu Tien-Tsin Wong 44 2 0 21 May 2024
Hand-Object Interaction Controller (HOIC): Deep Reinforcement Learning for Reconstructing Interactions with Physics Haoyu Hu Xinyu Yi Zhe Cao Jun-hai Yong Feng Xu 38 2 0 04 May 2024
PACER+: On-Demand Pedestrian Animation Controller in Driving Scenarios Jingbo Wang Zhengyi Luo Ye Yuan Yixuan Li Bo Dai 31 15 0 30 Apr 2024
WheelPose: Data Synthesis Techniques to Improve Pose Estimation Performance on Wheelchair Users William Huang Sam Ghahremani Siyou Pei Yang Zhang 32 3 0 25 Apr 2024
PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos Yufei Zhang Jeffrey O. Kephart Zijun Cui Qiang Ji ViT 32 6 0 05 Apr 2024
Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance Zan Wang Yixin Chen Baoxiong Jia Puhao Li Jinlu Zhang Jingze Zhang Tengyu Liu Yixin Zhu Wei Liang Siyuan Huang VGen DiffM 39 36 0 26 Mar 2024
Human Motion Prediction under Unexpected Perturbation Jiangbei Yue Baiyi Li Julien Pettré Armin Seyfried He-Nan Wang 33 2 0 23 Mar 2024
Contact-aware Human Motion Generation from Textual Descriptions Sihan Ma Qiong Cao Jing Zhang Dacheng Tao 36 7 0 23 Mar 2024
Recent Trends in 3D Reconstruction of General Non-Rigid Scenes Raza Yunus J. E. Lenssen Michael Niemeyer Yiyi Liao Christian Rupprecht Christian Theobalt Gerard Pons-Moll Jia-Bin Huang Vladislav Golyanik Eddy Ilg 46 25 0 22 Mar 2024
AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agents Jieming Cui Tengyu Liu Nian Liu Yaodong Yang Yixin Zhu Siyuan Huang 45 21 0 19 Mar 2024
Real-Time Simulated Avatar from Head-Mounted Sensors Zhengyi Luo Jinkun Cao Rawal Khirodkar Alexander W. Winkler Jing Huang Kris M. Kitani Weipeng Xu 34 7 0 11 Mar 2024
RoHM: Robust Human Motion Reconstruction via Diffusion Siwei Zhang Bharat Lal Bhatnagar Yuanlu Xu Alexander Winkler Petr Kadlecek Siyu Tang Federica Bogo DiffM 24 17 0 16 Jan 2024
PACE: Human and Camera Motion Estimation from in-the-wild Videos Muhammed Kocabas Ye Yuan Pavlo Molchanov Yunrong Guo Michael J. Black Otmar Hilliges Jan Kautz Umar Iqbal 3DH 26 14 0 20 Oct 2023
SICNav: Safe and Interactive Crowd Navigation using Model Predictive Control and Bilevel Optimization S. Samavi James R. Han Florian Shkurti Angela P. Schoellig 17 6 0 17 Oct 2023
Decaf: Monocular Deformation Capture for Face and Hand Interactions Soshi Shimada Carlos Esteves A. Makadia Stella X. Yu 3DH CVBM 21 11 0 28 Sep 2023
Physically Plausible Full-Body Hand-Object Interaction Synthesis Jona Braun Sammy Christen Muhammed Kocabas Emre Aksan Otmar Hilliges 21 38 0 14 Sep 2023
ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation Hui Zhang Sammy Christen Zicong Fan Luocheng Zheng Jemin Hwangbo Jie Song Otmar Hilliges 24 44 0 07 Sep 2023
Physics-Guided Human Motion Capture with Pose Probability Modeling Jingyi Ju Buzhen Huang Chen Zhu Zhihao Li Yangang Wang DiffM 25 3 0 19 Aug 2023
Language-guided Human Motion Synthesis with Atomic Actions Yuanhao Zhai Mingzhen Huang Tianyu Luan Lu Dong Ifeoma Nwogu Siwei Lyu David Doermann Junsong Yuan 27 11 0 18 Aug 2023
GraMMaR: Ground-aware Motion Model for 3D Human Motion Reconstruction Sihan Ma Qiong Cao Hongwei Yi Jing Zhang Dacheng Tao 3DH 19 3 0 29 Jun 2023
Physics-Informed Computer Vision: A Review and Perspectives C. Banerjee Kien Nguyen Clinton Fookes G. Karniadakis PINN AI4CE 30 28 0 29 May 2023
3D Human Pose Estimation via Intuitive Physics Shashank Tripathi Lea Müller C. Huang Omid Taheri Michael J. Black Dimitrios Tzionas 3DH 21 69 0 31 Mar 2023
Decoupling Human and Camera Motion from Videos in the Wild Vickie Ye Georgios Pavlakos Jitendra Malik Angjoo Kanazawa 3DH 26 83 0 24 Feb 2023
Scene-Aware 3D Multi-Human Motion Capture from a Single Camera D. Luvizon Marc Habermann Vladislav Golyanik Adam Kortylewski Christian Theobalt 3DH HAI 22 18 0 12 Jan 2023
NeMo: 3D Neural Motion Fields from Multiple Video Instances of the Same Action Kuan-Chieh Jackson Wang Zhenzhen Weng M. Xenochristou Joao Pedro Araujo Jeffrey Gu C. Karen Liu Serena Yeung 3DH 21 2 0 28 Dec 2022
Physically Plausible Animation of Human Upper Body from a Single Image Ziyuan Huang Zhengping Zhou Yung-Yu Chuang Jiajun Wu C. Karen Liu 3DH 11 2 0 09 Dec 2022
Ego-Body Pose Estimation via Ego-Head Pose Estimation Jiaman Li C. Karen Liu Jiajun Wu DiffM 22 61 0 09 Dec 2022
Transformer-Based Learned Optimization Erik Gartner Luke Metz Mykhaylo Andriluka C. Freeman C. Sminchisescu 16 11 0 02 Dec 2022
HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes Zan Wang Yixin Chen Tengyu Liu Yixin Zhu Wei Liang Siyuan Huang 32 103 0 18 Oct 2022
Neural3Points: Learning to Generate Physically Realistic Full-body Motion for Virtual Reality Users Yongjing Ye Libin Liu Lei Hu Shi-hong Xia 3DH 39 27 0 13 Sep 2022
Pathway to Future Symbiotic Creativity Yi-Ting Guo Qi-fei Liu Jie Chen Wei Xue Jie Fu ... Fernando Rosas Jeffrey Shaw Xing Wu Jiji Zhang Jianliang Xu 21 0 0 18 Aug 2022
The One Where They Reconstructed 3D Humans and Environments in TV Shows Georgios Pavlakos Ethan Weber Matthew Tancik Angjoo Kanazawa 3DH 43 23 0 28 Jul 2022
Capturing and Inferring Dense Full-Body Human-Scene Contact C. Huang Hongwei Yi Markus Hoschle Matvey Safroshkin Tsvetelina Alexiadis Senya Polikovsky D. Scharstein Michael J. Black 3DH 24 123 0 20 Jun 2022
Embodied Scene-aware Human Pose Estimation Zhengyi Luo Shun Iwase Ye Yuan Kris M. Kitani 3DH 19 28 0 18 Jun 2022
Trajectory Optimization for Physics-Based Reconstruction of 3d Human Pose from Monocular Video Erik Gartner Mykhaylo Andriluka Hongyi Xu C. Sminchisescu 3DH 15 39 0 24 May 2022
Differentiable Dynamics for Articulated 3d Human Motion Reconstruction Erik Gartner Mykhaylo Andriluka Erwin Coumans C. Sminchisescu 3DH 46 39 0 24 May 2022
PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervision Kehong Gong Bingbing Li Jianfeng Zhang Tao Wang Jing Huang Michael Bi Mi Jiashi Feng Xinchao Wang SSL 19 43 0 29 Mar 2022
Neural MoCon: Neural Motion Control for Physically Plausible Human Motion Capture Buzhen Huang Liang Pan Yuan Yang Jingyi Ju Yangang Wang 3DH 12 32 0 26 Mar 2022
Recovering 3D Human Mesh from Monocular Images: A Survey Yating Tian Hongwen Zhang Yebin Liu Limin Wang 3DH 20 126 0 03 Mar 2022
GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras Ye Yuan Umar Iqbal Pavlo Molchanov Kris M. Kitani Jan Kautz 3DH 35 114 0 02 Dec 2021
Learning to Fit Morphable Models Vasileios Choutas Federica Bogo Jingjing Shen Julien P. C. Valentin 3DH 17 18 0 29 Nov 2021
Contact and Human Dynamics from Monocular Video Davis Rempe Leonidas J. Guibas Aaron Hertzmann Bryan C. Russell Ruben Villegas Jimei Yang 3DH 71 101 0 22 Jul 2020