4D Human Body Capture from Egocentric Video via 3D Scene Grounding

26 November 2020

Miao Liu

Zhaopeng Cui

Siyu Tang

Papers citing "4D Human Body Capture from Egocentric Video via 3D Scene Grounding"

37 / 37 papers shown

Title
Fish2Mesh Transformer: 3D Human Mesh Recovery from Egocentric Vision David C. Jeong Aditya Puranik James Vong Vrushabh Abhijit Deogirikar Ryan Fell Julianna Dietrich Maria Kyrarini Christopher A. Kitts EgoV 71 0 0 08 Mar 2025
HiSC4D: Human-centered interaction and 4D Scene Capture in Large-scale Space Using Wearable IMUs and LiDAR Yudi Dai Zhiyong Wang Xiping Lin Chenglu Wen Lan Xu Siqi Shen Yuexin Ma Cheng Wang 32 1 0 06 Sep 2024
MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifolds Ziqiang Dang Tianxing Fan Boming Zhao Xujie Shen Lei Wang Guofeng Zhang Zhaopeng Cui 3DH 31 0 0 01 Sep 2024
COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation Jiefeng Li Ye Yuan Davis Rempe Haotian Zhang Pavlo Molchanov Cewu Lu Jan Kautz Umar Iqbal DiffM VGen 29 2 0 29 Aug 2024
CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangement Chengwen Zhang Yun-Hai Liu Ruofan Xing Bingda Tang Li Yi 38 10 0 27 Jun 2024
Synergistic Global-space Camera and Human Reconstruction from Videos Yizhou Zhao Tuanfeng Y. Wang Bhiksha Raj Min Xu Jimei Yang Chun-Hao Paul Huang 3DGS 3DH 38 1 0 23 May 2024
TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos Yufu Wang ZiYun Wang Lingjie Liu Kostas Daniilidis 37 25 0 26 Mar 2024
WHAC: World-grounded Humans and Cameras Wanqi Yin Zhongang Cai Ruisi Wang Fanzhou Wang Chen Wei ... Zhitao Yang Qingping Sun Atsushi Yamashita Ziwei Liu Lei Yang 38 10 0 19 Mar 2024
EgoGen: An Egocentric Synthetic Data Generator Gen Li Kai Zhao Siwei Zhang X. Lyu Mihai Dusmanu Yan Zhang Marc Pollefeys Siyu Tang EgoV VGen 26 14 0 16 Jan 2024
The Audio-Visual Conversational Graph: From an Egocentric-Exocentric Perspective Wenqi Jia Miao Liu Hao Jiang Ishwarya Ananthabhotla James M. Rehg V. Ithapu Ruohan Gao EgoV 18 6 0 20 Dec 2023
WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion Soyong Shin Juyong Kim Eni Halilaj Michael J. Black 3DH 29 67 0 12 Dec 2023
Cinematic Behavior Transfer via NeRF-based Differentiable Filming Xuekun Jiang Anyi Rao Jingbo Wang Dahua Lin Bo Dai 18 7 0 29 Nov 2023
PACE: Human and Camera Motion Estimation from in-the-wild Videos Muhammed Kocabas Ye Yuan Pavlo Molchanov Yunrong Guo Michael J. Black Otmar Hilliges Jan Kautz Umar Iqbal 3DH 26 14 0 20 Oct 2023
ROAM: Robust and Object-Aware Motion Generation Using Neural Pose Descriptors Wanyue Zhang Rishabh Dabral Thomas Leimkuhler Vladislav Golyanik Marc Habermann Christian Theobalt 22 17 0 24 Aug 2023
An Outlook into the Future of Egocentric Vision Chiara Plizzari Gabriele Goletto Antonino Furnari Siddhant Bansal Francesco Ragusa G. Farinella Dima Damen Tatiana Tommasi EgoV 32 38 0 14 Aug 2023
TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environments Yu Sun Qian Bao Wu Liu Tao Mei Michael J. Black 3DH 28 60 0 05 Jun 2023
EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensors Xinyu Yi Yuxiao Zhou Marc Habermann Vladislav Golyanik Shaohua Pan Christian Theobalt F. Xu 34 52 0 02 May 2023
Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Views Siwei Zhang Qianli Ma Yan Zhang S. Aliakbarian Darren Cosker Siyu Tang EgoV 20 25 0 12 Apr 2023
CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactions Ming Yan Xin Wang Yudi Dai Siqiu Shen Chenglu Wen Lan Xu Yuexin Ma Cheng-i Wang 21 21 0 31 Mar 2023
SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environments Yudi Dai Yi Lin Xiping Lin Chenglu Wen Lan Xu Hongwei Yi Siqiu Shen Yuexin Ma China 3DH 25 40 0 16 Mar 2023
Decoupling Human and Camera Motion from Videos in the Wild Vickie Ye Georgios Pavlakos Jitendra Malik Angjoo Kanazawa 3DH 26 83 0 24 Feb 2023
Scene-Aware 3D Multi-Human Motion Capture from a Single Camera D. Luvizon Marc Habermann Vladislav Golyanik Adam Kortylewski Christian Theobalt 3DH HAI 22 18 0 12 Jan 2023
In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation Bolin Lai Miao Liu Fiona Ryan James M. Rehg ViT 32 32 0 08 Aug 2022
The One Where They Reconstructed 3D Humans and Environments in TV Shows Georgios Pavlakos Ethan Weber Matthew Tancik Angjoo Kanazawa 3DH 43 23 0 28 Jul 2022
Self-supervised Video-centralised Transformer for Video Face Clustering Yujiang Wang Mingzhi Dong Jie Shen Yi-Si Luo Yiming Lin Pingchuan Ma Stavros Petridis M. Pantic ViT 18 3 0 24 Mar 2022
Recovering 3D Human Mesh from Monocular Images: A Survey Yating Tian Hongwen Zhang Yebin Liu Limin Wang 3DH 20 126 0 03 Mar 2022
The Wanderings of Odysseus in 3D Scenes Yan Zhang Siyu Tang 19 48 0 16 Dec 2021
EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devices Siwei Zhang Qianli Ma Yan Zhang Zhiyin Qian Taein Kwon Marc Pollefeys Federica Bogo Siyu Tang 24 92 0 14 Dec 2021
GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras Ye Yuan Umar Iqbal Pavlo Molchanov Kris M. Kitani Jan Kautz 3DH 33 114 0 02 Dec 2021
Ego4D: Around the World in 3,000 Hours of Egocentric Video Kristen Grauman Andrew Westbury Eugene Byrne Zachary Chavis Antonino Furnari ... Mike Zheng Shou Antonio Torralba Lorenzo Torresani Mingfei Yan Jitendra Malik EgoV 224 1,018 0 13 Oct 2021
SPEC: Seeing People in the Wild with an Estimated Camera Muhammed Kocabas C. Huang J. Tesch Lea Müller Otmar Hilliges Michael J. Black 3DH 24 140 0 01 Oct 2021
Physics-based Human Motion Estimation and Synthesis from Videos Kevin Xie Tingwu Wang Umar Iqbal Yunrong Guo Sanja Fidler Florian Shkurti 3DH 17 82 0 21 Sep 2021
Learning Motion Priors for 4D Human Body Capture in 3D Scenes Siwei Zhang Yan Zhang Federica Bogo Marc Pollefeys Siyu Tang 3DH 22 104 0 23 Aug 2021
Neural Free-Viewpoint Performance Rendering under Complex Human-object Interactions Guoxing Sun Xin Chen Yizhang Chen Anqi Pang Pei-Ying Lin Yuheng Jiang Lan Xu Jingya Wang Jingyi Yu 3DH 37 34 0 01 Aug 2021
Egocentric Activity Recognition and Localization on a 3D Map Miao Liu Lingni Ma Kiran Somasundaram Yin Li Kristen Grauman James M. Rehg Chao Li EgoV 14 19 0 20 May 2021
HuMoR: 3D Human Motion Model for Robust Pose Estimation Davis Rempe Tolga Birdal Aaron Hertzmann Jimei Yang Srinath Sridhar Leonidas J. Guibas 3DH 23 310 0 10 May 2021
Detecting Attended Visual Targets in Video Eunji Chong Yongxin Wang Nataniel Ruiz James M. Rehg 191 111 0 05 Mar 2020