Humans in 4D: Reconstructing and Tracking Humans with Transformers

31 May 2023

Shubham Goel

Georgios Pavlakos

Jathushan Rajasegaran

Papers citing "Humans in 4D: Reconstructing and Tracking Humans with Transformers"

50 / 139 papers shown

Title
Estimating Body and Hand Motion in an Ego-sensed World Brent Yi Vickie Ye Maya Zheng Lea Müller Georgios Pavlakos Yi Ma Jitendra Malik Angjoo Kanazawa DiffM 42 6 0 04 Oct 2024
Dessie: Disentanglement for Articulated 3D Horse Shape and Pose Estimation from Images Ci Li Yi Yang Zehang Weng Elin Hernlund Silvia Zuffi Hedvig Kjellström 28 3 0 04 Oct 2024
Ask, Pose, Unite: Scaling Data Acquisition for Close Interactions with Vision Language Models Laura Bravo Sánchez Jaewoo Heo Zhenzhen Weng Kuan-Chieh Jackson Wang Serena Yeung-Levy 3DH 19 0 0 01 Oct 2024
DressRecon: Freeform 4D Human Reconstruction from Monocular Video Jeff Tan Donglai Xiang Shubham Tulsiani Deva Ramanan Gengshan Yang 3DH 16 3 0 30 Sep 2024
Leveraging Anthropometric Measurements to Improve Human Mesh Estimation and Ensure Consistent Body Shapes K. Ludwig Julian Lorenz Daniel Kienzle Tuan Bui Rainer Lienhart 3DH 40 1 0 26 Sep 2024
MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modeling Yifang Men Yuan Yao Miaomiao Cui Liefeng Bo DiffM 16 16 0 24 Sep 2024
Unimotion: Unifying 3D Human Motion Synthesis and Understanding Chuqiao Li Julian Chibane Yannan He Naama Pearl Andreas Geiger Gerard Pons-Moll VGen 38 8 0 24 Sep 2024
WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild Rolandos Alexandros Potamias Jinglei Zhang Jiankang Deng S. Zafeiriou 3DH 23 10 0 18 Sep 2024
WheelPoser: Sparse-IMU Based Body Pose Estimation for Wheelchair Users Yunzhi Li Vimal Mollyn Kuang Yuan Patrick Carrington 22 2 0 13 Sep 2024
World-Grounded Human Motion Recovery via Gravity-View Coordinates Zehong Shen Huaijin Pi Yan Xia Zhi Cen Sida Peng Zechen Hu Hujun Bao Ruizhen Hu Xiaowei Zhou VGen 29 14 0 10 Sep 2024
PoseEmbroider: Towards a 3D, Visual, Semantic-aware Human Pose Representation Ginger Delmas Philippe Weinzaepfel Francesc Moreno-Noguer Grégory Rogez 27 2 0 10 Sep 2024
Synergy and Synchrony in Couple Dances V. Maluleke Lea Müller Jathushan Rajasegaran Georgios Pavlakos Shiry Ginosar Angjoo Kanazawa Jitendra Malik 32 2 0 06 Sep 2024
GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformers Lorenza Prospero Abdullah Hamdi João F. Henriques Christian Rupprecht 3DGS 29 2 0 06 Sep 2024
MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifolds Ziqiang Dang Tianxing Fan Boming Zhao Xujie Shen Lei Wang Guofeng Zhang Zhaopeng Cui 3DH 29 0 0 01 Sep 2024
COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation Jiefeng Li Ye Yuan Davis Rempe Haotian Zhang Pavlo Molchanov Cewu Lu Jan Kautz Umar Iqbal DiffM VGen 29 2 0 29 Aug 2024
OmniRe: Omni Urban Scene Reconstruction Ziyu Chen Jiawei Yang Jiahui Huang Riccardo de Lutio Janick Martinez Esturo ... Zan Gojcic Sanja Fidler Marco Pavone Li-Na Song Yue Wang 31 32 0 29 Aug 2024
Are Pose Estimators Ready for the Open World? STAGE: Synthetic Data Generation Toolkit for Auditing 3D Human Pose Estimators Nikita Kister István Sárándi Anna Khoreva Gerard Pons-Moll 49 0 0 28 Aug 2024
ExpertAF: Expert Actionable Feedback from Video Kumar Ashutosh Tushar Nagarajan Georgios Pavlakos Kris M. Kitani Kristen Grauman VGen 42 2 0 01 Aug 2024
Monocular Occupancy Prediction for Scalable Indoor Scenes Hongxiao Yu Yu-Quan Wang Yuntao Chen Zhaoxiang Zhang 61 6 0 16 Jul 2024
iHuman: Instant Animatable Digital Humans From Monocular Videos Pramish Paudel Anubhav Khanal Ajad Chhatkuli D. Paudel Jyoti Tandukar 3DGS 28 5 0 15 Jul 2024
Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mamba Haoye Dong Aviral Chharia Wenbo Gou Francisco Vicente Carrasco Fernando De la Torre Mamba 47 1 0 12 Jul 2024
MIGS: Multi-Identity Gaussian Splatting via Tensor Decomposition Aggelina Chatziagapi Grigorios G. Chrysos Dimitris Samaras 3DGS 19 1 0 10 Jul 2024
TAPVid-3D: A Benchmark for Tracking Any Point in 3D Skanda Koppula Ignacio Rocco Yi Yang Joe Heyward João Carreira Andrew Zisserman Gabriel J. Brostow Carl Doersch 39 14 0 08 Jul 2024
E.T. the Exceptional Trajectories: Text-to-camera-trajectory generation with character awareness Robin Courant Nicolas Dufour Xi Wang Marc Christie Vicky Kalogeiton VGen 31 4 0 01 Jul 2024
OccFusion: Rendering Occluded Humans with Generative Diffusion Priors Adam Sun Tiange Xiang Scott Delp Li Fei-Fei Ehsan Adeli 29 2 0 29 Jun 2024
Automatic infant 2D pose estimation from videos: comparing seven deep neural network methods Filipe Gama Matej Misar Lukas Navara S. T. Popescu Matej Hoffmann 3DH 36 2 0 25 Jun 2024
SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking Tianhong Catherine Yu Manru Zhang Peter He Chi-Jung Lee Cassidy Cheesman Saif Mahmud Ruidong Zhang François Guimbretière Cheng Zhang 20 2 0 17 Jun 2024
MeshPose: Unifying DensePose and 3D Body Mesh reconstruction Eric-Tuan Lê Antonis Kakolyris Petros Koutras Himmy Tam Efstratios Skordos George Papandreou Rıza Alp Güler Iasonas Kokkinos CVBM 3DH 25 2 0 14 Jun 2024
Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wild Lingni Ma Yuting Ye Fangzhou Hong Vladimir Guzov Yifeng Jiang ... C. Karen Liu Ziwei Liu Jakob Engel R. D. Nardi Richard A. Newcombe 32 21 0 14 Jun 2024
4M-21: An Any-to-Any Vision Model for Tens of Tasks and Modalities Roman Bachmann Oğuzhan Fatih Kar David Mizrahi Ali Garjani Mingfei Gao David Griffiths Jiaming Hu Afshin Dehghan Amir Zamir MoE VLM MLLM 28 14 0 13 Jun 2024
A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation Ruihe Wang Yukang Cao Kai Han Kwan-Yee K. Wong 42 5 0 06 Jun 2024
MEGA: Masked Generative Autoencoder for Human Mesh Recovery Guénolé Fiche Simon Leglaive Xavier Alameda-Pineda Francesc Moreno-Noguer 3DH 54 1 0 29 May 2024
Towards Open Domain Text-Driven Synthesis of Multi-Person Motions Mengyi Shan Lu Dong Yutao Han Yuanyuan Yao Tao Liu Ifeoma Nwogu Guo-Jun Qi Mitch Hill VGen DiffM 30 9 0 28 May 2024
Synergistic Global-space Camera and Human Reconstruction from Videos Yizhou Zhao Tuanfeng Y. Wang Bhiksha Raj Min Xu Jimei Yang Chun-Hao Paul Huang 3DGS 3DH 38 1 0 23 May 2024
S3O: A Dual-Phase Approach for Reconstructing Dynamic Shape and Skeleton of Articulated Objects from Single Monocular Video Hao Zhang Fang Li Samyak Rawlekar Narendra Ahuja 29 5 0 21 May 2024
AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale Keenon Werling Janelle Kaneda Alan Tan Rishi G. Agarwal Six Skov ... E. Preatoni Benjamin Fregly Jennifer Hicks Scott L. Delp C. Karen Liu 3DH 29 4 0 16 May 2024
Towards Unstructured Unlabeled Optical Mocap: A Video Helps! Nicholas Milef John Keyser Shu Kong 28 0 0 15 May 2024
ChatHuman: Language-driven 3D Human Understanding with Retrieval-Augmented Tool Reasoning Jing Lin Yao Feng Weiyang Liu Michael J. Black 3DH LRM 40 5 0 07 May 2024
Pose Priors from Language Models Sanjay Subramanian Evonne Ng Lea Muller Dan Klein Shiry Ginosar Trevor Darrell 36 3 0 06 May 2024
TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representation Sai Kumar Dwivedi Yu Sun Priyanka Patel Yao Feng Michael J. Black 3DH 42 26 0 25 Apr 2024
Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpses Inhee Lee Byungjun Kim Hanbyul Joo 3DGS 52 5 0 22 Apr 2024
MultiPhys: Multi-Person Physics-aware 3D Motion Estimation Nicolas Ugrinovic Boxiao Pan Georgios Pavlakos Despoina Paschalidou Bokui Shen Jordi Sánchez-Riera Francesc Moreno-Noguer Leonidas J. Guibas 3DH 29 3 0 18 Apr 2024
Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaption Buzhen Huang Chen Li Chongyang Xu Liang Pan Yangang Wang Gim Hee Lee 33 2 0 17 Apr 2024
Spatial Cognition from Egocentric Video: Out of Sight, Not Out of Mind Chiara Plizzari Shubham Goel Toby Perrett Jacob Chalk Angjoo Kanazawa Dima Damen 26 10 0 07 Apr 2024
PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos Yufei Zhang Jeffrey O. Kephart Zijun Cui Qiang Ji ViT 24 6 0 05 Apr 2024
AWOL: Analysis WithOut synthesis using Language Silvia Zuffi Michael J. Black 36 2 0 03 Apr 2024
LPSNet: End-to-End Human Pose and Shape Estimation with Lensless Imaging Haoyang Ge Qiao Feng Hailong Jia Xiongzheng Li Xiangjun Yin You Zhou Jingyu Yang Kun-Jhih Li 3DH 18 2 0 02 Apr 2024
MotionChain: Conversational Motion Controllers via Multimodal Prompts Biao Jiang Xin Chen C. Zhang Fukun Yin Zhuoyuan Li Gang Yu Jiayuan Fan VGen LRM 21 10 0 02 Apr 2024
WALT3D: Generating Realistic Training Data from Time-Lapse Imagery for Reconstructing Dynamic Objects under Occlusion Khiem Vuong N. D. Reddy R. Tamburo S. Narasimhan 24 1 0 27 Mar 2024
TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos Yufu Wang ZiYun Wang Lingjie Liu Kostas Daniilidis 37 25 0 26 Mar 2024