Humans in 4D: Reconstructing and Tracking Humans with Transformers

31 May 2023

Shubham Goel

Georgios Pavlakos

Jathushan Rajasegaran

Papers citing "Humans in 4D: Reconstructing and Tracking Humans with Transformers"

50 / 139 papers shown

Title
GENMO: A GENeralist Model for Human MOtion Jiefeng Li Jinkun Cao Haotian Zhang Davis Rempe Jan Kautz Umar Iqbal Ye Yuan DiffM VGen 42 1 0 02 May 2025
ReVision: High-Quality, Low-Cost Video Generation with Explicit 3D Physics Modeling for Complex Motion and Interaction Qihao Liu Ju He Qihang Yu Liang-Chieh Chen Alan Yuille DiffM VGen 75 0 0 30 Apr 2025
Dance Style Recognition Using Laban Movement Analysis Muhammad Turab P. Colantoni Damien Muselet A. Trémeau 28 0 0 29 Apr 2025
ShowMak3r: Compositional TV Show Reconstruction S. Kim Seunguk Do Jaesik Park VGen 36 0 0 28 Apr 2025
FSBench: A Figure Skating Benchmark for Advancing Artistic Sports Understanding Rong Gao Xin Liu Zhuozhao Hu Bohao Xing Baiqiang Xia Zitong Yu H. Kalviainen 41 0 0 28 Apr 2025
PICO: Reconstructing 3D People In Contact with Objects Alpár Cseke Shashank Tripathi Sai Kumar Dwivedi Arjun Lakshmipathy Agniv Chatterjee M. Black Dimitrios Tzionas 3DH 35 1 0 24 Apr 2025
Predict-Optimize-Distill: A Self-Improving Cycle for 4D Object Understanding Mingxuan Wu Huang Huang Justin Kerr C. Kim Anthony Zhang Brent Yi Angjoo Kanazawa 48 0 0 24 Apr 2025
ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videos Zetong Zhang Manuel Kaufmann Lixin Xue Jie Song Martin R. Oswald 3DH 62 0 0 17 Apr 2025
CoMotion: Concurrent Multi-person 3D Motion Alejandro Newell Peiyun Hu Lahav Lipson Stephan R. Richter V. Koltun 3DH VOT 67 0 0 16 Apr 2025
MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices Vasco Xu Chenfeng Gao Henry Hoffmann Karan Ahuja 3DH 32 4 0 16 Apr 2025
Efficient 2D to Full 3D Human Pose Uplifting including Joint Rotations K. Ludwig Yuliia Oksymets Robin Schon Daniel Kienzle Rainer Lienhart 3DH 39 0 0 14 Apr 2025
HUMOTO: A 4D Dataset of Mocap Human Object Interactions Jiaxin Lu Chun-Hao Paul Huang Uttaran Bhattacharya Qixing Huang Yi Zhou 36 0 0 14 Apr 2025
Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates Ren Li Cong Cao Corentin Dumery Yingxuan You Hao Li Pascal Fua DiffM 3DH 28 0 0 11 Apr 2025
The Invisible EgoHand: 3D Hand Forecasting through EgoBody Pose Estimation Masashi Hatano Zhifan Zhu Hideo Saito Dima Damen EgoV 24 0 0 11 Apr 2025
PromptHMR: Promptable Human Mesh Recovery Yufu Wang Yu Sun Priyanka Patel Kostas Daniilidis Michael J. Black Muhammed Kocabas 3DH 52 0 0 08 Apr 2025
InteractVLM: 3D Interaction Reasoning from 2D Foundational Models Sai Kumar Dwivedi Dimitrije Antić Shashank Tripathi Omid Taheri Cordelia Schmid M. Black Dimitrios Tzionas 26 1 0 07 Apr 2025
DiSRT-In-Bed: Diffusion-Based Sim-to-Real Transfer Framework for In-Bed Human Mesh Recovery Jing Gao Ce Zheng László A. Jeni Zackory Erickson 3DH 37 0 0 03 Apr 2025
DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance Yuxuan Luo Zhengkun Rong Lizhen Wang Longhao Zhang Tianshu Hu Yongming Zhu VGen 65 0 0 02 Apr 2025
Articulated Kinematics Distillation from Video Diffusion Models Xuan Li Qianli Ma Tsung-Yi Lin Yongxin Chen Chenfanfu Jiang Ming-Yu Liu Donglai Xiang VGen 28 0 0 01 Apr 2025
FRAME: Floor-aligned Representation for Avatar Motion from Egocentric Video Andrea Boscolo Camiletto Jian Wang Eduardo Alvarado Rishabh Dabral Thabo Beeler Marc Habermann Christian Theobalt 36 0 0 29 Mar 2025
Uni4D: Unifying Visual Foundation Models for 4D Modeling from a Single Video David Yifan Yao Albert Zhai Shenlong Wang VGen 46 1 0 27 Mar 2025
Reconstructing Humans with a Biomechanically Accurate Skeleton Yan Xia Xiaowei Zhou E. Vouga Qixing Huang Georgios Pavlakos 3DH 41 0 0 27 Mar 2025
ClimbingCap: Multi-Modal Dataset and Method for Rock Climbing in World Coordinate Ming Yan Xincheng Lin Yuhua Luo Shuqi Fan Yudi Dai ... Yuexin Ma Lan Xu Chenglu Wen Siqi Shen Cheng-Yu Wang 54 0 0 27 Mar 2025
LATTE-MV: Learning to Anticipate Table Tennis Hits from Monocular Videos Daniel Etaat Dvij Kalaria Nima Rahmanian S. Shankar Sastry 47 0 0 26 Mar 2025
Animating the Uncaptured: Humanoid Mesh Animation with Video Diffusion Models Marc Benedí San Millán Angela Dai Matthias Nießner DiffM 67 0 0 20 Mar 2025
CHROME: Clothed Human Reconstruction with Occlusion-Resilience and Multiview-Consistency from a Single Image Arindam Dutta Meng Zheng Zhongpai Gao Benjamin Planche Anwesha Choudhuri Terrence Chen A. Roy-Chowdhury Ziyan Wu 3DH 67 1 0 19 Mar 2025
PoseSyn: Synthesizing Diverse 3D Pose Data from In-the-Wild 2D Data ChangHee Yang H. Song Seokhun Choi Seungwoo Lee Jaechul Kim Hoseok Do 43 0 0 17 Mar 2025
HumanMM: Global Human Motion Recovery from Multi-shot Videos Y. Zhang Guanlin Wu Ling-Hao Chen Zhuokai Zhao Jing Lin ... Jiamin Wu Z. Li Hao Frank Yang Haoqian Wang Lei Zhang 3DH 55 0 0 10 Mar 2025
Fish2Mesh Transformer: 3D Human Mesh Recovery from Egocentric Vision David C. Jeong Aditya Puranik James Vong Vrushabh Abhijit Deogirikar Ryan Fell Julianna Dietrich Maria Kyrarini Christopher A. Kitts EgoV 71 0 0 08 Mar 2025
PI-HMR: Towards Robust In-bed Temporal Human Shape Reconstruction with Contact Pressure Sensing Ziyu Wu Yufan Xiong Mengting Niu Fangting Xie Quan Wan Qijun Ying Boyan Liu Xiaohui Cai 3DH 33 0 0 27 Feb 2025
Semantics-aware Test-time Adaptation for 3D Human Pose Estimation Qiuxia Lin Rongyu Chen Kerui Gu Angela Yao 3DH TTA 72 0 0 15 Feb 2025
Embrace Collisions: Humanoid Shadowing for Deployable Contact-Agnostics Motions Ziwen Zhuang Hang Zhao 43 4 0 03 Feb 2025
BioPose: Biomechanically-accurate 3D Pose Estimation from Monocular Videos Farnoosh Koleini Muhammad Usama Saleem Pu Wang Hongfei Xue Ahmed Helmy Abbey Fenwick 3DH 54 1 0 14 Jan 2025
Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learning Juntao Ren Priya Sundaresan Dorsa Sadigh Sanjiban Choudhury Jeannette Bohg 37 10 0 13 Jan 2025
WorldPose: A World Cup Dataset for Global 3D Human Pose Estimation Tianjian Jiang Johsan Billingham Sebastian Müksch Juan Jose Zarate Nicolas Evans Martin R. Oswald Marc Polleyfeys Otmar Hilliges Manuel Kaufmann Jie Song 3DH 47 3 0 06 Jan 2025
Overview of MWE history, challenges, and horizons: standing at the 20th anniversary of the MWE workshop series via MWE-UD2024 Lifeng Han Kilian Evang Archna Bhatia Gosse Bouma A. Seza Doğruöz Marcos Garcia Voula Giouli Joakim Nivre Alexandre Rademacher AI4TS 33 1 0 25 Dec 2024
Learning from Massive Human Videos for Universal Humanoid Pose Control Jiageng Mao Siheng Zhao Siqi Song Tianheng Shi Junjie Ye Mingtong Zhang Haoran Geng Jitendra Malik Vitor Campagnolo Guizilini Yue Wang 85 5 0 18 Dec 2024
Human Multi-View Synthesis from a Single-View Model:Transferred Body and Face Representations Yu Feng Shunsi Zhang Jian Shu HanFeng Zhao Guoliang Pang Chi Zhang Hao Wang DiffM 65 0 0 04 Dec 2024
Crowd3D++: Robust Monocular Crowd Reconstruction with Upright Space Jing Huang Hao-Kai Wen Tianyi Zhou Haozhe Lin Yu-Kun Lai Kun Li 3DH 23 0 0 09 Nov 2024
ProGraph: Temporally-alignable Probability Guided Graph Topological Modeling for 3D Human Reconstruction Hongsheng Wang Zehui Feng Tong Xiao Genfan Yang Shengyu Zhang Fei Wu Feng Lin DiffM 3DH 33 0 0 07 Nov 2024
Argus: Multi-View Egocentric Human Mesh Reconstruction Based on Stripped-Down Wearable mmWave Add-on Di Duan Shengzhe Lyu Mu Yuan Hongfei Xue Tianxing Li Weitao Xu Kaishun Wu Guoliang Xing 24 2 0 01 Nov 2024
Masked Differential Privacy David Schneider Sina Sajadmanesh Vikash Sehwag Saquib Sarfraz Rainer Stiefelhagen Lingjuan Lyu Vivek Sharma 28 1 0 22 Oct 2024
Agent-to-Sim: Learning Interactive Behavior Models from Casual Longitudinal Videos Gengshan Yang Andrea Bajcsy Shunsuke Saito Angjoo Kanazawa VGen 32 2 0 21 Oct 2024
Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Prior Calvin-Khang Ta Arindam Dutta Rohit Kundu Rohit Lal Hannah Dela Cruz Dripta S. Raychaudhuri A. Roy-Chowdhury DiffM 18 3 0 18 Oct 2024
OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitation Jinhan Li Yifeng Zhu Yuqi Xie Zhenyu Jiang Mingyo Seo Georgios Pavlakos Yuke Zhu LM&Ro 23 31 0 15 Oct 2024
Look Ma, no markers: holistic performance capture without the hassle Charlie Hewitt F. Saleh S. Aliakbarian Lohit Petikam Shideh Rezaeifar ... Zafiirah Hosenie T. Cashman Julien P. C. Valentin Darren Cosker T. Baltrušaitis 3DH 18 3 0 15 Oct 2024
X-Fi: A Modality-Invariant Foundation Model for Multimodal Human Sensing Xinyan Chen Jianfei Yang 28 0 0 14 Oct 2024
ToMiE: Towards Modular Growth in Enhanced SMPL Skeleton for 3D Human with Animatable Garments Yifan Zhan Qingtian Zhu Muyao Niu Mingze Ma Jiancheng Zhao Zhihang Zhong Xiao Sun Yu Qiao Yinqiang Zheng 3DH 26 1 0 10 Oct 2024
ELMO: Enhanced Real-time LiDAR Motion Capture through Upsampling Deok-Kyeong Jang Dongseok Yang Deok-Yun Jang Byeoli Choi Donghoon Shin Sung-Hee Lee 23 1 0 09 Oct 2024
D-PoSE: Depth as an Intermediate Representation for 3D Human Pose and Shape Estimation Nikolaos Vasilikopoulos Drosakis Drosakis Antonis Argyros 3DH 19 0 0 07 Oct 2024