Humans in 4D: Reconstructing and Tracking Humans with Transformers

31 May 2023

Shubham Goel

Georgios Pavlakos

Jathushan Rajasegaran

Papers citing "Humans in 4D: Reconstructing and Tracking Humans with Transformers"

39 / 139 papers shown

Title
Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videos Remy Sabathier Niloy J. Mitra David Novotny 3DH VGen 24 5 0 25 Mar 2024
Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance Shenhao Zhu Junming Leo Chen Zuozhuo Dai Qingkun Su Yinghui Xu Xun Cao Yao Yao Hao Zhu Siyu Zhu 3DH VGen 32 96 0 21 Mar 2024
PostoMETRO: Pose Token Enhanced Mesh Transformer for Robust 3D Human Mesh Recovery Wendi Yang Zihang Jiang Shang Zhao S. Kevin Zhou 33 0 0 19 Mar 2024
Human Mesh Recovery from Arbitrary Multi-view Images Xiaoben Li Mancheng Meng Ziyan Wu Terrence Chen Fan Yang Dinggang Shen 29 1 0 19 Mar 2024
Score-Guided Diffusion for 3D Human Recovery Anastasis Stathopoulos Ligong Han Dimitris N. Metaxas 31 18 0 14 Mar 2024
CLOAF: CoLlisiOn-Aware Human Flow Andrey Davydov Martin Engilberge Mathieu Salzmann Pascal Fua 3DH 25 1 0 14 Mar 2024
Multi-Human Mesh Recovery with Transformers Zeyu Wang Zhenzhen Weng Serena Yeung-Levy 3DH 19 1 0 26 Feb 2024
Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shot Fabien Baradel M. Armando Salma Galaaoui Romain Brégier Philippe Weinzaepfel Grégory Rogez Thomas Lucas 3DH 33 18 0 22 Feb 2024
Making Short-Form Videos Accessible with Hierarchical Video Summaries Tess Van Daele Akhil Iyer Yuning Zhang Jalyn C. Derry Mina Huh Amy Pavel 14 17 0 16 Feb 2024
DivaTrack: Diverse Bodies and Motions from Acceleration-Enhanced Three-Point Trackers Dongseok Yang Jiho Kang Lingni Ma Joseph Greer Yuting Ye Sung-Hee Lee 14 8 0 14 Feb 2024
Using Motion Cues to Supervise Single-Frame Body Pose and Shape Estimation in Low Data Regimes Andrey Davydov Alexey Sidnev A. Sanakoyeu Yuhua Chen Mathieu Salzmann Pascal Fua 3DH 19 0 0 05 Feb 2024
Synthesizing Moving People with 3D Control Boyi Li Jathushan Rajasegaran Yossi Gandelsman Alexei A. Efros Jitendra Malik VGen DiffM 33 1 0 19 Jan 2024
RoHM: Robust Human Motion Reconstruction via Diffusion Siwei Zhang Bharat Lal Bhatnagar Yuanlu Xu Alexander Winkler Petr Kadlecek Siyu Tang Federica Bogo DiffM 17 17 0 16 Jan 2024
Learning the 3D Fauna of the Web Zizhang Li Dor Litvak Ruining Li Yunzhi Zhang Tomas Jakab Christian Rupprecht Shangzhe Wu Andrea Vedaldi Jiajun Wu 28 22 0 04 Jan 2024
Mocap Everyone Everywhere: Lightweight Motion Capture With Smartwatches and a Head-Mounted Camera Jiye Lee Hanbyul Joo 23 15 0 01 Jan 2024
Wild2Avatar: Rendering Humans Behind Occlusions Tiange Xiang Adam Sun Scott Delp Kazuki Kozuka Fei-Fei Li Ehsan Adeli 19 3 0 31 Dec 2023
EnchantDance: Unveiling the Potential of Music-Driven Dance Movement Bo Han Yi Ren Hao Peng Teng Zhang Zeyu Ling Xiang Yin Feilin Han 11 3 0 26 Dec 2023
Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Rendering Youwang Kim Tae-Hyun Oh Gerard Pons-Moll DiffM 17 46 0 18 Dec 2023
VQ-HPS: Human Pose and Shape Estimation in a Vector-Quantized Latent Space Guénolé Fiche Simon Leglaive Xavier Alameda-Pineda Antonio Agudo Francesc Moreno-Noguer 21 5 0 13 Dec 2023
WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion Soyong Shin Juyong Kim Eni Halilaj Michael J. Black 3DH 29 66 0 12 Dec 2023
ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimation Cédric Rommel Victor Letzelter Nermin Samet Renaud Marlet Matthieu Cord Patrick Pérez Eduardo Valle 3DH 25 0 0 11 Dec 2023
Reconstructing Hands in 3D with Transformers Georgios Pavlakos Dandan Shan Ilija Radosavovic Angjoo Kanazawa David Fouhey Jitendra Malik 3DH 11 95 0 08 Dec 2023
ChatPose: Chatting about 3D Human Pose Yao Feng Jing Lin Sai Kumar Dwivedi Yu Sun Priyanka Patel Michael J. Black 3DH 23 34 0 30 Nov 2023
HUGS: Human Gaussian Splats Muhammed Kocabas Jen-Hao Rick Chang J. Gabriel Oncel Tuzel Anurag Ranjan 3DGS 28 90 0 29 Nov 2023
HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion Jingbo Zhang Xiaoyu Li Qi Zhang Yan-Pei Cao Ying Shan Jing Liao 22 8 0 28 Nov 2023
GART: Gaussian Articulated Template Models Jiahui Lei Yufu Wang Georgios Pavlakos Lingjie Liu Kostas Daniilidis 3DGS 23 71 0 27 Nov 2023
Weakly-Supervised 3D Reconstruction of Clothed Humans via Normal Maps Jane Wu Diego Thomas Ronald Fedkiw 3DH 22 1 0 27 Nov 2023
Enhanced Spatio-Temporal Context for Temporally Consistent Robust 3D Human Motion Recovery from Monocular Videos Sushovan Chanda Amogh Tiwari Lokender Tiwari Brojeshwar Bhowmick Avinash Sharma H. Barua 3DH 19 0 0 20 Nov 2023
LRM: Large Reconstruction Model for Single Image to 3D Yicong Hong Kai Zhang Jiuxiang Gu Sai Bi Yang Zhou Difan Liu Feng Liu Kalyan Sunkavalli Trung Bui Hao Tan 3DV 3DH 28 411 0 08 Nov 2023
HAP: Structure-Aware Masked Image Modeling for Human-Centric Perception Junkun Yuan Xinyu Zhang Hao Zhou Jian Wang Zhongwei Qiu ... Junyu Han Errui Ding Lanfen Lin Fei Wu Jingdong Wang 23 18 0 31 Oct 2023
SportsSloMo: A New Benchmark and Baselines for Human-centric Video Frame Interpolation Jiaben Chen Huaizu Jiang 3DH 27 6 0 31 Aug 2023
Generative Proxemics: A Prior for 3D Social Interaction from Images Lea Müller Vickie Ye Georgios Pavlakos Michael J. Black Angjoo Kanazawa DiffM 31 26 0 15 Jun 2023
HybrIK-X: Hybrid Analytical-Neural Inverse Kinematics for Whole-body Mesh Recovery Jiefeng Li Siyuan Bian Chaoshun Xu Zhicun Chen Lixin Yang Cewu Lu 3DH 15 33 0 12 Apr 2023
On the Benefits of 3D Pose and Tracking for Human Action Recognition Jathushan Rajasegaran Georgios Pavlakos Angjoo Kanazawa Christoph Feichtenhofer Jitendra Malik 26 30 0 03 Apr 2023
Recovering 3D Human Mesh from Monocular Images: A Survey Yating Tian Hongwen Zhang Yebin Liu Limin Wang 3DH 20 125 0 03 Mar 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,337 0 11 Nov 2021
TrackFormer: Multi-Object Tracking with Transformers Tim Meinhardt A. Kirillov Laura Leal-Taixe Christoph Feichtenhofer VOT 208 732 0 07 Jan 2021
Pose And Joint-Aware Action Recognition Anshul B. Shah Shlok Kumar Mishra Ankan Bansal Jun-Cheng Chen Ramalingam Chellappa Abhinav Shrivastava 31 32 0 16 Oct 2020
Shape and Viewpoint without Keypoints Shubham Goel Angjoo Kanazawa Jitendra Malik 3DV 86 108 0 21 Jul 2020