Effective Whole-body Pose Estimation with Two-stages Distillation

29 July 2023

Zhendong Yang

Ailing Zeng

Chun Yuan

Yu Li

ArXiv PDF HTML

Papers citing "Effective Whole-body Pose Estimation with Two-stages Distillation"

50 / 111 papers shown

Title
GUNet: A Graph Convolutional Network United Diffusion Model for Stable and Diversity Pose Generation Shuowen Liang Sisi Li Qingyun Wang Cen Zhang Kaiquan Zhu Tian Yang DiffM 18 0 0 18 Sep 2024
Adaptive Multi-Modal Control of Digital Human Hand Synthesis Using a Region-Aware Cycle Loss Qifan Fu Xiaohang Yang Muhammad Asad Changjae Oh Shanxin Yuan Gregory Slabaugh 35 2 0 13 Sep 2024
RealisDance: Equip controllable character animation with realistic hands Jingkai Zhou Benzhi Wang Weihua Chen Jingqi Bai Dongyang Li Aixi Zhang Hao Xu Mingyang Yang F. Wang 14 10 0 10 Sep 2024
RealisHuman: A Two-Stage Approach for Refining Malformed Human Parts in Generated Images Benzhi Wang Jingkai Zhou Jingqi Bai Yang Yang Weihua Chen F. Wang Zhen Lei DiffM 18 2 0 05 Sep 2024
CyberHost: Taming Audio-driven Avatar Diffusion Model with Region Codebook Attention Gaojie Lin Jianwen Jiang Chao Liang Tianyun Zhong Jiaqi Yang Yanbo Zheng VGen DiffM 58 13 0 03 Sep 2024
SCOPE: Sign Language Contextual Processing with Embedding from LLMs Yuqi Liu Wenqian Zhang Sihan Ren Chengyu Huang Jingyi Yu Lan Xu SLR 38 0 0 02 Sep 2024
3D Pose-Based Temporal Action Segmentation for Figure Skating: A Fine-Grained and Jump Procedure-Aware Annotation Approach Ryota Tanaka Tomohiro Suzuki Keisuke Fujii 30 2 0 29 Aug 2024
Alignment is All You Need: A Training-free Augmentation Strategy for Pose-guided Video Generation Xiaoyu Jin Zunnan Xu Mingwen Ou Wenming Yang DiffM 38 7 0 29 Aug 2024
MegActor- $Σ$ : Unlocking Flexible Mixed-Modal Control in Portrait Animation with Diffusion Transformer Shurong Yang Huadong Li Juhao Wu Minhao Jing Linze Li Renhe Ji Jiajun Liang Haoqiang Fan Jin Wang VGen DiffM 35 9 0 27 Aug 2024
Sapiens: Foundation for Human Vision Models Rawal Khirodkar Timur M. Bagautdinov Julieta Martinez Su Zhaoen Austin James Peter Selednik Stuart Anderson Shunsuke Saito VLM 31 63 0 22 Aug 2024
VTON-HandFit: Virtual Try-on for Arbitrary Hand Pose Guided by Hand Priors Embedding Yujie Liang Xiaobin Hu Boyuan Jiang Donghao Luo Kai WU Wenhui Han Taisong Jin Chengjie Wang DiffM 27 2 0 22 Aug 2024
Body of Her: A Preliminary Study on End-to-End Humanoid Agent Tenglong Ao LM&Ro 18 1 0 06 Aug 2024
HumanVid: Demystifying Training Data for Camera-controllable Human Image Animation Zhenzhi Wang Yixuan Li Yanhong Zeng Youqing Fang Yuwei Guo ... Jing Tan Kai Chen Tianfan Xue Bo Dai Dahua Lin VGen 3DH 35 17 0 24 Jul 2024
IDOL: Unified Dual-Modal Latent Diffusion for Human-Centric Joint Video-Depth Generation Yuanhao Zhai K. Lin Linjie Li Chung-Ching Lin Jianfeng Wang Zhengyuan Yang David Doermann Junsong Yuan Zicheng Liu Lijuan Wang DiffM VGen 16 3 0 15 Jul 2024
GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimation Haonan Wang Jie Liu Jie Tang Gangshan Wu Bo Xu Y. Kevin Chou Yong Wang ViT 27 2 0 15 Jul 2024
TCAN: Animating Human Images with Temporally Consistent Pose Guidance using Diffusion Models J. Kim Min-Jung Kim Junsoo Lee Jaegul Choo DiffM 29 5 0 12 Jul 2024
RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimation Tao Jiang Xinchen Xie Yining Li 3DH 33 2 0 11 Jul 2024
A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insights Wentao Lei Jinting Wang Fengji Ma Guanjie Huang Li Liu VGen EGVM 60 8 0 11 Jul 2024
Behavioural gap assessment of human-vehicle interaction in real and virtual reality-based scenarios in autonomous driving Sergio Martín Serrano R. Izquierdo Iván García Daza Miguel Ángel Sotelo David Fernández Llorca 16 2 0 04 Jul 2024
Expressive Gaussian Human Avatars from Monocular RGB Video Hezhen Hu Zhiwen Fan Tianhao Wu Yihan Xi Seoyoung Lee Georgios Pavlakos Zhangyang Wang 3DGS VGen 26 3 0 03 Jul 2024
MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance Yuang Zhang Jiaxi Gu Li-Wen Wang Han Wang Junqi Cheng Yuefeng Zhu Fangyuan Zou VGen 55 64 0 28 Jun 2024
Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation Y. Ma Hongyu Liu H. Wang Heng Pan Yingqing He ... Ailing Zeng Chengfei Cai H. Shum W. Liu Qifeng Chen 29 52 0 04 Jun 2024
UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation Xiang Wang Shiwei Zhang Changxin Gao Jiayu Wang Xiaoqiang Zhou Yingya Zhang Luxin Yan Nong Sang VGen 62 29 0 03 Jun 2024
MegActor: Harness the Power of Raw Video for Vivid Portrait Animation Shurong Yang Huadong Li Juhao Wu Minhao Jing Linze Li Renhe Ji Jiajun Liang Haoqiang Fan DiffM VGen 14 14 0 31 May 2024
MotionFollower: Editing Video Motion via Lightweight Score-Guided Diffusion Shuyuan Tu Qi Dai Zihao Zhang Sicheng Xie Zhi-Qi Cheng Chong Luo Xintong Han Zuxuan Wu Yu-Gang Jiang DiffM VGen 23 10 0 30 May 2024
MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model Muyao Niu Xiaodong Cun Xintao Wang Yong Zhang Ying Shan Yinqiang Zheng DiffM VGen 33 30 0 30 May 2024
Estimating Human Poses Across Datasets: A Unified Skeleton and Multi-Teacher Distillation Approach Muhammad Gul Zain Ali Khan Dhavalkumar Limbachiya Didier Stricker Muhammad Zeshan Afzal 3DH 16 0 0 30 May 2024
AnyFit: Controllable Virtual Try-on for Any Combination of Attire Across Any Scenario Yuhan Li Hao Zhou Wenxiang Shang Ran Lin Xuanhong Chen Bingbing Ni DiffM 16 3 0 28 May 2024
VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation Qilin Wang Zhengkai Jiang Chengming Xu Jiangning Zhang Yabiao Wang Xinyi Zhang Yunkang Cao Weijian Cao Chengjie Wang Yanwei Fu VGen 19 9 0 28 May 2024
Disentangling Foreground and Background Motion for Enhanced Realism in Human Video Generation Jinlin Liu Kai Yu Mengyang Feng Xiefan Guo Miaomiao Cui DiffM 37 3 0 26 May 2024
Autonomous Quilt Spreading for Caregiving Robots Yuchun Guo Zhiqing Lu Yanling Zhou Xin Jiang 19 0 0 24 May 2024
PoseCrafter: One-Shot Personalized Video Synthesis Following Flexible Pose Control Yong Zhong Min Zhao Zebin You Xiaofeng Yu Changwang Zhang Chongxuan Li DiffM 26 6 0 23 May 2024
AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movements Calvin Yeung Kenjiro Ide Keisuke Fujii 3DH 19 7 0 20 May 2024
Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warping Tianhao Wu Jing Yang Zhilin Guo Jingyi Wan Fangcheng Zhong Cengiz Öztireli 3DGS 42 1 0 20 May 2024
Cross-Domain Knowledge Distillation for Low-Resolution Human Pose Estimation Zejun Gu Zhongming Zhao Henghui Ding Hao Shen Zhao Zhang De-Shuang Huang 30 0 0 19 May 2024
Focus on Low-Resolution Information: Multi-Granular Information-Lossless Model for Low-Resolution Human Pose Estimation Zejun Gu Zhongqiu Zhao Hao Shen Zhao Zhang 3DH 25 1 0 19 May 2024
From Parts to Whole: A Unified Reference Framework for Controllable Human Image Generation Zehuan Huang Hongxing Fan Lipeng Wang Lu Sheng DiffM 18 10 0 23 Apr 2024
PhysAvatar: Learning the Physics of Dressed 3D Avatars from Visual Observations Yang Zheng Qingqing Zhao Guandao Yang Wang Yifan Donglai Xiang ... Dmitry Lagun Thabo Beeler Federico Tombari Leonidas J. Guibas Gordon Wetzstein AI4CE 33 17 0 05 Apr 2024
DiffBody: Human Body Restoration by Imagining with Generative Diffusion Prior Yiming Zhang Zhe Wang Xinjie Li Yunchen Yuan Chengsong Zhang Xiao Sun Zhihang Zhong Jian Wang DiffM 31 0 0 04 Apr 2024
Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Model Xu He Qiaochu Huang Zhensong Zhang Zhiwei Lin Zhiyong Wu Sicheng Yang Minglei Li Zhiyi Chen Songcen Xu Xiaofei Wu 18 15 0 02 Apr 2024
Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance Shenhao Zhu Junming Leo Chen Zuozhuo Dai Qingkun Su Yinghui Xu Xun Cao Yao Yao Hao Zhu Siyu Zhu 3DH VGen 32 96 0 21 Mar 2024
Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignment Mengting Chen Xi Chen Zhonghua Zhai Chen Ju Xuewen Hong Jinsong Lan Shuai Xiao OOD DiffM 33 21 0 19 Mar 2024
TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generation Yufei Liu Junwei Zhu Junshu Tang Shijie Zhang Jiangning Zhang Weijian Cao Chengjie Wang Yunsheng Wu Dongjin Huang 31 8 0 19 Mar 2024
AnimateDiff-Lightning: Cross-Model Diffusion Distillation Shanchuan Lin Xiao Yang DiffM VGen 24 18 0 19 Mar 2024
Grounded SAM: Assembling Open-World Models for Diverse Visual Tasks Tianhe Ren Shilong Liu Ailing Zeng Jing Lin Kunchang Li ... Feng Li Jie-jin Yang Hongyang Li Qing Jiang Lei Zhang VLM 35 358 0 25 Jan 2024
LEMON: Learning 3D Human-Object Interaction Relation from 2D Images Yuhang Yang Wei Zhai Hongcheng Luo Yang Cao Zheng-Jun Zha 16 22 0 14 Dec 2023
DreaMoving: A Human Video Generation Framework based on Diffusion Models Mengyang Feng Jinlin Liu Kai Yu Yuan Yao Zheng Hui ... Xiaoyang Kang Biwen Lei Miaomiao Cui Peiran Ren Xuansong Xie VGen 25 25 0 08 Dec 2023
HandDiffuse: Generative Controllers for Two-Hand Interactions via Diffusion Models Pei-Ying Lin Sihang Xu Hongdi Yang Yiran Liu Xin Chen Jingya Wang Jingyi Yu Lan Xu 32 9 0 08 Dec 2023
Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation Liucheng Hu Xin Gao Peng Zhang Ke Sun Bang Zhang Liefeng Bo DiffM VGen 28 329 0 28 Nov 2023
MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model Zhongcong Xu Jianfeng Zhang Jun Hao Liew Hanshu Yan Jia-Wei Liu Chenxu Zhang Jiashi Feng Mike Zheng Shou VGen DiffM 22 183 0 27 Nov 2023