MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators

19 June 2023

Di Huang

Qi Chu

Wanli Ouyang

Papers citing "MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators"

36 / 86 papers shown

Title
Text-controlled Motion Mamba: Text-Instructed Temporal Grounding of Human Motion Xinghan Wang Zixi Kang Yadong Mu Mamba 28 6 0 17 Apr 2024
Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions Leena Mathur Paul Pu Liang Louis-Philippe Morency LLMAG 25 6 0 17 Apr 2024
Exploring Text-to-Motion Generation with Human Preference Jenny Sheng Matthieu Lin Andrew Zhao Kevin Pruvost Yu-Hui Wen Yangguang Li Gao Huang Yong-Jin Liu VGen 16 1 0 15 Apr 2024
Large Motion Model for Unified Multi-Modal Motion Generation Mingyuan Zhang Daisheng Jin Chenyang Gu Fangzhou Hong Zhongang Cai ... Chongzhi Zhang Xinying Guo Lei Yang Ying He Ziwei Liu VGen 45 19 0 01 Apr 2024
LLMs are Good Action Recognizers Haoxuan Qu Yujun Cai Jun Liu 32 15 0 31 Mar 2024
InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction Sirui Xu Ziyin Wang Yu-Xiong Wang Liangyan Gui 34 24 0 28 Mar 2024
GPT-Connect: Interaction between Text-Driven Human Motion Generator and 3D Scenes in a Training-free Manner Haoxuan Qu Ziyan Guo Jun Liu VGen 27 3 0 22 Mar 2024
CoMo: Controllable Motion Generation through Language Guided Pose Code Editing Yiming Huang Weilin Wan Yue Yang Chris Callison-Burch Mark Yatskar Lingjie Liu 18 21 0 20 Mar 2024
AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agents Jieming Cui Tengyu Liu Nian Liu Yaodong Yang Yixin Zhu Siyuan Huang 32 7 0 19 Mar 2024
FG-MDM: Towards Zero-Shot Human Motion Generation via Fine-Grained Descriptions Xu Shi Wei Yao Chuanchen Luo Junran Peng Hongwen Zhang Yunlian Sun VGen 21 4 0 05 Dec 2023
EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generation Wenyang Zhou Zhiyang Dou Zeyu Cao Zhouyingcheng Liao Jingbo Wang Wenjia Wang Yuan-Bin Liu Taku Komura Wenping Wang Lingjie Liu VGen 18 47 0 04 Dec 2023
Hulk: A Universal Knowledge Translator for Human-Centric Tasks Yizhou Wang YiXuan Wu Shixiang Tang Weizhen He Xun Guo ... Lei Bai Rui Zhao Jian Wu Tong He Wanli Ouyang VLM 23 14 0 04 Dec 2023
MoMask: Generative Masked Modeling of 3D Human Motions Chuan Guo Yuxuan Mu Muhammad Gohar Javed Sen Wang Li Cheng VGen 13 113 0 29 Nov 2023
Generative Hierarchical Temporal Transformer for Hand Action Recognition and Motion Prediction Yilin Wen Hao Pan Takehiko Ohkawa Lei Yang Jia Pan Yoichi Sato Taku Komura Wenping Wang 28 0 0 29 Nov 2023
AvatarGPT: All-in-One Framework for Motion Understanding, Planning, Generation and Beyond Zixiang Zhou Yu Wan Baoyuan Wang 8 31 0 28 Nov 2023
SemanticBoost: Elevating Motion Generation with Augmented Textual Cues Xin He Shaoli Huang Xiaohang Zhan Chao Wen Ying Shan 23 4 0 31 Oct 2023
Frozen Transformers in Language Models Are Effective Visual Encoder Layers Ziqi Pang Ziyang Xie Yunze Man Yu-xiong Wang 38 12 0 19 Oct 2023
OmniControl: Control Any Joint at Any Time for Human Motion Generation Yiming Xie Varun Jampani Lei Zhong Deqing Sun Huaizu Jiang DiffM 19 108 0 12 Oct 2023
Universal Humanoid Motion Representations for Physics-Based Control Zhengyi Luo Jinkun Cao Josh Merel Alexander W. Winkler Jing Huang Kris M. Kitani Weipeng Xu 16 11 0 06 Oct 2023
LLMR: Real-time Prompting of Interactive Worlds using Large Language Models Fernanda De La Torre Cathy Mengying Fang Han Huang Andrzej Banburski-Fahey Judith Amores Fernandez Jaron Lanier 19 45 0 21 Sep 2023
What is the Best Automated Metric for Text to Motion Generation? Jordan Voas Yili Wang Qixing Huang Raymond Mooney EGVM 23 12 0 19 Sep 2023
Unified Human-Scene Interaction via Prompted Chain-of-Contacts Zeqi Xiao Tai Wang Jingbo Wang Jinkun Cao Wenwei Zhang Bo Dai Dahua Lin Jiangmiao Pang 28 64 0 14 Sep 2023
UbiPhysio: Support Daily Functioning, Fitness, and Rehabilitation with Action Understanding and Feedback in Natural Language Chongyang Wang Yuan Feng L. Zhong Siyi Zhu Chi Zhang ... Chen Liang Yuntao wang Chen-Jun He Chun Yu Yuanchun Shi 19 5 0 21 Aug 2023
Self-Supervised Learning of Gait-Based Biomarkers R. J. Cotton J. D. P. F. er Kunal Shah Allison DeLillo A. Cimorelli Shawana Anarwala Kayan Abdou T. Karakostas SSL 13 5 0 30 Jul 2023
Large Language Models as General Pattern Machines Suvir Mirchandani F. Xia Peter R. Florence Brian Ichter Danny Driess Montse Gonzalez Arenas Kanishka Rao Dorsa Sadigh Andy Zeng LLMAG 34 183 0 10 Jul 2023
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality Qinghao Ye Haiyang Xu Guohai Xu Jiabo Ye Ming Yan ... Junfeng Tian Qiang Qi Ji Zhang Feiyan Huang Jingren Zhou VLM MLLM 198 883 0 27 Apr 2023
InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions Hanming Liang Wenqian Zhang Wenxu Li Jingyi Yu Lan Xu DiffM VGen 8 97 0 12 Apr 2023
Vision-Language Models as Success Detectors Yuqing Du Ksenia Konyushkova Misha Denil A. Raju Jessica Landon Felix Hill Nando de Freitas Serkan Cabi MLLM LRM 82 76 0 13 Mar 2023
Human Motion Diffusion Model Guy Tevet Sigal Raab Brian Gordon Yonatan Shafir Daniel Cohen-Or Amit H. Bermano DiffM VGen 177 713 0 29 Sep 2022
TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Texts Chuan Guo Xinxin Xuo Sen Wang Li Cheng VGen 60 138 0 04 Jul 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu Kaixuan Ji Yicheng Fu Weng Lam Tam Zhengxiao Du Zhilin Yang Jie Tang VLM 234 780 0 14 Oct 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 275 3,784 0 18 Apr 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 253 4,735 0 24 Feb 2021
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++ Ruilong Li Sha Yang David A. Ross Angjoo Kanazawa ViT 198 467 0 21 Jan 2021
The KIT Motion-Language Dataset Matthias Plappert Christian Mandery Tamim Asfour 166 267 0 13 Jul 2016