MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators

19 June 2023

Di Huang

Qi Chu

Wanli Ouyang

Papers citing "MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators"

50 / 86 papers shown

Title
Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animation Lei Zhong Chuan Guo Yiming Xie Jiawei Wang Changjian Li VGen 40 0 0 27 Apr 2025
SocialGen: Modeling Multi-Human Social Interaction with Language Models Heng Yu Juze Zhang Changan Chen Tiange Xiang Yusu Fang Juan Carlos Niebles Ehsan Adeli VGen 42 0 0 28 Mar 2025
HOIGPT: Learning Long Sequence Hand-Object Interaction with Language Models Mingzhen Huang Fu-Jen Chu Bugra Tekin Kevin J Liang Haoyu Ma ... Hongfei Xue Siwei Lyu Kris M. Kitani Matt Feiszli Hao Tang VLM 56 0 0 24 Mar 2025
MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space Lixing Xiao Shunlin Lu Huaijin Pi Ke Fan Liang Pan Yueer Zhou Ziyong Feng Xiaowei Zhou Sida Peng Jingbo Wang DiffM VGen 35 3 0 19 Mar 2025
MDocAgent: A Multi-Modal Multi-Agent Framework for Document Understanding S. Han Peng Xia Ruiyi Zhang Tong Sun Yun-Qing Li Hongtu Zhu Huaxiu Yao VLM 55 2 0 18 Mar 2025
SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editing Seokhyeon Hong Chaelin Kim Serin Yoon Junghyun Nam Sihun Cha Junyong Noh DiffM VGen 63 0 0 18 Mar 2025
Motion Anything: Any to Motion Generation Zeyu Zhang Yiran Wang Wei Mao Danning Li Rui Zhao Biao Wu Zirui Song Bohan Zhuang Ian Reid Richard I. Hartley DiffM VGen 51 1 0 13 Mar 2025
HERO: Human Reaction Generation from Videos Chengjun Yu Wei-dong Zhai Yuhang Yang Yang Cao Zheng-jun Zha VGen 50 0 0 11 Mar 2025
HiSTF Mamba: Hierarchical Spatiotemporal Fusion with Multi-Granular Body-Spatial Modeling for High-Fidelity Text-to-Motion Generation Xingzu Zhan Chen Xie Haoran Sun Xiaochun Mai Mamba 45 0 0 10 Mar 2025
Unlocking Pretrained LLMs for Motion-Related Multimodal Generation: A Fine-Tuning Approach to Unify Diffusion and Next-Token Prediction Shinichi Tanaka Zhao Wang Yoichi Kato Jun Ohya DiffM 39 0 0 08 Mar 2025
Maximizing Signal in Human-Model Preference Alignment Kelsey Kraus Margaret Kroll ALM 40 0 0 06 Mar 2025
FuseChat-3.0: Preference Optimization Meets Heterogeneous Model Fusion Ziyi Yang Fanqi Wan Longguang Zhong Canbin Huang Guosheng Liang Xiaojun Quan MoMe 87 0 0 06 Mar 2025
Mojito: LLM-Aided Motion Instructor with Jitter-Reduced Inertial Tokens Ziwei Shan Yaoyu He Chengfeng Zhao Jiashen Du Jingyan Zhang Qixuan Zhang Jingyi Yu Lan Xu 46 1 0 22 Feb 2025
Human-Centric Foundation Models: Perception, Generation and Agentic Modeling Shixiang Tang Y. Wang Lu Chen Yuan Wang Sida Peng Dan Xu W. Ouyang VGen 123 2 0 12 Feb 2025
CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editing Yu Yuan Shizhao Sun Qi Liu Jiang Bian 86 0 0 06 Feb 2025
Graph Neural Backdoor: Fundamentals, Methodologies, Applications, and Future Directions Xiao Yang Gaolei Li Jianhua Li AAML AI4CE 35 1 0 08 Jan 2025
The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motion Changan Chen Juze Zhang S. K. Lakshmikanth Yusu Fang Ruizhi Shao Gordon Wetzstein L. Fei-Fei Ehsan Adeli VGen 65 3 0 13 Dec 2024
SOLAMI: Social Vision-Language-Action Modeling for Immersive Interaction with 3D Autonomous Characters Jianping Jiang Weiye Xiao Zhengyu Lin H. Zhang Tianxiang Ren Yang Gao Zhiqian Lin Zhongang Cai Lei Yang Ziwei Liu 79 3 0 29 Nov 2024
DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decoding Jungbin Cho Junwan Kim Jisoo Kim Minseo Kim Mingu Kang S. Hong Tae-Hyun Oh Youngjae Yu VGen 82 1 0 29 Nov 2024
Rethinking Diffusion for Text-Driven Human Motion Generation Zichong Meng Yiming Xie Xiaogang Peng Zeyu Han Huaizu Jiang VGen 69 0 0 25 Nov 2024
DanceFusion: A Spatio-Temporal Skeleton Diffusion Transformer for Audio-Driven Dance Motion Reconstruction Li Zhao Zhengmin Lu VGen 25 0 0 07 Nov 2024
Textual Decomposition Then Sub-motion-space Scattering for Open-Vocabulary Motion Generation Ke Fan J. Zhang Ran Yi Jingyu Gong Yabiao Wang Yating Wang Xin Tan Chengjie Wang Lizhuang Ma 29 2 0 06 Nov 2024
Spontaneous Emergence of Agent Individuality through Social Interactions in LLM-Based Communities Ryosuke Takata A. Masumori Takashi Ikegami LLMAG 20 1 0 05 Nov 2024
MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understanding Yuan Wang Di Huang Yaqi Zhang Wanli Ouyang J. Jiao Xuetao Feng Yan Zhou Pengfei Wan Shixiang Tang Dan Xu VGen 20 0 0 29 Oct 2024
MotionBank: A Large-scale Video Motion Benchmark with Disentangled Rule-based Annotations Liang Xu Shaoyang Hua Zili Lin Yifan Liu Feipeng Ma Yichao Yan Xin Jin Xiaokang Yang Wenjun Zeng VGen 31 1 0 17 Oct 2024
Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions Zhenyu Jiang Yuqi Xie Jinhan Li Ye Yuan Yifeng Zhu Yuke Zhu 16 10 0 16 Oct 2024
LaMP: Language-Motion Pretraining for Motion Generation, Retrieval, and Captioning Zhe Li Weihao Yuan Yisheng He Lingteng Qiu Shenhao Zhu Xiaodong Gu Weichao Shen Yuan Dong Zilong Dong Laurence T. Yang 11 8 0 09 Oct 2024
Scaling Large Motion Models with Million-Level Human Motions Ye Wang Sipeng Zheng Bin Cao Qianshan Wei Qin Jin Qin Jin Zongqing Lu VGen 31 0 0 04 Oct 2024
COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Models Divyanshu Daiya Damon Conover Aniket Bera DiffM 29 0 0 30 Sep 2024
EgoLM: Multi-Modal Language Model of Egocentric Motions Fangzhou Hong Vladimir Guzov Hyo Jin Kim Yuting Ye Richard A. Newcombe Ziwei Liu Lingni Ma 18 5 0 26 Sep 2024
MoGenTS: Motion Generation based on Spatial-Temporal Joint Modeling Weihao Yuan Weichao Shen Yisheng He Yuan Dong Xiaodong Gu Zilong Dong Liefeng Bo Qixing Huang MQ 18 2 0 26 Sep 2024
Human Motion Synthesis_ A Diffusion Approach for Motion Stitching and In-Betweening Michael Adewole Oluwaseyi Giwa Favour Nerrise Martins Osifeko A. Oyedeji VGen DiffM 19 0 0 10 Sep 2024
Enhancing Source Code Security with LLMs: Demystifying The Challenges and Generating Reliable Repairs Nafis Tanveer Islam Joseph Khoury Andrew Seong E. Bou-Harb Peyman Najafirad AAML 18 0 0 01 Sep 2024
An Efficient Sign Language Translation Using Spatial Configuration and Motion Dynamics with LLMs Eui Jun Hwang Sukmin Cho Junmyeong Lee Jong C. Park SLR 48 4 0 20 Aug 2024
SMooDi: Stylized Motion Diffusion Model Lei Zhong Yiming Xie Varun Jampani Deqing Sun Huaizu Jiang DiffM 39 15 0 17 Jul 2024
Local Action-Guided Motion Diffusion Model for Text-to-Motion Generation Peng Jin Hao Li Ze-Long Cheng Kehan Li Runyi Yu Chang-Shu Liu Xiangyang Ji Li-ming Yuan Jie Chen DiffM 14 0 0 15 Jul 2024
SuperPADL: Scaling Language-Directed Physics-Based Control with Progressive Supervised Distillation Jordan Juravsky Yunrong Guo Sanja Fidler Xue Bin Peng AI4CE 18 9 0 15 Jul 2024
Human-Object Interaction from Human-Level Instructions Zhen Wu Jiaman Li C. Karen Liu LM&Ro 18 5 0 25 Jun 2024
YouDream: Generating Anatomically Controllable Consistent Text-to-3D Animals Sandeep Mishra Oindrila Saha A. Bovik 19 0 0 24 Jun 2024
Effective Generative AI: The Human-Algorithm Centaur S. Saghafian Lihi Idan 25 3 0 16 Jun 2024
FreeMotion: MoCap-Free Human Motion Synthesis with Multimodal Large Language Models Zhikai Zhang Yitang Li Haofeng Huang Mingxian Lin Li Yi 27 2 0 15 Jun 2024
Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wild Lingni Ma Yuting Ye Fangzhou Hong Vladimir Guzov Yifeng Jiang ... C. Karen Liu Ziwei Liu Jakob Engel R. D. Nardi Richard A. Newcombe 32 21 0 14 Jun 2024
Situational Awareness Matters in 3D Vision Language Reasoning Yunze Man Liang-Yan Gui Yu-Xiong Wang 30 12 0 11 Jun 2024
Data-Efficient Approach to Humanoid Control via Fine-Tuning a Pre-Trained GPT on Action Data Siddharth Padmanabhan Kazuki Miyazawa Takato Horii Takayuki Nagai 23 0 0 29 May 2024
M $^3$ GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generation Mingshuang Luo Ruibing Hou Hong Chang Zimo Liu Yaowei Wang Shiguang Shan 27 11 0 25 May 2024
Learning Generalizable Human Motion Generator with Reinforcement Learning Yunyao Mao Xiaoyang Liu Wen-gang Zhou Zhenbo Lu Houqiang Li 21 2 0 24 May 2024
Language-Driven Interactive Traffic Trajectory Generation Junkai Xia Chenxin Xu Qingyao Xu Chen Xie Yanfeng Wang Siheng Chen 19 4 0 24 May 2024
Off-the-shelf ChatGPT is a Good Few-shot Human Motion Predictor Haoxuan Qu Zhaoyang He Zeyu Hu Yujun Cai Jun Liu 20 1 0 24 May 2024
Generating Human Motion in 3D Scenes from Text Descriptions Zhi Cen Huaijin Pi Sida Peng Zehong Shen Minghui Yang Shuai Zhu Hujun Bao Xiaowei Zhou 30 19 0 13 May 2024
MLP: Motion Label Prior for Temporal Sentence Localization in Untrimmed 3D Human Motions Sheng Yan Mengyuan Liu Yong Wang Yang Liu C. L. P. Chen Hong Liu 25 0 0 21 Apr 2024