Audio to Body Dynamics

19 December 2017

Eli Shlizerman

Lucio Dery

Hayden Schoen

Ira Kemelmacher-Shlizerman

VGen

ArXiv PDF HTML

Papers citing "Audio to Body Dynamics"

29 / 79 papers shown

Title
Action2Motion: Conditioned Generation of 3D Human Motions Chuan Guo X. Zuo Sen Wang Shihao Zou Qingyao Sun Annan Deng Minglun Gong Li Cheng 9 398 0 30 Jul 2020
Noisy Agents: Self-supervised Exploration by Predicting Auditory Events Chuang Gan Xiaoyu Chen Phillip Isola Antonio Torralba J. Tenenbaum 8 7 0 27 Jul 2020
Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach Chaitanya Ahuja Dong Won Lee Y. Nakano Louis-Philippe Morency 9 100 0 24 Jul 2020
Sound2Sight: Generating Visual Dynamics from Sound and Context A. Cherian Moitreya Chatterjee N. Ahuja VGen 57 35 0 23 Jul 2020
Foley Music: Learning to Generate Music from Videos Chuang Gan Deng Huang Peihao Chen J. Tenenbaum Antonio Torralba VGen 10 135 0 21 Jul 2020
Speech2Video Synthesis with 3D Skeleton Regularization and Expressive Body Poses Miao Liao Sibo Zhang Peng Wang Hao Zhu Xinxin Zuo Ruigang Yang 3DH 6 1 0 17 Jul 2020
Audeo: Audio Generation for a Silent Performance Video Kun Su Xiulong Liu Eli Shlizerman VGen 15 50 0 23 Jun 2020
Solos: A Dataset for Audio-Visual Music Analysis Juan F. Montesinos Olga Slizovskaia G. Haro 6 11 0 14 Jun 2020
Iterate & Cluster: Iterative Semi-Supervised Action Recognition Jingyuan Li Eli Shlizerman 11 10 0 12 Jun 2020
Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learning Ruozi Huang Huang Hu Wei Wu Kei Sawada Mi Zhang Daxin Jiang 19 111 0 11 Jun 2020
Music Gesture for Visual Sound Separation Chuang Gan Deng Huang Hang Zhao J. Tenenbaum Antonio Torralba 17 190 0 20 Apr 2020
R-FORCE: Robust Learning for Random Recurrent Neural Networks Yang Zheng Eli Shlizerman OOD 17 4 0 25 Mar 2020
Deep Audio-Visual Learning: A Survey Hao Zhu Mandi Luo Rui Wang A. Zheng R. He 16 140 0 14 Jan 2020
Unsupervised Audiovisual Synthesis via Exemplar Autoencoders Kangle Deng Aayush Bansal Deva Ramanan SSL VGen 18 12 0 13 Jan 2020
Generative Autoregressive Networks for 3D Dancing Move Synthesis from Music Hyemin Ahn Jaehun Kim Kihyun Kim Songhwai Oh GAN 13 38 0 11 Nov 2019
Dancing to Music Hsin-Ying Lee Xiaodong Yang Ming-Yu Liu Ting-Chun Wang Yu-Ding Lu Ming-Hsuan Yang Jan Kautz 14 15 0 05 Nov 2019
Animation Synthesis Triggered by Vocal Mimics A. Nivaggioli D. Rohmer 13 1 0 18 Oct 2019
Learning to Have an Ear for Face Super-Resolution Givi Meishvili Simon Jenni Paolo Favaro SupR CVBM 20 23 0 27 Sep 2019
Learning Individual Styles of Conversational Gesture Shiry Ginosar Amir Bar Gefen Kohavi Caroline Chan Andrew Owens Jitendra Malik SLR 12 279 0 10 Jun 2019
Speech2Face: Learning the Face Behind a Voice Tae-Hyun Oh Tali Dekel Changil Kim Inbar Mosseri William T. Freeman Michael Rubinstein Wojciech Matusik SSL CVBM 14 151 0 23 May 2019
A Simple Baseline for Audio-Visual Scene-Aware Dialog Idan Schwartz A. Schwing Tamir Hazan 8 69 0 11 Apr 2019
Animating an Autonomous 3D Talking Avatar D. Borer Dominik Lutz Martine Guay 16 1 0 13 Mar 2019
Hand Pose Estimation: A Survey Bardia Doosti 3DH 11 47 0 03 Mar 2019
Modeling Human Motion with Quaternion-based Neural Networks Dario Pavllo Christoph Feichtenhofer Michael Auli David Grangier 3DH 25 173 0 21 Jan 2019
Robots Learn Social Skills: End-to-End Learning of Co-Speech Gesture Generation for Humanoid Robots Youngwoo Yoon Woo-Ri Ko Minsu Jang Jaeyeon Lee Jaehong Kim Geehyuk Lee SLR 8 200 0 30 Oct 2018
X2Face: A network for controlling face generation by using images, audio, and pose codes Olivia Wiles A. Sophia Koepke Andrew Zisserman CVBM 8 410 0 27 Jul 2018
QuaterNet: A Quaternion-based Recurrent Model for Human Motion Dario Pavllo David Grangier Michael Auli 3DH 12 249 0 16 May 2018
Creating A Multi-track Classical Musical Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications Bochen Li Xinzhao Liu K. Dinesh Z. Duan Gaurav Sharma 13 132 0 27 Dec 2016
Lip Reading Sentences in the Wild Joon Son Chung A. Senior Oriol Vinyals Andrew Zisserman 160 782 0 16 Nov 2016