Joint Multimodal Learning with Deep Generative Models

7 November 2016

Papers citing "Joint Multimodal Learning with Deep Generative Models"

30 / 30 papers shown

Title
A Markov Random Field Multi-Modal Variational AutoEncoder Fouad Oubari M. Baha Raphael Meunier Rodrigue Décatoire Mathilde Mougeot 31 0 0 18 Aug 2024
Multimodal Variational Auto-encoder based Audio-Visual Segmentation Yuxin Mao Jing Zhang Mochu Xiang Yiran Zhong Yuchao Dai 35 34 0 12 Oct 2023
Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses Eslam Abdelaleem I. Nemenman K. M. Martini 30 5 0 05 Oct 2023
Learning Representations without Compositional Assumptions Tennison Liu Jeroen Berrevoets Zhaozhi Qian M. Schaar OCL SSL 30 1 0 31 May 2023
Improving Multimodal Joint Variational Autoencoders through Normalizing Flows and Correlation Analysis Agathe Senellart Clément Chadebec S. Allassonnière DRL 32 1 0 19 May 2023
Patchwork Learning: A Paradigm Towards Integrative Analysis across Diverse Biomedical Data Sources Suraj Rajendran Weishen Pan M. Sabuncu Yong Chen Jiayu Zhou Fei Wang 49 14 0 10 May 2023
A multimodal dynamical variational autoencoder for audiovisual speech representation learning Samir Sadok Simon Leglaive Laurent Girin Xavier Alameda-Pineda Renaud Séguier 16 11 0 05 May 2023
Multimodal Sequential Generative Models for Semi-Supervised Language Instruction Following K. Akuzawa Yusuke Iwasawa Yutaka Matsuo GAN 33 0 0 29 Dec 2022
Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environments Abhinav Joshi Naman K. Gupta Jinang Shah Binod Bhattarai Ashutosh Modi Danail Stoyanov OffRL 28 2 0 07 Nov 2022
Cross-Modal 3D Shape Generation and Manipulation Zezhou Cheng Menglei Chai Jian Ren Hsin-Ying Lee Kyle Olszewski Zeng Huang Subhransu Maji Sergey Tulyakov 36 32 0 24 Jul 2022
Controllable Data Generation by Deep Learning: A Review Shiyu Wang Yuanqi Du Xiaojie Guo Bo Pan Zhaohui Qin Liang Zhao 29 28 0 19 Jul 2022
Text to Image Synthesis using Stacked Conditional Variational Autoencoders and Conditional Generative Adversarial Networks Haileleol Tibebu Aadin Malik V. D. Silva GAN 18 7 0 06 Jul 2022
Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Models T. Taniguchi Yuto Yoshida Akira Taniguchi Y. Hagiwara MLLM 14 22 0 24 May 2022
Multimodal Adversarially Learned Inference with Factorized Discriminators Wenxue Chen Jianke Zhu 43 3 0 20 Dec 2021
Generating Diverse 3D Reconstructions from a Single Occluded Face Image Rahul Dey Vishnu Naresh Boddeti CVBM 3DH 21 7 0 01 Dec 2021
Discriminative Multimodal Learning via Conditional Priors in Generative Models R. A. Mancisidor Michael C. Kampffmeyer K. Aas Robert Jenssen GAN 20 5 0 09 Oct 2021
How to Sense the World: Leveraging Hierarchy in Multimodal Perception for Robust Reinforcement Learning Agents Miguel Vasco Hang Yin Francisco S. Melo Ana Paiva 19 7 0 07 Oct 2021
Generalized Multimodal ELBO Thomas M. Sutter Imant Daunhawer Julia E. Vogt 11 89 0 06 May 2021
A Whole Brain Probabilistic Generative Model: Toward Realizing Cognitive Architectures for Developmental Robots T. Taniguchi Hiroshi Yamakawa Takayuki Nagai Kenji Doya M. Sakagami Masahiro Suzuki Tomoaki Nakamura Akira Taniguchi 18 23 0 15 Mar 2021
SMIL: Multimodal Learning with Severely Missing Modality Mengmeng Ma Jian Ren Long Zhao Sergey Tulyakov Cathy H. Wu Xi Peng 35 238 0 09 Mar 2021
Multimodal Generative Learning Utilizing Jensen-Shannon-Divergence Thomas M. Sutter Imant Daunhawer Julia E. Vogt 31 67 0 15 Jun 2020
Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models Yuge Shi Siddharth Narayanaswamy Brooks Paige Philip H. S. Torr DRL 19 266 0 08 Nov 2019
Neuro-SERKET: Development of Integrative Cognitive System through the Composition of Deep Probabilistic Generative Models T. Taniguchi Tomoaki Nakamura Masahiro Suzuki Ryo Kuniyasu Kaede Hayashi Akira Taniguchi Takato Horii Takayuki Nagai BDL DRL 14 48 0 20 Oct 2019
Multi-modal Deep Analysis for Multimedia Wenwu Zhu Xin Eric Wang Hongzhi Li 19 38 0 11 Oct 2019
Multimodal representation models for prediction and control from partial information Martina Zambelli Antoine Cully Y. Demiris 16 27 0 09 Oct 2019
Balancing Reconstruction Quality and Regularisation in ELBO for VAEs Shuyu Lin Stephen J. Roberts Niki Trigoni R. Clark DRL 11 15 0 09 Sep 2019
Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Tasks Michelle A. Lee Yuke Zhu Peter Zachares Matthew Tan K. Srinivasan Silvio Savarese Fei-Fei Li Animesh Garg Jeannette Bohg SSL 18 207 0 28 Jul 2019
Multi-Source Neural Variational Inference Richard Kurle Stephan Günnemann Patrick van der Smagt BDL SSL DRL 13 25 0 11 Nov 2018
Learning Factorized Multimodal Representations Yao-Hung Hubert Tsai Paul Pu Liang Amir Zadeh Louis-Philippe Morency Ruslan Salakhutdinov DRL 42 401 0 16 Jun 2018
SCAN: Learning Hierarchical Compositional Visual Concepts I. Higgins Nicolas Sonnerat Loic Matthey Arka Pal Christopher P. Burgess Matko Bosnjak Murray Shanahan M. Botvinick Demis Hassabis Alexander Lerchner OCL DRL CoGe 13 51 0 11 Jul 2017