Learning deep representations by mutual information estimation and maximization

20 August 2018

R. Devon Hjelm

A. Fedorov

Samuel Lavoie-Marchildon

Papers citing "Learning deep representations by mutual information estimation and maximization"

50 / 515 papers shown

Title
Contrastive Multi-View Representation Learning on Graphs Kaveh Hassani Amir Hosein Khas Ahmadi SSL 13 1,273 0 10 Jun 2020
Multi-view Contrastive Learning for Online Knowledge Distillation Chuanguang Yang Zhulin An Yongjun Xu 14 23 0 07 Jun 2020
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations John Giorgi Osvald Nitski Bo Wang Gary D. Bader SSL 19 489 0 05 Jun 2020
Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID Yixiao Ge Feng Zhu Dapeng Chen Rui Zhao Hongsheng Li VLM 25 556 0 04 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 39 1,305 0 20 May 2020
Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systems Chang Zhou Jianxin Ma Jianwei Zhang Jingren Zhou Hongxia Yang 18 142 0 20 May 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong S. Hoi SSL DRL 87 956 0 11 May 2020
Mutual Information Gradient Estimation for Representation Learning Liangjiang Wen Yiji Zhou Lirong He Mingyuan Zhou Zenglin Xu DRL SSL 20 27 0 03 May 2020
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training Linjie Li Yen-Chun Chen Yu Cheng Zhe Gan Licheng Yu Jingjing Liu MLLM VLM OffRL AI4TS 41 493 0 01 May 2020
Alleviating the Incompatibility between Cross Entropy Loss and Episode Training for Few-shot Skin Disease Classification Wei-wei Zhu Haofu Liao Wenbin Li Weijian Li Jiebo Luo 31 17 0 21 Apr 2020
Discriminator Contrastive Divergence: Semi-Amortized Generative Modeling by Exploring Energy of the Discriminator Yuxuan Song Qiwei Ye Minkai Xu Tie-Yan Liu 25 8 0 05 Apr 2020
Global-Local Bidirectional Reasoning for Unsupervised Representation Learning of 3D Point Clouds Yongming Rao Jiwen Lu Jie Zhou 3DPC 22 130 0 29 Mar 2020
A Survey of Deep Learning for Scientific Discovery M. Raghu Erica Schmidt OOD AI4CE 38 120 0 26 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,452 0 18 Mar 2020
Watching the World Go By: Representation Learning from Unlabeled Videos Daniel Gordon Kiana Ehsani D. Fox Ali Farhadi SSL AI4TS 29 87 0 18 Mar 2020
Mutual Information Maximization for Effective Lip Reading Xingyuan Zhao Shuang Yang Shiguang Shan Xilin Chen 16 58 0 13 Mar 2020
DHOG: Deep Hierarchical Object Grouping L. N. Darlow Amos Storkey 8 7 0 13 Mar 2020
Un-Mix: Rethinking Image Mixtures for Unsupervised Visual Representation Learning Zhiqiang Shen Zechun Liu Zhuang Liu Marios Savvides Trevor Darrell Eric P. Xing OCL SSL 27 103 0 11 Mar 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 267 3,375 0 09 Mar 2020
Out-of-Distribution Generalization via Risk Extrapolation (REx) David M. Krueger Ethan Caballero J. Jacobsen Amy Zhang Jonathan Binas Dinghuai Zhang Rémi Le Priol Aaron Courville OOD 215 901 0 02 Mar 2020
Automatic Shortcut Removal for Self-Supervised Representation Learning Matthias Minderer Olivier Bachem N. Houlsby Michael Tschannen SSL 13 73 0 20 Feb 2020
Convergence of End-to-End Training in Deep Unsupervised Contrastive Learning Zixin Wen SSL 21 2 0 17 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 78 18,314 0 13 Feb 2020
The Conditional Entropy Bottleneck Ian S. Fischer OOD 19 115 0 13 Feb 2020
Subclass Distillation Rafael Müller Simon Kornblith Geoffrey E. Hinton 26 33 0 10 Feb 2020
Graph Representation Learning via Graphical Mutual Information Maximization Zhen Peng Wenbing Huang Minnan Luo Q. Zheng Yu Rong Tingyang Xu Junzhou Huang SSL 47 566 0 04 Feb 2020
Multi-task self-supervised learning for Robust Speech Recognition Mirco Ravanelli Jianyuan Zhong Santiago Pascual P. Swietojanski João Monteiro J. Trmal Yoshua Bengio SSL 189 288 0 25 Jan 2020
Learning Representations by Maximizing Mutual Information in Variational Autoencoders Ali Lotfi-Rezaabad S. Vishwanath DRL SSL 9 39 0 21 Dec 2019
Predictive Coding for Boosting Deep Reinforcement Learning with Sparse Rewards Xingyu Lu Stas Tiomkin Pieter Abbeel OffRL 27 4 0 21 Dec 2019
Locality and compositionality in zero-shot learning Tristan Sylvain Linda Petrini R. Devon Hjelm 18 56 0 20 Dec 2019
Deep Verifier Networks: Verification of Deep Discriminative Models with Deep Generative Models Tong Che Xiaofeng Liu Site Li Yubin Ge Ruixiang Zhang Caiming Xiong Yoshua Bengio 33 52 0 18 Nov 2019
Unsupervised Attributed Multiplex Network Embedding Chanyoung Park Donghyun Kim Jiawei Han Hwanjo Yu 27 249 0 15 Nov 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 50 11,842 0 13 Nov 2019
Contrastive Multi-document Question Generation W. Cho Yizhe Zhang Sudha Rao Asli Celikyilmaz Chenyan Xiong Jianfeng Gao Mengdi Wang Bill Dolan SyDa 17 28 0 08 Nov 2019
Conditional Mutual Information Neural Estimator Sina Molavipour Germán Bassi Mikael Skoglund 15 14 0 06 Nov 2019
Adversarial Fisher Vectors for Unsupervised Representation Learning Shuangfei Zhai Walter A. Talbott Carlos Guestrin J. Susskind GAN 22 8 0 29 Oct 2019
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 47 1,030 0 23 Oct 2019
Bridging the Gap Between $f$ -GANs and Wasserstein GANs Jiaming Song Stefano Ermon 8 40 0 22 Oct 2019
When Does Self-supervision Improve Few-shot Learning? Jong-Chyi Su Subhransu Maji B. Hariharan 19 168 0 08 Oct 2019
High Mutual Information in Representation Learning with Symmetric Variational Inference M. Livne Kevin Swersky David J. Fleet SSL DRL 28 0 0 04 Oct 2019
How to Write Summaries with Patterns? Learning towards Abstractive Summarization through Prototype Editing Shen Gao Xiuying Chen Piji Li Zhangming Chan Dongyan Zhao Rui Yan 18 30 0 19 Sep 2019
Learning Deep Representations by Mutual Information for Person Re-identification Peng Chen Tong Jia Pengfei Wu Jianjun Wu Dongyue Chen SSL 25 5 0 16 Aug 2019
InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization Fan-Yun Sun Jordan Hoffmann Vikas Verma Jian Tang SSL 38 840 0 31 Jul 2019
Weakly-supervised Knowledge Graph Alignment with Adversarial Learning Meng Qu Jian Tang Yoshua Bengio 27 13 0 06 Jul 2019
Tuning-Free Disentanglement via Projection Yue Bai L. Duan 6 3 0 27 Jun 2019
Unsupervised State Representation Learning in Atari Ankesh Anand Evan Racah Sherjil Ozair Yoshua Bengio Marc-Alexandre Côté R. Devon Hjelm SSL 32 254 0 19 Jun 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 61 2,362 0 13 Jun 2019
Learning Video Representations using Contrastive Bidirectional Transformer Chen Sun Fabien Baradel Kevin Patrick Murphy Cordelia Schmid SSL ViT 21 133 0 13 Jun 2019
Utilizing Edge Features in Graph Neural Networks via Variational Information Maximization Pengfei Chen Weiwen Liu Chang-Yu Hsieh Guangyong Chen Shengyu Zhang 17 21 0 13 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 67 1,452 0 03 Jun 2019