On Mutual Information Maximization for Representation Learning

31 July 2019

Michael Tschannen

Josip Djolonga

Paul Kishan Rubenstein

Papers citing "On Mutual Information Maximization for Representation Learning"

50 / 150 papers shown

Title
Dual Contrastive Loss and Attention for GANs Ning Yu Guilin Liu Aysegül Dündar Andrew Tao Bryan Catanzaro Larry S. Davis Mario Fritz GAN 34 60 0 31 Mar 2021
Explaining Representation by Mutual Information Li Gu SSL FAtt 37 0 0 28 Mar 2021
Unsupervised Two-Stage Anomaly Detection Yunfei Liu Chaoqun Zhuang Feng Lu 39 29 0 22 Mar 2021
Tensor networks and efficient descriptions of classical data Sirui Lu Márton Kanász-Nagy I. Kukuljan J. I. Cirac 24 24 0 11 Mar 2021
CoDeGAN: Contrastive Disentanglement for Generative Adversarial Network Lili Pan Peijun Tang Zhiyong Chen Zenglin Xu GAN DRL 18 6 0 05 Mar 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 96 91 0 25 Feb 2021
Self-Supervised Learning of Graph Neural Networks: A Unified Review Yaochen Xie Zhao Xu Jingtun Zhang Zhengyang Wang Shuiwang Ji SSL 38 325 0 22 Feb 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 209 0 17 Feb 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 22 43 0 13 Feb 2021
Disentangled Recurrent Wasserstein Autoencoder Jun Han Martin Renqiang Min Ligong Han Erran L. Li Xuan Zhang CoGe SyDa DRL 27 33 0 19 Jan 2021
Addressing Feature Suppression in Unsupervised Visual Representations Tianhong Li Lijie Fan Yuan. Yuan Hao He Yonglong Tian Rogerio Feris Piotr Indyk Dina Katabi SSL 33 15 0 17 Dec 2020
A case for new neural network smoothness constraints Mihaela Rosca T. Weber Arthur Gretton S. Mohamed AAML 35 48 0 14 Dec 2020
Contrastive Learning for Label-Efficient Semantic Segmentation Xiangyu Zhao Raviteja Vemulapalli Philip Mansfield Boqing Gong Bradley Green Lior Shapira Ying Nian Wu SSL SSeg 36 174 0 13 Dec 2020
Unsupervised Adversarially-Robust Representation Learning on Graphs Jiarong Xu Yang Yang Junru Chen Chunping Wang Xin Jiang Jiangang Lu Yizhou Sun SSL AAML OOD 35 36 0 04 Dec 2020
Unsupervised Video Representation Learning by Bidirectional Feature Prediction Nadine Behrmann Juergen Gall M. Noroozi SSL MDE 32 29 0 11 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 36 174 0 05 Nov 2020
Specialization in Hierarchical Learning Systems Heinke Hihn Daniel A. Braun 29 16 0 03 Nov 2020
Graph Contrastive Learning with Adaptive Augmentation Yanqiao Zhu Yichen Xu Feng Yu Qiang Liu Shu Wu Liang Wang 34 1,076 0 27 Oct 2020
Iterative Graph Self-Distillation Hanlin Zhang Shuai Lin Weiyang Liu Pan Zhou Jian Tang Xiaodan Liang Eric Xing SSL 57 33 0 23 Oct 2020
Maximum-Entropy Adversarial Data Augmentation for Improved Generalization and Robustness Long Zhao Ting Liu Xi Peng Dimitris N. Metaxas OOD AAML 27 165 0 15 Oct 2020
Contrastive Representation Learning: A Framework and Review Phúc H. Lê Khắc Graham Healy Alan F. Smeaton SSL AI4TS 184 687 0 10 Oct 2020
Representation Learning for Sequence Data with Deep Autoencoding Predictive Components Junwen Bai Weiran Wang Yingbo Zhou Caiming Xiong SSL AI4TS 27 12 0 07 Oct 2020
EqCo: Equivalent Rules for Self-supervised Contrastive Learning Benjin Zhu Junqiang Huang Zeming Li Xiangyu Zhang Jian Sun SSL 22 13 0 05 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 53 628 0 02 Oct 2020
Learning Optimal Representations with the Decodable Information Bottleneck Yann Dubois Douwe Kiela D. Schwab Ramakrishna Vedantam 26 43 0 27 Sep 2020
Interest-Behaviour Multiplicative Network for Resource-limited Recommendation Qianliang Wu Tong Zhang Zhen Cui Jian Yang 19 1 0 24 Sep 2020
Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised Learning Sheng Wan Shirui Pan Jian Yang Chen Gong SSL 22 137 0 15 Sep 2020
Ramifications of Approximate Posterior Inference for Bayesian Deep Learning in Adversarial and Out-of-Distribution Settings John Mitros A. Pakrashi Brian Mac Namee UQCV 26 2 0 03 Sep 2020
Contrastive learning, multi-view redundancy, and linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu SSL 35 163 0 24 Aug 2020
Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination Xudong Wang Ziwei Liu Stella X. Yu SSL 20 76 0 09 Aug 2020
Autoregressive Unsupervised Image Segmentation Yassine Ouali C´eline Hudelot Myriam Tami SSL 35 86 0 16 Jul 2020
GraphCL: Contrastive Self-Supervised Learning of Graph Representations H. Hafidi Mounir Ghogho P. Ciblat A. Swami SSL 28 53 0 15 Jul 2020
Efficient Empowerment Estimation for Unsupervised Stabilization Ruihan Zhao Kevin Lu Pieter Abbeel Stas Tiomkin 26 8 0 14 Jul 2020
Graph Clustering with Graph Neural Networks Anton Tsitsulin John Palowitch Bryan Perozzi Emmanuel Müller GNN AI4CE 25 259 0 30 Jun 2020
Contrastive learning of global and local features for medical image segmentation with limited annotations K. Chaitanya Ertunc Erdil Neerav Karani E. Konukoglu SSL 30 550 0 18 Jun 2020
Contrastive Learning for Weakly Supervised Phrase Grounding Tanmay Gupta Arash Vahdat Gal Chechik Xiaodong Yang Jan Kautz Derek Hoiem ObjD SSL 42 140 0 17 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 52 1,587 0 15 Jun 2020
Contrastive Multi-View Representation Learning on Graphs Kaveh Hassani Amir Hosein Khas Ahmadi SSL 31 1,275 0 10 Jun 2020
Self-supervised Learning from a Multi-view Perspective Yao-Hung Hubert Tsai Yue Wu Ruslan Salakhutdinov Louis-Philippe Morency SSL 25 30 0 10 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 39 1,308 0 20 May 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 87 956 0 11 May 2020
Mutual Information Gradient Estimation for Representation Learning Liangjiang Wen Yiji Zhou Lirong He Mingyuan Zhou Zenglin Xu DRL SSL 33 27 0 03 May 2020
CURL: Contrastive Unsupervised Representations for Reinforcement Learning A. Srinivas Michael Laskin Pieter Abbeel SSL DRL OffRL 49 1,061 0 08 Apr 2020
Global-Local Bidirectional Reasoning for Unsupervised Representation Learning of 3D Point Clouds Yongming Rao Jiwen Lu Jie Zhou 3DPC 33 131 0 29 Mar 2020
Unpacking Information Bottlenecks: Unifying Information-Theoretic Objectives in Deep Learning Andreas Kirsch Clare Lyle Y. Gal 27 16 0 27 Mar 2020
A unifying mutual information view of metric learning: cross-entropy vs. pairwise losses Malik Boudiaf Jérôme Rony Imtiaz Masud Ziko Eric Granger M. Pedersoli Pablo Piantanida Ismail Ben Ayed SSL 23 158 0 19 Mar 2020
DHOG: Deep Hierarchical Object Grouping L. N. Darlow Amos Storkey 13 7 0 13 Mar 2020
Automatic Shortcut Removal for Self-Supervised Representation Learning Matthias Minderer Olivier Bachem N. Houlsby Michael Tschannen SSL 15 73 0 20 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 78 18,337 0 13 Feb 2020
A Mutual Information Maximization Perspective of Language Representation Learning Lingpeng Kong Cyprien de Masson dÁutume Wang Ling Lei Yu Zihang Dai Dani Yogatama SSL 226 166 0 18 Oct 2019