Learning deep representations by mutual information estimation and maximization

20 August 2018

R. Devon Hjelm

A. Fedorov

Samuel Lavoie-Marchildon

Papers citing "Learning deep representations by mutual information estimation and maximization"

50 / 517 papers shown

Title
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Changlin Li Tao Tang Guangrun Wang Jiefeng Peng Bing Wang Xiaodan Liang Xiaojun Chang ViT 46 105 0 23 Mar 2021
Cluster Contrast for Unsupervised Person Re-Identification Zuozhuo Dai Guangyuan Wang Weihao Yuan Xiaoli Liu Siyu Zhu P. Tan 28 212 0 22 Mar 2021
Efficient Visual Pretraining with Contrastive Detection Olivier J. Hénaff Skanda Koppula Jean-Baptiste Alayrac Aaron van den Oord Oriol Vinyals João Carreira VLM SSL 38 162 0 19 Mar 2021
Adversarial and Contrastive Variational Autoencoder for Sequential Recommendation Zhe Xie Chengxuan Liu Yichi Zhang Hongtao Lu Dong Wang Yue Ding BDL DRL 30 91 0 19 Mar 2021
Contrastive Learning of Musical Representations Janne Spijkervet J. Burgoyne 36 111 0 17 Mar 2021
Tensor networks and efficient descriptions of classical data Sirui Lu Márton Kanász-Nagy I. Kukuljan J. I. Cirac 16 24 0 11 Mar 2021
Multi-Pretext Attention Network for Few-shot Learning with Self-supervision Hainan Li Renshuai Tao Jun Li Haotong Qin Yifu Ding Shuo Wang Xianglong Liu SSL 27 8 0 10 Mar 2021
FSCE: Few-Shot Object Detection via Contrastive Proposal Encoding Bo Sun Banghuai Li Shengcai Cai Ye Yuan Chi Zhang 42 370 0 10 Mar 2021
Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors Jian Ding Enze Xie Hang Xu Chenhan Jiang Zhenguo Li Ping Luo Guisong Xia 25 16 0 08 Mar 2021
Multimodal Representation Learning via Maximization of Local Mutual Information Ruizhi Liao Daniel Moyer Miriam Cha Keegan Quigley Seth Berkowitz Steven Horng Polina Golland W. Wells SSL 15 41 0 08 Mar 2021
CoDeGAN: Contrastive Disentanglement for Generative Adversarial Network Lili Pan Peijun Tang Zhiyong Chen Zenglin Xu GAN DRL 18 6 0 05 Mar 2021
Can Pretext-Based Self-Supervised Learning Be Boosted by Downstream Data? A Theoretical Analysis Jiaye Teng Weiran Huang Haowei He SSL 29 11 0 05 Mar 2021
Self-Supervised Multi-View Learning via Auto-Encoding 3D Transformations Xiang Gao Wei Hu Guo-Jun Qi 26 6 0 01 Mar 2021
Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning Yixin Liu Zhao Li Shirui Pan Chen Gong Chuan Zhou George Karypis 37 289 0 27 Feb 2021
Towards Robust Graph Contrastive Learning Nikola Jovanović Zhao Meng Lukas Faber Roger Wattenhofer SSL 26 33 0 25 Feb 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 90 90 0 25 Feb 2021
Self-Supervised Learning of Graph Neural Networks: A Unified Review Yaochen Xie Zhao Xu Jingtun Zhang Zhengyang Wang Shuiwang Ji SSL 33 324 0 22 Feb 2021
MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretation Yen Nhi Truong Vu Richard Wang N. Balachandar Can Liu A. Ng Pranav Rajpurkar 18 81 0 21 Feb 2021
S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration Zhiqiang Shen Zechun Liu Jie Qin Lei Huang Kwang-Ting Cheng Marios Savvides UQCV SSL MQ 248 22 0 17 Feb 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 207 0 17 Feb 2021
HDMI: High-order Deep Multiplex Infomax Baoyu Jing Chanyoung Park Hanghang Tong 98 164 0 15 Feb 2021
Large-Scale Representation Learning on Graphs via Bootstrapping S. Thakoor Corentin Tallec M. G. Azar Mehdi Azabou Eva L. Dyer Rémi Munos Petar Velivcković Michal Valko SSL 29 217 0 12 Feb 2021
Quantifying and Mitigating Privacy Risks of Contrastive Learning Xinlei He Yang Zhang 16 51 0 08 Feb 2021
Calibrating and Improving Graph Contrastive Learning Kaili Ma Haochen Yang Han Yang Yongqiang Chen James Cheng 45 6 0 27 Jan 2021
SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanism Qingyun Sun Jianxin Li Hao Peng Jia Wu Yuanxing Ning Phillip S. Yu Lifang He 24 162 0 20 Jan 2021
Momentum^2 Teacher: Momentum Teacher with Momentum Statistics for Self-Supervised Learning Zeming Li Songtao Liu Jian Sun 51 16 0 19 Jan 2021
DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimation Alexandre Ramé Matthieu Cord FedML 50 51 0 14 Jan 2021
Label Contrastive Coding based Graph Neural Network for Graph Classification Yuxiang Ren Jiyang Bai Jiawei Zhang 31 26 0 14 Jan 2021
Addressing Feature Suppression in Unsupervised Visual Representations Tianhong Li Lijie Fan Yuan. Yuan Hao He Yonglong Tian Rogerio Feris Piotr Indyk Dina Katabi SSL 33 15 0 17 Dec 2020
ISD: Self-Supervised Learning by Iterative Similarity Distillation Ajinkya Tejankar Soroush Abbasi Koohpayegani Vipin Pillai Paolo Favaro Hamed Pirsiavash SSL 27 44 0 16 Dec 2020
Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts Ji Hou Benjamin Graham Matthias Nießner Saining Xie 3DPC 56 263 0 16 Dec 2020
Hypothesis Disparity Regularized Mutual Information Maximization Qicheng Lao Xiang Jiang Mohammad Havaei 33 24 0 15 Dec 2020
LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding Hao Fu Shaojun Zhou Qihong Yang Junjie Tang Guiquan Liu Kaikui Liu Xiaolong Li 37 57 0 14 Dec 2020
Information-Theoretic Segmentation by Inpainting Error Maximization Pedro H. P. Savarese Sunnie S. Y. Kim Michael Maire G. Shakhnarovich David A. McAllester 29 29 0 14 Dec 2020
The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Michael Carbin Zhangyang Wang 27 122 0 12 Dec 2020
Bipartite Graph Embedding via Mutual Information Maximization Jiangxia Cao Xixun Lin Shu Guo Luchen Liu Tingwen Liu Bin Wang 74 110 0 10 Dec 2020
Contrastive Transformation for Self-supervised Correspondence Learning Ning Wang Wen-gang Zhou Houqiang Li VOS 24 33 0 09 Dec 2020
ESAD: End-to-end Deep Semi-supervised Anomaly Detection Chaoqin Huang Fei Ye Peisen Zhao Ya-Qin Zhang Yanfeng Wang Qi Tian 27 12 0 09 Dec 2020
Accurate 3D Object Detection using Energy-Based Models Fredrik K. Gustafsson Martin Danelljan Thomas B. Schon 3DPC 38 10 0 08 Dec 2020
Boosting Contrastive Self-Supervised Learning with False Negative Cancellation T. Huynh Simon Kornblith Matthew R. Walter Michael Maire M. Khademi SSL 22 165 0 23 Nov 2020
Hierarchically Decoupled Spatial-Temporal Contrast for Self-supervised Video Representation Learning Zehua Zhang David J. Crandall AI4TS SSL 28 23 0 23 Nov 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 19 3,960 0 20 Nov 2020
Towards Domain-Agnostic Contrastive Learning Vikas Verma Minh-Thang Luong Kenji Kawaguchi Hieu H. Pham Quoc V. Le SSL 15 115 0 09 Nov 2020
Image Clustering using an Augmented Generative Adversarial Network and Information Maximization Foivos Ntelemis Yaochu Jin S. Thomas GAN 28 13 0 08 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 36 173 0 05 Nov 2020
Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning Beliz Gunel Jingfei Du Alexis Conneau Ves Stoyanov 18 497 0 03 Nov 2020
A Survey on Contrastive Self-supervised Learning Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee F. Makedon SSL 25 1,359 0 31 Oct 2020
Pretext-Contrastive Learning: Toward Good Practices in Self-supervised Video Representation Leaning L. Tao Xueting Wang T. Yamasaki VLM SSL 23 14 0 29 Oct 2020
Quantifying Learnability and Describability of Visual Concepts Emerging in Representation Learning Iro Laina Ruth C. Fong Andrea Vedaldi OCL 33 13 0 27 Oct 2020
Graph Contrastive Learning with Adaptive Augmentation Yanqiao Zhu Yichen Xu Feng Yu Qiang Liu Shu Wu Liang Wang 34 1,072 0 27 Oct 2020