Learning deep representations by mutual information estimation and maximization

20 August 2018

R. Devon Hjelm

A. Fedorov

Samuel Lavoie-Marchildon

Papers citing "Learning deep representations by mutual information estimation and maximization"

50 / 517 papers shown

Title
Patch-wise Contrastive Style Learning for Instagram Filter Removal Furkan Kinli B. Özcan Mustafa Furkan Kıraç 16 7 0 15 Apr 2022
Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification Jiangtao Xie Fei Long Jiaming Lv Qilong Wang P. Li 23 160 0 09 Apr 2022
Self-Labeling Refinement for Robust Representation Learning with Bootstrap Your Own Latent Siddhant Garg Dhruval Jain SSL 45 0 0 09 Apr 2022
Attribute Prototype Network for Any-Shot Learning Wenjia Xu Yongqin Xian Jiuniu Wang Bernt Schiele Zeynep Akata VLM 29 37 0 04 Apr 2022
Diverse Preference Augmentation with Multiple Domains for Cold-start Recommendations Yan Zhang Changyu Li Ivor W. Tsang Hui Xu Lixin Duan Hongzhi Yin Wen Li Jie Shao 23 9 0 01 Apr 2022
Weakly-supervised Temporal Path Representation Learning with Contrastive Curriculum Learning -- Extended Version Sean Bin Yang Chenjuan Guo Jilin Hu B. Yang Jiangtao Tang Christian S. Jensen 25 20 0 30 Mar 2022
Temporal Feature Alignment and Mutual Information Maximization for Video-Based Human Pose Estimation Zhenguang Liu Runyang Feng Haoming Chen Shuang Wu Yixing Gao Yunjun Gao Xiang Wang 30 42 0 29 Mar 2022
Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learning Liulei Li Tianfei Zhou Wenguan Wang Lu Yang Jian-Wei Li Yi Yang SSL 30 47 0 27 Mar 2022
Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap Yifei Wang Qi Zhang Yisen Wang Jiansheng Yang Zhouchen Lin 27 98 0 25 Mar 2022
Multi-scale and Cross-scale Contrastive Learning for Semantic Segmentation Theodoros Pissas Claudio S. Ravasio L. Cruz Christos Bergeles 25 15 0 25 Mar 2022
Object discovery and representation networks Olivier J. Hénaff Skanda Koppula Evan Shelhamer Daniel Zoran Andrew Jaegle Andrew Zisserman João Carreira Relja Arandjelović 44 87 0 16 Mar 2022
MetAug: Contrastive Learning via Meta Feature Augmentation Jiangmeng Li Jingyao Wang Changwen Zheng Bing-Huang Su Hui Xiong 22 23 0 10 Mar 2022
Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective Quan Cui Bingchen Zhao Zhao-Min Chen Borui Zhao Renjie Song Jiajun Liang Boyan Zhou Osamu Yoshie 24 18 0 08 Mar 2022
Audio Self-supervised Learning: A Survey Shuo Liu Adria Mallol-Ragolta Emilia Parada-Cabeleiro Kun Qian Xingshuo Jing Alexander Kathan Bin Hu Bjoern W. Schuller SSL 35 106 0 02 Mar 2022
Understanding Contrastive Learning Requires Incorporating Inductive Biases Nikunj Saunshi Jordan T. Ash Surbhi Goel Dipendra Kumar Misra Cyril Zhang Sanjeev Arora Sham Kakade A. Krishnamurthy SSL 24 109 0 28 Feb 2022
Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representations Tao Guo Song Guo Jiewei Zhang Wenchao Xu Junxiao Wang MU 27 17 0 27 Feb 2022
Vision-Language Pre-Training with Triple Contrastive Learning Jinyu Yang Jiali Duan Son N. Tran Yi Xu Sampath Chanda Liqun Chen Belinda Zeng Trishul Chilimbi Junzhou Huang VLM 29 289 0 21 Feb 2022
Task-Agnostic Graph Explanations Yaochen Xie S. Katariya Xianfeng Tang E-Wen Huang Nikhil S. Rao Karthik Subbian Shuiwang Ji 43 25 0 16 Feb 2022
A Differential Entropy Estimator for Training Neural Networks Georg Pichler Pierre Colombo Malik Boudiaf Günther Koliander Pablo Piantanida 25 21 0 14 Feb 2022
Conditional Contrastive Learning with Kernel Yao-Hung Hubert Tsai Tianqi Li Martin Q. Ma Han Zhao Anton van den Hengel Louis-Philippe Morency Ruslan Salakhutdinov 19 25 0 11 Feb 2022
Informative Pseudo-Labeling for Graph Neural Networks with Few Labels Yayong Li Jie Yin Ling-Hao Chen 19 33 0 20 Jan 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 34 101 0 15 Jan 2022
Robust Contrastive Learning against Noisy Views Ching-Yao Chuang R. Devon Hjelm Xin Wang Vibhav Vineet Neel Joshi Antonio Torralba Stefanie Jegelka Ya-heng Song NoLa 13 68 0 12 Jan 2022
Sound and Visual Representation Learning with Multiple Pretraining Tasks A. Vasudevan Dengxin Dai Luc Van Gool SSL 33 6 0 04 Jan 2022
Representation Learning via Consistent Assignment of Views to Clusters T. Silva Adín Ramirez Rivera SSL 19 8 0 31 Dec 2021
Disentanglement and Generalization Under Correlation Shifts Christina M. Funke Paul Vicol Kuan-Chieh Jackson Wang Matthias Kümmerer R. Zemel Matthias Bethge OOD 39 7 0 29 Dec 2021
Computationally Efficient Approximations for Matrix-based Renyi's Entropy Tieliang Gong Yuxin Dong Shujian Yu B. Dong 67 2 0 27 Dec 2021
How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness? Xinhsuai Dong Anh Tuan Luu Min-Bin Lin Shuicheng Yan Hanwang Zhang SILM AAML 20 55 0 22 Dec 2021
CLIP-Lite: Information Efficient Visual Representation Learning with Language Supervision A. Shrivastava Ramprasaath R. Selvaraju Nikhil Naik Vicente Ordonez VLM CLIP 30 6 0 14 Dec 2021
Semi-Supervised Contrastive Learning for Remote Sensing: Identifying Ancient Urbanization in the South Central Andes Jiachen Xu Junlin Guo James Zimmer-Dauphinee Quan Liu Yuxuan Shi Zuhayr Asad D. Mitchell Wilkes Parker VanValkenburgh Steven A. Wernke Yuankai Huo SSL 24 2 0 13 Dec 2021
Self-Supervised Modality-Aware Multiple Granularity Pre-Training for RGB-Infrared Person Re-Identification Lin Wan Qianyan Jing Zongyuan Sun Chuan Zhang Zhihang Li Yehansen Chen SSL 17 5 0 12 Dec 2021
A Unified Framework for Multi-distribution Density Ratio Estimation Lantao Yu Yujia Jin Stefano Ermon 11 4 0 07 Dec 2021
Joint Learning of Localized Representations from Medical Images and Reports Philipp Muller Georgios Kaissis Cong Zou Daniel Munich 137 81 0 06 Dec 2021
Representation Learning for Conversational Data using Discourse Mutual Information Maximization Bishal Santra Sumegh Roychowdhury Aishik Mandal Vasu Gurram Atharva Naik Manish Gupta Pawan Goyal SSL 21 4 0 04 Dec 2021
GANORCON: Are Generative Models Useful for Few-shot Segmentation? Oindrila Saha Zezhou Cheng Subhransu Maji 34 17 0 01 Dec 2021
CLAWS: Contrastive Learning with hard Attention and Weak Supervision Jansel Herrera-Gerena Ramakrishnan Sundareswaran John Just Matthew J. Darr Ali Jannesari SSL 43 2 0 01 Dec 2021
Molecular Contrastive Learning with Chemical Element Knowledge Graph Yin Fang Qiang Zhang Haihong Yang Xiang Zhuang Shumin Deng Wen Zhang Minghai Qin Zhuo Chen Xiaohui Fan Huajun Chen 15 108 0 01 Dec 2021
MC-SSL0.0: Towards Multi-Concept Self-Supervised Learning Sara Atito Muhammad Awais Ammarah Farooq Zhenhua Feng J. Kittler 17 17 0 30 Nov 2021
A Practical Contrastive Learning Framework for Single-Image Super-Resolution Gang Wu Junjun Jiang Xianming Liu 44 50 0 27 Nov 2021
Data Invariants to Understand Unsupervised Out-of-Distribution Detection Lars Doorenbos Raphael Sznitman Pablo Márquez-Neila OODD 27 6 0 26 Nov 2021
Causality-inspired Single-source Domain Generalization for Medical Image Segmentation Cheng Ouyang C. L. P. Chen Surui Li Zeju Li C. Qin Wenjia Bai Daniel Rueckert OOD 30 155 0 24 Nov 2021
Towards Graph Self-Supervised Learning with Contrastive Adjusted Zooming Yizhen Zheng Ming Jin Shirui Pan Yuan-Fang Li Hao Peng Ming Li Zhao‐Rui Li SSL 33 24 0 20 Nov 2021
Discovering and Explaining the Representation Bottleneck of DNNs Huiqi Deng Qihan Ren Hao Zhang Quanshi Zhang 39 59 0 11 Nov 2021
Dual Prototypical Contrastive Learning for Few-shot Semantic Segmentation Hyeongjun Kwon Somi Jeong Sunok Kim Kwanghoon Sohn VLM 28 10 0 09 Nov 2021
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 21 106 0 01 Nov 2021
Barlow Graph Auto-Encoder for Unsupervised Network Embedding R. A. Khan M. Kleinsteuber SSL 25 3 0 29 Oct 2021
Self-Supervised Learning Disentangled Group Representation as Feature Tan Wang Zhongqi Yue Jianqiang Huang Qianru Sun Hanwang Zhang OOD 36 67 0 28 Oct 2021
Contrastive Learning for Neural Topic Model Thong Nguyen A. Luu 26 56 0 25 Oct 2021
CLLD: Contrastive Learning with Label Distance for Text Classification Jinhe Lan Qingyuan Zhan Chenhao Jiang Kunping Yuan Desheng Wang VLM 34 2 0 25 Oct 2021
MUSE: Feature Self-Distillation with Mutual Information and Self-Information Yunpeng Gong Ye Yu Gaurav Mittal Greg Mori Mei Chen SSL 28 2 0 25 Oct 2021