Learning deep representations by mutual information estimation and maximization

20 August 2018

R. Devon Hjelm

A. Fedorov

Samuel Lavoie-Marchildon

Papers citing "Learning deep representations by mutual information estimation and maximization"

50 / 517 papers shown

Title
SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption Dara Bahri Heinrich Jiang Yi Tay Donald Metzler SSL 19 163 0 29 Jun 2021
Time-Series Representation Learning via Temporal and Contextual Contrasting Emadeldeen Eldele Mohamed Ragab Zhenghua Chen Min-man Wu C. Kwoh Xiaoli Li Cuntai Guan AI4TS 40 491 0 26 Jun 2021
Decomposed Mutual Information Estimation for Contrastive Representation Learning Alessandro Sordoni Nouha Dziri Hannes Schulz Geoffrey J. Gordon Philip Bachman Rémi Tachet des Combes SSL 24 29 0 25 Jun 2021
Unsupervised Object-Level Representation Learning from Scene Images Jiahao Xie Xiaohang Zhan Ziwei Liu Yew-Soon Ong Chen Change Loy SSL OCL 38 73 0 22 Jun 2021
Can contrastive learning avoid shortcut solutions? Joshua Robinson Li Sun Ke Yu Kayhan Batmanghelich Stefanie Jegelka S. Sra SSL 19 142 0 21 Jun 2021
Interventional Video Grounding with Dual Contrastive Learning Guoshun Nan Rui Qiao Yao Xiao Jun Liu Sicong Leng H. Zhang Wei Lu 26 144 0 21 Jun 2021
Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting Martine Toering Ioannis Gatopoulos M. Stol Vincent Tao Hu SSL 40 11 0 18 Jun 2021
Efficient Self-supervised Vision Transformers for Representation Learning Chunyuan Li Jianwei Yang Pengchuan Zhang Mei Gao Bin Xiao Xiyang Dai Lu Yuan Jianfeng Gao ViT 37 209 0 17 Jun 2021
Prototypical Graph Contrastive Learning Shuai Lin Pan Zhou Zi-Yuan Hu Shuojia Wang Ruihui Zhao Yefeng Zheng Liang Lin Eric P. Xing Xiaodan Liang 24 86 0 17 Jun 2021
Unsupervised Path Representation Learning with Curriculum Negative Sampling Sean Bin Yang Chenjuan Guo Jilin Hu Jiangtao Tang Bin Yang SSL 16 47 0 17 Jun 2021
Frustratingly Easy Transferability Estimation Long-Kai Huang Ying Wei Yu Rong Qiang Yang Junzhou Huang 33 57 0 17 Jun 2021
Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification Li Lyna Zhang Qing Wang Kong Aik Lee Lei Xie Haizhou Li 14 13 0 17 Jun 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 66 2,749 0 15 Jun 2021
Which Mutual-Information Representation Learning Objectives are Sufficient for Control? Kate Rakelly Abhishek Gupta Carlos Florensa Sergey Levine SSL 26 38 0 14 Jun 2021
InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping Runshi Liu Pengda Qin Yuhong Li Weigao Wen Dong Li Kefeng Deng Qiang Wu AI4TS 15 0 0 13 Jun 2021
Refining Pseudo Labels with Clustering Consensus over Generations for Unsupervised Object Re-identification Xiao Zhang Yixiao Ge Yu Qiao Hongsheng Li 30 96 0 11 Jun 2021
MST: Masked Self-Supervised Transformer for Visual Representation Zhaowen Li Zhiyang Chen Fan Yang Wei Li Yousong Zhu ... Rui Deng Liwei Wu Rui Zhao Ming Tang Jinqiao Wang ViT 42 162 0 10 Jun 2021
Fairness-Aware Node Representation Learning Öykü Deniz Köse Yanning Shen 16 22 0 09 Jun 2021
PlayVirtual: Augmenting Cycle-Consistent Virtual Trajectories for Reinforcement Learning Tao Yu Cuiling Lan Wenjun Zeng Mingxiao Feng Zhizheng Zhang Zhibo Chen OffRL 20 46 0 08 Jun 2021
Incremental False Negative Detection for Contrastive Learning Tsai-Shien Chen Wei-Chih Hung Hung-Yu Tseng Shao-Yi Chien Ming-Hsuan Yang SSL CLL 18 60 0 07 Jun 2021
Large-scale Unsupervised Semantic Segmentation Shangqi Gao Zhong-Yu Li Ming-Hsuan Yang Mingg-Ming Cheng Junwei Han Philip Torr UQCV 38 84 0 06 Jun 2021
Category Contrast for Unsupervised Domain Adaptation in Visual Tasks Jiaxing Huang Dayan Guan Aoran Xiao Shijian Lu Ling Shao CML 32 128 0 05 Jun 2021
CLEVE: Contrastive Pre-training for Event Extraction Ziqi Wang Xiaozhi Wang Xu Han Yankai Lin Lei Hou Zhiyuan Liu Peng Li Juan-Zi Li Jie Zhou 37 116 0 30 May 2021
The Power of Log-Sum-Exp: Sequential Density Ratio Matrix Estimation for Speed-Accuracy Optimization Taiki Miyagawa Akinori F. Ebihara 25 3 0 28 May 2021
Contrastive Fine-tuning Improves Robustness for Neural Rankers Xiaofei Ma Cicero Nogueira dos Santos Andrew O. Arnold 13 20 0 27 May 2021
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer Yuanmeng Yan Rumei Li Sirui Wang Fuzheng Zhang Wei Yu Wu Weiran Xu SSL 52 546 0 25 May 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 86 902 0 11 May 2021
Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Bounds Steven Kleinegesse Michael U. Gutmann FedML 30 25 0 10 May 2021
Contrastive Attraction and Contrastive Repulsion for Representation Learning Huangjie Zheng Xu Chen Jiangchao Yao Hongxia Yang Chunyuan Li Ya-Qin Zhang Hao Zhang Ivor Tsang Jingren Zhou Mingyuan Zhou SSL 42 12 0 08 May 2021
A Novel Estimator of Mutual Information for Learning to Disentangle Textual Representations Pierre Colombo Chloé Clavel Pablo Piantanida AAML DRL 26 50 0 06 May 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 133 187 0 02 May 2021
A Good Image Generator Is What You Need for High-Resolution Video Synthesis Yu Tian Jian Ren Menglei Chai Kyle Olszewski Xi Peng Dimitris N. Metaxas Sergey Tulyakov VGen 51 183 0 30 Apr 2021
Learning Multi-Granular Hypergraphs for Video-Based Person Re-Identification Yichao Yan Jie Qin Jiaxin Chen Li Liu Fan Zhu Ying Tai Ling Shao 25 130 0 30 Apr 2021
A Large-Scale Study on Unsupervised Spatiotemporal Representation Learning Christoph Feichtenhofer Haoqi Fan Bo Xiong Ross B. Girshick Kaiming He SSL AI4TS 39 257 0 29 Apr 2021
Shot Contrastive Self-Supervised Learning for Scene Boundary Detection Shixing Chen Xiaohan Nie David D. Fan Dongqing Zhang Vimal Bhat Raffay Hamid SSL 27 62 0 28 Apr 2021
3KG: Contrastive Learning of 12-Lead Electrocardiograms using Physiologically-Inspired Augmentations Bryan Gopal Ryan Han Gautham Raghupathi A. Ng G. Tison Pranav Rajpurkar MedIm 13 57 0 21 Apr 2021
Distill on the Go: Online knowledge distillation in self-supervised learning Prashant Bhat Elahe Arani Bahram Zonooz SSL 22 28 0 20 Apr 2021
Data-Efficient Language-Supervised Zero-Shot Learning with Self-Distillation Rui Cheng Bichen Wu Peizhao Zhang Peter Vajda Joseph E. Gonzalez CLIP VLM 21 31 0 18 Apr 2021
SiT: Self-supervised vIsion Transformer Sara Atito Ali Ahmed Muhammad Awais J. Kittler ViT 36 139 0 08 Apr 2021
Contrastive Syn-to-Real Generalization Wuyang Chen Zhiding Yu Shalini De Mello Sifei Liu J. Álvarez Zhangyang Wang Anima Anandkumar 20 46 0 06 Apr 2021
The Spatially-Correlative Loss for Various Image Translation Tasks Chuanxia Zheng Tat-Jen Cham Jianfei Cai 24 116 0 02 Apr 2021
A Realistic Evaluation of Semi-Supervised Learning for Fine-Grained Classification Jong-Chyi Su Zezhou Cheng Subhransu Maji 23 57 0 01 Apr 2021
Composable Augmentation Encoding for Video Representation Learning Chen Sun Arsha Nagrani Yonglong Tian Cordelia Schmid SSL AI4TS 35 17 0 01 Apr 2021
Contrastive Learning of Single-Cell Phenotypic Representations for Treatment Classification A. Perakis A. Gorji Samriddhi Jain K. Chaitanya Simone Rizza E. Konukoglu SSL 21 33 0 30 Mar 2021
Broaden Your Views for Self-Supervised Video Learning Adrià Recasens Pauline Luc Jean-Baptiste Alayrac Luyu Wang Ross Hemsley ... Florent Altché M. Valko Jean-Bastien Grill Aaron van den Oord Andrew Zisserman SSL AI4TS 33 127 0 30 Mar 2021
Complementary Relation Contrastive Distillation Jinguo Zhu Shixiang Tang Dapeng Chen Shijie Yu Yakun Liu A. Yang M. Rong Xiaohua Wang 24 77 0 29 Mar 2021
Explaining Representation by Mutual Information Li Gu SSL FAtt 32 0 0 28 Mar 2021
Contrasting Contrastive Self-Supervised Representation Learning Pipelines Klemen Kotar Gabriel Ilharco Ludwig Schmidt Kiana Ehsani Roozbeh Mottaghi SSL 33 45 0 25 Mar 2021
Learning Graph Representation by Aggregating Subgraphs via Mutual Information Maximization Chenguang Wang Ziwen Liu SSL 33 17 0 24 Mar 2021
Characterizing and Improving the Robustness of Self-Supervised Learning through Background Augmentations Chaitanya K. Ryali D. Schwab Ari S. Morcos SSL 32 9 0 23 Mar 2021