On Mutual Information Maximization for Representation Learning

31 July 2019

Michael Tschannen

Josip Djolonga

Paul Kishan Rubenstein

Papers citing "On Mutual Information Maximization for Representation Learning"

50 / 148 papers shown

Title
Multi-modal contrastive learning adapts to intrinsic dimensions of shared latent variables Yu Gui Cong Ma Zongming Ma SSL 26 0 0 18 May 2025
InfoPO: On Mutual Information Maximization for Large Language Model Alignment Teng Xiao Zhen Ge Sujay Sanghavi Tian Wang Julian Katz-Samuels Marc Versage Qingjun Cui Trishul Chilimbi 31 0 0 13 May 2025
Rethinking Graph Contrastive Learning through Relative Similarity Preservation Zhiyuan Ning Meng Xiao Ziyue Qiao Pengyang Wang Yuanchun Zhou 210 0 0 08 May 2025
A Tutorial on Discriminative Clustering and Mutual Information Louis Ohl Pierre-Alexandre Mattei F. Precioso 32 0 0 07 May 2025
Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendation Jiakai Tang Sunhao Dai Teng Shi Jun Xu X. Chen Wen Chen Wu Jian Yuning Jiang LRM 77 5 0 28 Mar 2025
Structural Entropy Guided Unsupervised Graph Out-Of-Distribution Detection Yue Hou He Zhu Ruomei Liu Yingke Su Jinxiang Xia Junran Wu Ke Xu OODD 111 0 0 13 Mar 2025
TwinTURBO: Semi-Supervised Fine-Tuning of Foundation Models via Mutual Information Decompositions for Downstream Task and Latent Spaces Guillaume Quétant Pavlo Molchanov Slava Voloshynovskiy 47 0 0 10 Mar 2025
Dynamic Low-Rank Sparse Adaptation for Large Language Models Weizhong Huang Yuxin Zhang Xiawu Zheng Yong-Jin Liu Jing Lin Yiwu Yao Rongrong Ji 97 1 0 21 Feb 2025
InfoBridge: Mutual Information estimation via Bridge Matching Sergei Kholkin Ivan Butakov E. Burnaev Nikita Gushchin Alexander Korotin DiffM FedML 57 0 0 03 Feb 2025
Sample-efficient Unsupervised Policy Cloning from Ensemble Self-supervised Labeled Videos Xin Liu Yaran Chen Haoran Li SSL 94 0 0 14 Dec 2024
Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax I. Butakov Alexander Sememenko Alexander Tolmachev Andrey Gladkov Marina Munkhoeva Alexey Frolov 37 0 0 09 Oct 2024
Establishing Deep InfoMax as an effective self-supervised learning methodology in materials informatics Michael Moran Vladimir V. Gusev M. Gaultois Dmytro Antypov M. Rosseinsky AI4CE 33 0 0 30 Jun 2024
Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints Ran Song Shizhu He Shengxiang Gao Li Cai Kang Liu Zhengtao Yu Jun Zhao LRM 50 5 0 26 Jun 2024
Poly-View Contrastive Learning Amitis Shidani Devon Hjelm Jason Ramapuram Russ Webb Eeshan Gunesh Dhekane Dan Busbridge VLM SSL 39 4 0 08 Mar 2024
Learning to Maximize Mutual Information for Chain-of-Thought Distillation Xin Chen Hanxian Huang Yanjun Gao Yi Wang Jishen Zhao Ke Ding 35 12 0 05 Mar 2024
Separating common from salient patterns with Contrastive Representation Learning Robin Louiset Edouard Duchesnay Antoine Grigis Pietro Gori SSL DRL 46 1 0 19 Feb 2024
Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairing Jaeill Kim Duhun Hwang Eunjung Lee Jangwon Suh Jimyeong Kim Wonjong Rhee 33 0 0 11 Jan 2024
Enhancing Context Through Contrast Kshitij Ambilduke Aneesh Shetye Diksha Bagade Rishika Bhagwatkar Khurshed Fitter P. Vagdargi Shital S. Chiddarwar 26 0 0 06 Jan 2024
Towards a Unified Framework of Contrastive Learning for Disentangled Representations Stefan Matthes Zhiwei Han Hao Shen 37 4 0 08 Nov 2023
Multimodal Variational Auto-encoder based Audio-Visual Segmentation Yuxin Mao Jing Zhang Mochu Xiang Yiran Zhong Yuchao Dai 40 34 0 12 Oct 2023
Learning Disentangled Representation with Mutual Information Maximization for Real-Time UAV Tracking Xucheng Wang Xiangyang Yang Hengzhou Ye Shuiwang Li 21 5 0 20 Aug 2023
GiGaMAE: Generalizable Graph Masked Autoencoder via Collaborative Latent Space Reconstruction Yucheng Shi Yushun Dong Qiaoyu Tan Jundong Li Ninghao Liu 48 25 0 18 Aug 2023
HomoGCL: Rethinking Homophily in Graph Contrastive Learning Wenzhong Li Changdong Wang Hui Xiong Jian-Huang Lai 32 22 0 16 Jun 2023
On the Robustness of Aspect-based Sentiment Analysis: Rethinking Model, Data, and Training Hao Fei Tat-Seng Chua Chenliang Li Donghong Ji Meishan Zhang Yafeng Ren 35 39 0 19 Apr 2023
Shuffle & Divide: Contrastive Learning for Long Text Joonseok Lee Seongho Joe Kyoungwon Park Bogun Kim Ho. Kang Jaeseon Park Youngjune Gwon 17 0 0 19 Apr 2023
ContraCluster: Learning to Classify without Labels by Contrastive Self-Supervision and Prototype-Based Semi-Supervision Seongho Joe Byoungjip Kim Ho. Kang Kyoungwon Park Bogun Kim Jaeseon Park Joonseok Lee Youngjune Gwon SSL 26 1 0 19 Apr 2023
Looking Similar, Sounding Different: Leveraging Counterfactual Cross-Modal Pairs for Audiovisual Representation Learning Nikhil Singh Chih-Wei Wu Iroro Orife Mahdi M. Kalayeh 25 2 0 12 Apr 2023
VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution Jaeill Kim Suhyun Kang Duhun Hwang Jungwook Shin Wonjong Rhee DRL 13 21 0 04 Apr 2023
Generalized Information Bottleneck for Gaussian Variables Wave Ngampruetikorn David J. Schwab 19 1 0 31 Mar 2023
Hybrid Augmented Automated Graph Contrastive Learning Yifu Chen Qianqian Ren Liu Yong 39 1 0 24 Mar 2023
Deep Clustering with a Constraint for Topological Invariance based on Symmetric InfoNCE Yuhui Zhang Yuichiro Wada Hiroki Waida Kaito Goto Yusaku Hino Takafumi Kanamori 27 3 0 06 Mar 2023
Transformed Distribution Matching for Missing Value Imputation He Zhao Ke Sun Amir Dezfouli Edwin V. Bonilla 34 19 0 20 Feb 2023
A Review of Predictive and Contrastive Self-supervised Learning for Medical Images Wei-Chien Wang Euijoon Ahn Da-wei Feng Jinman Kim MedIm 32 27 0 10 Feb 2023
Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU? Jakub Ho'scilowicz Marcin Sowanski Piotr Czubowski Artur Janicki 25 2 0 27 Jan 2023
Personalised Federated Learning On Heterogeneous Feature Spaces A. Rakotomamonjy Maxime Vono H. M. Ruiz L. Ralaivola FedML 18 8 0 26 Jan 2023
Learning to Summarize Videos by Contrasting Clips Ivan Sosnovik A. Moskalev Cees Kaandorp A. Smeulders 17 0 0 12 Jan 2023
Transferring Pre-trained Multimodal Representations with Cross-modal Similarity Matching Byoungjip Kim Sun Choi Dasol Hwang Moontae Lee Honglak Lee 33 10 0 07 Jan 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 20 9 0 27 Dec 2022
Statistical Physics of Deep Neural Networks: Initialization toward Optimal Channels Kangyu Weng Aohua Cheng Ziyang Zhang Pei Sun Yang Tian 53 2 0 04 Dec 2022
Curiosity in Hindsight: Intrinsic Exploration in Stochastic Environments Daniel Jarrett Corentin Tallec Florent Altché Thomas Mesnard Rémi Munos Michal Valko 48 5 0 18 Nov 2022
More Generalized and Personalized Unsupervised Representation Learning In A Distributed System Yue Yang Jingwei Sun Ang Li H. Li Yiran Chen OOD 31 0 0 11 Nov 2022
Adversarial Auto-Augment with Label Preservation: A Representation Learning Principle Guided Approach Kaiwen Yang Yanchao Sun Jiahao Su Fengxiang He Xinmei Tian Furong Huang Dinesh Manocha Dacheng Tao 38 13 0 02 Nov 2022
Hyperspectral Images Classification and Dimensionality Reduction using spectral interaction and SVM classifier Asma Elmaizi E. Sarhrouni A. Hammouch C. Nacir 12 2 0 27 Oct 2022
Self-Supervised Learning via Maximum Entropy Coding Xin Liu Zhongdao Wang Yali Li Shengjin Wang SSL 37 40 0 20 Oct 2022
Self-Supervised Learning Through Efference Copies Franz Scherr Qinghai Guo Timoleon Moraitis 24 10 0 17 Oct 2022
A Comprehensive Survey of Data Augmentation in Visual Reinforcement Learning Guozheng Ma Zhen Wang Zhecheng Yuan Xueqian Wang Bo Yuan Dacheng Tao OffRL 43 27 0 10 Oct 2022
Unsupervised Few-shot Learning via Deep Laplacian Eigenmaps Kuilin Chen Chi-Guhn Lee SSL 40 3 0 07 Oct 2022
Graph Soft-Contrastive Learning via Neighborhood Ranking Zhiyuan Ning P. Wang Pengyang Wang Ziyue Qiao Wei Fan Denghui Zhang Yi Du Yuanchun Zhou 23 15 0 28 Sep 2022
PointCAT: Contrastive Adversarial Training for Robust Point Cloud Recognition Qidong Huang Xiaoyi Dong Dongdong Chen Hang Zhou Weiming Zhang Kui Zhang Gang Hua Nenghai Yu 3DPC 32 12 0 16 Sep 2022
Graph Contrastive Learning with Cross-view Reconstruction Qianlong Wen Z. Ouyang Chunhui Zhang Y. Qian Yanfang Ye Chuxu Zhang SSL 27 6 0 16 Sep 2022