Contrastive learning, multi-view redundancy, and linear models

24 August 2020

Papers citing "Contrastive learning, multi-view redundancy, and linear models"

50 / 104 papers shown

Title
Representation Learning via Non-Contrastive Mutual Information Z. Guo Bernardo Avila-Pires Khimya Khetarpal Dale Schuurmans Bo Dai SSL 61 0 0 23 Apr 2025
A Survey on Self-supervised Contrastive Learning for Multimodal Text-Image Analysis Asifullah Khan Laiba Asmatullah Anza Malik Shahzaib Khan Hamna Asif SSL VLM 79 0 0 14 Mar 2025
Cross-Lingual IPA Contrastive Learning for Zero-Shot NER Jimin Sohn David R. Mortensen 49 0 0 10 Mar 2025
CIMAGE: Exploiting the Conditional Independence in Masked Graph Auto-encoders Jongwon Park Heesoo Jung Hogun Park 51 1 0 10 Mar 2025
RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddings A. Dhakal S. Sastry Subash Khanal Adeel Ahmad Eric Xing Nathan Jacobs 53 0 0 27 Feb 2025
Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Models Taj Jones-McCormick Aukosh Jagannath S. Sen 58 0 0 24 Feb 2025
Understanding the Emergence of Multimodal Representation Alignment Megan Tjandrasuwita Chanakya Ekbote Liu Ziyin Paul Pu Liang 52 1 0 22 Feb 2025
An Information Criterion for Controlled Disentanglement of Multimodal Data Chenyu Wang Sharut Gupta Xinyi Zhang Sana Tonekaboni Stefanie Jegelka Tommi Jaakkola Caroline Uhler DRL 42 1 0 31 Oct 2024
Contrastive Learning to Fine-Tune Feature Extraction Models for the Visual Cortex Alex Mulrooney Austin J. Brockmeier 43 0 0 08 Oct 2024
Investigating the Impact of Model Complexity in Large Language Models Jing Luo Huiyuan Wang Weiran Huang 39 0 0 01 Oct 2024
Bridging OOD Detection and Generalization: A Graph-Theoretic View Han Wang Yixuan Li CML 39 0 0 26 Sep 2024
Beyond Redundancy: Information-aware Unsupervised Multiplex Graph Structure Learning Zhixiang Shen Shuo Wang Zhao Kang 30 2 0 25 Sep 2024
A Unified Framework for Combinatorial Optimization Based on Graph Neural Networks Yaochu Jin Xueming Yan Shiqing Liu Xiangyu Wang 49 3 0 19 Jun 2024
Contrastive Learning from Synthetic Audio Doppelgängers Manuel Cherep Nikhil Singh 40 1 0 09 Jun 2024
Alignment Calibration: Machine Unlearning for Contrastive Learning under Auditing Yihan Wang Yiwei Lu Guojun Zhang Franziska Boenisch Adam Dziedzic Yaoliang Yu Xiao-Shan Gao MU 26 1 0 05 Jun 2024
Causal Contrastive Learning for Counterfactual Regression Over Time Mouad El Bouchattaoui Myriam Tami Benoit Lepetit P. Cournède CML AI4TS 38 2 0 01 Jun 2024
A Generalization Theory of Cross-Modality Distillation with Contrastive Learning Hangyu Lin Chen Liu Chengming Xu Zhengqi Gao Yanwei Fu Yuan Yao VLM 38 0 0 06 May 2024
$f$ -MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning Yiwei Lu Guojun Zhang Sun Sun Hongyu Guo Yaoliang Yu VLM 23 5 0 15 Feb 2024
Low-Rank Approximation of Structural Redundancy for Self-Supervised Learning Kang Du Yu Xiang 27 0 0 10 Feb 2024
A Probabilistic Model behind Self-Supervised Learning Alice Bizeul Bernhard Schölkopf Carl Allen SSL 26 2 0 02 Feb 2024
Better Representations via Adversarial Training in Pre-Training: A Theoretical Perspective Yue Xing Xiaofeng Lin Qifan Song Yi Tian Xu Belinda Zeng Guang Cheng SSL 26 0 0 26 Jan 2024
Complementary Information Mutual Learning for Multimodality Medical Image Segmentation Chuyun Shen Wenhao Li Haoqing Chen Xiaoling Wang Fengping Zhu Yuxin Li Xiangfeng Wang Bo Jin 45 3 0 05 Jan 2024
Spectral Temporal Contrastive Learning Sacha Morin Somjit Nath Samira Ebrahimi Kahou Guy Wolf 15 0 0 01 Dec 2023
Optimal Sample Complexity of Contrastive Learning Noga Alon Dmitrii Avdiukhin Dor Elboim Orr Fischer G. Yaroslavtsev SSL 30 5 0 01 Dec 2023
Multi-View Causal Representation Learning with Partial Observability Dingling Yao Danru Xu Sébastien Lachapelle Sara Magliacane Perouz Taslakian Georg Martius Julius von Kügelgen Francesco Locatello CML 42 30 0 07 Nov 2023
A Graph-Theoretic Framework for Understanding Open-World Semi-Supervised Learning Yiyou Sun Zhenmei Shi Yixuan Li OffRL 43 20 0 06 Nov 2023
WeedCLR: Weed Contrastive Learning through Visual Representations with Class-Optimized Loss in Long-Tailed Datasets Alzayat Saleh A. Olsen Jake Wood B. Philippa M. R. Azghadi 9 0 0 19 Oct 2023
What Makes for Robust Multi-Modal Models in the Face of Missing Modalities? Siting Li Chenzhuang Du Yue Zhao Yu Huang Hang Zhao 24 4 0 10 Oct 2023
Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift Yihao Xue Siddharth Joshi Dang Nguyen Baharan Mirzasoleiman VLM 31 4 0 08 Oct 2023
An Investigation of Representation and Allocation Harms in Contrastive Learning Subha Maity Mayank Agarwal Mikhail Yurochkin Yuekai Sun 34 2 0 02 Oct 2023
Information Flow in Self-Supervised Learning Zhiyuan Tan Jingqin Yang Weiran Huang Yang Yuan Yifan Zhang SSL 33 14 0 29 Sep 2023
Contrastive Learning as Kernel Approximation Konstantinos Christopher Tsiolis SSL 18 0 0 06 Sep 2023
Representation Learning Dynamics of Self-Supervised Models P. Esser Satyaki Mukherjee D. Ghoshdastidar SSL 29 2 0 05 Sep 2023
When and How Does Known Class Help Discover Unknown Ones? Provable Understanding Through Spectral Analysis Yiyou Sun Zhenmei Shi Yingyu Liang Yixuan Li 37 19 0 09 Aug 2023
Composition-contrastive Learning for Sentence Embeddings Sachin Chanchani Ruihong Huang 27 14 0 14 Jul 2023
Factorized Contrastive Learning: Going Beyond Multi-view Redundancy Paul Pu Liang Zihao Deng Martin Q. Ma James Zou Louis-Philippe Morency Ruslan Salakhutdinov SSL 26 49 0 08 Jun 2023
Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applications Paul Pu Liang Chun Kai Ling Yun Cheng A. Obolenskiy Yudong Liu Rohan Pandey Alex Wilf Louis-Philippe Morency Ruslan Salakhutdinov OffRL 28 11 0 07 Jun 2023
Multimodal Fusion Interactions: A Study of Human and Automatic Quantification Paul Pu Liang Yun Cheng Ruslan Salakhutdinov Louis-Philippe Morency 17 5 0 07 Jun 2023
Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression Runtian Zhai Bing Liu Andrej Risteski Zico Kolter Pradeep Ravikumar SSL 28 9 0 01 Jun 2023
Matrix Information Theory for Self-Supervised Learning Yifan Zhang Zhi-Hao Tan Jingqin Yang Weiran Huang Yang Yuan SSL 48 16 0 27 May 2023
Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression Yihao Xue S. Joshi Eric Gan Pin-Yu Chen Baharan Mirzasoleiman SSL 30 23 0 25 May 2023
How does Contrastive Learning Organize Images? Yunzhe Zhang Yao Lu Qi Xuan SSL 32 0 0 17 May 2023
Towards Understanding the Mechanism of Contrastive Learning via Similarity Structure: A Theoretical Analysis Hiroki Waida Yuichiro Wada Léo Andéol Takumi Nakagawa Yuhui Zhang Takafumi Kanamori SSL 29 5 0 01 Apr 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 37 30 0 27 Mar 2023
Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism Zhijian Zhuo Yifei Wang Jinwen Ma Yisen Wang 45 24 0 04 Mar 2023
On the Provable Advantage of Unsupervised Pretraining Jiawei Ge Shange Tang Jianqing Fan Chi Jin SSL 33 16 0 02 Mar 2023
The Trade-off between Universality and Label Efficiency of Representations from Contrastive Learning Zhenmei Shi Jiefeng Chen Kunyang Li Jayaram Raghuram Xi Wu Yingyu Liang S. Jha SSL 22 17 0 28 Feb 2023
Hiding Data Helps: On the Benefits of Masking for Sparse Coding Muthuraman Chidambaram Chenwei Wu Yu Cheng Rong Ge 20 0 0 24 Feb 2023
Generalization Analysis for Contrastive Representation Learning Yunwen Lei Tianbao Yang Yiming Ying Ding-Xuan Zhou 28 8 0 24 Feb 2023
Quantifying & Modeling Multimodal Interactions: An Information Decomposition Framework Paul Pu Liang Yun Cheng Xiang Fan Chun Kai Ling Suzanne Nie ... Nicholas B. Allen Randy P. Auerbach Faisal Mahmood Ruslan Salakhutdinov Louis-Philippe Morency 43 29 0 23 Feb 2023