Factorized Contrastive Learning: Going Beyond Multi-view Redundancy

8 June 2023

Louis-Philippe Morency

Ruslan Salakhutdinov

SSL

ArXiv PDF HTML

Papers citing "Factorized Contrastive Learning: Going Beyond Multi-view Redundancy"

34 / 34 papers shown

Title
Enhance Generation Quality of Flow Matching V2A Model via Multi-Step CoT-Like Guidance and Combined Preference Optimization Haomin Zhang S. Haoyu Wang Zihao Chen X. Liu Chaofan Ding Xinhan Di 31 0 0 28 Mar 2025
STiL: Semi-supervised Tabular-Image Learning for Comprehensive Task-Relevant Information Exploration in Multimodal Classification Siyi Du Xinzhe Luo D. O’Regan Chen Qin 62 0 0 08 Mar 2025
RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddings A. Dhakal S. Sastry Subash Khanal Adeel Ahmad Eric Xing Nathan Jacobs 48 0 0 27 Feb 2025
Understanding the Emergence of Multimodal Representation Alignment Megan Tjandrasuwita Chanakya Ekbote Liu Ziyin Paul Pu Liang 50 1 0 22 Feb 2025
Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology Alignment Shuo Wang Bokui Wang Zhixiang Shen Boyan Deng Zhao Kang 90 1 0 04 Feb 2025
Modality Interactive Mixture-of-Experts for Fake News Detection Yifan Liu Y. Liu Z. Li Ruichen Yao Yang Zhang Dong Wang MoE 31 0 0 21 Jan 2025
Enhancing Contrastive Learning Inspired by the Philosophy of "The Blind Men and the Elephant" Yudong Zhang Ruobing Xie Jiansheng Chen X. Sun Zhanhui Kang Yu Wang 81 0 0 21 Dec 2024
Multi-label Sequential Sentence Classification via Large Language Model Mengfei Lan Lecheng Zheng Shufan Ming Halil Kilicoglu 59 1 0 23 Nov 2024
Multimodal Fusion Balancing Through Game-Theoretic Regularization Konstantinos Kontras Thomas Strypsteen Christos Chatzichristos Paul P. Liang Matthew Blaschko M. D. Vos 31 0 0 11 Nov 2024
Self-Supervised Multi-View Learning for Disentangled Music Audio Representations J. Wilkins Sivan Ding Magdalena Fuentes J. P. Bello 24 0 0 05 Nov 2024
Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited Modalities A. Saporta A. Puli Mark Goldstein Rajesh Ranganath SSL 34 0 0 01 Nov 2024
TaxaBind: A Unified Embedding Space for Ecological Applications S. Sastry Subash Khanal A. Dhakal Adeel Ahmad Nathan Jacobs 55 6 0 01 Nov 2024
An Information Criterion for Controlled Disentanglement of Multimodal Data Chenyu Wang Sharut Gupta Xinyi Zhang Sana Tonekaboni Stefanie Jegelka Tommi Jaakkola Caroline Uhler DRL 37 1 0 31 Oct 2024
Bridging Gaps: Federated Multi-View Clustering in Heterogeneous Hybrid Views Xinyue Chen Yazhou Ren Jie Xu Fangfei Lin X. Pu Yang Yang FedML 20 0 0 12 Oct 2024
Channel-aware Contrastive Conditional Diffusion for Multivariate Probabilistic Time Series Forecasting Siyang Li Yize Chen Hui Xiong DiffM AI4TS 28 0 0 03 Oct 2024
Anchors Aweigh! Sail for Optimal Unified Multi-Modal Representations Minoh Jeong Min Namgung Zae Myung Kim Dongyeop Kang Yao-Yi Chiang Alfred Hero 25 0 0 02 Oct 2024
Beyond Redundancy: Information-aware Unsupervised Multiplex Graph Structure Learning Zhixiang Shen Shuo Wang Zhao Kang 25 2 0 25 Sep 2024
What to align in multimodal contrastive learning? Benoit Dufumier J. Castillo-Navarro D. Tuia Jean-Philippe Thiran 22 3 0 11 Sep 2024
Causal Contrastive Learning for Counterfactual Regression Over Time Mouad El Bouchattaoui Myriam Tami Benoit Lepetit P. Cournède CML AI4TS 38 2 0 01 Jun 2024
ReconBoost: Boosting Can Achieve Modality Reconcilement Cong Hua Qianqian Xu Shilong Bao Zhiyong Yang Qingming Huang 38 9 0 15 May 2024
Two Effects, One Trigger: On the Modality Gap, Object Bias, and Information Imbalance in Contrastive Vision-Language Models Simon Schrodi David T. Hoffmann Max Argus Volker Fischer Thomas Brox VLM 50 0 0 11 Apr 2024
Demonstrating and Reducing Shortcuts in Vision-Language Representation Learning Maurits J. R. Bleeker Mariya Hendriksen Andrew Yates Maarten de Rijke VLM 38 3 0 27 Feb 2024
Partial Information Decomposition for Continuous Variables based on Shared Exclusions: Analytical Formulation and Estimation David A. Ehrlich Kyle Schick-Poland Abdullah Makkeh Felix Lanfermann Patricia Wollstadt Michael Wibral 15 9 0 10 Nov 2023
Interpretable Diffusion via Information Decomposition Xianghao Kong Ollie Liu Han Li Dani Yogatama Greg Ver Steeg 18 19 0 12 Oct 2023
Understanding Transferable Representation Learning and Zero-shot Transfer in CLIP Zixiang Chen Yihe Deng Yuanzhi Li Quanquan Gu VLM 23 10 0 02 Oct 2023
Decoupling Common and Unique Representations for Multimodal Self-supervised Learning Yi Wang C. Albrecht Nassim Ait Ali Braham Chenying Liu Zhitong Xiong Xiaoxiang Zhu SSL 25 16 0 11 Sep 2023
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions Paul Pu Liang Amir Zadeh Louis-Philippe Morency 16 60 0 07 Sep 2022
Conditional Supervised Contrastive Learning for Fair Text Classification Jianfeng Chi Will Shand Yaodong Yu Kai-Wei Chang Han Zhao Yuan Tian FaML 41 14 0 23 May 2022
Text and Code Embeddings by Contrastive Pre-Training Arvind Neelakantan Tao Xu Raul Puri Alec Radford Jesse Michael Han ... Tabarak Khan Toki Sherbakov Joanne Jang Peter Welinder Lilian Weng SSL AI4TS 213 421 0 24 Jan 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 296 7,434 0 11 Nov 2021
MURAL: Multimodal, Multitask Retrieval Across Languages Aashi Jain Mandy Guo Krishna Srinivasan Ting-Li Chen Sneha Kudugunta Chao Jia Yinfei Yang Jason Baldridge VLM 115 52 0 10 Sep 2021
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text Hassan Akbari Liangzhe Yuan Rui Qian Wei-Hong Chuang Shih-Fu Chang Yin Cui Boqing Gong ViT 240 577 0 22 Apr 2021
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining Yu Meng Chenyan Xiong Payal Bajaj Saurabh Tiwary Paul N. Bennett Jiawei Han Xia Song 125 202 0 16 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 293 3,693 0 11 Feb 2021