A Theoretical Analysis of Contrastive Unsupervised Representation Learning

25 February 2019

Papers citing "A Theoretical Analysis of Contrastive Unsupervised Representation Learning"

50 / 504 papers shown

Title
Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning Xuxin Cheng Wanshi Xu Zhihong Zhu Hongxiang Li Yuexian Zou 61 13 0 31 May 2024
Topological Perspectives on Optimal Multimodal Embedding Spaces Abdul Aziz Abdul Rahim BDL 47 0 0 29 May 2024
Provable Contrastive Continual Learning Yichen Wen Zhiquan Tan Kaipeng Zheng Chuanlong Xie Weiran Huang CLL 34 4 0 29 May 2024
Bridging Mini-Batch and Asymptotic Analysis in Contrastive Learning: From InfoNCE to Kernel-Based Losses Panagiotis Koromilas Giorgos Bouritsas Theodoros Giannakopoulos M. Nicolaou Yannis Panagakis 42 0 0 28 May 2024
UniCL: A Universal Contrastive Learning Framework for Large Time Series Models Jiawei Li Jingshu Peng Haoyang Li Lei Chen AI4TS 51 3 0 17 May 2024
The Platonic Representation Hypothesis Minyoung Huh Brian Cheung Tongzhou Wang Phillip Isola 82 117 0 13 May 2024
OpenDlign: Enhancing Open-World 3D Learning with Depth-Aligned Images Ye Mao Junpeng Jing K. Mikolajczyk VLM 32 2 0 25 Apr 2024
Understanding Hyperbolic Metric Learning through Hard Negative Sampling Yun Yue Fangzhou Lin Guanyi Mou Ziming Zhang SSL 34 1 0 23 Apr 2024
Can Contrastive Learning Refine Embeddings Lihui Liu Jinha Kim Vidit Bansal SSL 42 1 0 11 Apr 2024
New Intent Discovery with Attracting and Dispersing Prototype Shun Zhang Jian Yang Jiaqi Bai Chaoran Yan Tongliang Li Zhao Yan Zhoujun Li 49 4 0 25 Mar 2024
Non-negative Contrastive Learning Yifei Wang Qi Zhang Yaoyu Guo Yisen Wang 36 9 0 19 Mar 2024
When can we Approximate Wide Contrastive Models with Neural Tangent Kernels and Principal Component Analysis? Gautham Govind Anil P. Esser D. Ghoshdastidar 45 1 0 13 Mar 2024
On the Generalization Ability of Unsupervised Pretraining Yuyang Deng Junyuan Hong Jiayu Zhou M. Mahdavi SSL 55 4 0 11 Mar 2024
Understanding and Mitigating Human-Labelling Errors in Supervised Contrastive Learning Zijun Long Lipeng Zhuang George Killick R. McCreadie Gerardo Aragon Camarasa Paul Henderson NoLa 33 1 0 10 Mar 2024
Bit-mask Robust Contrastive Knowledge Distillation for Unsupervised Semantic Hashing Liyang He Zhenya Huang Jiayu Liu Enhong Chen Fei-Yue Wang Jing Sha Shijin Wang 26 5 0 10 Mar 2024
Towards Deviation-Robust Agent Navigation via Perturbation-Aware Contrastive Learning Bingqian Lin Yanxin Long Yi Zhu Fengda Zhu Xiaodan Liang QiXiang Ye Liang Lin 37 5 0 09 Mar 2024
Inference via Interpolation: Contrastive Representations Provably Enable Planning and Inference Benjamin Eysenbach Vivek Myers Ruslan Salakhutdinov Sergey Levine AI4TS 43 8 0 06 Mar 2024
BootTOD: Bootstrap Task-oriented Dialogue Representations by Aligning Diverse Responses Weihao Zeng Keqing He Yejie Wang Dayuan Fu Weiran Xu 35 0 0 02 Mar 2024
Rethinking The Uniformity Metric in Self-Supervised Learning Xianghong Fang Jian Li Qiang Sun Benyou Wang SSL 17 0 0 01 Mar 2024
Does Negative Sampling Matter? A Review with Insights into its Theory and Applications Zhen Yang Ming Ding Tinglin Huang Yukuo Cen Junshuai Song Bin Xu Yuxiao Dong Jie Tang 36 9 0 27 Feb 2024
Smaug: Fixing Failure Modes of Preference Optimisation with DPO-Positive Arka Pal Deep Karkhanis Samuel Dooley Manley Roberts Siddartha Naidu Colin White OSLM 46 129 0 20 Feb 2024
Analysis of Using Sigmoid Loss for Contrastive Learning Chungpa Lee Joonhwan Chang Jy-yong Sohn 48 2 0 20 Feb 2024
$f$ -MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning Yiwei Lu Guojun Zhang Sun Sun Hongyu Guo Yaoliang Yu VLM 23 5 0 15 Feb 2024
DUEL: Duplicate Elimination on Active Memory for Self-Supervised Class-Imbalanced Learning Won-Seok Choi Hyun-Dong Lee Dong-Sig Han Junseok Park Heeyeon Koo Byoung-Tak Zhang 35 1 0 14 Feb 2024
Low-Rank Approximation of Structural Redundancy for Self-Supervised Learning Kang Du Yu Xiang 27 0 0 10 Feb 2024
Learning Contrastive Feature Representations for Facial Action Unit Detection Ziqiao Shang Bin Liu Fengmao Lv Fei Teng Tian-Jie Li 47 1 0 09 Feb 2024
Beyond DAGs: A Latent Partial Causal Model for Multimodal Learning Yuhang Liu Zhen Zhang Dong Gong Erdun Gao Biwei Huang Anton Van Den Hengel Kun Zhang Javen Qinfeng Shi Javen Qinfeng Shi 52 5 0 09 Feb 2024
CAMBranch: Contrastive Learning with Augmented MILPs for Branching Jiacheng Lin Meng Xu Zhihua Xiong Huangang Wang 22 3 0 06 Feb 2024
A Probabilistic Model behind Self-Supervised Learning Alice Bizeul Bernhard Schölkopf Carl Allen SSL 28 2 0 02 Feb 2024
Better Representations via Adversarial Training in Pre-Training: A Theoretical Perspective Yue Xing Xiaofeng Lin Qifan Song Yi Tian Xu Belinda Zeng Guang Cheng SSL 28 0 0 26 Jan 2024
Memorization in Self-Supervised Learning Improves Downstream Generalization Wenhao Wang Muhammad Ahmad Kaleem Adam Dziedzic Michael Backes Nicolas Papernot Franziska Boenisch SSL 27 9 0 19 Jan 2024
Contrastive Learning with Negative Sampling Correction Lu Wang Chao Du Pu Zhao Chuan Luo Zhangchi Zhu ... Wei Zhang Qingwei Lin Saravan Rajmohan Dongmei Zhang Qi Zhang SSL 96 1 0 13 Jan 2024
Understanding Representation Learnability of Nonlinear Self-Supervised Learning Ruofeng Yang Xiangyuan Li Bo Jiang Shuai Li SSL MLT 53 2 0 06 Jan 2024
Probing Biological and Artificial Neural Networks with Task-dependent Neural Manifolds Michael Kuoch Chi-Ning Chou Nikhil Parthasarathy Joel Dapello J. DiCarlo H. Sompolinsky SueYeon Chung 19 1 0 21 Dec 2023
The Right Losses for the Right Gains: Improving the Semantic Consistency of Deep Text-to-Image Generation with Distribution-Sensitive Losses Mahmoud Ahmed Omer Moussa Ismail Shaheen Mohamed S. Abdelfattah Amr Abdalla Marwan Eid Hesham M. Eraqi Mohamed Moustafa 21 0 0 18 Dec 2023
Contextually Affinitive Neighborhood Refinery for Deep Clustering Chunlin Yu Ye-ling Shi Jingya Wang 34 6 0 12 Dec 2023
Complementary Benefits of Contrastive Learning and Self-Training Under Distribution Shift Saurabh Garg Amrith Rajagopal Setlur Zachary Chase Lipton Sivaraman Balakrishnan Virginia Smith Aditi Raghunathan SSL 30 6 0 06 Dec 2023
Spectral Temporal Contrastive Learning Sacha Morin Somjit Nath Samira Ebrahimi Kahou Guy Wolf 18 0 0 01 Dec 2023
Optimal Sample Complexity of Contrastive Learning Noga Alon Dmitrii Avdiukhin Dor Elboim Orr Fischer G. Yaroslavtsev SSL 30 5 0 01 Dec 2023
Making Self-supervised Learning Robust to Spurious Correlation via Learning-speed Aware Sampling Weicheng Zhu Sheng Liu C. Fernandez‐Granda N. Razavian 52 1 0 27 Nov 2023
Elucidating and Overcoming the Challenges of Label Noise in Supervised Contrastive Learning Zijun Long George Killick Lipeng Zhuang R. McCreadie Gerardo Aragon Camarasa Paul Henderson 33 5 0 25 Nov 2023
ML-LMCL: Mutual Learning and Large-Margin Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding Xuxin Cheng Bowen Cao Qichen Ye Zhihong Zhu Hongxiang Li Yuexian Zou 32 26 0 19 Nov 2023
Community-Aware Efficient Graph Contrastive Learning via Personalized Self-Training Yuecheng Li Yanming Hu Lele Fu Chuan Chen Lei Yang Zibin Zheng 32 3 0 18 Nov 2023
Robust Contrastive Learning With Theory Guarantee Ngoc N. Tran Lam C. Tran Hoang Phan Anh-Vu Bui Tung Pham Toan M. Tran Dinh Q. Phung Trung Le SSL NoLa 31 0 0 16 Nov 2023
A Graph-Theoretic Framework for Understanding Open-World Semi-Supervised Learning Yiyou Sun Zhenmei Shi Yixuan Li OffRL 43 20 0 06 Nov 2023
Contrastive Multi-Level Graph Neural Networks for Session-based Recommendation F. Wang Xingyu Gao Zhenyu Chen Lei Lyu 21 12 0 06 Nov 2023
MNN: Mixed Nearest-Neighbors for Self-Supervised Learning Xianzhong Long Chen Peng Yun Li SSL 33 0 0 01 Nov 2023
Contrastive Difference Predictive Coding Chongyi Zheng Ruslan Salakhutdinov Benjamin Eysenbach AI4TS OffRL 28 13 0 31 Oct 2023
Identifiable Contrastive Learning with Automatic Feature Importance Discovery Qi Zhang Yifei Wang Yisen Wang 38 12 0 29 Oct 2023
Simple and Asymmetric Graph Contrastive Learning without Augmentations Teng Xiao Huaisheng Zhu Zhengyu Chen Suhang Wang 35 31 0 29 Oct 2023