A Theoretical Analysis of Contrastive Unsupervised Representation Learning

25 February 2019

Papers citing "A Theoretical Analysis of Contrastive Unsupervised Representation Learning"

50 / 504 papers shown

Title
Feature Selection in the Contrastive Analysis Setting Ethan Weinberger Ian Covert Su-In Lee 40 2 0 27 Oct 2023
EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation Learning Ping Guo Xiangpeng Wei Yue Hu Baosong Yang Dayiheng Liu Fei Huang Jun Xie 26 2 0 26 Oct 2023
The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining Ting-Rui Chiang Dani Yogatama 25 1 0 25 Oct 2023
Graph Ranking Contrastive Learning: A Extremely Simple yet Efficient Method Yulan Hu Ouyang Sheng Jingyu Liu Ge Chen Zhirui Yang Junchen Wan Fuzheng Zhang Zhongyuan Wang Yong Liu 33 0 0 23 Oct 2023
TATA: Stance Detection via Topic-Agnostic and Topic-Aware Embeddings Hans W. A. Hanley Zakir Durumeric 41 4 0 22 Oct 2023
Augment with Care: Enhancing Graph Contrastive Learning with Selective Spectrum Perturbation Kaiqi Yang Haoyu Han Wei-dong Jin Hui Liu 33 3 0 20 Oct 2023
WeedCLR: Weed Contrastive Learning through Visual Representations with Class-Optimized Loss in Long-Tailed Datasets Alzayat Saleh A. Olsen Jake Wood B. Philippa M. R. Azghadi 25 0 0 19 Oct 2023
Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift Yihao Xue Siddharth Joshi Dang Nguyen Baharan Mirzasoleiman VLM 33 4 0 08 Oct 2023
Perfect Alignment May be Poisonous to Graph Contrastive Learning Jingyu Liu Huayi Tang Yong Liu 30 2 0 06 Oct 2023
Certifiably Robust Graph Contrastive Learning Min Lin Teng Xiao Enyan Dai Xiang Zhang Suhang Wang AAML 29 6 0 05 Oct 2023
FiGURe: Simple and Efficient Unsupervised Node Representations with Filter Augmentations C. Ekbote Ajinkya Deshpande Arun Shankar Iyer Ramakrishna Bairi Sundararajan Sellamanickam SSL 44 3 0 03 Oct 2023
An Investigation of Representation and Allocation Harms in Contrastive Learning Subha Maity Mayank Agarwal Mikhail Yurochkin Yuekai Sun 45 2 0 02 Oct 2023
Understanding Transferable Representation Learning and Zero-shot Transfer in CLIP Zixiang Chen Yihe Deng Yuanzhi Li Quanquan Gu VLM 30 11 0 02 Oct 2023
Spectral Neural Networks: Approximation Theory and Optimization Landscape Chenghui Li Rishi Sonthalia Nicolas García Trillos 37 1 0 01 Oct 2023
Information Flow in Self-Supervised Learning Zhiyuan Tan Jingqin Yang Weiran Huang Yang Yuan Yifan Zhang SSL 38 14 0 29 Sep 2023
Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics Han Bao SSL MLT 34 1 0 28 Sep 2023
CWCL: Cross-Modal Transfer with Continuously Weighted Contrastive Loss R. S. Srinivasa Jaejin Cho Chouchang Yang Yashas Malur Saidutta Ching Hua Lee Yilin Shen Hongxia Jin VLM 38 8 0 26 Sep 2023
Finding Order in Chaos: A Novel Data Augmentation Method for Time Series in Contrastive Learning B. U. Demirel Christian Holz AI4TS 26 18 0 23 Sep 2023
Contrastive Speaker Embedding With Sequential Disentanglement Youzhi Tu Man-Wai Mak Jen-Tzung Chien CoGe 21 5 0 23 Sep 2023
A Theory of Multimodal Learning Zhou Lu 32 8 0 21 Sep 2023
Contrastive Learning as Kernel Approximation Konstantinos Christopher Tsiolis SSL 23 0 0 06 Sep 2023
Non-Parametric Representation Learning with Kernels P. Esser Maximilian Fleissner D. Ghoshdastidar SSL 27 4 0 05 Sep 2023
Representation Learning Dynamics of Self-Supervised Models P. Esser Satyaki Mukherjee D. Ghoshdastidar SSL 34 3 0 05 Sep 2023
Towards a Rigorous Analysis of Mutual Information in Contrastive Learning Kyungeun Lee Jaeill Kim Suhyun Kang Wonjong Rhee SSL 36 2 0 30 Aug 2023
CAME: Contrastive Automated Model Evaluation Ru Peng Qiuyang Duan Haobo Wang Jiachen Ma Yanbo Jiang Yongjun Tu Xiu Jiang Jun Zhao ELM 33 4 0 22 Aug 2023
Information Theory-Guided Heuristic Progressive Multi-View Coding Jiangmeng Li Hang Gao Jingyao Wang Changwen Zheng 27 2 0 21 Aug 2023
AST-MHSA : Code Summarization using Multi-Head Self-Attention Y. Nagaraj U. Gupta 25 1 0 10 Aug 2023
When and How Does Known Class Help Discover Unknown Ones? Provable Understanding Through Spectral Analysis Yiyou Sun Zhenmei Shi Yingyu Liang Yixuan Li 45 19 0 09 Aug 2023
Synaptic Plasticity Models and Bio-Inspired Unsupervised Deep Learning: A Survey Gabriele Lagani Fabrizio Falchi Claudio Gennaro Giuseppe Amato AAML 45 6 0 30 Jul 2023
Density-invariant Features for Distant Point Cloud Registration Quanpan Liu Hongzi Zhu Yunsong Zhou Hongyang Li Shan Chang Minyi Guo 3DPC 34 19 0 19 Jul 2023
Towards the Sparseness of Projection Head in Self-Supervised Learning Changwen Zheng Xingzhe Su Wenwen Qiang Jingyao Wang Changwen Zheng Gang Hua 38 3 0 18 Jul 2023
Composition-contrastive Learning for Sentence Embeddings Sachin Chanchani Ruihong Huang 32 14 0 14 Jul 2023
Multimodal Molecular Pretraining via Modality Blending Qiying Yu Yudi Zhang Yuyan Ni Shi Feng Yanyan Lan Hao Zhou Jingjing Liu 26 13 0 12 Jul 2023
Novel Categories Discovery Via Constraints on Empirical Prediction Statistics Zahid Hasan A. Faridee Masud Ahmed S. Purushotham H. Kwon Hyungtae Lee Nirmalya Roy 40 0 0 07 Jul 2023
A generic self-supervised learning (SSL) framework for representation learning from spectra-spatial feature of unlabeled remote sensing imagery Xin Zhang Liangxiu Han SSL 24 2 0 27 Jun 2023
FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue Weihao Zeng Keqing He Yejie Wang Chen Zeng Jingang Wang Yunsen Xian Weiran Xu 24 1 0 17 Jun 2023
On the Generalization of Multi-modal Contrastive Learning Qi Zhang Yifei Wang Yisen Wang 29 24 0 07 Jun 2023
Rethinking Weak Supervision in Helping Contrastive Learning Jingyi Cui Weiran Huang Yifei Wang Yisen Wang NoLa SSL 36 13 0 07 Jun 2023
Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression Runtian Zhai Bing Liu Andrej Risteski Zico Kolter Pradeep Ravikumar SSL 40 9 0 01 Jun 2023
W-procer: Weighted Prototypical Contrastive Learning for Medical Few-Shot Named Entity Recognition Mingchen Li Yang Ye Jeremy Yeung Huixue Zhou Huaiyuan Chu Rui Zhang 68 2 0 29 May 2023
Matrix Information Theory for Self-Supervised Learning Yifan Zhang Zhi-Hao Tan Jingqin Yang Weiran Huang Yang Yuan SSL 50 18 0 27 May 2023
Inverse Dynamics Pretraining Learns Good Representations for Multitask Imitation David Brandfonbrener Ofir Nachum Joan Bruna AI4CE 28 21 0 26 May 2023
Modulate Your Spectrum in Self-Supervised Learning Xi Weng Yu-Li Ni Tengwei Song Jie Luo Rao Muhammad Anwer Salman Khan Fahad Shahbaz Khan Lei Huang 45 5 0 26 May 2023
Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression Yihao Xue S. Joshi Eric Gan Pin-Yu Chen Baharan Mirzasoleiman SSL 38 25 0 25 May 2023
Detecting Heart Disease from Multi-View Ultrasound Images via Supervised Attention Multiple Instance Learning Zhe Huang B. Wessler M. C. Hughes 30 4 0 25 May 2023
Reverse Engineering Self-Supervised Learning Ido Ben-Shaul Ravid Shwartz-Ziv Tomer Galanti S. Dekel Yann LeCun SSL 26 35 0 24 May 2023
Clinically Labeled Contrastive Learning for OCT Biomarker Classification Kiran Kokilepersaud Stephanie Trejo Corona Mohit Prabhushankar Ghassan Al-Regib C. Wykoff 31 13 0 24 May 2023
Sharpness & Shift-Aware Self-Supervised Learning Ngoc N. Tran S. Duong Hoang Phan Tung Pham Dinh Q. Phung Trung Le SSL 45 1 0 17 May 2023
How does Contrastive Learning Organize Images? Yunzhe Zhang Yao Lu Qi Xuan SSL 34 0 0 17 May 2023
ChatGPT-Like Large-Scale Foundation Models for Prognostics and Health Management: A Survey and Roadmaps Yanfang Li Huan Wang Muxia Sun LM&MA AI4TS AI4CE 29 46 0 10 May 2023