DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations

5 June 2020

Papers citing "DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations"

34 / 84 papers shown

Title
Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings Malte Ostendorff Nils Rethmeier Isabelle Augenstein Bela Gipp Georg Rehm 19 73 0 14 Feb 2022
Contrastive predictive coding for Anomaly Detection in Multi-variate Time Series Data Theivendiram Pranavan Terence Sim Arulmurugan Ambikapathi Savitha Ramasamy AI4TS 23 7 0 08 Feb 2022
Comparison and Combination of Sentence Embeddings Derived from Different Supervision Signals Hayato Tsukagoshi Ryohei Sasano Koichi Takeda 12 8 0 07 Feb 2022
SSLGuard: A Watermarking Scheme for Self-supervised Learning Pre-trained Encoders Tianshuo Cong Xinlei He Yang Zhang 15 52 0 27 Jan 2022
Text and Code Embeddings by Contrastive Pre-Training Arvind Neelakantan Tao Xu Raul Puri Alec Radford Jesse Michael Han ... Tabarak Khan Toki Sherbakov Joanne Jang Peter Welinder Lilian Weng SSL AI4TS 218 421 0 24 Jan 2022
Robust Contrastive Learning against Noisy Views Ching-Yao Chuang R. Devon Hjelm Xin Eric Wang Vibhav Vineet Neel Joshi Antonio Torralba Stefanie Jegelka Ya-heng Song NoLa 13 68 0 12 Jan 2022
A Fistful of Words: Learning Transferable Visual Models from Bag-of-Words Supervision Ajinkya Tejankar Maziar Sanjabi Bichen Wu Saining Xie Madian Khabsa Hamed Pirsiavash Hamed Firooz VLM 26 17 0 27 Dec 2021
Unsupervised Dense Information Retrieval with Contrastive Learning Gautier Izacard Mathilde Caron Lucas Hosseini Sebastian Riedel Piotr Bojanowski Armand Joulin Edouard Grave RALM 26 807 0 16 Dec 2021
DeepQR: Neural-based Quality Ratings for Learnersourced Multiple-Choice Questions Lin Ni Qiming Bao Xiaoxuan Li Qianqian Qi Paul Denny Jim Warren Michael Witbrock Jiamo Liu AI4Ed 11 15 0 19 Nov 2021
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 21 105 0 01 Nov 2021
Contrastive Document Representation Learning with Graph Attention Networks Peng-Tao Xu Xinchi Chen Xiaofei Ma Zhiheng Huang Bing Xiang 14 9 0 20 Oct 2021
Virtual Augmentation Supported Contrastive Learning of Sentence Representations Dejiao Zhang Wei Xiao Henghui Zhu Xiaofei Ma Andrew O. Arnold SSL 51 29 0 16 Oct 2021
Heterogeneous Graph-Based Multimodal Brain Network Learning Gen Shi Yifan Zhu Wenjin Liu Quanming Yao Xia Li 21 7 0 16 Oct 2021
Towards Learning (Dis)-Similarity of Source Code from Program Contrasts Yangruibo Ding Luca Buratti Saurabh Pujar Alessandro Morari Baishakhi Ray Saikat Chakraborty 21 36 0 08 Oct 2021
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Fangyu Liu Yunlong Jiao Jordan Massiah Emine Yilmaz Serhii Havrylov SSL 89 29 0 27 Sep 2021
Efficient Contrastive Learning via Novel Data Augmentation and Curriculum Learning Seonghyeon Ye Jiseon Kim Alice H. Oh CLL VLM 24 21 0 10 Sep 2021
Aligning Cross-lingual Sentence Representations with Dual Momentum Contrast Liang Wang Wei-Ye Zhao Jingming Liu 32 14 0 01 Sep 2021
Improved Text Classification via Contrastive Adversarial Training Lin Pan Chung-Wei Hang Avirup Sil Saloni Potdar AAML 18 86 0 21 Jul 2021
Investigating the Role of Negatives in Contrastive Representation Learning Jordan T. Ash Surbhi Goel A. Krishnamurthy Dipendra Kumar Misra SSL 29 49 0 18 Jun 2021
Self-Guided Contrastive Learning for BERT Sentence Representations Taeuk Kim Kang Min Yoo Sang-goo Lee SSL 36 202 0 03 Jun 2021
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer Yuanmeng Yan Rumei Li Sirui Wang Fuzheng Zhang Wei Yu Wu Weiran Xu SSL 37 546 0 25 May 2021
Contrastive Attraction and Contrastive Repulsion for Representation Learning Huangjie Zheng Xu Chen Jiangchao Yao Hongxia Yang Chunyuan Li Ya-Qin Zhang Hao Zhang Ivor Tsang Jingren Zhou Mingyuan Zhou SSL 42 12 0 08 May 2021
Data-Efficient Language-Supervised Zero-Shot Learning with Self-Distillation Rui Cheng Bichen Wu Peizhao Zhang Peter Vajda Joseph E. Gonzalez CLIP VLM 21 31 0 18 Apr 2021
Disentangled Contrastive Learning for Learning Robust Textual Representations Xiang Chen Xin Xie Zhen Bi Hongbin Ye Shumin Deng Ningyu Zhang Huajun Chen 33 5 0 11 Apr 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 87 90 0 25 Feb 2021
Quantifying and Mitigating Privacy Risks of Contrastive Learning Xinlei He Yang Zhang 11 51 0 08 Feb 2021
Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup Luyu Gao Yunyi Zhang Jiawei Han Jamie Callan 23 90 0 18 Jan 2021
CLEAR: Contrastive Learning for Sentence Representation Zhuofeng Wu Sinong Wang Jiatao Gu Madian Khabsa Fei Sun Hao Ma SSL 30 319 0 31 Dec 2020
Universal Sentence Representation Learning with Conditional Masked Language Model Ziyi Yang Yinfei Yang Daniel Matthew Cer Jax Law Eric F. Darve SSL 24 57 0 28 Dec 2020
CODER: Knowledge infused cross-lingual medical term embedding for term normalization Zheng Yuan Zhengyun Zhao Haixia Sun Jiao Li Fei Wang Sheng Yu MedIm 13 95 0 05 Nov 2020
A Survey on Contrastive Self-supervised Learning Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee F. Makedon SSL 20 1,358 0 31 Oct 2020
A Mutual Information Maximization Perspective of Language Representation Learning Lingpeng Kong Cyprien de Masson dÁutume Wang Ling Lei Yu Zihang Dai Dani Yogatama SSL 214 165 0 18 Oct 2019
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 201 882 0 03 May 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,956 0 20 Apr 2018