Self-Guided Contrastive Learning for BERT Sentence Representations

3 June 2021

Papers citing "Self-Guided Contrastive Learning for BERT Sentence Representations"

50 / 102 papers shown

Title
An Experimental Study on Pretraining Transformers from Scratch for IR Carlos Lassance Hervé Déjean S. Clinchant 23 11 0 25 Jan 2023
JCSE: Contrastive Learning of Japanese Sentence Embeddings and Its Applications Zihao Chen H. Handa Kimiaki Shirahama 14 2 0 19 Jan 2023
Semantic-aware Contrastive Learning for More Accurate Semantic Parsing Shan Wu Chunlei Xin Bo Chen Xianpei Han Le Sun 19 3 0 19 Jan 2023
Facilitating Contrastive Learning of Discourse Relational Senses by Exploiting the Hierarchy of Sense Relations Wanqiu Long Bonnie Webber 36 33 0 06 Jan 2023
English Contrastive Learning Can Learn Universal Cross-lingual Sentence Embeddings Yau-Shian Wang Ashley Wu Graham Neubig SSL 27 31 0 11 Nov 2022
miCSE: Mutual Information Contrastive Learning for Low-shot Sentence Embeddings T. Klein Moin Nabi SSL 18 15 0 09 Nov 2022
Dial2vec: Self-Guided Contrastive Learning of Unsupervised Dialogue Embeddings Che Liu Rui Wang Junfeng Jiang Yongbin Li Fei Huang SSL 28 8 0 27 Oct 2022
Enhancing Out-of-Distribution Detection in Natural Language Understanding via Implicit Layer Ensemble Hyunsoo Cho Choonghyun Park Jaewoo Kang Kang Min Yoo Taeuk Kim Sang-goo Lee OODD 22 8 0 20 Oct 2022
AugCSE: Contrastive Sentence Embedding with Diverse Augmentations Zilu Tang Muhammed Yusuf Kocyigit Derry Wijaya 23 8 0 20 Oct 2022
Learning from the Dictionary: Heterogeneous Knowledge Guided Fine-tuning for Chinese Spell Checking Yinghui Li Shirong Ma Qingyu Zhou Zhongli Li Li Yangning Shulin Huang R. Liu Chao Li Yunbo Cao Haitao Zheng 20 36 0 19 Oct 2022
Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representation Deng Cai Xin Li Jackie Chun-Sing Ho Lidong Bing W. Lam 18 6 0 18 Oct 2022
Fine-grained Category Discovery under Coarse-grained supervision with Hierarchical Weighted Self-contrastive Learning Wenbin An Feng Tian Ping Chen Siliang Tang Qinghua Zheng Qianying Wang 23 17 0 14 Oct 2022
Multilingual Representation Distillation with Contrastive Learning Weiting Tan Kevin Heffernan Holger Schwenk Philipp Koehn 35 16 0 10 Oct 2022
Label-Driven Denoising Framework for Multi-Label Few-Shot Aspect Category Detection Fei Zhao Yuchen Shen Zhanghua Wu Xinyu Dai 33 11 0 09 Oct 2022
InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings Xing Wu Chaochen Gao Zijia Lin Jizhong Han Zhongyuan Wang Songlin Hu 8 32 0 08 Oct 2022
SDA: Simple Discrete Augmentation for Contrastive Sentence Representation Learning Dongsheng Zhu Zhenyu Mao Jinghui Lu Rui Zhao Fei Tan 26 1 0 08 Oct 2022
ContraCLM: Contrastive Learning For Causal Language Model Nihal Jain Dejiao Zhang Wasi Uddin Ahmad Zijian Wang Feng Nan ... Ramesh Nallapati Baishakhi Ray Parminder Bhatia Xiaofei Ma Bing Xiang 23 16 0 03 Oct 2022
Supervised Contrastive Learning as Multi-Objective Optimization for Fine-Tuning Large Pre-trained Language Models Youness Moukafih Mounir Ghogho Kamel Smaïli AAML 11 4 0 28 Sep 2022
Non-Linguistic Supervision for Contrastive Learning of Sentence Embeddings Yiren Jian Chongyang Gao Soroush Vosoughi SSL 18 15 0 20 Sep 2022
Ranking-Enhanced Unsupervised Sentence Representation Learning Yeon Seonwoo Guoyin Wang Changmin Seo Sajal Choudhary Jiwei Li Xiang Li Puyang Xu Sunghyun Park Alice H. Oh SSL DRL AI4TS 47 15 0 09 Sep 2022
CrossDial: An Entertaining Dialogue Dataset of Chinese Crosstalk Baizhou Huang Shikang Du Xiao-Yi Wan 8 0 0 03 Sep 2022
EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learning Zhuoyuan Mao Chenhui Chu Sadao Kurohashi 29 1 0 31 May 2022
New Intent Discovery with Pre-training and Contrastive Learning Yuwei Zhang Haode Zhang Li-Ming Zhan Albert Y.S. Lam Albert Y. S. Lam SSL VLM 26 40 0 25 May 2022
Arithmetic-Based Pretraining -- Improving Numeracy of Pretrained Language Models Dominic Petrak N. Moosavi Iryna Gurevych AIMat 29 2 0 13 May 2022
EASE: Entity-Aware Contrastive Learning of Sentence Embedding Sosuke Nishikawa Ryokan Ri Ikuya Yamada Yoshimasa Tsuruoka Isao Echizen 20 29 0 09 May 2022
Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding Yanfeng Chang Yun-Nung Chen 15 9 0 02 May 2022
Debiased Contrastive Learning of Unsupervised Sentence Representations Kun Zhou Beichen Zhang Wayne Xin Zhao Ji-Rong Wen SSL 28 98 0 02 May 2022
MCSE: Multimodal Contrastive Learning of Sentence Embeddings Miaoran Zhang Marius Mosbach David Ifeoluwa Adelani Michael A. Hedderich Dietrich Klakow 23 34 0 22 Apr 2022
DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings Yung-Sung Chuang Rumen Dangovski Hongyin Luo Yang Zhang Shiyu Chang M. Soljavcić Shang-Wen Li Wen-tau Yih Yoon Kim James R. Glass 28 220 0 21 Apr 2022
Contrastive Learning with Hard Negative Entities for Entity Set Expansion Yinghui Li Y. Li Yuxin He Tianyu Yu Ying Shen Haitao Zheng 16 32 0 16 Apr 2022
Contrastive Demonstration Tuning for Pre-trained Language Models Xiaozhuan Liang Ningyu Zhang Shuyang Cheng Zhenru Zhang Chuanqi Tan Huajun Chen VLM ALM VPVLM 28 9 0 09 Apr 2022
Graph Enhanced Contrastive Learning for Radiology Findings Summarization Jinpeng Hu Zhuo Li Zhihong Chen Zhuguo Li Xiang Wan Tsung-Hui Chang MedIm 6 46 0 01 Apr 2022
Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning Ziyun Xu Chengyu Wang Minghui Qiu Fuli Luo Runxin Xu Songfang Huang Jun Huang VLM 38 31 0 01 Apr 2022
DEIM: An effective deep encoding and interaction model for sentence matching Kexin Jiang Yahui Zhao Rong-yi Cui Zhenguo Zhang 7 4 0 20 Mar 2022
Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning Yuxin Jiang Linhan Zhang Wei Wang SSL 11 46 0 14 Mar 2022
Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification Zihan Wang Peiyi Wang Lianzhe Huang Xin Sun Houfeng Wang AILaw VLM 19 99 0 08 Mar 2022
Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings Malte Ostendorff Nils Rethmeier Isabelle Augenstein Bela Gipp Georg Rehm 13 73 0 14 Feb 2022
PCL: Peer-Contrastive Learning with Diverse Augmentations for Unsupervised Sentence Embeddings Qiyu Wu Chongyang Tao Tao Shen Can Xu Xiubo Geng Daxin Jiang SSL 14 33 0 28 Jan 2022
Contrast and Generation Make BART a Good Dialogue Emotion Recognizer Shimin Li Hang Yan Xipeng Qiu 11 84 0 21 Dec 2021
Virtual Augmentation Supported Contrastive Learning of Sentence Representations Dejiao Zhang Wei Xiao Henghui Zhu Xiaofei Ma Andrew O. Arnold SSL 46 29 0 16 Oct 2021
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Fangyu Liu Yunlong Jiao Jordan Massiah Emine Yilmaz Serhii Havrylov SSL 87 29 0 27 Sep 2021
MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models Qianchu Liu Fangyu Liu Nigel Collier Anna Korhonen Ivan Vulić 131 21 0 19 Sep 2021
ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding Xing Wu Chaochen Gao Liangjun Zang Jizhong Han Zhongyuan Wang Songlin Hu SSL AILaw 31 129 0 09 Sep 2021
PAUSE: Positive and Annealed Unlabeled Sentence Embedding Le-le Cao Emil Larsson Vilhelm von Ehrenheim Dhiana Deva Cavalcanti Rocha Anna Martin Sonja Horn 13 5 0 07 Sep 2021
Self-Supervised Contrastive Learning with Adversarial Perturbations for Defending Word Substitution-based Attacks Zhao Meng Yihan Dong Mrinmaya Sachan Roger Wattenhofer AAML 66 10 0 15 Jul 2021
Sentence Similarity Based on Contexts Xiaofei Sun Yuxian Meng Xiang Ao Fei Wu Tianwei Zhang Jiwei Li Chun Fan 14 29 0 17 May 2021
SimCSE: Simple Contrastive Learning of Sentence Embeddings Tianyu Gao Xingcheng Yao Danqi Chen AILaw SSL 11 3,248 0 18 Apr 2021
Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders Fangyu Liu Ivan Vulić Anna Korhonen Nigel Collier VLM OffRL 13 117 0 16 Apr 2021
Structure Inducing Pre-Training Matthew B. A. McDermott Brendan Yap Peter Szolovits Marinka Zitnik 30 18 0 18 Mar 2021
Contrastive Representation Learning: A Framework and Review Phúc H. Lê Khắc Graham Healy A. Smeaton SSL AI4TS 164 684 0 10 Oct 2020