CERT: Contrastive Self-supervised Learning for Language Understanding

16 May 2020

Papers citing "CERT: Contrastive Self-supervised Learning for Language Understanding"

50 / 54 papers shown

Title
LLM-QE: Improving Query Expansion by Aligning Large Language Models with Ranking Preferences Sijia Yao Pengcheng Huang Zhenghao Liu Yu Gu Yukun Yan S. Yu Ge Yu RALM 36 0 0 24 Feb 2025
Reducing and Exploiting Data Augmentation Noise through Meta Reweighting Contrastive Learning for Text Classification Guanyi Mou Yichuan Li Kyumin Lee 28 3 0 26 Sep 2024
Space Decomposition for Sentence Embedding Wuttikorn Ponwitayarat Peerat Limkonchotiwat E. Chuangsuwanich Sarana Nutanong 24 0 0 05 Jun 2024
Sparse Concept Bottleneck Models: Gumbel Tricks in Contrastive Learning Andrei Semenov Vladimir Ivanov Aleksandr Beznosikov Alexander Gasnikov 31 6 0 04 Apr 2024
Heterogeneous Contrastive Learning for Foundation Models and Beyond Lecheng Zheng Baoyu Jing Zihao Li Hanghang Tong Jingrui He VLM 30 19 0 30 Mar 2024
Towards Deviation-Robust Agent Navigation via Perturbation-Aware Contrastive Learning Bingqian Lin Yanxin Long Yi Zhu Fengda Zhu Xiaodan Liang QiXiang Ye Liang Lin 29 5 0 09 Mar 2024
Injecting Wiktionary to improve token-level contextual representations using contrastive learning Anna Mosolova Marie Candito Carlos Ramisch 24 0 0 12 Feb 2024
Contrastive Multi-Level Graph Neural Networks for Session-based Recommendation F. Wang Xingyu Gao Zhenyu Chen Lei Lyu 16 12 0 06 Nov 2023
Retrofitting Light-weight Language Models for Emotions using Supervised Contrastive Learning Sapan Shah Sreedhar Reddy Pushpak Bhattacharyya 13 0 0 29 Oct 2023
Graph Contrastive Topic Model Zheheng Luo Lei Liu Qianqian Xie Sophia Ananiadou 16 2 0 05 Jul 2023
Instance Smoothed Contrastive Learning for Unsupervised Sentence Embedding Hongliang He Junlei Zhang Zhenzhong Lan Yue Zhang 33 5 0 12 May 2023
Detecting Contextomized Quotes in News Headlines by Contrastive Learning Seonyeong Song Hyeonho Song Kunwoo Park Jiyoung Han M. Cha 19 1 0 09 Feb 2023
Episodes Discovery Recommendation with Multi-Source Augmentations Ziwei Fan Alice Wang Zahra Nazari AI4TS 28 2 0 04 Jan 2023
Few-shot Object Detection with Refined Contrastive Learning Zeyu Shangguan Lian Huai Tong Liu Xingqun Jiang 17 7 0 24 Nov 2022
Dictionary-Assisted Supervised Contrastive Learning Patrick Y. Wu Richard Bonneau Joshua A. Tucker Jonathan Nagler CLIP 25 0 0 27 Oct 2022
Event-Centric Question Answering via Contrastive Learning and Invertible Event Transformation Junru Lu Xingwei Tan Gabriele Pergola Lin Gui Yulan He 19 10 0 24 Oct 2022
A Benchmark Study of Contrastive Learning for Arabic Social Meaning Md. Tawkat Islam Khondaker El Moatez Billah Nagoudi AbdelRahim Elmadany Muhammad Abdul-Mageed L. Lakshmanan 20 3 0 22 Oct 2022
Few-shot Text Classification with Dual Contrastive Consistency Liwen Sun Jiawei Han 19 0 0 29 Sep 2022
CLOWER: A Pre-trained Language Model with Contrastive Learning over Word and Character Representations Borun Chen Hongyin Tang Jiahao Bu Kai Zhang Jingang Wang Qifan Wang Haitao Zheng Wei Yu Wu Liqian Yu VLM 25 1 0 23 Aug 2022
Type-enriched Hierarchical Contrastive Strategy for Fine-Grained Entity Typing Xinyu Zuo Haijin Liang Ning Jing Shuang Zeng Zhou Fang Yu Luo 26 6 0 22 Aug 2022
Personalized Showcases: Generating Multi-Modal Explanations for Recommendations An Yan Zhankui He Jiacheng Li Tianyang Zhang Julian McAuley 27 35 0 30 Jun 2022
Intrinsic Anomaly Detection for Multi-Variate Time Series Stephan Rabanser Tim Januschowski Kashif Rasul Oliver Borchert Richard Kurle Jan Gasthaus Michael Bohlke-Schneider Nicolas Papernot Valentin Flunkert AI4TS 28 4 0 29 Jun 2022
EASE: Entity-Aware Contrastive Learning of Sentence Embedding Sosuke Nishikawa Ryokan Ri Ikuya Yamada Yoshimasa Tsuruoka Isao Echizen 20 29 0 09 May 2022
Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding Yanfeng Chang Yun-Nung Chen 20 9 0 02 May 2022
DialAug: Mixing up Dialogue Contexts in Contrastive Learning for Robust Conversational Modeling Lahari Poddar Peiyao Wang J. Reinspach 11 5 0 15 Apr 2022
Contextual Representation Learning beyond Masked Language Modeling Zhiyi Fu Wangchunshu Zhou Jingjing Xu Hao Zhou Lei Li 28 25 0 08 Apr 2022
CoCoSoDa: Effective Contrastive Learning for Code Search Ensheng Shi Yanlin Wang Wenchao Gu Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun 28 33 0 07 Apr 2022
A Dual-Contrastive Framework for Low-Resource Cross-Lingual Named Entity Recognition Yingwen Fu Nankai Lin Ziyu Yang Shengyi Jiang 24 4 0 02 Apr 2022
SCD: Self-Contrastive Decorrelation for Sentence Embeddings T. Klein Moin Nabi SSL 27 25 0 15 Mar 2022
Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification Zihan Wang Peiyi Wang Lianzhe Huang Xin Sun Houfeng Wang AILaw VLM 19 99 0 08 Mar 2022
Improving Health Mentioning Classification of Tweets using Contrastive Adversarial Training Pervaiz Iqbal Khan Shoaib Ahmed Siddiqui Imran Razzak Andreas Dengel Sheraz Ahmed 13 3 0 03 Mar 2022
Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings Malte Ostendorff Nils Rethmeier Isabelle Augenstein Bela Gipp Georg Rehm 19 73 0 14 Feb 2022
Text and Code Embeddings by Contrastive Pre-Training Arvind Neelakantan Tao Xu Raul Puri Alec Radford Jesse Michael Han ... Tabarak Khan Toki Sherbakov Joanne Jang Peter Welinder Lilian Weng SSL AI4TS 218 421 0 24 Jan 2022
Unsupervised Dense Information Retrieval with Contrastive Learning Gautier Izacard Mathilde Caron Lucas Hosseini Sebastian Riedel Piotr Bojanowski Armand Joulin Edouard Grave RALM 26 807 0 16 Dec 2021
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 21 105 0 01 Nov 2021
Contrastive Document Representation Learning with Graph Attention Networks Peng-Tao Xu Xinchi Chen Xiaofei Ma Zhiheng Huang Bing Xiang 14 9 0 20 Oct 2021
Natural Attribute-based Shift Detection Jeonghoon Park Jimin Hong Radhika Dua Daehoon Gwak Yixuan Li Jaegul Choo E. Choi OOD 25 3 0 18 Oct 2021
Virtual Augmentation Supported Contrastive Learning of Sentence Representations Dejiao Zhang Wei Xiao Henghui Zhu Xiaofei Ma Andrew O. Arnold SSL 51 29 0 16 Oct 2021
Building Chinese Biomedical Language Models via Multi-Level Text Discrimination Quan Wang Songtai Dai Benfeng Xu Yajuan Lyu Yong Zhu Hua-Hong Wu Haifeng Wang 63 14 0 14 Oct 2021
ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding Xing Wu Chaochen Gao Liangjun Zang Jizhong Han Zhongyuan Wang Songlin Hu SSL AILaw 33 129 0 09 Sep 2021
Enhanced Seq2Seq Autoencoder via Contrastive Learning for Abstractive Text Summarization Chujie Zheng Kunpeng Zhang Harry J. Wang Ling Fan Zhe Wang 20 6 0 26 Aug 2021
A Survey on Data Augmentation for Text Classification Markus Bayer M. Kaufhold Christian A. Reuter 30 334 0 07 Jul 2021
Investigating the Role of Negatives in Contrastive Representation Learning Jordan T. Ash Surbhi Goel A. Krishnamurthy Dipendra Kumar Misra SSL 26 49 0 18 Jun 2021
Self-Guided Contrastive Learning for BERT Sentence Representations Taeuk Kim Kang Min Yoo Sang-goo Lee SSL 33 202 0 03 Jun 2021
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer Yuanmeng Yan Rumei Li Sirui Wang Fuzheng Zhang Wei Yu Wu Weiran Xu SSL 37 546 0 25 May 2021
Contrastive Attraction and Contrastive Repulsion for Representation Learning Huangjie Zheng Xu Chen Jiangchao Yao Hongxia Yang Chunyuan Li Ya-Qin Zhang Hao Zhang Ivor Tsang Jingren Zhou Mingyuan Zhou SSL 39 12 0 08 May 2021
Improving BERT Model Using Contrastive Learning for Biomedical Relation Extraction P. Su Yifan Peng K. Vijay-Shanker SSL 26 35 0 28 Apr 2021
Disentangled Contrastive Learning for Learning Robust Textual Representations Xiang Chen Xin Xie Zhen Bi Hongbin Ye Shumin Deng Ningyu Zhang Huajun Chen 33 5 0 11 Apr 2021
Supervised Contrastive Replay: Revisiting the Nearest Class Mean Classifier in Online Class-Incremental Continual Learning Zheda Mai Ruiwen Li Hyunwoo J. Kim Scott Sanner CLL 23 180 0 22 Mar 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 87 90 0 25 Feb 2021