Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning

3 November 2020

Papers citing "Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning"

50 / 74 papers shown

Title
DMRL: Data- and Model-aware Reward Learning for Data Extraction Zhiqiang Wang Ruoxi Cheng 26 0 0 07 May 2025
Evaluating Contrastive Feedback for Effective User Simulations Andreas Konstantin Kruff Timo Breuer Philipp Schaer 16 0 0 05 May 2025
Semantic-Aware Contrastive Fine-Tuning: Boosting Multimodal Malware Classification with Discriminative Embeddings Ivan Montoya Sanchez Shaswata Mitra Aritran Piplai Sudip Mittal 44 0 0 25 Apr 2025
LOCO-EPI: Leave-one-chromosome-out (LOCO) as a benchmarking paradigm for deep learning based prediction of enhancer-promoter interactions Muhammad Tahir Shehroz S. Khan James Davie Soichiro Yamanaka A. Ashraf 47 1 0 01 Apr 2025
Multi-level Supervised Contrastive Learning Naghmeh Ghanooni Barbod Pajoum Harshit Rawal Sophie Fellenz Vo Nguyen Le Duy Marius Kloft 86 0 0 04 Feb 2025
Fact-Preserved Personalized News Headline Generation Zhao Yang Junhong Lian Xiang Ao 72 1 0 21 Jan 2025
Fine-Tuning Games: Bargaining and Adaptation for General-Purpose Models Benjamin Laufer Jon M. Kleinberg Hoda Heidari 55 8 0 03 Jan 2025
Reducing and Exploiting Data Augmentation Noise through Meta Reweighting Contrastive Learning for Text Classification Guanyi Mou Yichuan Li Kyumin Lee 26 3 0 26 Sep 2024
Constrained Multi-Layer Contrastive Learning for Implicit Discourse Relationship Recognition Yiheng Wu Junhui Li Muhua Zhu 19 0 0 07 Sep 2024
UniDEC : Unified Dual Encoder and Classifier Training for Extreme Multi-Label Classification Siddhant Kharbanda Devaansh Gupta K. Gururaj Pankaj Malhotra Cho-Jui Hsieh Rohit Babbar Rohit Babbar 33 0 0 04 May 2024
Heterogeneous Contrastive Learning for Foundation Models and Beyond Lecheng Zheng Baoyu Jing Zihao Li Hanghang Tong Jingrui He VLM 30 19 0 30 Mar 2024
Persona Extraction Through Semantic Similarity for Emotional Support Conversation Generation Seunghee Han Se Jin Park Chae Won Kim Y. Ro 27 1 0 07 Mar 2024
Supervised Contrastive Representation Learning: Landscape Analysis with Unconstrained Features Tina Behnia Christos Thrampoulidis SSL 31 0 0 29 Feb 2024
CLCE: An Approach to Refining Cross-Entropy and Contrastive Learning for Optimized Learning Fusion Zijun Long George Killick Lipeng Zhuang Gerardo Aragon Camarasa Zaiqiao Meng R. McCreadie VLM 37 2 0 22 Feb 2024
PASCL: Supervised Contrastive Learning with Perturbative Augmentation for Particle Decay Reconstruction Junjian Lu Siwei Liu Dmitrii Kobylianski Etienne Dreyer Eilam Gross Shangsong Liang 29 3 0 18 Feb 2024
Injecting Wiktionary to improve token-level contextual representations using contrastive learning Anna Mosolova Marie Candito Carlos Ramisch 24 0 0 12 Feb 2024
Adaptive Hypergraph Network for Trust Prediction Rongwei Xu Guanfeng Liu Yan Wang Xuyun Zhang Kai Zheng Xiaofang Zhou 19 0 0 07 Feb 2024
Institutional Platform for Secure Self-Service Large Language Model Exploration V. Bumgardner Mitchell A. Klusty W. V. Logan Samuel E. Armstrong Caylin D. Hickey Jeff Talbert Caylin Hickey Jeff Talbert 48 1 0 01 Feb 2024
Retrofitting Light-weight Language Models for Emotions using Supervised Contrastive Learning Sapan Shah Sreedhar Reddy Pushpak Bhattacharyya 13 0 0 29 Oct 2023
RAPL: A Relation-Aware Prototype Learning Approach for Few-Shot Document-Level Relation Extraction Shiao Meng Xuming Hu Aiwei Liu Shuang Li Fukun Ma Yawen Yang Lijie Wen 30 7 0 24 Oct 2023
Symmetric Neural-Collapse Representations with Supervised Contrastive Loss: The Impact of ReLU and Batching Ganesh Ramachandra Kini V. Vakilian Tina Behnia Jaidev Gill Christos Thrampoulidis 17 1 0 13 Jun 2023
BUCA: A Binary Classification Approach to Unsupervised Commonsense Question Answering Jie He U. SimonChiLok Víctor Gutiérrez-Basulto Jeff Z. Pan 33 10 0 25 May 2023
What are the Desired Characteristics of Calibration Sets? Identifying Correlates on Long Form Scientific Summarization Griffin Adams Bichlien H. Nguyen Jake A. Smith Yingce Xia Shufang Xie Anna Ostropolets Budhaditya Deb Yuan Chen Tristan Naumann Noémie Elhadad 22 8 0 12 May 2023
Cluster-Level Contrastive Learning for Emotion Recognition in Conversations Kailai Yang Tianlin Zhang Hassan Alhuzali Sophia Ananiadou 29 43 0 07 Feb 2023
Effective End-to-End Vision Language Pretraining with Semantic Visual Loss Xiaofeng Yang Fayao Liu Guosheng Lin VLM 19 7 0 18 Jan 2023
Continual Contrastive Finetuning Improves Low-Resource Relation Extraction Wenxuan Zhou Sheng Zhang Tristan Naumann Muhao Chen Hoifung Poon 46 6 0 21 Dec 2022
NBC-Softmax : Darkweb Author fingerprinting and migration tracking Gayan K. Kulatilleke Shekhar S. Chandra Marius Portmann 34 0 0 15 Dec 2022
Feature-Level Debiased Natural Language Understanding Yougang Lyu Piji Li Yechang Yang Maarten de Rijke Pengjie Ren Yukun Zhao Dawei Yin Z. Ren 26 10 0 11 Dec 2022
Finetune like you pretrain: Improved finetuning of zero-shot vision models Sachin Goyal Ananya Kumar Sankalp Garg Zico Kolter Aditi Raghunathan CLIP VLM 27 136 0 01 Dec 2022
Revisiting Distance Metric Learning for Few-Shot Natural Language Classification Witold Sosnowski Anna Wróblewska Karolina Seweryn P. Gawrysiak 18 0 0 28 Nov 2022
Distance Metric Learning Loss Functions in Few-Shot Scenarios of Supervised Language Models Fine-Tuning Witold Sosnowski Karolina Seweryn Anna Wróblewska P. Gawrysiak 20 0 0 28 Nov 2022
Prototypical Fine-tuning: Towards Robust Performance Under Varying Data Sizes Yiqiao Jin Xiting Wang Y. Hao Yizhou Sun Xing Xie 33 11 0 24 Nov 2022
Estimating Soft Labels for Out-of-Domain Intent Detection Hao Lang Yinhe Zheng Jian Sun Feiling Huang Luo Si Yongbin Li 28 15 0 10 Nov 2022
WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domain Raj Sanjay Shah Kunal Chawla Dheeraj Eidnani Agam Shah Wendi Du S. Chava Natraj Raman Charese Smiley Jiaao Chen Diyi Yang AIFin 26 103 0 31 Oct 2022
SDCL: Self-Distillation Contrastive Learning for Chinese Spell Checking Xiaotian Zhang Hang Yan Sun Yu Xipeng Qiu 24 4 0 31 Oct 2022
Dictionary-Assisted Supervised Contrastive Learning Patrick Y. Wu Richard Bonneau Joshua A. Tucker Jonathan Nagler CLIP 25 0 0 27 Oct 2022
HCL-TAT: A Hybrid Contrastive Learning Method for Few-shot Event Detection with Task-Adaptive Threshold Rui-lan Zhang Wei Wei Xian-Ling Mao Rui Fang Dangyang Chen 30 11 0 17 Oct 2022
Label-Driven Denoising Framework for Multi-Label Few-Shot Aspect Category Detection Fei Zhao Yuchen Shen Zhanghua Wu Xinyu Dai 33 11 0 09 Oct 2022
Few-shot Text Classification with Dual Contrastive Consistency Liwen Sun Jiawei Han 19 0 0 29 Sep 2022
Whodunit? Learning to Contrast for Authorship Attribution Bo Ai Yuchen Wang Yugin Tan Samson Tan SSL 16 16 0 23 Sep 2022
Non-Linguistic Supervision for Contrastive Learning of Sentence Embeddings Yiren Jian Chongyang Gao Soroush Vosoughi SSL 18 15 0 20 Sep 2022
Mere Contrastive Learning for Cross-Domain Sentiment Analysis Yun Luo Fang Guo Zihan Liu Yue Zhang 31 15 0 18 Aug 2022
To Answer or Not to Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learning Yunjie Ji Liangyu Chen Chenxiao Dou Baochang Ma Xiangang Li 41 5 0 02 Aug 2022
Improving Fine-tuning of Self-supervised Models with Contrastive Initialization Haolin Pan Yong Guo Qinyi Deng Hao-Fan Yang Yiqun Chen Jian Chen SSL 18 19 0 30 Jul 2022
Negative Samples are at Large: Leveraging Hard-distance Elastic Loss for Re-identification Hyungtae Lee Sungmin Eum H. Kwon VLM 15 4 0 20 Jul 2022
A Multi-level Supervised Contrastive Learning Framework for Low-Resource Natural Language Inference Shuang Li Xuming Hu Li Lin Aiwei Liu Lijie Wen Philip S. Yu 27 18 0 31 May 2022
New Intent Discovery with Pre-training and Contrastive Learning Yuwei Zhang Haode Zhang Li-Ming Zhan Albert Y.S. Lam Albert Y. S. Lam SSL VLM 26 40 0 25 May 2022
Conditional Supervised Contrastive Learning for Fair Text Classification Jianfeng Chi Will Shand Yaodong Yu Kai-Wei Chang Han Zhao Yuan Tian FaML 46 14 0 23 May 2022
Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding Yanfeng Chang Yun-Nung Chen 20 9 0 02 May 2022
When do Contrastive Word Alignments Improve Many-to-many Neural Machine Translation? Zhuoyuan Mao Chenhui Chu Raj Dabre Haiyue Song Zhen Wan Sadao Kurohashi 19 3 0 26 Apr 2022