Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning

3 November 2020

Papers citing "Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning"

50 / 237 papers shown

Title
Developing Healthcare Language Model Embedding Spaces Niall Taylor Dan Schofield Andrey Kormilitzin Dan W Joyce A. Nevado-Holgado 35 0 0 28 Mar 2024
A Question-centric Multi-experts Contrastive Learning Framework for Improving the Accuracy and Interpretability of Deep Sequential Knowledge Tracing Models Hengyuan Zhang Zitao Liu Chenming Shang Dawei Li Yong Jiang AI4Ed 49 8 0 12 Mar 2024
Understanding and Mitigating Human-Labelling Errors in Supervised Contrastive Learning Zijun Long Lipeng Zhuang George Killick R. McCreadie Gerardo Aragon Camarasa Paul Henderson NoLa 30 1 0 10 Mar 2024
Persona Extraction Through Semantic Similarity for Emotional Support Conversation Generation Seunghee Han Se Jin Park Chae Won Kim Y. Ro 27 1 0 07 Mar 2024
Supervised Contrastive Representation Learning: Landscape Analysis with Unconstrained Features Tina Behnia Christos Thrampoulidis SSL 33 0 0 29 Feb 2024
CLCE: An Approach to Refining Cross-Entropy and Contrastive Learning for Optimized Learning Fusion Zijun Long George Killick Lipeng Zhuang Gerardo Aragon Camarasa Zaiqiao Meng R. McCreadie VLM 44 2 0 22 Feb 2024
PASCL: Supervised Contrastive Learning with Perturbative Augmentation for Particle Decay Reconstruction Junjian Lu Siwei Liu Dmitrii Kobylianski Etienne Dreyer Eilam Gross Shangsong Liang 32 3 0 18 Feb 2024
Injecting Wiktionary to improve token-level contextual representations using contrastive learning Anna Mosolova Marie Candito Carlos Ramisch 24 0 0 12 Feb 2024
Adaptive Hypergraph Network for Trust Prediction Rongwei Xu Guanfeng Liu Yan Wang Xuyun Zhang Kai Zheng Xiaofang Zhou 19 0 0 07 Feb 2024
Toward Human-AI Alignment in Large-Scale Multi-Player Games Sugandha Sharma Guy Davidson Khimya Khetarpal Anssi Kanervisto Udit Arora Katja Hofmann Ida Momennejad 22 0 0 05 Feb 2024
Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Better Shengchao Liu Xiaoming Liu Yichen Wang Zehua Cheng Chengzhengxu Li Zhaohan Zhang Y. Lan Chao Shen DeLMO 32 2 0 01 Feb 2024
Institutional Platform for Secure Self-Service Large Language Model Exploration V. Bumgardner Mitchell A. Klusty W. V. Logan Samuel E. Armstrong Caylin D. Hickey Jeff Talbert Caylin Hickey Jeff Talbert 54 1 0 01 Feb 2024
Rank Supervised Contrastive Learning for Time Series Classification Qianying Ren Dongsheng Luo Dongjin Song AI4TS 21 2 0 31 Jan 2024
MIMIC: Mask Image Pre-training with Mix Contrastive Fine-tuning for Facial Expression Recognition Fan Zhang Xiaobao Guo Xiaojiang Peng Alex C. Kot 24 0 0 14 Jan 2024
Structured Probabilistic Coding Dou Hu Lingwei Wei Yaxin Liu Wei Zhou Songlin Hu 19 1 0 21 Dec 2023
Text2Tree: Aligning Text Representation to the Label Tree Hierarchy for Imbalanced Medical Classification Jiahuan Yan Haojun Gao Zhang Kai Weize Liu D. Z. Chen Jian Wu Jintai Chen 18 3 0 28 Nov 2023
SCStory: Self-supervised and Continual Online Story Discovery Susik Yoon Yu Meng Dongha Lee Jiawei Han CLL 38 8 0 27 Nov 2023
Elucidating and Overcoming the Challenges of Label Noise in Supervised Contrastive Learning Zijun Long George Killick Lipeng Zhuang R. McCreadie Gerardo Aragon Camarasa Paul Henderson 30 5 0 25 Nov 2023
DualTalker: A Cross-Modal Dual Learning Approach for Speech-Driven 3D Facial Animation Guinan Su Yanwu Yang Zhifeng Li VGen 33 1 0 08 Nov 2023
Retrofitting Light-weight Language Models for Emotions using Supervised Contrastive Learning Sapan Shah Sreedhar Reddy Pushpak Bhattacharyya 13 0 0 29 Oct 2023
PAC-tuning:Fine-tuning Pretrained Language Models with PAC-driven Perturbed Gradient Descent Guang-Da Liu Zhiyu Xue Xitong Zhang K. Johnson Rongrong Wang 20 5 0 26 Oct 2023
EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation Learning Ping Guo Xiangpeng Wei Yue Hu Baosong Yang Dayiheng Liu Fei Huang Jun Xie 21 2 0 26 Oct 2023
NADI 2023: The Fourth Nuanced Arabic Dialect Identification Shared Task Muhammad Abdul-Mageed AbdelRahim Elmadany Chiyu Zhang El Moatez Billah Nagoudi Houda Bouamor Nizar Habash 25 35 0 24 Oct 2023
RAPL: A Relation-Aware Prototype Learning Approach for Few-Shot Document-Level Relation Extraction Shiao Meng Xuming Hu Aiwei Liu Shuang Li Fukun Ma Yawen Yang Lijie Wen 35 7 0 24 Oct 2023
Hallucination Detection for Grounded Instruction Generation Lingjun Zhao Khanh Nguyen Hal Daumé HILM 36 7 0 23 Oct 2023
TATA: Stance Detection via Topic-Agnostic and Topic-Aware Embeddings Hans W. A. Hanley Zakir Durumeric 33 4 0 22 Oct 2023
RSVP: Customer Intent Detection via Agent Response Contrastive and Generative Pre-Training Yu-Chien Tang Wei-Yao Wang An-Zi Yen Wenjie Peng 26 1 0 15 Oct 2023
Incorporating Domain Knowledge Graph into Multimodal Movie Genre Classification with Self-Supervised Attention and Contrastive Learning Jiaqi Li Guilin Qi Chuanyi Zhang Yongrui Chen Yiming Tan Chenlong Xia Ye Tian 30 2 0 12 Oct 2023
Leveraging Twitter Data for Sentiment Analysis of Transit User Feedback: An NLP Framework Adway Das Abhishek Kumar Prajapati Pengxiang Zhang Mukund Srinath A. Ranjbari 9 2 0 11 Oct 2023
Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classification Simon Chi Lok Yu Jie He Víctor Gutiérrez-Basulto Jeff Z. Pan 27 3 0 08 Oct 2023
SINCERE: Supervised Information Noise-Contrastive Estimation REvisited Patrick Feeney M. C. Hughes 23 3 0 25 Sep 2023
Prompt Learning With Knowledge Memorizing Prototypes For Generalized Few-Shot Intent Detection Chaiyut Luoyiching Y. Li Yinghui Li Rongsheng Li Hai-Tao Zheng Nannan Zhou Hanjing Su CLL 28 0 0 10 Sep 2023
All Labels Together: Low-shot Intent Detection with an Efficient Label Semantic Encoding Paradigm Jiangshu Du Congying Xia Wenpeng Yin Tingting Liang Philip S. Yu VLM 24 0 0 07 Sep 2023
Supervised Contrastive Learning with Nearest Neighbor Search for Speech Emotion Recognition Xuechen Wang Shiwan Zhao Yong Qin 22 6 0 31 Aug 2023
When hard negative sampling meets supervised contrastive learning Zijun Long George Killick R. McCreadie Gerardo Aragon Camarasa Zaiqiao Meng SSL 28 3 0 28 Aug 2023
Joint Multiple Intent Detection and Slot Filling with Supervised Contrastive Learning and Self-Distillation Nguyen Anh Tu Hoang Thi Thu Uyen Tu Minh Phuong Ngo Xuan Bach VLM 14 4 0 28 Aug 2023
MatchXML: An Efficient Text-label Matching Framework for Extreme Multi-label Text Classification Hui Ye Rajshekhar Sunderraman Shihao Ji 29 3 0 25 Aug 2023
DR-Tune: Improving Fine-tuning of Pretrained Visual Models by Distribution Regularization with Semantic Calibration Nana Zhou Jiaxin Chen Di Huang 19 4 0 23 Aug 2023
Hate Speech Detection via Dual Contrastive Learning Junyu Lu Ho-Yi Lin Xiaokun Zhang Zhaoqing Li Tongyue Zhang Linlin Zong Fenglong Ma Bo Xu 30 17 0 10 Jul 2023
Hard Sample Mining Enabled Supervised Contrastive Feature Learning for Wind Turbine Pitch System Fault Diagnosis Zixuan Wang Bo Qin Mengxuan Li Jian Zhang M. Butala Peng Peng Hongwei Wang 13 0 0 26 Jun 2023
Symmetric Neural-Collapse Representations with Supervised Contrastive Loss: The Impact of ReLU and Batching Ganesh Ramachandra Kini V. Vakilian Tina Behnia Jaidev Gill Christos Thrampoulidis 17 1 0 13 Jun 2023
Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversations Dou Hu Yinan Bao Lingwei Wei Wei Zhou Song Hu 26 51 0 02 Jun 2023
THiFLY Research at SemEval-2023 Task 7: A Multi-granularity System for CTR-based Textual Entailment and Evidence Retrieval Yuxuan Zhou Ziyun Jin Meiwei Li Miao Li Xien Liu Xinxin You Ji Wu 29 11 0 02 Jun 2023
UCAS-IIE-NLP at SemEval-2023 Task 12: Enhancing Generalization of Multilingual BERT for Low-resource Sentiment Analysis Dou Hu Lingwei Wei Yaxin Liu Wei Zhou Songlin Hu 22 2 0 01 Jun 2023
Controlled Text Generation with Hidden Representation Transformations Vaibhav Kumar H. Koorehdavoudi Masud Moshtaghi Amita Misra Ankit Chadha Emilio Ferrara 18 3 0 30 May 2023
ContrastNER: Contrastive-based Prompt Tuning for Few-shot NER Amirhossein Layegh A. H. Payberah A. Soylu Dumitru Roman M. Matskin VLM 25 8 0 29 May 2023
BUCA: A Binary Classification Approach to Unsupervised Commonsense Question Answering Jie He U. SimonChiLok Víctor Gutiérrez-Basulto Jeff Z. Pan 39 10 0 25 May 2023
Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for Out-of-Domain Detection Rheeya Uppaal Junjie Hu Yixuan Li OODD 119 33 0 22 May 2023
What are the Desired Characteristics of Calibration Sets? Identifying Correlates on Long Form Scientific Summarization Griffin Adams Bichlien H. Nguyen Jake A. Smith Yingce Xia Shufang Xie Anna Ostropolets Budhaditya Deb Yuan Chen Tristan Naumann Noémie Elhadad 27 8 0 12 May 2023
Enhancing Contrastive Learning with Noise-Guided Attack: Towards Continual Relation Extraction in the Wild Ting Wu Jingyi Liu Rui Zheng Qi Zhang Tao Gui Xuanjing Huang CLL 33 0 0 11 May 2023