Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach

15 October 2020

Papers citing "Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach"

34 / 34 papers shown

Title
Whispering in Amharic: Fine-tuning Whisper for Low-resource Language Dawit Ketema Gete Bedru Yimam Ahamed Tadesse Destaw Belay Yohannes Ayana Ejigu Sukairaj Hafiz Imam ... Umma Aliyu Musa Martin Semmann Shamsuddeen Hassan Muhammad Henning Schreiber Seid Muhie Yimam 52 0 0 24 Mar 2025
Sun-Shine: A Large Language Model for Tibetan Culture Cheng Huang Fan Gao Nyima Tashi Yutong Liu Xiangxiang Wang ... Gadeng Luosang Rinchen Dongrub Dorje Tashi Xiao Feng Yongbin Yu ALM 106 2 0 24 Mar 2025
Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Models Ran Xu Hejie Cui Yue Yu Xuan Kan Wenqi Shi Yuchen Zhuang Wei Jin Joyce C. Ho Carl Yang 77 14 0 28 Jan 2025
Theoretical Analysis of Weak-to-Strong Generalization Hunter Lang David Sontag Aravindan Vijayaraghavan 32 21 0 25 May 2024
Cross-Platform Hate Speech Detection with Weakly Supervised Causal Disentanglement Paras Sheth Tharindu Kumarage Raha Moraffah Amanat Chadha Huan Liu 42 1 0 17 Apr 2024
From Robustness to Improved Generalization and Calibration in Pre-trained Language Models Josip Jukić Jan Snajder 53 0 0 31 Mar 2024
Domain Adaptation of Multilingual Semantic Search -- Literature Review Anna Bringmann Anastasia Zhukova VLM 50 0 0 05 Feb 2024
Manifold-based Verbalizer Space Re-embedding for Tuning-free Prompt-based Classification Hao Wang Sendong Zhao Chi-Liang Liu Nuwa Xi Muzhen Cai Bing Qin Ting Liu 29 1 0 08 Sep 2023
DEFTri: A Few-Shot Label Fused Contextual Representation Learning For Product Defect Triage in e-Commerce Ipsita Mohanty 24 2 0 21 Jul 2023
An Adaptive Method for Weak Supervision with Drifting Data Alessio Mazzetto Reza Esfandiarpoor E. Upfal Stephen H. Bach Stephen H. Bach 78 1 0 02 Jun 2023
Controlled Text Generation with Hidden Representation Transformations Vaibhav Kumar H. Koorehdavoudi Masud Moshtaghi Amita Misra Ankit Chadha Emilio Ferrara 31 3 0 30 May 2023
Weakly Supervised Label Learning Flows You Lu Chidubem Arachie Bert Huang 31 0 0 19 Feb 2023
Losses over Labels: Weakly Supervised Learning via Direct Loss Construction Dylan Sam J. Zico Kolter NoLa OffRL 37 13 0 13 Dec 2022
Learning Task-Aware Effective Brain Connectivity for fMRI Analysis with Graph Neural Networks Yue Yu Xuan Kan Hejie Cui Ran Xu Yu Zheng ... Kun Zhang Razieh Nabi Ying Guo Chaogang Zhang Carl Yang 20 17 0 01 Nov 2022
Where to start? Analyzing the potential value of intermediate models Leshem Choshen Elad Venezian Shachar Don-Yehiya Noam Slonim Yoav Katz MoMe 35 27 0 31 Oct 2022
BERT-Flow-VAE: A Weakly-supervised Model for Multi-Label Text Classification Ziwen Liu J. Grau-Bové Scott Orr 45 1 0 27 Oct 2022
Adaptive Multi-view Rule Discovery for Weakly-Supervised Compatible Products Prediction Rongzhi Zhang Rebecca West Xiquan Cui Chao Zhang 37 6 0 28 Jun 2022
Training Subset Selection for Weak Supervision Hunter Lang Aravindan Vijayaraghavan David Sontag NoLa 18 21 0 06 Jun 2022
XPASC: Measuring Generalization in Weak Supervision by Explainability and Association Luisa März Ehsaneddin Asgari Fabienne Braune Franziska Zimmermann Benjamin Roth 27 0 0 03 Jun 2022
Multi-Domain Targeted Sentiment Analysis Orith Toledo-Ronen Matan Orbach Yoav Katz Noam Slonim 33 7 0 08 May 2022
Language Models in the Loop: Incorporating Prompting into Weak Supervision Ryan Smith Jason Alan Fries Braden Hancock Stephen H. Bach 58 53 0 04 May 2022
ULF: Unsupervised Labeling Function Correction using Cross-Validation for Weak Supervision Anastasiia Sedova Benjamin Roth 28 0 0 14 Apr 2022
Training-Free Robust Multimodal Learning via Sample-Wise Jacobian Regularization Zhengqi Gao Sucheng Ren Zihui Xue Siting Li Hang Zhao 29 3 0 05 Apr 2022
PRBoost: Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning Rongzhi Zhang Yue Yu Pranav Shetty Le Song Chao Zhang 32 23 0 18 Mar 2022
A Survey on Programmatic Weak Supervision Jieyu Zhang Cheng-Yu Hsieh Yue Yu Chao Zhang Alexander Ratner 34 91 0 11 Feb 2022
Seeking Patterns, Not just Memorizing Procedures: Contrastive Learning for Solving Math Word Problems Zhongli Li Wenxuan Zhang Chao Yan Qingyu Zhou Chao Li Hongzhi Liu Yunbo Cao AIMat 41 55 0 16 Oct 2021
WRENCH: A Comprehensive Benchmark for Weak Supervision Jieyu Zhang Yue Yu Yinghao Li Yujing Wang Yaming Yang Mao Yang Alexander Ratner 27 111 0 23 Sep 2021
Self-Training with Differentiable Teacher Simiao Zuo Yue Yu Chen Liang Haoming Jiang Siawpeng Er Chao Zhang T. Zhao H. Zha 46 14 0 15 Sep 2021
Named Entity Recognition with Small Strongly Labeled and Large Weakly Labeled Data Haoming Jiang Danqing Zhang Tianyu Cao Bing Yin T. Zhao NoLa 30 44 0 16 Jun 2021
InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective Wei Ping Shuohang Wang Yu Cheng Zhe Gan R. Jia Bo Li Jingjing Liu AAML 48 113 0 05 Oct 2020
Revisiting Self-Training for Neural Sequence Generation Junxian He Jiatao Gu Jiajun Shen MarcÁurelio Ranzato SSL LRM 244 270 0 30 Sep 2019
FreeLB: Enhanced Adversarial Training for Natural Language Understanding Chen Zhu Yu Cheng Zhe Gan S. Sun Tom Goldstein Jingjing Liu AAML 234 438 0 25 Sep 2019
Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results Antti Tarvainen Harri Valpola OOD MoMe 273 1,275 0 06 Mar 2017
Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference Y. Gal Zoubin Ghahramani UQCV BDL 213 745 0 06 Jun 2015