Fine-tuning Pre-trained Language Models for Few-shot Intent Detection:
Supervised Pre-training and Isotropization

Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization

15 May 2022

Xiao-Ming Wu

Albert Y. S. Lam

Papers citing "Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization"

19 / 19 papers shown

Title
LANID: LLM-assisted New Intent Discovery Lu Fan Jiashu Pu Rongsheng Zhang Xiao-Ming Wu 55 1 0 31 Mar 2025
Understanding Layer Significance in LLM Alignment Guangyuan Shi Zexin Lu Xiaoyu Dong Wenlong Zhang Xuanyu Zhang Yujie Feng Xiao-Ming Wu 48 2 0 23 Oct 2024
Diversity-grounded Channel Prototypical Learning for Out-of-Distribution Intent Detection Bo Liu Liming Zhan Yujie Feng Zexin Lu Chengqiang Xie Lei Xue Albert Y. S. Lam Xiao-Ming Wu OODD 28 1 0 17 Sep 2024
Practical token pruning for foundation models in few-shot conversational virtual assistant systems Haode Qi Cheng Qian Jian Ni Pratyush Singh Reza Fazeli Gengyu Wang Zhongzheng Shu Eric Wayne Juergen Bross 20 0 0 21 Aug 2024
UniFashion: A Unified Vision-Language Model for Multimodal Fashion Retrieval and Generation Xiangyu Zhao Yuehan Zhang Wenlong Zhang X. Wu 36 4 0 21 Aug 2024
Minimizing PLM-Based Few-Shot Intent Detectors Haode Zhang Xiao-Ming Wu Albert Y. S. Lam VLM 30 0 0 13 Jul 2024
Can Your Model Tell a Negation from an Implicature? Unravelling Challenges With Intent Encoders Yuwei Zhang Siffi Singh Sailik Sengupta Igor Shalyminov Hang Su Hwanjun Song Saab Mansour 32 2 0 07 Mar 2024
RSVP: Customer Intent Detection via Agent Response Contrastive and Generative Pre-Training Yu-Chien Tang Wei-Yao Wang An-Zi Yen Wenjie Peng 26 1 0 15 Oct 2023
Low-rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition Yu Yu Chao-Han Huck Yang J. Kolehmainen Prashanth Gurunath Shivakumar Yile Gu ... Denis Filimonov Shalini Ghosh A. Stolcke Ariya Rastrow I. Bulyko 29 8 0 26 Sep 2023
All Labels Together: Low-shot Intent Detection with an Efficient Label Semantic Encoding Paradigm Jiangshu Du Congying Xia Wenpeng Yin Tingting Liang Philip S. Yu VLM 24 0 0 07 Sep 2023
Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training Haode Zhang Haowen Liang Li-Ming Zhan Xiao-Ming Wu Albert Y. S. Lam VLM 16 8 0 08 Jun 2023
Language Models are Causal Knowledge Extractors for Zero-shot Video Question Answering Hung-Ting Su Yulei Niu Xudong Lin Winston H. Hsu Shih-Fu Chang VGen ELM 21 6 0 07 Apr 2023
QAID: Question Answering Inspired Few-shot Intent Detection Asaf Yehudai Matan Vetzler Y. Mass Koren Lazar Doron Cohen Boaz Carmeli 10 7 0 02 Mar 2023
The Devil is in the Details: On Models and Training Regimes for Few-Shot Intent Classification Mohsen Mesgar Thy Thy Tran Goran Glavas Iryna Gurevych 6 3 0 12 Oct 2022
Parameter-Efficient and Student-Friendly Knowledge Distillation Jun Rao Xv Meng Liang Ding Shuhan Qi Dacheng Tao 34 46 0 28 May 2022
Effectiveness of Pre-training for Few-shot Intent Classification Haode Zhang Yuwei Zhang Li-Ming Zhan Jiaxin Chen Guangyuan Shi Xiao-Ming Wu Albert Y. S. Lam VLM 72 44 0 13 Sep 2021
How Does Fine-tuning Affect the Geometry of Embedding Space: A Case Study on Isotropy S. Rajaee Mohammad Taher Pilehvar 71 20 0 10 Sep 2021
Efficient Intent Detection with Dual Sentence Encoders I. Casanueva Tadas Temvcinas D. Gerz Matthew Henderson Ivan Vulić VLM 180 451 0 10 Mar 2020
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 299 11,681 0 09 Mar 2017