Raise a Child in Large Language Model: Towards Effective and
Generalizable Fine-tuning

Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning

13 September 2021

Runxin Xu

Chuanqi Tan

Fei Huang

Papers citing "Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning"

4 / 4 papers shown

Title
LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning Zhekai Du Yinjie Min Jingjing Li Ke Lu Changliang Zou Liuhua Peng Tingjin Chu M. Gong 68 1 0 05 Feb 2025
Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models Cheolhyoung Lee Kyunghyun Cho Wanmo Kang MoE 204 190 0 25 Sep 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 267 6,003 0 20 Apr 2018
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 251 2,696 0 15 Sep 2016