ResearchTrend.AI
TrimBERT: Tailoring BERT for Trade-offs

TrimBERT: Tailoring BERT for Trade-offs

S. N. Sridhar
Anthony Sarah
Sairam Sundaresan
    MQ
ArXiv (abs)PDFHTML

Papers citing "TrimBERT: Tailoring BERT for Trade-offs"

3 / 3 papers shown
Title
Simplifying Transformer Blocks
Simplifying Transformer BlocksInternational Conference on Learning Representations (ICLR), 2023
Bobby He
Thomas Hofmann
332
46
0
03 Nov 2023
Sensi-BERT: Towards Sensitivity Driven Fine-Tuning for Parameter-Efficient BERT
Sensi-BERT: Towards Sensitivity Driven Fine-Tuning for Parameter-Efficient BERT
Souvik Kundu
S. Nittur
Maciej Szankin
Sairam Sundaresan
MQ
175
2
0
14 Jul 2023
Cramming: Training a Language Model on a Single GPU in One Day
Cramming: Training a Language Model on a Single GPU in One DayInternational Conference on Machine Learning (ICML), 2022
Jonas Geiping
Tom Goldstein
MoE
252
101
0
28 Dec 2022