Sparsity-Accelerated Training for Large Language Models

Sparsity-Accelerated Training for Large Language Models

3 June 2024

Hongshen Xu

Kai Yu

Papers citing "Sparsity-Accelerated Training for Large Language Models"

5 / 5 papers shown

Title
Evaluation of large language models for assessing code maintainability Marc Dillmann Julien Siebert Adam Trendowicz 26 2 0 23 Jan 2024
PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU Yixin Song Zeyu Mi Haotong Xie Haibo Chen BDL 120 114 0 16 Dec 2023
PMC-LLaMA: Towards Building Open-source Language Models for Medicine Chaoyi Wu Weixiong Lin Xiaoman Zhang Ya-Qin Zhang Yanfeng Wang Weidi Xie LM&MA AI4MH 86 74 0 27 Apr 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 303 11,730 0 04 Mar 2022
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 243 7,597 0 03 Jul 2012