Scaling Laws Beyond Backpropagation

26 October 2022

Papers citing "Scaling Laws Beyond Backpropagation"

6 / 6 papers shown

Title
(Mis)Fitting: A Survey of Scaling Laws Margaret Li Sneha Kudugunta Luke Zettlemoyer 69 2 0 26 Feb 2025
What Language Model to Train if You Have One Million GPU Hours? Teven Le Scao Thomas Wang Daniel Hesslow Lucile Saulnier Stas Bekman ... Lintang Sutawika Jaesung Tae Zheng-Xin Yong Julien Launay Iz Beltagy MoE AI4CE 225 103 0 27 Oct 2022
Revisiting Neural Scaling Laws in Language and Vision Ibrahim M. Alabdulmohsin Behnam Neyshabur Xiaohua Zhai 151 102 0 13 Sep 2022
Is the Number of Trainable Parameters All That Actually Matters? A. Chatelain Amine Djeghri Daniel Hesslow Julien Launay Iacopo Poli 43 7 0 24 Sep 2021
ROPUST: Improving Robustness through Fine-tuning with Photonic Processors and Synthetic Gradients Alessandro Cappelli Julien Launay Laurent Meunier Ruben Ohana Iacopo Poli AAML 10 4 0 06 Jul 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,453 0 23 Jan 2020