Scaling Laws for Predicting Downstream Performance in LLMs

Scaling Laws for Predicting Downstream Performance in LLMs

11 October 2024

Zhengyang Wang

Papers citing "Scaling Laws for Predicting Downstream Performance in LLMs"

6 / 6 papers shown

Title
Position: Enough of Scaling LLMs! Lets Focus on Downscaling Ayan Sengupta Yash Goel Tanmoy Chakraborty 29 0 0 02 May 2025
Dynamic-KGQA: A Scalable Framework for Generating Adaptive Question Answering Datasets Preetam Prabhu Srikar Dammu Himanshu Naidu Chirag Shah 31 0 0 06 Mar 2025
Unveiling Downstream Performance Scaling of LLMs: A Clustering-Based Perspective Chengyin Xu Kaiyuan Chen Xiao Li Ke Shen Chenggang Li OffRL 36 0 0 24 Feb 2025
How to Upscale Neural Networks with Scaling Law? A Survey and Practical Guidelines Ayan Sengupta Yash Goel Tanmoy Chakraborty 31 0 0 17 Feb 2025
The interplay between domain specialization and model size Roseval Malaquias Junior Ramon Pires Thales Sales Almeida Kenzo Sakiyama R. Romero R. Nogueira 36 0 0 03 Jan 2025
Scaling Laws for Mixed quantization in Large Language Models Zeyu Cao Cheng Zhang Pedro Gimenes Jianqiao Lu Jianyi Cheng Yiren Zhao MQ 18 1 0 09 Oct 2024