Unlocking Tokens as Data Points for Generalization Bounds on Larger
Language Models

Unlocking Tokens as Data Points for Generalization Bounds on Larger Language Models

25 July 2024

Andrew Gordon Wilson

Papers citing "Unlocking Tokens as Data Points for Generalization Bounds on Larger Language Models"

11 / 11 papers shown

Title
Compute-Optimal LLMs Provably Generalize Better With Scale Marc Finzi Sanyam Kapoor Diego Granziol Anming Gu Christopher De Sa J. Zico Kolter Andrew Gordon Wilson 26 0 0 21 Apr 2025
Non-vacuous Generalization Bounds for Deep Neural Networks without any modification to the trained models Khoat Than Dat Phan BDL AAML VLM 55 0 0 10 Mar 2025
Deep Learning is Not So Mysterious or Different Andrew Gordon Wilson 36 1 0 03 Mar 2025
Bayesian Optimization of Antibodies Informed by a Generative Model of Evolving Sequences Alan Nawzad Amin Nate Gruver Yilun Kuang Lily Li Hunter Elliott Calvin McCarter Aniruddh Raghu Peyton Greenside Andrew Gordon Wilson 69 1 0 10 Dec 2024
A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs A. S. Rawat Veeranjaneyulu Sadhanala Afshin Rostamizadeh Ayan Chakrabarti Wittawat Jitkrittum ... Rakesh Shivanna Sashank J. Reddi A. Menon Rohan Anil Sanjiv Kumar 28 2 0 24 Oct 2024
Large Language Models as Markov Chains Oussama Zekri Ambroise Odonnat Abdelhakim Benechehab Linus Bleistein Nicolas Boullé I. Redko 34 9 0 03 Oct 2024
Not All LLM Reasoners Are Created Equal Arian Hosseini Alessandro Sordoni Daniel Toyama Aaron C. Courville Rishabh Agarwal LRM 39 11 0 02 Oct 2024
Sample Compression Unleashed: New Generalization Bounds for Real Valued Losses Mathieu Bazinet Valentina Zantedeschi Pascal Germain MLT AI4CE 16 2 0 26 Sep 2024
QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks Albert Tseng Jerry Chee Qingyao Sun Volodymyr Kuleshov Christopher De Sa MQ 126 91 0 06 Feb 2024
Understanding prompt engineering may not require rethinking generalization Victor Akinwande Yiding Jiang Dylan Sam J. Zico Kolter VLM VPVLM 112 7 0 06 Oct 2023
Pac-Bayesian Supervised Classification: The Thermodynamics of Statistical Learning O. Catoni 135 451 0 03 Dec 2007