Scaffold-BPE: Enhancing Byte Pair Encoding with Simple and Effective Scaffold Token Removal

27 April 2024

Hui Chen

Papers citing "Scaffold-BPE: Enhancing Byte Pair Encoding with Simple and Effective Scaffold Token Removal"

3 / 3 papers shown

Title
Tokenization Is More Than Compression Craig W. Schmidt Varshini Reddy Haoran Zhang Alec Alameddine Omri Uzan Yuval Pinter Chris Tanner 33 27 0 28 Feb 2024
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 245 1,977 0 31 Dec 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,424 0 23 Jan 2020