CLIMB: Curriculum Learning for Infant-inspired Model Building

CLIMB: Curriculum Learning for Infant-inspired Model Building

15 November 2023

Richard Diehl Martinez

Zébulon Goriely

Christopher Davis

Papers citing "CLIMB: Curriculum Learning for Infant-inspired Model Building"

10 / 10 papers shown

Title
Towards Developmentally Plausible Rewards: Communicative Success as a Learning Signal for Interactive Language Models Lennart Stöpler Rufat Asadli Mitja Nikolaus Ryan Cotterell Alex Warstadt LRM 37 0 0 09 May 2025
Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora Alex Warstadt Aaron Mueller Leshem Choshen E. Wilcox Chengxu Zhuang ... Rafael Mosquera Bhargavi Paranjape Adina Williams Tal Linzen Ryan Cotterell 38 106 0 10 Apr 2025
Scaling LLM Pre-training with Vocabulary Curriculum Fangyuan Yu 73 2 0 25 Feb 2025
Learning from Impairment: Leveraging Insights from Clinical Linguistics in Language Modelling Research Dominique Brunato 74 0 0 20 Dec 2024
Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase Pretraining Steven Feng Shrimai Prabhumoye Kezhi Kong Dan Su M. Patwary M. Shoeybi Bryan Catanzaro 67 2 0 18 Dec 2024
Choosy Babies Need One Coach: Inducing Mode-Seeking Behavior in BabyLlama with Reverse KL Divergence Shaozhen Shi Yevgen Matusevych Malvina Nissim 27 0 0 29 Oct 2024
Exploring Curriculum Learning for Vision-Language Tasks: A Study on Small-Scale Multimodal Training Rohan Saha Abrar Fahim Alona Fyshe Alex Murphy 26 0 0 20 Oct 2024
Is Child-Directed Speech Effective Training Data for Language Models? Steven Y. Feng Noah D. Goodman Michael C. Frank 40 9 0 07 Aug 2024
Better Language Model with Hypernym Class Prediction Richard He Bai Tong Wang Alessandro Sordoni Peng Shi 76 15 0 21 Mar 2022
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 248 1,986 0 31 Dec 2020