CodeGen2: Lessons for Training LLMs on Programming and Natural Languages

CodeGen2: Lessons for Training LLMs on Programming and Natural Languages

3 May 2023

Erik Nijkamp

Silvio Savarese

Yingbo Zhou

Papers citing "CodeGen2: Lessons for Training LLMs on Programming and Natural Languages"

3 / 3 papers shown

Title
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 205 8,441 0 04 Mar 2022
CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation Shuai Lu Daya Guo Shuo Ren Junjie Huang Alexey Svyatkovskiy ... Nan Duan Neel Sundaresan Shao Kun Deng Shengyu Fu Shujie Liu ELM 128 853 0 09 Feb 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 126 1,508 0 31 Dec 2020