CatCode: A Comprehensive Evaluation Framework for LLMs On the Mixture of Code and Text

4 March 2024

Papers citing "CatCode: A Comprehensive Evaluation Framework for LLMs On the Mixture of Code and Text"

5 / 5 papers shown

Title
Multi-lingual Evaluation of Code Generation Models Ben Athiwaratkun Sanjay Krishna Gouda Zijian Wang Xiaopeng Li Yuchen Tian ... Baishakhi Ray Parminder Bhatia Sudipta Sengupta Dan Roth Bing Xiang ELM 112 160 0 26 Oct 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 308 11,915 0 04 Mar 2022
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Shafiq R. Joty S. Hoi 214 1,489 0 02 Sep 2021
CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation Shuai Lu Daya Guo Shuo Ren Junjie Huang Alexey Svyatkovskiy ... Nan Duan Neel Sundaresan Shao Kun Deng Shengyu Fu Shujie Liu ELM 196 853 0 09 Feb 2021
Semantic Robustness of Models of Source Code Goutham Ramakrishnan Jordan Henkel Zi Wang Aws Albarghouthi S. Jha Thomas W. Reps SILM AAML 35 97 0 07 Feb 2020