MHPP: Exploring the Capabilities and Limitations of Language Models
Beyond Basic Code Generation

MHPP: Exploring the Capabilities and Limitations of Language Models Beyond Basic Code Generation

19 May 2024

Papers citing "MHPP: Exploring the Capabilities and Limitations of Language Models Beyond Basic Code Generation"

9 / 9 papers shown

Title
Bias Testing and Mitigation in LLM-based Code Generation Dong Huang Qingwen Bu Jie M. Zhang Xiaofei Xie Junjie Chen Heming Cui 21 20 0 03 Sep 2023
Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Jiawei Liu Chun Xia Yuyao Wang Lingming Zhang ELM ALM 161 388 0 02 May 2023
Multi-lingual Evaluation of Code Generation Models Ben Athiwaratkun Sanjay Krishna Gouda Zijian Wang Xiaopeng Li Yuchen Tian ... Baishakhi Ray Parminder Bhatia Sudipta Sengupta Dan Roth Bing Xiang ELM 91 117 0 26 Oct 2022
Few-shot training LLMs for project-specific code-summarization Toufique Ahmed Prem Devanbu 163 137 0 09 Jul 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
Training and Evaluating a Jupyter Notebook Data Science Assistant Shubham Chandel Colin B. Clement Guillermo Serrato Neel Sundaresan 30 43 0 30 Jan 2022
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Shafiq R. Joty S. Hoi 196 1,451 0 02 Sep 2021
Measuring Coding Challenge Competence With APPS Dan Hendrycks Steven Basart Saurav Kadavath Mantas Mazeika Akul Arora ... Collin Burns Samir Puranik Horace He D. Song Jacob Steinhardt ELM AIMat ALM 189 614 0 20 May 2021
Type4Py: Practical Deep Similarity Learning-Based Type Inference for Python A. Mir Evaldas Latoskinas Sebastian Proksch Georgios Gousios 60 49 0 12 Jan 2021