EffiBench: Benchmarking the Efficiency of Automatically Generated Code

EffiBench: Benchmarking the Efficiency of Automatically Generated Code

3 February 2024

Heming Cui

Papers citing "EffiBench: Benchmarking the Efficiency of Automatically Generated Code"

10 / 10 papers shown

Title
Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks Yixin Cao Shibo Hong X. Li Jiahao Ying Yubo Ma ... Juanzi Li Aixin Sun Xuanjing Huang Tat-Seng Chua Yu Jiang ALM ELM 84 0 0 26 Apr 2025
How Efficient is LLM-Generated Code? A Rigorous & High-Standard Benchmark Ruizhong Qiu Weiliang Will Zeng Hanghang Tong James Ezick Christopher Lott 82 15 0 20 Feb 2025
CursorCore: Assist Programming through Aligning Anything Hao Jiang Qi Liu Rui Li Shengyu Ye Shijin Wang 34 1 0 09 Oct 2024
Learn to Code Sustainably: An Empirical Study on LLM-based Green Code Generation Tina Vartziotis Ippolyti Dellatolas George Dasoulas Maximilian Schmidt Florian Schneider Tim Hoffmann S. Kotsopoulos Michael Keckeisen 58 6 0 05 Mar 2024
Bias Testing and Mitigation in LLM-based Code Generation Dong Huang Qingwen Bu Jie M. Zhang Xiaofei Xie Junjie Chen Heming Cui 23 20 0 03 Sep 2023
Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Jiawei Liu Chun Xia Yuyao Wang Lingming Zhang ELM ALM 163 388 0 02 May 2023
Multi-lingual Evaluation of Code Generation Models Ben Athiwaratkun Sanjay Krishna Gouda Zijian Wang Xiaopeng Li Yuchen Tian ... Baishakhi Ray Parminder Bhatia Sudipta Sengupta Dan Roth Bing Xiang ELM 96 117 0 26 Oct 2022
Few-shot training LLMs for project-specific code-summarization Toufique Ahmed Prem Devanbu 165 213 0 09 Jul 2022
Measuring Coding Challenge Competence With APPS Dan Hendrycks Steven Basart Saurav Kadavath Mantas Mazeika Akul Arora ... Collin Burns Samir Puranik Horace He D. Song Jacob Steinhardt ELM AIMat ALM 189 614 0 20 May 2021
Type4Py: Practical Deep Similarity Learning-Based Type Inference for Python A. Mir Evaldas Latoskinas Sebastian Proksch Georgios Gousios 65 49 0 12 Jan 2021