How Efficient is LLM-Generated Code? A Rigorous & High-Standard Benchmark

How Efficient is LLM-Generated Code? A Rigorous & High-Standard Benchmark

20 February 2025

Weiliang Will Zeng

Christopher Lott

Papers citing "How Efficient is LLM-Generated Code? A Rigorous & High-Standard Benchmark"

10 / 10 papers shown

Title
LLM4EFFI: Leveraging Large Language Models to Enhance Code Efficiency and Correctness Tong Ye Weigang Huang X. Zhang Tengfei Ma Peiyu Liu Jianwei Yin Wenhai Wang LLMAG 35 2 0 17 Feb 2025
LLM Program Optimization via Retrieval Augmented Search Sagnik Anupam Alexander Shypula Osbert Bastani 115 1 0 31 Jan 2025
How Should We Build A Benchmark? Revisiting 274 Code-Related Benchmarks For LLMs Jialun Cao Yuk-Kit Chan Zixuan Ling Wenxuan Wang Shuqing Li ... Pinjia He Shuai Wang Zibin Zheng Michael R. Lyu S. Cheung ALM 66 1 0 18 Jan 2025
CKGFuzzer: LLM-Based Fuzz Driver Generation Enhanced By Code Knowledge Graph HanXiang Xu Wei Ma Ting Zhou Yanjie Zhao Kai Chen Q. Hu Yang Liu Haoyu Wang 59 0 0 18 Nov 2024
Gradient Compressed Sensing: A Query-Efficient Gradient Estimator for High-Dimensional Zeroth-Order Optimization Ruizhong Qiu Hanghang Tong 24 3 0 27 May 2024
DevBench: A Comprehensive Benchmark for Software Development Bowen Li Wenhan Wu Ziwei Tang Lin Shi John Yang ... He Du Ping Yang Dahua Lin Chao Peng Kai Chen 72 10 0 13 Mar 2024
EffiBench: Benchmarking the Efficiency of Automatically Generated Code Dong Huang Yuhao Qing Weiyi Shang Heming Cui Jie M. Zhang 66 10 0 03 Feb 2024
Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Jiawei Liu Chun Xia Yuyao Wang Lingming Zhang ELM ALM 161 388 0 02 May 2023
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 313 8,261 0 28 Jan 2022
Measuring Coding Challenge Competence With APPS Dan Hendrycks Steven Basart Saurav Kadavath Mantas Mazeika Akul Arora ... Collin Burns Samir Puranik Horace He D. Song Jacob Steinhardt ELM AIMat ALM 189 614 0 20 May 2021