Large Language Models and Simple, Stupid Bugs

IEEE Working Conference on Mining Software Repositories (MSR), 2023

20 March 2023

Papers citing "Large Language Models and Simple, Stupid Bugs"

33 / 33 papers shown

Title
Open the Oyster: Empirical Evaluation and Improvement of Code Reasoning Confidence in LLMs Shufan Wang Xing Hu Junkai Chen Zhiyuan Pan Xin Xia LRM 117 0 0 04 Nov 2025
Investigating Security Implications of Automatically Generated Code on the Software Supply Chain Xiaofan Li Xing Gao SILM AAML 140 0 0 24 Sep 2025
Evaluating the Limitations of Local LLMs in Solving Complex Programming Challenges Kadin Matotek Heather Cassel Md Amiruzzaman Linh B. Ngo 59 0 0 18 Sep 2025
MultiAIGCD: A Comprehensive dataset for AI Generated Code Detection Covering Multiple Languages, Models,Prompts, and Scenarios Basak Demirok Mucahid Kutlu Selin Mergen 121 0 0 29 Jul 2025
Hallucination by Code Generation LLMs: Taxonomy, Benchmarks, Mitigation, and Challenges Yunseo Lee John Youngeun Song Dongsun Kim Jindae Kim Mijung Kim Jaechang Nam HILM LRM 310 5 0 29 Apr 2025
Risk Assessment Framework for Code LLMs via Leveraging Internal States Yuheng Huang Lei Ma Keizaburo Nishikino Takumi Akazaki 207 1 0 20 Apr 2025
MigGPT: Harnessing Large Language Models for Automated Migration of Out-of-Tree Linux Kernel Patches Across Versions Pucheng Dang Di Huang Dong Li Kang Chen Yuanbo Wen Qi Guo Xing Hu 309 1 0 13 Apr 2025
Correctness Assessment of Code Generated by Large Language Models Using Internal RepresentationsJournal of Systems and Software (JSS), 2025 Tuan-Dung Bui Thanh Trong Vu Thu-Trang Nguyen Son Nguyen H. Vo LRM 197 3 0 22 Jan 2025
AIGCodeSet: A New Annotated Dataset for AI Generated Code DetectionSignal Processing and Communications Applications Conference (SPCA), 2024 Basak Demirok Mucahid Kutlu DeLMO 376 5 0 21 Dec 2024
AlphaVerus: Bootstrapping Formally Verified Code Generation through Self-Improving Translation and Treefinement Pranjal Aggarwal Bryan Parno Sean Welleck 274 16 0 09 Dec 2024
A Deep Dive Into Large Language Model Code Generation Mistakes: What and Why? QiHong Chen Jiawei Li Jiecheng Deng Jiachen Yu Justin Tian Jin Chen Iftekhar Ahmed 262 6 0 03 Nov 2024
Impeding LLM-assisted Cheating in Introductory Programming Assignments via Adversarial PerturbationConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Saiful Islam Salim Rubin Yuchan Yang Alexander Cooper Suryashree Ray Saumya Debray Sazzadur Rahaman AAML 230 4 0 12 Oct 2024
APILOT: Navigating Large Language Models to Generate Secure Code by Sidestepping Outdated API Pitfalls Weiheng Bai Keyang Xuan Pengxiang Huang Qiushi Wu Jianing Wen Jingjing Wu Kangjie Lu LLMAG KELM 134 5 0 25 Sep 2024
N-Version Assessment and Enhancement of Generative AIIEEE Software (IEEE Softw.), 2024 Marcus Kessel Colin Atkinson 106 5 0 21 Sep 2024
Enhancing Source Code Security with LLMs: Demystifying The Challenges and Generating Reliable Repairs Nafis Tanveer Islam Joseph Khoury Andrew Seong E. Bou-Harb Peyman Najafirad AAML 253 3 0 01 Sep 2024
A Performance Study of LLM-Generated Code on Leetcode Tristan Coignion Clément Quinton Romain Rouvoy 288 84 0 31 Jul 2024
Prompting Techniques for Secure Code Generation: A Systematic Investigation Catherine Tony Nicolás E. Díaz Ferreyra Markus Mutas Salem Dhiff Riccardo Scandariato SILM 358 32 0 09 Jul 2024
Harnessing the Power of LLMs: Automating Unit Test Generation for High-Performance Computing Rabimba Karanjai Aftab Hussain Md Rafiqul Islam Rabin Lei Xu Weidong Shi Mohammad Amin Alipour 142 6 0 06 Jul 2024
Leveraging Large Language Models for Software Model Completion: Results from Industrial and Public Datasets Christof Tinnes Alisa Welter Sven Apel LLMAG 76 0 0 25 Jun 2024
Morescient GAI for Software EngineeringACM Transactions on Software Engineering and Methodology (TOSEM), 2024 Marcus Kessel Colin Atkinson SyDa 203 4 0 07 Jun 2024
Automatic Programming: Large Language Models and BeyondACM Transactions on Software Engineering and Methodology (TOSEM), 2024 Michael R. Lyu Baishakhi Ray Abhik Roychoudhury Shin Hwei Tan Patanamon Thongtanunam 285 45 0 03 May 2024
CodeHalu: Investigating Code Hallucinations in LLMs via Execution-based Verification Yuchen Tian Weixiang Yan Qian Yang Xuandong Zhao Qian Chen Ziyang Luo Lei Ma Lei Ma Dawn Song 255 2 0 30 Apr 2024
Calibration of Large Language Models on Code Summarization Yuvraj Virk Prem Devanbu Toufique Ahmed 220 11 0 30 Apr 2024
Exploring and Evaluating Hallucinations in LLM-Powered Code Generation Fang Liu Yang Liu Lin Shi Houkun Huang Ruifeng Wang Zhen Yang Li Zhang Zhongqi Li Yuchi Ma 229 222 0 01 Apr 2024
Securing Large Language Models: Threats, Vulnerabilities and Responsible Practices Sara Abdali Richard Anarfi C. Barberan Jia He Erfan Shayegani PILM 357 45 0 19 Mar 2024
Bugs in Large Language Models Generated Code: An Empirical StudyEmpirical Software Engineering (EMSE), 2024 Florian Tambon Arghavan Moradi Dakhel Amin Nikanjam Foutse Khomh Michel C. Desmarais G. Antoniol ELM 271 67 0 13 Mar 2024
Studying LLM Performance on Closed- and Open-source Data Toufique Ahmed Christian Bird Prem Devanbu Saikat Chakraborty 176 17 0 23 Feb 2024
Calibration and Correctness of Language Models for Code Claudio Spiess David Gros Kunal Suresh Pai Michael Pradel Md Rafiqul Islam Rabin Amin Alipour Susmit Jha Prem Devanbu Toufique Ahmed 226 55 0 03 Feb 2024
Code Security Vulnerability Repair Using Reinforcement Learning with Large Language Models Nafis Tanveer Islam Mohammad Bahrami Karkevandi Peyman Najafirad 244 16 0 13 Jan 2024
LLM-Powered Code Vulnerability Repair with Reinforcement Learning and Semantic Reward Nafis Tanveer Islam Joseph Khoury Andrew Seong Mohammad Bahrami Karkevandi G. Parra E. Bou-Harb Peyman Najafirad AAML 201 32 0 07 Jan 2024
Gotcha! This Model Uses My Code! Evaluating Membership Leakage Risks in Code ModelsIEEE Transactions on Software Engineering (TSE), 2023 Zhou Yang Zhipeng Zhao Chenyu Wang Jieke Shi Dongsum Kim Donggyun Han David Lo SILM AAML MIACV 237 18 0 02 Oct 2023
Can ChatGPT replace StackOverflow? A Study on Robustness and Reliability of Large Language Model Code GenerationAAAI Conference on Artificial Intelligence (AAAI), 2023 Li Zhong Zilong Wang ELM SILM 410 105 0 20 Aug 2023
A Language Model of Java Methods with Train/Test Deduplication Chia-Yi Su Aakash Bansal Vijayanta Jain S. Ghanavati Collin McMillan SyDa VLM 162 14 0 15 May 2023