Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions

20 August 2021

Papers citing "Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions"

50 / 213 papers shown

Title
Code Vulnerability Repair with Large Language Model using Context-Aware Prompt Tuning Arshiya Khan Guannan Liu Xing Gao KELM 31 1 0 27 Sep 2024
Software Security Analysis in 2030 and Beyond: A Research Roadmap Marcel Böhme Eric Bodden Tevfik Bultan Cristian Cadar Yang Liu Giuseppe Scanniello 31 1 0 26 Sep 2024
APILOT: Navigating Large Language Models to Generate Secure Code by Sidestepping Outdated API Pitfalls Weiheng Bai Keyang Xuan Pengxiang Huang Qiushi Wu Jianing Wen Jingjing Wu Kangjie Lu LLMAG KELM 32 1 0 25 Sep 2024
A Comprehensive Framework for Evaluating API-oriented Code Generation in Large Language Models Yixi Wu Pengfei He Zehao Wang Shaowei Wang Yuan Tian Tse-Hsun Chen ALM 37 0 0 23 Sep 2024
PromSec: Prompt Optimization for Secure Generation of Functional Source Code with Large Language Models (LLMs) Mahmoud Nazzal Issa Khalil Abdallah Khreishah NhatHai Phan AAML 32 5 0 19 Sep 2024
AutoSafeCoder: A Multi-Agent Framework for Securing LLM Code Generation through Static Analysis and Fuzz Testing Ana Nunez Nafis Tanveer Islam S. Jha Peyman Najafirad LLMAG 25 6 0 16 Sep 2024
Demo: SGCode: A Flexible Prompt-Optimizing System for Secure Generation of Code Khiem Ton Nhi Nguyen Mahmoud Nazzal Abdallah Khreishah Cristian Borcea NhatHai Phan Ruoming Jin Issa Khalil Yelong Shen SILM 29 0 0 11 Sep 2024
HexaCoder: Secure Code Generation via Oracle-Guided Synthetic Training Data Hossein Hajipour Lea Schönherr Thorsten Holz Mario Fritz AAML SyDa 26 0 0 10 Sep 2024
The Quest to Build Trust Earlier in Digital Design Benjamin Tan 29 0 0 09 Sep 2024
What Guides Our Choices? Modeling Developers' Trust and Behavioral Intentions Towards GenAI Rudrajit Choudhuri Bianca Trinkenreich Rahul Pandita Eirini Kalliamvakou Igor Steinmacher M. Gerosa Christopher Sanchez Anita Sarma 21 4 0 06 Sep 2024
Automatic Detection of LLM-generated Code: A Case Study of Claude 3 Haiku Musfiqur Rahman SayedHassan Khatoonabadi Ahmad Abdellatif Emad Shihab 35 3 0 02 Sep 2024
Enhancing Source Code Security with LLMs: Demystifying The Challenges and Generating Reliable Repairs Nafis Tanveer Islam Joseph Khoury Andrew Seong E. Bou-Harb Peyman Najafirad AAML 36 3 0 01 Sep 2024
Unintentional Security Flaws in Code: Automated Defense via Root Cause Analysis Nafis Tanveer Islam Mazal Bethany Dylan Manuel Murtuza Jadliwala Peyman Najafirad 33 0 0 30 Aug 2024
How Well Do Large Language Models Serve as End-to-End Secure Code Producers? Jianian Gong Nachuan Duan Ziheng Tao Zhaohui Gong Yuan Yuan Minlie Huang ELM 28 2 0 20 Aug 2024
"You still have to study" -- On the Security of LLM generated code Stefan Goetz Andreas Schaad 16 2 0 13 Aug 2024
FDI: Attack Neural Code Generation Systems through User Feedback Channel Zhensu Sun Xiaoning Du Xiapu Luo Fu Song David Lo Li Li AAML 30 3 0 08 Aug 2024
Practical Attacks against Black-box Code Completion Engines Slobodan Jenko Jingxuan He Niels Mündler Mark Vero Martin Vechev ELM AAML SILM 27 3 0 05 Aug 2024
SpecRover: Code Intent Extraction via LLMs Haifeng Ruan Yuntong Zhang Abhik Roychoudhury 29 17 0 05 Aug 2024
LLM as Runtime Error Handler: A Promising Pathway to Adaptive Self-Healing of Software Systems Zhensu Sun Haotian Zhu Bowen Xu Xiaoning Du Yizhe Zhu David Lo 30 3 0 02 Aug 2024
A Performance Study of LLM-Generated Code on Leetcode Tristan Coignion Clément Quinton Romain Rouvoy 45 26 0 31 Jul 2024
How Are LLMs Mitigating Stereotyping Harms? Learning from Search Engine Studies Alina Leidinger Richard Rogers 34 5 0 16 Jul 2024
On Mitigating Code LLM Hallucinations with API Documentation Nihal Jain Robert Kwiatkowski Baishakhi Ray M. K. Ramanathan Varun Kumar 41 7 0 13 Jul 2024
MaPPing Your Model: Assessing the Impact of Adversarial Attacks on LLM-based Programming Assistants John Heibel Daniel Lowd AAML 40 3 0 12 Jul 2024
Learning Program Behavioral Models from Synthesized Input-Output Pairs Tural Mammadov Dietrich Klakow Alexander Koller Andreas Zeller 45 3 0 11 Jul 2024
Prompting Techniques for Secure Code Generation: A Systematic Investigation Catherine Tony Nicolás E. Díaz Ferreyra Markus Mutas Salem Dhiff Riccardo Scandariato SILM 76 9 0 09 Jul 2024
Enhancing Computer Programming Education with LLMs: A Study on Effective Prompt Engineering for Python Code Generation Tianyu Wang Nianjun Zhou Zhixiong Chen 28 9 0 07 Jul 2024
Harnessing the Power of LLMs: Automating Unit Test Generation for High-Performance Computing Rabimba Karanjai Aftab Hussain Md Rafiqul Islam Rabin Lei Xu Weidong Shi Mohammad Amin Alipour 62 2 0 06 Jul 2024
Looking into Black Box Code Language Models Muhammad Umair Haider Umar Farooq A. B. Siddique Mark Marron 39 2 0 05 Jul 2024
Is Your AI-Generated Code Really Safe? Evaluating Large Language Models on Secure Code Generation with CodeSecEval Jiexin Wang Xitong Luo Liuwen Cao Hongkui He Hailin Huang Jiayuan Xie Adam Jatowt Yi Cai ELM 38 14 0 02 Jul 2024
Generative Monoculture in Large Language Models Fan Wu Emily Black Varun Chandrasekaran SyDa 35 3 0 02 Jul 2024
Efficacy of Various Large Language Models in Generating Smart Contracts Siddhartha Chatterjee B. Ramamurthy 31 3 0 28 Jun 2024
Transforming Software Development: Evaluating the Efficiency and Challenges of GitHub Copilot in Real-World Projects Ruchika Pandey Prabhat Singh Raymond Wei Shaila Shankar 22 7 0 25 Jun 2024
BEEAR: Embedding-based Adversarial Removal of Safety Backdoors in Instruction-tuned Language Models Yi Zeng Weiyu Sun Tran Ngoc Huynh Dawn Song Bo Li Ruoxi Jia AAML LLMSV 42 19 0 24 Jun 2024
INDICT: Code Generation with Internal Dialogues of Critiques for Both Security and Helpfulness Hung Le Yingbo Zhou Caiming Xiong Silvio Savarese Doyen Sahoo 52 2 0 23 Jun 2024
Does GPT Really Get It? A Hierarchical Scale to Quantify Human vs AI's Understanding of Algorithms Mirabel Reid Santosh Vempala ELM 35 0 0 20 Jun 2024
MagicItem: Dynamic Behavior Design of Virtual Objects with Large Language Models in a Consumer Metaverse Platform Ryutaro Kurai Takefumi Hiraki Yuichi Hiroi Yutaro Hirao Monica Perusquía-Hernández H. Uchiyama Kiyoshi Kiyokawa VLM 13 7 0 19 Jun 2024
What is in the Chrome Web Store? Investigating Security-Noteworthy Browser Extensions Sheryl Hsu Manda Tran Aurore Fass ELM 11 3 0 18 Jun 2024
GitHub Copilot: the perfect Code compLeeter? Ilja Siros Dave Singelée Bart Preneel ALM ELM 26 4 0 17 Jun 2024
The Rise and Fall(?) of Software Engineering Antonio Mastropaolo Camilo Escobar-Velásquez Mario Linares-Vásquez 35 2 0 14 Jun 2024
We Have a Package for You! A Comprehensive Analysis of Package Hallucinations by Code Generating LLMs Joseph Spracklen Raveen Wijewickrama A. H. M. N. Sakib Anindya Maiti Murtuza Jadliwala Murtuza Jadliwala 45 10 0 12 Jun 2024
Using AI-Based Coding Assistants in Practice: State of Affairs, Perceptions, and Ways Forward Agnia Sergeyuk Yaroslav Golubev T. Bryksin Iftekhar Ahmed 62 11 0 11 Jun 2024
Time to Separate from StackOverflow and Match with ChatGPT for Encryption Ehsan Firouzi Mohammad Ghafari SILM 33 3 0 10 Jun 2024
HoneyGPT: Breaking the Trilemma in Terminal Honeypots with Large Language Model Ziyang Wang Jianzhou You Haining Wang Tianwei Yuan Shichao Lv Yang Wang Limin Sun 34 2 0 04 Jun 2024
Uncovering LLM-Generated Code: A Zero-Shot Synthetic Code Detector via Code Rewriting Tong Ye Yangkai Du Tengfei Ma Lingfei Wu Xuhong Zhang Shouling Ji Wenhai Wang DeLMO 49 6 0 25 May 2024
ChatGPT Code Detection: Techniques for Uncovering the Source of Code Marc Oedingen Raphael C. Engelhardt Robin Denz Maximilian Hammer Wolfgang Konen DeLMO 45 8 0 24 May 2024
Evaluation of the Programming Skills of Large Language Models Luc Bryan Heitz Joun Chamas Christopher Scherb ALM 29 0 0 23 May 2024
Using AI Assistants in Software Development: A Qualitative Study on Security Practices and Concerns J. Klemmer Stefan Albert Horstmann Nikhil Patnaik Cordelia Ludden Cordell Burton ... Daniel Votipka H. Lipford Awais Rashid Alena Naiakshina University of North Carolina at Charlotte 26 17 0 10 May 2024
When LLMs Meet Cybersecurity: A Systematic Literature Review Jie Zhang Haoyu Bu Hui Wen Yu Chen Lun Li Hongsong Zhu 42 36 0 06 May 2024
A Controlled Experiment on the Energy Efficiency of the Source Code Generated by Code Llama Vlad-Andrei Cursaru Laura Duits Joel Milligan Damla Ural Berta Rodriguez Sanchez Vincenzo Stoico I. Malavolta 19 3 0 06 May 2024
Trojans in Large Language Models of Code: A Critical Review through a Trigger-Based Taxonomy Aftab Hussain Md Rafiqul Islam Rabin Toufique Ahmed Bowen Xu Prem Devanbu Mohammad Amin Alipour 142 1 0 05 May 2024