Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions

20 August 2021

Papers citing "Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions"

50 / 213 papers shown

Title
Automatic Programming: Large Language Models and Beyond Michael R. Lyu Baishakhi Ray Abhik Roychoudhury Shin Hwei Tan Patanamon Thongtanunam 33 15 0 03 May 2024
Towards Neural Synthesis for SMT-Assisted Proof-Oriented Programming Saikat Chakraborty Gabriel Ebner Siddharth Bhat Sarah Fakhoury Sakina Fatima Shuvendu K. Lahiri Nikhil Swamy 42 15 0 03 May 2024
LLM Security Guard for Code Arya Kavian Mohammad Mehdi Pourhashem Kallehbasti Sajjad Kazemi Ehsan Firouzi Mohammad Ghafari 32 8 0 02 May 2024
Constrained Decoding for Secure Code Generation Yanjun Fu Ethan Baker Yu Ding Yizheng Chen AAML 40 8 0 30 Apr 2024
Automated Creation of Source Code Variants of a Cryptographic Hash Function Implementation Using Generative Pre-Trained Transformer Models Elijah Pelofske Vincent Urias L. Liebrock 35 0 0 24 Apr 2024
CodeCloak: A Method for Evaluating and Mitigating Code Leakage by LLM Code Assistants Amit Finkman Eden Bar-Kochva Avishag Shapira D. Mimran Yuval Elovici A. Shabtai ELM 36 1 0 13 Apr 2024
An Investigation into Misuse of Java Security APIs by Large Language Models Zahra Mousavi Chadni Islam Kristen Moore A. Abuadbba Muhammad Ali Babar SILM 29 13 0 04 Apr 2024
The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmers Hussein Mozannar Valerie Chen Mohammed Alsobay Subhro Das Sebastian Zhao Dennis L. Wei Manish Nagireddy P. Sattigeri Ameet Talwalkar David Sontag ELM 46 18 0 03 Apr 2024
Just another copy and paste? Comparing the security vulnerabilities of ChatGPT generated code and StackOverflow answers Sivana Hamer Marcelo dÁmorim Laurie A. Williams SILM ELM 27 18 0 22 Mar 2024
A Study of Vulnerability Repair in JavaScript Programs with Large Language Models Tan Khang Le Saba Alimadadi Steven Y. Ko 54 5 0 19 Mar 2024
Enhancing Security of AI-Based Code Synthesis with GitHub Copilot via Cheap and Efficient Prompt-Engineering Jakub Res I. Homoliak Martin Peresíni A. Smrčka K. Malinka P. Hanáček 29 3 0 19 Mar 2024
Securing Large Language Models: Threats, Vulnerabilities and Responsible Practices Sara Abdali Richard Anarfi C. Barberan Jia He PILM 70 24 0 19 Mar 2024
On the effectiveness of Large Language Models for GitHub Workflows Xinyu Zhang Siddharth Muralee Sourag Cherupattamoolayil Aravind Machiry 33 2 0 19 Mar 2024
Bifurcated Attention: Accelerating Massively Parallel Decoding with Shared Prefixes in LLMs Ben Athiwaratkun Sujan Kumar Gonugondla Sanjay Krishna Gouda Haifeng Qian Hantian Ding ... Liangfu Chen Parminder Bhatia Ramesh Nallapati Sudipta Sengupta Bing Xiang 59 4 0 13 Mar 2024
LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code Naman Jain King Han Alex Gu Wen-Ding Li Fanjia Yan Tianjun Zhang Sida I. Wang Armando Solar-Lezama Koushik Sen Ion Stoica ELM 36 274 0 12 Mar 2024
Guiding Enumerative Program Synthesis with Large Language Models Yixuan Li Julian Parsert Elizabeth Polgreen ELM 41 6 0 06 Mar 2024
A New Era in LLM Security: Exploring Security Concerns in Real-World LLM-based Systems Fangzhou Wu Ning Zhang Somesh Jha P. McDaniel Chaowei Xiao 34 68 0 28 Feb 2024
Exploring Advanced Methodologies in Security Evaluation for LLMs Junming Huang Jiawei Zhang Qi Wang Weihong Han Yanchun Zhang 42 0 0 28 Feb 2024
WIPI: A New Web Threat for LLM-Driven Web Agents Fangzhou Wu Shutong Wu Yulong Cao Chaowei Xiao LLMAG 34 18 0 26 Feb 2024
Instruction Tuning for Secure Code Generation Jingxuan He Mark Vero Gabriela Krasnopolska Martin Vechev 21 16 0 14 Feb 2024
Resilient Watermarking for LLM-Generated Codes Boquan Li Mengdi Zhang Peixin Zhang Jun Sun Xingmei Wang Zijian Liu Tianzi Zhang WaLM 33 3 0 12 Feb 2024
Human-Centered Privacy Research in the Age of Large Language Models Tianshi Li Sauvik Das Hao-Ping Lee Dakuo Wang Bingsheng Yao Zhiping Zhang PILM 16 11 0 03 Feb 2024
NoFunEval: Funny How Code LMs Falter on Requirements Beyond Functional Correctness Manav Singhal Tushar Aggarwal Abhijeet Awasthi Nagarajan Natarajan Aditya Kanade 32 12 0 29 Jan 2024
Raidar: geneRative AI Detection viA Rewriting Chengzhi Mao Carl Vondrick Hao Wang Junfeng Yang DeLMO 31 23 0 23 Jan 2024
In-IDE Human-AI Experience in the Era of Large Language Models; A Literature Review Agnia Sergeyuk Sergey Titov M. Izadi 39 6 0 19 Jan 2024
Code Security Vulnerability Repair Using Reinforcement Learning with Large Language Models Nafis Tanveer Islam Mohammad Bahrami Karkevandi Peyman Najafirad 28 6 0 13 Jan 2024
LLM-Powered Code Vulnerability Repair with Reinforcement Learning and Semantic Reward Nafis Tanveer Islam Joseph Khoury Andrew Seong Mohammad Bahrami Karkevandi G. Parra E. Bou-Harb Peyman Najafirad AAML 57 14 0 07 Jan 2024
Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models Terry Yue Zhuo A. Zebaze Nitchakarn Suppattarachai Leandro von Werra H. D. Vries Qian Liu Niklas Muennighoff ALM 38 15 0 01 Jan 2024
Prompt Fuzzing for Fuzz Driver Generation Yunlong Lyu Yuxuan Xie Peng Chen Hao Chen 22 15 0 29 Dec 2023
LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarks Saad Ullah Mingji Han Saurabh Pujar Hammond Pearce Ayse K. Coskun Gianluca Stringhini ELM LRM 21 60 0 19 Dec 2023
Towards Trustworthy AI Software Development Assistance Daniel Maninger Krishna Narasimhan Mira Mezini 32 3 0 14 Dec 2023
Poisoned ChatGPT Finds Work for Idle Hands: Exploring Developers' Coding Practices with Insecure Suggestions from Poisoned AI Models Sanghak Oh Kiho Lee Seonhye Park Doowon Kim Hyoungshick Kim SILM 21 16 0 11 Dec 2023
Exploring the Limits of ChatGPT in Software Security Applications Fangzhou Wu Qingzhao Zhang Ati Priya Bajaj Tiffany Bao Ning Zhang Ruoyu Wang Chaowei Xiao ALM SILM ELM 20 8 0 08 Dec 2023
DeceptPrompt: Exploiting LLM-driven Code Generation via Adversarial Natural Language Instructions Fangzhou Wu Xiaogeng Liu Chaowei Xiao AAML SILM 26 26 0 07 Dec 2023
Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Models Manish P Bhatt Sahana Chennabasappa Cyrus Nikolaidis Shengye Wan Ivan Evtimov ... Aleksandar Straumann Gabriel Synnaeve Varun Vontimitta Spencer Whitman Joshua Saxe ELM 21 68 0 07 Dec 2023
Monitor Placement for Fault Localization in Deep Neural Network Accelerators Wei-Kai Liu 25 0 0 28 Nov 2023
Refactoring Programs Using Large Language Models with Few-Shot Examples Atsushi Shirafuji Yusuke Oda Jun Suzuki Makoto Morishita Yutaka Watanobe 24 33 0 20 Nov 2023
Automating the Correctness Assessment of AI-generated Code for Security Contexts Domenico Cotroneo Alessio Foggia Cristina Improta Pietro Liguori R. Natella 26 8 0 28 Oct 2023
Pitfalls in Language Models for Code Intelligence: A Taxonomy and Survey Xinyu She Yue Liu Yanjie Zhao Yiling He Li Li C. Tantithamthavorn Zhan Qin Haoyu Wang ELM 32 13 0 27 Oct 2023
Clover: Closed-Loop Verifiable Code Generation Chuyue Sun Ying Sheng Oded Padon Clark W. Barrett OffRL ALM 33 28 0 26 Oct 2023
Enhancing Large Language Models for Secure Code Generation: A Dataset-driven Study on Vulnerability Mitigation Jiexin Wang Liuwen Cao Xitong Luo Zhiping Zhou Jiayuan Xie Adam Jatowt Yi Cai 44 10 0 25 Oct 2023
Towards the Imagenets of ML4EDA A. B. Chowdhury Shailja Thakur Hammond Pearce Ramesh Karri Siddharth Garg 12 1 0 16 Oct 2023
Benchmarking and Explaining Large Language Model-based Code Generation: A Causality-Centric Approach Zhenlan Ji Pingchuan Ma Zongjie Li Shuai Wang 29 21 0 10 Oct 2023
Top of the Heap: Efficient Memory Error Protection for Many Heap Objects Kaiming Huang Mathias Payer Zhiyun Qian Jack Sampson Gang Tan Trent Jaeger 13 1 0 10 Oct 2023
Trust in Generative AI among students: An Exploratory Study Matin Amoozadeh David Daniels Daye Nam Aayush Kumar Stella Chen Michael Hilton Sruti Srinivasa Ragavan Mohammad Amin Alipour 11 53 0 07 Oct 2023
Security Weaknesses of Copilot-Generated Code in GitHub Projects: An Empirical Study Yujia Fu Peng Liang Amjed Tahir Zengyang Li Mojtaba Shahin Jiaxin Yu Jinfu Chen SILM 56 24 0 03 Oct 2023
Gotcha! This Model Uses My Code! Evaluating Membership Leakage Risks in Code Models Zhou Yang Zhipeng Zhao Chenyu Wang Jieke Shi Dongsum Kim Donggyun Han David Lo SILM AAML MIACV 33 12 0 02 Oct 2023
Efficient Avoidance of Vulnerabilities in Auto-completed Smart Contract Code Using Vulnerability-constrained Decoding André Storhaug Jingyue Li Tianyuan Hu AAML 34 14 0 18 Sep 2023
Your Code Secret Belongs to Me: Neural Code Completion Tools Can Memorize Hard-Coded Credentials Yizhan Huang Yichen Li Weibin Wu Jianping Zhang Michael R. Lyu 31 14 0 14 Sep 2023
The Effectiveness of Security Interventions on GitHub F. Fischer Jonas Höbenreich Jens Grossklags 17 4 0 09 Sep 2023