Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions

20 August 2021

Papers citing "Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions"

50 / 213 papers shown

Title
Can You Really Trust Code Copilots? Evaluating Large Language Models from a Code Security Perspective Yutao Mou Xiao Deng Yuxiao Luo Shikun Zhang Wei Ye ELM 16 0 0 15 May 2025
"I Apologize For Not Understanding Your Policy": Exploring the Specification and Evaluation of User-Managed Access Control Policies by AI Virtual Assistants Jennifer Mondragon Carlos Rubio-Medrano Gael Cruz Dvijesh Shastri 24 0 0 12 May 2025
Directed Greybox Fuzzing via Large Language Model HanXiang Xu Yanjie Zhao Haoyu Wang 48 0 0 06 May 2025
Secure Coding with AI, From Creation to Inspection Vladislav Belozerov Peter J. Barclay Ashkan Sami 21 0 0 29 Apr 2025
SecRepoBench: Benchmarking LLMs for Secure Code Generation in Real-World Repositories Connor Dilgren Purva Chiniya Luke Griffith Yu Ding Yizheng Chen 42 0 0 29 Apr 2025
Hallucination by Code Generation LLMs: Taxonomy, Benchmarks, Mitigation, and Challenges Yunseo Lee John Youngeun Song Dongsun Kim Jindae Kim Mijung Kim Jaechang Nam HILM LRM 42 0 0 29 Apr 2025
CodeBC: A More Secure Large Language Model for Smart Contract Code Generation in Blockchain LingXiang Wang Hainan Zhang Qinnan Zhang Ziwei Wang Hongwei Zheng Jin Dong Zhiming Zheng 61 0 0 28 Apr 2025
Give LLMs a Security Course: Securing Retrieval-Augmented Code Generation via Knowledge Injection Bo Lin Shangwen Wang Yihao Qin Liqian Chen Xiaoguang Mao SILM 33 0 0 23 Apr 2025
On Developers' Self-Declaration of AI-Generated Code: An Analysis of Practices Syed Mohammad Kashif Peng Liang Amjed Tahir 27 0 0 23 Apr 2025
The Code Barrier: What LLMs Actually Understand? Serge Lionel Nikiema Jordan Samhi A. Kaboré Jacques Klein Tegawende F. Bissyande ELM 27 1 0 14 Apr 2025
Understanding Users' Security and Privacy Concerns and Attitudes Towards Conversational AI Platforms Mutahar Ali Arjun Arunasalam Habiba Farrukh SILM 54 0 0 09 Apr 2025
Exploring utilization of generative AI for research and education in data-driven materials science Takahiro Misawa Ai Koizumi Ryo Tamura Kazuyoshi Yoshimi AI4CE 24 0 0 09 Apr 2025
DeCoMa: Detecting and Purifying Code Dataset Watermarks through Dual Channel Code Abstraction Yuan Xiao Yuchen Chen Shiqing Ma Haocheng Huang Chunrong Fang Y. Chen Dongrui Liu Yunfeng Zhu Xinming Zhang Zhenyu Chen 31 0 0 09 Apr 2025
Frontier AI's Impact on the Cybersecurity Landscape Wenbo Guo Yujin Potter Tianneng Shi Zhun Wang Andy Zhang Dawn Song 52 1 0 07 Apr 2025
SandboxEval: Towards Securing Test Environment for Untrusted Code Rafiqul Rabin Jesse Hostetler Sean McGregor Brett Weir Nick Judd ELM 39 0 0 27 Mar 2025
A Comprehensive Study of LLM Secure Code Generation Shih-Chieh Dai Jun Xu Guanhong Tao ELM 48 0 0 18 Mar 2025
Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectives Dipin Khati Yijin Liu David Nader-Palacio Yixuan Zhang Denys Poshyvanyk 51 0 0 18 Mar 2025
VeriLeaky: Navigating IP Protection vs Utility in Fine-Tuning for LLM-Driven Verilog Coding Zeng Wang Minghao Shao M. Nabeel P. Roy Likhitha Mankali Jitendra Bhandari Ramesh Karri Ozgur Sinanoglu Muhammad Shafique J. Knechtel 70 0 0 17 Mar 2025
Can Reasoning Models Reason about Hardware? An Agentic HLS Perspective L. Collini Andrew Hennessee Ramesh Karri Siddharth Garg ELM LRM 46 0 0 17 Mar 2025
SOSecure: Safer Code Generation with RAG and StackOverflow Discussions Manisha Mukherjee Vincent J. Hellendoorn SILM 60 1 0 17 Mar 2025
Unveiling Pitfalls: Understanding Why AI-driven Code Agents Fail at GitHub Issue Resolution Zhi Chen Wei Ma Lingxiao Jiang LLMAG 56 0 0 16 Mar 2025
Empirical Computation Eric Tang Marcel Böhme 49 0 0 13 Mar 2025
Fully Autonomous Programming using Iterative Multi-Agent Debugging with Large Language Models Anastasiia Grishina Vadim Liventsev Aki Härmä Leon Moonen ELM 87 0 0 10 Mar 2025
Human-AI Experience in Integrated Development Environments: A Systematic Literature Review Agnia Sergeyuk Ilya Zakharov Ekaterina Koshchenko M. Izadi 58 0 0 08 Mar 2025
Transferable Foundation Models for Geometric Tasks on Point Cloud Representations: Geometric Neural Operators Blaine Quackenbush P. Atzberger 3DPC AI4CE 65 0 0 06 Mar 2025
Mapping Trustworthiness in Large Language Models: A Bibliometric Analysis Bridging Theory to Practice José Antonio Siqueira de Cerqueira Kai-Kristian Kemell Muhammad Waseem Rebekah Rousi Nannan Xi Juho Hamari 104 3 0 27 Feb 2025
Do LLMs Consider Security? An Empirical Study on Responses to Programming Questions Amirali Sajadi Binh Le A. Nguyen Kostadin Damevski Preetha Chatterjee 63 2 0 20 Feb 2025
Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code Shahin Honarvar Mark van der Wilk Alastair Donaldson 80 6 0 28 Jan 2025
Generative AI Uses and Risks for Knowledge Workers in a Science Organization Kelly B. Wagman Matthew T. Dearing Marshini Chetty AI4CE 45 1 0 27 Jan 2025
Towards Advancing Code Generation with Large Language Models: A Research Roadmap Haolin Jin Huaming Chen Qinghua Lu Liming Zhu LLMAG 45 1 0 20 Jan 2025
CWEval: Outcome-driven Evaluation on Functionality and Security of LLM Code Generation Jinjun Peng Leyi Cui Kele Huang Junfeng Yang Baishakhi Ray ELM 62 8 0 14 Jan 2025
Logic Meets Magic: LLMs Cracking Smart Contract Vulnerabilities ZeKe Xiao Qin Wang Hammond Pearce Shiping Chen 42 0 0 13 Jan 2025
Harnessing the Power of LLM to Support Binary Taint Analysis Puzhuo Liu Chengnian Sun Yaowen Zheng Xuan Feng Chuan Qin ... Zhenyang Xu Zhi Li Peng Di Yu Jiang Limin Sun 37 11 0 10 Jan 2025
Cracks in The Stack: Hidden Vulnerabilities and Licensing Risks in LLM Pre-Training Datasets Mahmoud Jahanshahi Audris Mockus AAML 26 1 0 05 Jan 2025
Security Attacks on LLM-based Code Completion Tools Wen Cheng Ke Sun Xinyu Zhang Wei Wang SILM AAML ELM 62 4 0 03 Jan 2025
Formal Mathematical Reasoning: A New Frontier in AI Kaiyu Yang Gabriel Poesia Jingxuan He Wenda Li Kristin Lauter Swarat Chaudhuri Dawn Song LRM AI4CE 82 21 0 20 Dec 2024
Optimizing AI-Assisted Code Generation Simon Torka Sahin Albayrak 75 0 0 14 Dec 2024
Protect Your Secrets: Understanding and Measuring Data Exposure in VSCode Extensions Yue Liu C. Tantithamthavorn Li Li 72 0 0 01 Dec 2024
On the Adversarial Robustness of Instruction-Tuned Large Language Models for Code Md. Imran Hossen X. Hei AAML ELM 64 0 0 29 Nov 2024
CKGFuzzer: LLM-Based Fuzz Driver Generation Enhanced By Code Knowledge Graph HanXiang Xu Wei Ma Ting Zhou Yanjie Zhao Kai Chen Q. Hu Yang Liu Haoyu Wang 74 0 0 18 Nov 2024
EDBooks: AI-Enhanced Interactive Narratives for Programming Education Steve Oney Yue Shen Fei Wu Young Suh Hong Ziang Wang Yamini Khajekar Jiacheng Zhang A. Wang AI4Ed 37 0 0 16 Nov 2024
Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AI José Antonio Siqueira de Cerqueira Mamia Agbese Rebekah Rousi Nannan Xi Juho Hamari Pekka Abrahamsson LLMAG 41 4 0 25 Oct 2024
Dynamic Intelligence Assessment: Benchmarking LLMs on the Road to AGI with a Focus on Model Confidence Norbert Tihanyi Tamás Bisztray Richard A. Dubniczky Rebeka Tóth B. Borsos ... Ryan Marinelli Lucas C. Cordeiro Merouane Debbah Vasileios Mavroeidis Audun Josang 23 4 0 20 Oct 2024
Contextual Augmented Multi-Model Programming (CAMP): A Hybrid Local-Cloud Copilot Framework Yuchen Wang Shangxin Guo C. Tan 34 0 0 20 Oct 2024
From Solitary Directives to Interactive Encouragement! LLM Secure Code Generation by Natural Language Prompting Shigang Liu Bushra Sabir Seung Ick Jang Yuval Kansal Yansong Gao Kristen Moore A. Abuadbba Surya Nepal 30 2 0 18 Oct 2024
Evaluating Software Development Agents: Patch Patterns, Code Quality, and Issue Complexity in Real-World GitHub Scenarios Zhi Chen Lingxiao Jiang LLMAG 28 1 0 16 Oct 2024
SecCodePLT: A Unified Platform for Evaluating the Security of Code GenAI Yu Yang Yuzhou Nie Zhun Wang Yuheng Tang Wenbo Guo Bo Li D. Song ELM 38 6 0 14 Oct 2024
Generalized Adversarial Code-Suggestions: Exploiting Contexts of LLM-based Code-Completion Karl Rubel Maximilian Noppel Christian Wressnegger AAML SILM 23 0 0 14 Oct 2024
CursorCore: Assist Programming through Aligning Anything Hao Jiang Qi Liu Rui Li Shengyu Ye Shijin Wang 53 1 0 09 Oct 2024
Artificial-Intelligence Generated Code Considered Harmful: A Road Map for Secure and High-Quality Code Generation Chun Jie Chong Zhihao Yao Iulian Neamtiu 26 2 0 27 Sep 2024