Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions

20 August 2021

Papers citing "Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions"

50 / 213 papers shown

Title
Trustworthy and Synergistic Artificial Intelligence for Software Engineering: Vision and Roadmaps David Lo 34 39 0 08 Sep 2023
Demystifying RCE Vulnerabilities in LLM-Integrated Apps Tong Liu Zizhuang Deng Guozhu Meng Yuekang Li Kai Chen SILM 44 19 0 06 Sep 2023
Identifying and Mitigating the Security Risks of Generative AI Clark W. Barrett Bradley L Boyd Ellie Burzstein Nicholas Carlini Brad Chen ... Zulfikar Ramzan Khawaja Shams D. Song Ankur Taly Diyi Yang SILM 37 92 0 28 Aug 2023
Can ChatGPT replace StackOverflow? A Study on Robustness and Reliability of Large Language Model Code Generation Li Zhong Zilong Wang ELM SILM 19 59 0 20 Aug 2023
PentestGPT: An LLM-empowered Automatic Penetration Testing Tool Gelei Deng Yi Liu Víctor Mayoral-Vilches Peng Liu Yuekang Li Yuan Xu Tianwei Zhang Yang Liu M. Pinzger Stefan Rass LLMAG 20 82 0 13 Aug 2023
A User-centered Security Evaluation of Copilot Owura Asare M. Nagappan Nadarajah Asokan ELM 16 5 0 12 Aug 2023
An Empirical Study of AI-based Smart Contract Creation Rabimba Karanjai Edward Li Lei Xu W. Shi 18 9 0 05 Aug 2023
Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attacks Domenico Cotroneo Cristina Improta Pietro Liguori R. Natella SILM 30 22 0 04 Aug 2023
VeriGen: A Large Language Model for Verilog Code Generation Shailja Thakur Baleegh Ahmad Hammond Pearce Benjamin Tan Brendan Dolan-Gavitt Ramesh Karri S. Garg 37 139 0 28 Jul 2023
BotHawk: An Approach for Bots Detection in Open Source Software Projects Fenglin Bi Zhi-liang Zhu Wei Wang Xiaoya Xia Hassan Ali Khan Pengxian Pu 17 1 0 25 Jul 2023
A Lightweight Framework for High-Quality Code Generation Mohammed Latif Siddiq B.K. Casey Joanna C. S. Santos 44 17 0 17 Jul 2023
The FormAI Dataset: Generative AI in Software Security Through the Lens of Formal Verification Norbert Tihanyi Tamás Bisztray Ridhi Jain M. Ferrag Lucas C. Cordeiro Vasileios Mavroeidis 27 37 0 05 Jul 2023
Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review M. Wong Shangxin Guo Ching Nam Hang Siu-Wai Ho C. Tan 42 78 0 04 Jul 2023
Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generation William F. Godoy Pedro Valero-Lara K. Teranishi Prasanna Balaprakash Jeffrey S. Vetter ELM 23 24 0 27 Jun 2023
Exploring the Robustness of Large Language Models for Solving Programming Problems Atsushi Shirafuji Yutaka Watanobe Takumi Ito Makoto Morishita Yuki Nakamura Yusuke Oda Jun Suzuki ELM 41 18 0 26 Jun 2023
(Security) Assertions by Large Language Models Rahul Kande Hammond Pearce Benjamin Tan Brendan Dolan-Gavitt Shailja Thakur Ramesh Karri Jeyavijayan Rajendran Texas AM University 36 48 0 24 Jun 2023
FLAG: Finding Line Anomalies (in code) with Generative AI Baleegh Ahmad Benjamin Tan Ramesh Karri Hammond Pearce 25 12 0 22 Jun 2023
Is AI the better programming partner? Human-Human Pair Programming vs. Human-AI pAIr Programming Qianou Ma Tongshuang Wu Kenneth R. Koedinger 13 33 0 08 Jun 2023
StudentEval: A Benchmark of Student-Written Prompts for Large Language Models of Code Hannah McLean Babe S. Nguyen Yangtian Zi Arjun Guha Molly Q. Feldman Carolyn Jane Anderson ALM LRM 44 35 0 07 Jun 2023
Computing Education in the Era of Generative AI Paul Denny James Prather Brett A. Becker James Finnie-Ansley Arto Hellas Juho Leinonen Andrew Luxton-Reilly B. Reeves E. Santos Sami Sarsa 26 170 0 05 Jun 2023
Do Large Language Models Pay Similar Attention Like Human Programmers When Generating Code? Bonan Kou Shengmai Chen Zhijie Wang Lei Ma Tianyi Zhang ALM 11 13 0 02 Jun 2023
Who Wrote this Code? Watermarking for Code Generation Taehyun Lee Seokhee Hong Jaewoo Ahn Ilgee Hong Hwaran Lee Sangdoo Yun Jamin Shin Gunhee Kim WaLM 20 84 0 24 May 2023
Chip-Chat: Challenges and Opportunities in Conversational Hardware Design Jason Blocklove S. Garg Ramesh Karri Hammond Pearce 45 168 0 22 May 2023
Comparing Software Developers with ChatGPT: An Empirical Investigation Nathalia Nascimento Paulo S. C. Alencar Donald D. Cowan 13 29 0 19 May 2023
Investigating and Designing for Trust in AI-powered Code Generation Tools Ruotong Wang Ruijia Cheng Denae Ford Thomas Zimmermann 32 45 0 18 May 2023
StarCoder: may the source be with you! Raymond Li Loubna Ben Allal Yangtian Zi Niklas Muennighoff Denis Kocetkov ... Sean M. Hughes Thomas Wolf Arjun Guha Leandro von Werra H. D. Vries 50 716 0 09 May 2023
Using Large Language Models to Generate JUnit Tests: An Empirical Study Mohammed Latif Siddiq Joanna C. S. Santos Ridwanul Hasan Tanvir Noshin Ulfat Fahmid Al Rifat Vinicius Carvalho Lopes ELM 65 50 0 30 Apr 2023
Semantic Compression With Large Language Models Henry Gilbert Michael Sandborn Douglas C. Schmidt Jesse Spencer-Smith Jules White 14 22 0 25 Apr 2023
Fully Autonomous Programming with Large Language Models Vadim Liventsev Anastasiia Grishina Aki Härmä Leon Moonen ELM 34 37 0 20 Apr 2023
In ChatGPT We Trust? Measuring and Characterizing the Reliability of ChatGPT Xinyue Shen Z. Chen Michael Backes Yang Zhang 21 55 0 18 Apr 2023
Enhancing Automated Program Repair through Fine-tuning and Prompt Engineering Rishov Paul Md. Mohib Hossain Mohammed Latif Siddiq Masum Hasan Anindya Iqbal Joanna C. S. Santos KELM 34 11 0 16 Apr 2023
"It's Weird That it Knows What I Want": Usability and Interactions with Copilot for Novice Programmers James Prather B. Reeves Paul Denny Brett A. Becker Juho Leinonen Andrew Luxton-Reilly Garrett B. Powell James Finnie-Ansley E. Santos 40 131 0 05 Apr 2023
Large Language Models and Simple, Stupid Bugs Kevin Jesse Toufique Ahmed Prem Devanbu Emily Morgan ELM 37 51 0 20 Mar 2023
LLMSecEval: A Dataset of Natural Language Prompts for Security Evaluations Catherine Tony Markus Mutas Nicolás E. Díaz Ferreyra Riccardo Scandariato ELM 12 44 0 16 Mar 2023
Can Generative Pre-trained Transformers (GPT) Pass Assessments in Higher Education Programming Courses? Jaromír Šavelka Arav Agarwal Chris Bogart Yifan Song M. Sakr ELM 39 97 0 16 Mar 2023
ChatGPT Prompt Patterns for Improving Code Quality, Refactoring, Requirements Elicitation, and Software Design Jules White Sam Hays Quchen Fu Jesse Spencer-Smith Douglas C. Schmidt LLMAG 25 154 0 11 Mar 2023
From Copilot to Pilot: Towards AI Supported Software Development Rohith Pudari Neil A. Ernst 23 20 0 07 Mar 2023
The (ab)use of Open Source Code to Train Large Language Models Ali Al-Kaswan M. Izadi 12 19 0 27 Feb 2023
A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT Jules White Quchen Fu Sam Hays Michael Sandborn Carlos Olea Henry Gilbert Ashraf Elnashar Jesse Spencer-Smith Douglas C. Schmidt LLMAG 57 1,053 0 21 Feb 2023
Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions Helena Vasconcelos Gagan Bansal Adam Fourney Q. V. Liao Jennifer Wortman Vaughan 32 5 0 14 Feb 2023
Large Language Models for Code: Security Hardening and Adversarial Testing Jingxuan He Martin Vechev ELM AAML 15 108 0 10 Feb 2023
CrossCodeBench: Benchmarking Cross-Task Generalization of Source Code Models Changan Niu Chuanyi Li Vincent Ng Bin Luo ELM ALM 34 9 0 08 Feb 2023
CodeLMSec Benchmark: Systematically Evaluating and Finding Security Vulnerabilities in Black-Box Code Language Models Hossein Hajipour Keno Hassler Thorsten Holz Lea Schonherr Mario Fritz ELM 40 20 0 08 Feb 2023
Numeracy from Literacy: Data Science as an Emergent Skill from Large Language Models David A. Noever Forrest McKee ELM 74 12 0 31 Jan 2023
Navigating Complexity in Software Engineering: A Prototype for Comparing GPT-n Solutions Christoph Treude 24 17 0 28 Jan 2023
Study of software developers' experience using the Github Copilot Tool in the software development process Mateusz Jaworski Dariusz Piotrkowski 16 5 0 12 Jan 2023
TrojanPuzzle: Covertly Poisoning Code-Suggestion Models H. Aghakhani Wei Dai Andre Manoel Xavier Fernandes Anant Kharkar Christopher Kruegel Giovanni Vigna David E. Evans B. Zorn Robert Sim SILM 21 33 0 06 Jan 2023
Execution-Based Evaluation for Open-Domain Code Generation Zhiruo Wang Shuyan Zhou Daniel Fried Graham Neubig ELM 37 80 0 20 Dec 2022
Large Language Models Meet NL2Code: A Survey Daoguang Zan B. Chen Fengji Zhang Di Lu Bingchao Wu Bei Guan Yongji Wang Jian-Guang Lou ELM ALM 31 170 0 19 Dec 2022
Discovering Language Model Behaviors with Model-Written Evaluations Ethan Perez Sam Ringer Kamilė Lukošiūtė Karina Nguyen Edwin Chen ... Danny Hernandez Deep Ganguli Evan Hubinger Nicholas Schiefer Jared Kaplan ALM 22 364 0 19 Dec 2022