Understanding the Effectiveness of Large Language Models in Detecting Security Vulnerabilities

16 November 2023

Papers citing "Understanding the Effectiveness of Large Language Models in Detecting Security Vulnerabilities"

25 / 25 papers shown

Title
Trace Gadgets: Minimizing Code Context for Machine Learning-Based Vulnerability Prediction Felix Mächtle Nils Loose Tim Schulz Florian Sieck Jan-Niclas Serr Ralf Möller T. Eisenbarth 24 0 0 18 Apr 2025
The Hitchhiker's Guide to Program Analysis, Part II: Deep Thoughts by LLMs Haonan Li Hang Zhang Kexin Pei Zhiyun Qian 50 1 0 16 Apr 2025
Reasoning with LLMs for Zero-Shot Vulnerability Detection Arastoo Zibaeirad Marco Vieira AAML LRM 42 2 0 22 Mar 2025
A Comprehensive Study of LLM Secure Code Generation Shih-Chieh Dai Jun Xu Guanhong Tao ELM 40 0 0 18 Mar 2025
A Framework for Evaluating Emerging Cyberattack Capabilities of AI Mikel Rodriguez Raluca Ada Popa Four Flynn Lihao Liang Allan Dafoe Anna Wang ELM 53 2 0 14 Mar 2025
Evaluating LLaMA 3.2 for Software Vulnerability Detection José Gonçalves Miguel Silva Bernardo Cabral Tiago Dias Eva Maia Isabel Praça Ricardo Severino Luis Lino Ferreira 41 1 0 10 Mar 2025
Evaluating Large Language Models in Vulnerability Detection Under Variable Context Windows Jie Lin David Mohaisen 51 0 0 30 Jan 2025
RTL-Breaker: Assessing the Security of LLMs against Backdoor Attacks on HDL Code Generation Lakshmi Likhitha Mankali Jitendra Bhandari Manaar Alam Ramesh Karri Michail Maniatakos Ozgur Sinanoglu J. Knechtel 64 2 0 26 Nov 2024
ProveRAG: Provenance-Driven Vulnerability Analysis with Automated Retrieval-Augmented LLMs Reza Fayyazi Stella Hoyos Trueba Michael Zuzak S. Yang 31 0 0 22 Oct 2024
LLM-SmartAudit: Advanced Smart Contract Vulnerability Detection Zhiyuan Wei Jing Sun Zijiang Zhang Xianhao Zhang Meng Li Zhe Hou 26 3 0 12 Oct 2024
Comparing Unidirectional, Bidirectional, and Word2vec Models for Discovering Vulnerabilities in Compiled Lifted Code Gary A. McCully John D. Hastings Shengjie Xu Adam Fortier 23 2 0 26 Sep 2024
VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patching Arastoo Zibaeirad Marco Vieira 16 7 0 16 Sep 2024
Large Language Models for Secure Code Assessment: A Multi-Language Empirical Study Kohei Dozono Tiago Gasiba Andrea Stocco ELM 15 2 0 12 Aug 2024
VulDetectBench: Evaluating the Deep Capability of Vulnerability Detection with Large Language Models Yu Liu Lang Gao Mingxin Yang Yu Xie Ping Chen Xiaojin Zhang Wei Chen ELM 18 3 0 11 Jun 2024
An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities against Strong Detection Shenao Yan Shen Wang Yue Duan Hanbin Hong Kiho Lee Doowon Kim Yuan Hong AAML SILM 35 16 0 10 Jun 2024
IRIS: LLM-Assisted Static Analysis for Detecting Security Vulnerabilities Ziyang Li Saikat Dutta Mayur Naik 45 40 0 27 May 2024
Harnessing Large Language Models for Software Vulnerability Detection: A Comprehensive Benchmarking Study Karl Tamberg Hayretdin Bahsi 34 5 0 24 May 2024
Large Language Models for Cyber Security: A Systematic Literature Review HanXiang Xu Shenao Wang Ningke Li Kailong Wang Yanjie Zhao Kai Chen Ting Yu Yang Liu Haoyu Wang 29 23 0 08 May 2024
When LLMs Meet Cybersecurity: A Systematic Literature Review Jie Zhang Haoyu Bu Hui Wen Yu Chen Lun Li Hongsong Zhu 24 36 0 06 May 2024
Vulnerability Detection with Code Language Models: How Far Are We? Yangruibo Ding Yanjun Fu Omniyyah Ibrahim Chawin Sitawarin Xinyun Chen Basel Alomair David A. Wagner Baishakhi Ray Yizheng Chen AAML 36 43 0 27 Mar 2024
On the effectiveness of Large Language Models for GitHub Workflows Xinyu Zhang Siddharth Muralee Sourag Cherupattamoolayil Aravind Machiry 25 2 0 19 Mar 2024
LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoning Yuqiang Sun Daoyuan Wu Yue Xue Han Liu Wei Ma Lyuye Zhang Miaolei Shi Yingjiu Li ELM 76 46 0 29 Jan 2024
Asymmetric Bias in Text-to-Image Generation with Adversarial Attacks Haz Sameen Shahgir Xianghao Kong Greg Ver Steeg Yue Dong 8 5 0 22 Dec 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 206 2,232 0 22 Mar 2023
ReAct: Synergizing Reasoning and Acting in Language Models Shunyu Yao Jeffrey Zhao Dian Yu Nan Du Izhak Shafran Karthik Narasimhan Yuan Cao LLMAG ReLM LRM 223 2,413 0 06 Oct 2022