ChatGPT for Vulnerability Detection, Classification, and Repair: How Far Are We?

15 October 2023

Michael Fu

Chakkrit Tantithamthavorn

Van Nguyen

Trung Le

SILM

ELM

ArXiv (abs)PDF HTML Github (11★)

Papers citing "ChatGPT for Vulnerability Detection, Classification, and Repair: How Far Are We?"

32 / 32 papers shown

Title
MulVuln: Enhancing Pre-trained LMs with Shared and Language-Specific Knowledge for Multilingual Vulnerability Detection Van Nguyen Surya Nepal Xingliang Yuan Tingmin Wu Fengchao Chen Carsten Rudolph AAML 100 0 0 05 Oct 2025
Large Language Models for Security Operations Centers: A Comprehensive Survey Ali Habibzadeh Farid Feyzi Reza Ebrahimi Atani 280 2 0 13 Sep 2025
From CVE Entries to Verifiable Exploits: An Automated Multi-Agent Framework for Reproducing CVEs Saad Ullah Praneeth Balasubramanian Wenbo Guo Amanda Burnett Hammond Pearce Christopher Kruegel Giovanni Vigna Gianluca Stringhini 181 3 0 01 Sep 2025
Repairing vulnerabilities without invisible hands. A differentiated replication study on LLMs Maria Camporese Fabio Massacci 97 1 0 28 Jul 2025
Revisiting Pre-trained Language Models for Vulnerability Detection Youpeng Li Weiliang Qi Xuyu Wang Fuxun Yu Xinda Wang AAML 176 1 0 22 Jul 2025
Quantum Machine Learning in Multi-Qubit Phase-Space Part I: Foundations Timothy Heightman Edward Jiang Ruth Mora-Soto Maciej Lewenstein Marcin Płodzień 247 5 0 16 Jul 2025
Worst-Case Symbolic Constraints Analysis and Generalisation with Large Language Models Daniel Koh Yannic Noller C. Păsăreanu Adrians Skapars Youcheng Sun 171 0 0 09 Jun 2025
LPASS: Linear Probes as Stepping Stones for vulnerability detection using compressed LLMsJournal of Information Security and Applications (JISA), 2025 Luis Ibanez-Lissen Lorena Gonzalez-Manzano José Maria De Fuentes Nicolas Anciaux 131 2 0 30 May 2025
Secure Coding with AI, From Creation to Inspection Vladislav Belozerov Peter J. Barclay Ashkan Sami 152 1 0 29 Apr 2025
Exploring the Role of Large Language Models in Cybersecurity: A Systematic Survey Shuang Tian Tao Zhang Qingbin Liu Jiacheng Wang Xuangou Wu ... Ruichen Zhang Feiyu Xiong Zhenhui Yuan Shiwen Mao Dong In Kim 316 4 0 22 Apr 2025
Large Language Models for In-File Vulnerability Localization Can Be "Lost in the End" Francesco Sovrano Adam Bauer Alberto Bacchelli 238 4 0 09 Feb 2025
SoK: Towards Effective Automated Vulnerability Repair Ying Li Faysal hossain shezan Bomin wei Gang Wang Yuan Tian 389 6 0 31 Jan 2025
Can LLM Generate Regression Tests for Software Commits? Jing Liu Seongmin Lee Eleonora Losiouk Marcel Böhme 157 4 0 19 Jan 2025
MAG-V: A Multi-Agent Framework for Synthetic Data Generation and Verification Saptarshi Sengupta Kristal Curtis Akshay Mallipeddi Abhinav Mathur Joseph Ross Liang Gou Liang Gou LLMAG SyDa 387 8 0 28 Nov 2024
EnStack: An Ensemble Stacking Framework of Large Language Models for Enhanced Vulnerability Detection in Source CodeBigData Congress [Services Society] (BSS), 2024 Shahriyar Zaman Ridoy Md. Shazzad Hossain Shaon A. Cuzzocrea Mst. Shapna Akter 209 5 0 25 Nov 2024
Hacking Back the AI-Hacker: Prompt Injection as a Defense Against LLM-driven Cyberattacks Dario Pasquini Evgenios M. Kornaropoulos G. Ateniese AAML 185 10 0 28 Oct 2024
StagedVulBERT: Multi-Granular Vulnerability Detection with a Novel Pre-trained Code ModelIEEE Transactions on Software Engineering (TSE), 2024 Yuan Jiang Yujian Zhang Xiaohong Su Christoph Treude Tiantian Wang 173 4 0 08 Oct 2024
How Well Do Large Language Models Serve as End-to-End Secure Code Agents for Python? Jianian Gong Nachuan Duan Ziheng Tao Zhaohui Gong Yuan Yuan Minlie Huang ELM 222 2 0 20 Aug 2024
A Qualitative Study on Using ChatGPT for Software Security: Perception vs. PracticalityInternational Conference on Trust, Privacy and Security in Intelligent Systems and Applications (ICPSISA), 2024 Youjia Fu M. A. Babar Shuqiu Tan 150 5 0 01 Aug 2024
Comparison of Static Application Security Testing Tools and Large Language Models for Repo-level Vulnerability Detection Xin Zhou Duc-Manh Tran Thanh Le-Cong Ting Zhang Ivana Clairine Irsan Joshua Sumarlin Bach Le David Lo ELM 165 28 0 23 Jul 2024
Mitigating Data Imbalance for Software Vulnerability Assessment: Does Data Augmentation Help? T. H. Le Muhammad Ali Babar 159 11 0 15 Jul 2024
VulDetectBench: Evaluating the Deep Capability of Vulnerability Detection with Large Language Models Yu Liu Lang Gao Mingxin Yang Yu Xie Ping Chen Xiaojin Zhang Wei Chen ELM 148 15 0 11 Jun 2024
Harnessing Large Language Models for Software Vulnerability Detection: A Comprehensive Benchmarking Study Karl Tamberg Hayretdin Bahsi 182 31 0 24 May 2024
Software Vulnerability Prediction in Low-Resource Languages: An Empirical Study of CodeBERT and ChatGPT T. H. Le Muhammad Ali Babar Tung Hoang Thai 204 13 0 26 Apr 2024
Deep Learning-Based Out-of-distribution Source Code Data Identification: How Far Have We Gone? Van Nguyen Xingliang Yuan Tingmin Wu Surya Nepal M. Grobler Carsten Rudolph 201 2 0 09 Apr 2024
SCALE: Constructing Structured Natural Language Comment Trees for Software Vulnerability Detection Xinjie Wen Cuiyun Gao Shuzheng Gao Yang Xiao Michael R. Lyu 164 23 0 28 Mar 2024
Multi-role Consensus through LLMs Discussions for Vulnerability Detection Zhenyu Mao Jialong Li Dongming Jin Munan Li Kenji Tei 204 24 0 21 Mar 2024
AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacks Jiacen Xu Jack W. Stokes Geoff McDonald Xuesong Bai David Marshall Siyue Wang Adith Swaminathan Zhou Li 235 96 0 02 Mar 2024
Finetuning Large Language Models for Vulnerability Detection Alexey Shestov Rodion Levichev Ravil Mussabayev Evgeny Maslov Anton Cheshkov Pavel Zadorozhny 247 69 0 30 Jan 2024
A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the UglyHigh-Confidence Computing (HC), 2023 Yifan Yao Jinhao Duan Kaidi Xu Yuanfang Cai Eric Sun Yue Zhang PILM ELM 530 885 0 04 Dec 2023
FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code RepairIEEE Transactions on Software Engineering (TSE), 2023 Sakina Fatima Hadi Hemmati Lionel C. Briand 300 16 0 21 Jun 2023
Statement-Level Vulnerability Detection: Learning Vulnerability Patterns Through Information Theory and Contrastive Learning Van Nguyen Trung Le Chakkrit Tantithamthavorn Michael Fu John C. Grundy Hung Nguyen S. Çamtepe Paul Quirk Dinh Q. Phung 142 6 0 20 Sep 2022