LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoning

29 January 2024

Daoyuan Wu

Yingjiu Li

Papers citing "LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoning"

32 / 32 papers shown

Title
Can LLMs handle WebShell detection? Overcoming Detection Challenges with Behavioral Function-Aware Framework Feijiang Han Jiaming Zhang Chuyi Deng Jianheng Tang Yunhuai Liu 19 0 0 14 Apr 2025
R2Vul: Learning to Reason about Software Vulnerabilities with Reinforcement Learning and Structured Reasoning Distillation M. Weyssow Chengran Yang Junkai Chen Yikun Li Huihui Huang ... Han Wei Ang Frank Liauw Eng Lieh Ouh Lwin Khin Shar David Lo LRM 33 0 0 07 Apr 2025
Generative Large Language Model usage in Smart Contract Vulnerability Detection Peter Ince Jiangshan Yu Joseph K. Liu Xiaoning Du 27 0 0 07 Apr 2025
Frontier AI's Impact on the Cybersecurity Landscape Wenbo Guo Yujin Potter Tianneng Shi Zhun Wang Andy Zhang Dawn Song 31 1 0 07 Apr 2025
Benchmarking LLMs and LLM-based Agents in Practical Vulnerability Detection for Code Repositories Alperen Yildiz Sin G. Teo Yiling Lou Yebo Feng Chong Wang Dinil M. Divakaran 46 0 0 05 Mar 2025
Experiences with Content Development and Assessment Design in the Era of GenAI Aakanksha Sharma S. Shailendra Rajan Kadel 26 0 0 28 Feb 2025
LAMD: Context-driven Android Malware Detection and Classification with LLMs Xingzhi Qian Xinran Zheng Yiling He Shuo Yang Lorenzo Cavallaro 72 2 0 18 Feb 2025
Generative AI for Internet of Things Security: Challenges and Opportunities Yan Lin Aung Ivan Christian Ye Dong Xiaodong Ye Sudipta Chattopadhyay Jianying Zhou 47 0 0 13 Feb 2025
CS-Eval: A Comprehensive Large Language Model Benchmark for CyberSecurity Zhengmin Yu Jiutian Zeng Siyi Chen Wenhan Xu Dandan Xu Xiangyu Liu Zonghao Ying Nan Wang Yuan Zhang Min Yang ELM 103 1 0 20 Jan 2025
SmartLLMSentry: A Comprehensive LLM Based Smart Contract Vulnerability Detection Framework Oualid Zaazaa H. Bakkali 66 0 0 28 Nov 2024
SmartInv: Multimodal Learning for Smart Contract Invariant Inference Sally Junsong Wang Kexin Pei Junfeng Yang 45 12 0 14 Nov 2024
LProtector: An LLM-driven Vulnerability Detection System Ze Sheng Fenghua Wu Xiangwu Zuo Chao Li Yuxin Qiao Lei Hang 47 3 0 10 Nov 2024
LLM-SmartAudit: Advanced Smart Contract Vulnerability Detection Zhiyuan Wei Jing Sun Zijiang Zhang Xianhao Zhang Meng Li Zhe Hou 21 3 0 12 Oct 2024
RealVul: Can We Detect Vulnerabilities in Web Applications with LLM? Di Cao Yong Liao Xiuwei Shang 21 0 0 10 Oct 2024
Large Language Model-Based Agents for Software Engineering: A Survey Junwei Liu Kaixin Wang Yixuan Chen Xin Peng Zhenpeng Chen Lingming Zhang Yiling Lou AI4CE LLMAG LM&Ro 29 28 0 04 Sep 2024
Disassembling Obfuscated Executables with LLM Huanyao Rong Yue Duan Hang Zhang XiaoFeng Wang Hongbo Chen Shengchen Duan Shen Wang 19 5 0 12 Jul 2024
Ollabench: Evaluating LLMs' Reasoning for Human-centric Interdependent Cybersecurity Tam n. Nguyen ELM 23 1 0 11 Jun 2024
SelfDefend: LLMs Can Defend Themselves against Jailbreaking in a Practical Manner Xunguang Wang Daoyuan Wu Zhenlan Ji Zongjie Li Pingchuan Ma Shuai Wang Yingjiu Li Yang Liu Ning Liu Juergen Rahmel AAML 46 6 0 08 Jun 2024
Harnessing Large Language Models for Software Vulnerability Detection: A Comprehensive Benchmarking Study Karl Tamberg Hayretdin Bahsi 26 11 0 24 May 2024
When LLMs Meet Cybersecurity: A Systematic Literature Review Jie Zhang Haoyu Bu Hui Wen Yu Chen Lun Li Hongsong Zhu 24 31 0 06 May 2024
PropertyGPT: LLM-driven Formal Verification of Smart Contracts through Retrieval-Augmented Property Generation Ye Liu Yue Xue Daoyuan Wu Yuqiang Sun Yi Li Miaolei Shi Yang Liu 29 20 0 04 May 2024
Testing and Understanding Erroneous Planning in LLM Agents through Synthesized User Inputs Zhenlan Ji Daoyuan Wu Pingchuan Ma Zongjie Li Shuai Wang LLMAG 27 2 0 27 Apr 2024
CyberSecEval 2: A Wide-Ranging Cybersecurity Evaluation Suite for Large Language Models Manish P Bhatt Sahana Chennabasappa Yue Li Cyrus Nikolaidis Daniel Song ... Yaohui Chen Dhaval Kapil David Molnar Spencer Whitman Joshua Saxe ELM 21 22 0 19 Apr 2024
Vulnerability Detection with Code Language Models: How Far Are We? Yangruibo Ding Yanjun Fu Omniyyah Ibrahim Chawin Sitawarin Xinyun Chen Basel Alomair David A. Wagner Baishakhi Ray Yizheng Chen AAML 31 24 0 27 Mar 2024
Large Language Models for Blockchain Security: A Systematic Literature Review Zheyuan He Zihao Li Sen Yang Ao Qiao Xiaosong Zhang Xiapu Luo Ting Chen Ting Chen PILM 42 14 0 21 Mar 2024
ACFIX: Guiding LLMs with Mined Common RBAC Practices for Context-Aware Repair of Access Control Vulnerabilities in Smart Contracts Lyuye Zhang Kaixuan Li Kairan Sun Daoyuan Wu Ye Liu Haoye Tian Yang Liu 35 20 0 11 Mar 2024
Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise and Reconstruction Tong Liu Yingjie Zhang Zhe Zhao Yinpeng Dong Guozhu Meng Kai Chen AAML 24 43 0 28 Feb 2024
LLMs Can Defend Themselves Against Jailbreaking in a Practical Manner: A Vision Paper Daoyuan Wu Shuaibao Wang Yang Liu Ning Liu AAML 31 6 0 24 Feb 2024
Survey on Quality Assurance of Smart Contracts Zhiyuan Wei Jing Sun Zijian Zhang Xianhao Zhang Xiaoxuan Yang Liehuang Zhu 14 6 0 01 Nov 2023
SecureFalcon: Are We There Yet in Automated Software Vulnerability Detection with LLMs? M. Ferrag A. Battah Norbert Tihanyi Ridhi Jain Diana Maimut ... Thierry Lestable Narinderjit Singh Thandi Abdechakour Mechri Merouane Debbah Lucas C. Cordeiro 33 7 0 13 Jul 2023
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 291 2,712 0 24 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022