ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2302.04012
  4. Cited By
CodeLMSec Benchmark: Systematically Evaluating and Finding Security
  Vulnerabilities in Black-Box Code Language Models

CodeLMSec Benchmark: Systematically Evaluating and Finding Security Vulnerabilities in Black-Box Code Language Models

8 February 2023
Hossein Hajipour
Keno Hassler
Thorsten Holz
Lea Schonherr
Mario Fritz
    ELM
ArXivPDFHTML

Papers citing "CodeLMSec Benchmark: Systematically Evaluating and Finding Security Vulnerabilities in Black-Box Code Language Models"

21 / 21 papers shown
Title
SecRepoBench: Benchmarking LLMs for Secure Code Generation in Real-World Repositories
SecRepoBench: Benchmarking LLMs for Secure Code Generation in Real-World Repositories
Connor Dilgren
Purva Chiniya
Luke Griffith
Yu Ding
Yizheng Chen
38
0
0
29 Apr 2025
Transferable Foundation Models for Geometric Tasks on Point Cloud Representations: Geometric Neural Operators
Transferable Foundation Models for Geometric Tasks on Point Cloud Representations: Geometric Neural Operators
Blaine Quackenbush
P. Atzberger
3DPC
AI4CE
58
1
0
06 Mar 2025
Large Language Models for Code Generation: A Comprehensive Survey of Challenges, Techniques, Evaluation, and Applications
Large Language Models for Code Generation: A Comprehensive Survey of Challenges, Techniques, Evaluation, and Applications
Nam Huynh
Beiyu Lin
LM&MA
72
16
0
03 Mar 2025
A Comprehensive Framework for Evaluating API-oriented Code Generation in
  Large Language Models
A Comprehensive Framework for Evaluating API-oriented Code Generation in Large Language Models
Yixi Wu
Pengfei He
Zehao Wang
Shaowei Wang
Yuan Tian
Tse-Hsun Chen
ALM
27
0
0
23 Sep 2024
HexaCoder: Secure Code Generation via Oracle-Guided Synthetic Training
  Data
HexaCoder: Secure Code Generation via Oracle-Guided Synthetic Training Data
Hossein Hajipour
Lea Schönherr
Thorsten Holz
Mario Fritz
AAML
SyDa
21
0
0
10 Sep 2024
Practical Attacks against Black-box Code Completion Engines
Practical Attacks against Black-box Code Completion Engines
Slobodan Jenko
Jingxuan He
Niels Mündler
Mark Vero
Martin Vechev
ELM
AAML
SILM
27
3
0
05 Aug 2024
Can We Trust Large Language Models Generated Code? A Framework for
  In-Context Learning, Security Patterns, and Code Evaluations Across Diverse
  LLMs
Can We Trust Large Language Models Generated Code? A Framework for In-Context Learning, Security Patterns, and Code Evaluations Across Diverse LLMs
Ahmad Mohsin
Helge Janicke
Adrian Wood
Iqbal H. Sarker
Leandros A. Maglaras
N. Janjua
22
8
0
18 Jun 2024
Using AI Assistants in Software Development: A Qualitative Study on
  Security Practices and Concerns
Using AI Assistants in Software Development: A Qualitative Study on Security Practices and Concerns
J. Klemmer
Stefan Albert Horstmann
Nikhil Patnaik
Cordelia Ludden
Cordell Burton
...
Daniel Votipka
H. Lipford
Awais Rashid
Alena Naiakshina
University of North Carolina at Charlotte
15
16
0
10 May 2024
LLM Security Guard for Code
LLM Security Guard for Code
Arya Kavian
Mohammad Mehdi Pourhashem Kallehbasti
Sajjad Kazemi
Ehsan Firouzi
Mohammad Ghafari
22
5
0
02 May 2024
Constrained Decoding for Secure Code Generation
Constrained Decoding for Secure Code Generation
Yanjun Fu
Ethan Baker
Yu Ding
Yizheng Chen
AAML
23
8
0
30 Apr 2024
LLMs for Coding and Robotics Education
LLMs for Coding and Robotics Education
Peng Shu
Huaqin Zhao
Hanqi Jiang
Yiwei Li
Shaochen Xu
...
Zheng Liu
Guoyu Lu
Le Guan
Gong Chen
Xianqiao Wang Tianming Liu
22
5
0
09 Feb 2024
Ocassionally Secure: A Comparative Analysis of Code Generation
  Assistants
Ocassionally Secure: A Comparative Analysis of Code Generation Assistants
Ran Elgedawy
John Sadik
Senjuti Dutta
Anuj Gautam
Konstantinos Georgiou
Farzin Gholamrezae
Fujiao Ji
Kyungchan Lim
Qian Liu
Scott Ruoti
11
7
0
01 Feb 2024
LLM for SoC Security: A Paradigm Shift
LLM for SoC Security: A Paradigm Shift
Dipayan Saha
Shams Tarek
Katayoon Yahyaei
S. Saha
Jingbo Zhou
M. Tehranipoor
Farimah Farahmandi
54
41
0
09 Oct 2023
An Empirical Study of AI-based Smart Contract Creation
An Empirical Study of AI-based Smart Contract Creation
Rabimba Karanjai
Edward Li
Lei Xu
W. Shi
6
9
0
05 Aug 2023
Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of
  Large Language Models for Code Generation
Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation
Jiawei Liu
Chun Xia
Yuyao Wang
Lingming Zhang
ELM
ALM
178
780
0
02 May 2023
Text Revealer: Private Text Reconstruction via Model Inversion Attacks
  against Transformers
Text Revealer: Private Text Reconstruction via Model Inversion Attacks against Transformers
Ruisi Zhang
Seira Hidano
F. Koushanfar
SILM
58
26
0
21 Sep 2022
Training language models to follow instructions with human feedback
Training language models to follow instructions with human feedback
Long Ouyang
Jeff Wu
Xu Jiang
Diogo Almeida
Carroll L. Wainwright
...
Amanda Askell
Peter Welinder
Paul Christiano
Jan Leike
Ryan J. Lowe
OSLM
ALM
301
11,730
0
04 Mar 2022
A Systematic Evaluation of Large Language Models of Code
A Systematic Evaluation of Large Language Models of Code
Frank F. Xu
Uri Alon
Graham Neubig
Vincent J. Hellendoorn
ELM
ALM
196
624
0
26 Feb 2022
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for
  Code Understanding and Generation
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation
Yue Wang
Weishi Wang
Shafiq R. Joty
S. Hoi
204
1,451
0
02 Sep 2021
Fantastically Ordered Prompts and Where to Find Them: Overcoming
  Few-Shot Prompt Order Sensitivity
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity
Yao Lu
Max Bartolo
Alastair Moore
Sebastian Riedel
Pontus Stenetorp
AILaw
LRM
274
1,114
0
18 Apr 2021
Extracting Training Data from Large Language Models
Extracting Training Data from Large Language Models
Nicholas Carlini
Florian Tramèr
Eric Wallace
Matthew Jagielski
Ariel Herbert-Voss
...
Tom B. Brown
D. Song
Ulfar Erlingsson
Alina Oprea
Colin Raffel
MLAU
SILM
267
1,798
0
14 Dec 2020
1