What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code

14 February 2022

Papers citing "What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code"

42 / 42 papers shown

Title
Selective Prompt Anchoring for Code Generation Yuan Tian Tianyi Zhang 86 3 0 24 Feb 2025
Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code Shahin Honarvar Mark van der Wilk Alastair Donaldson 78 6 0 28 Jan 2025
A Survey on Adversarial Machine Learning for Code Data: Realistic Threats, Countermeasures, and Interpretations Yulong Yang Haoran Fan Chenhao Lin Qian Li Zhengyu Zhao Chao Shen Xiaohong Guan AAML 43 0 0 12 Nov 2024
Embedding with Large Language Models for Classification of HIPAA Safeguard Compliance Rules M. Rahman Md Abdul Barek ABM Kamrul Islam Riad Md Mostafizur Rahman Md Bajlur Rashid Smita Ambedkar Md Raihan Miaa Fan Wu A. Cuzzocrea S. Ahamed 15 1 0 28 Oct 2024
From Imitation to Introspection: Probing Self-Consciousness in Language Models Sirui Chen Shu Yu Shengjie Zhao Chaochao Lu MILM LRM 30 1 0 24 Oct 2024
Do Current Language Models Support Code Intelligence for R Programming Language? Zixiao Zhao Fatemeh H. Fard ELM 42 0 0 10 Oct 2024
In-Context Code-Text Learning for Bimodal Software Engineering Xunzhu Tang Liran Wang Yonghui Liu Linzheng Chai Jian Yang Zhoujun Li Haoye Tian Jacques Klein Tegawende F. Bissyande 22 0 0 08 Oct 2024
Showing LLM-Generated Code Selectively Based on Confidence of LLMs Jia Li Yuqi Zhu Yongmin Li Ge Li Zhi Jin 28 0 0 04 Oct 2024
RAMBO: Enhancing RAG-based Repository-Level Method Body Completion Tuan-Dung Bui Duc-Thieu Luu-Van Thanh-Phat Nguyen Thu-Trang Nguyen Son Nguyen H. Vo 24 4 0 23 Sep 2024
Towards More Trustworthy and Interpretable LLMs for Code through Syntax-Grounded Explanations David Nader-Palacio Daniel Rodríguez-Cárdenas Alejandro Velasco Dipin Khati Kevin Moran Denys Poshyvanyk 48 6 0 12 Jul 2024
DeepCodeProbe: Towards Understanding What Models Trained on Code Learn Vahid Majdinasab Amin Nikanjam Foutse Khomh 38 1 0 11 Jul 2024
Looking into Black Box Code Language Models Muhammad Umair Haider Umar Farooq A. B. Siddique Mark Marron 39 2 0 05 Jul 2024
An Empirical Study on Capability of Large Language Models in Understanding Code Semantics Thu-Trang Nguyen Thanh Trong Vu H. Vo Son Nguyen ELM 33 2 0 04 Jul 2024
A Critical Study of What Code-LLMs (Do Not) Learn Abhinav Anand Shweta Verma Krishna Narasimhan Mira Mezini 40 4 0 17 Jun 2024
Graph Neural Networks for Vulnerability Detection: A Counterfactual Explanation Zhaoyang Chu Yao Wan Qian Li Yang Wu Hongyu Zhang Yulei Sui Guandong Xu Hai Jin AAML 36 9 0 24 Apr 2024
Beyond Self-learned Attention: Mitigating Attention Bias in Transformer-based Models Using Attention Guidance Jiri Gesi Iftekhar Ahmed 33 0 0 26 Feb 2024
A Systematic Literature Review on Explainability for Machine/Deep Learning-based Software Engineering Research Sicong Cao Xiaobing Sun Ratnadira Widyasari David Lo Xiaoxue Wu ... Jiale Zhang Bin Li Wei Liu Di Wu Yixin Chen 24 6 0 26 Jan 2024
Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models Terry Yue Zhuo A. Zebaze Nitchakarn Suppattarachai Leandro von Werra H. D. Vries Qian Liu Niklas Muennighoff ALM 28 15 0 01 Jan 2024
Deep Learning for Code Intelligence: Survey, Benchmark and Toolkit Yao Wan Yang He Zhangqian Bi Jianguo Zhang Hongyu Zhang Yulei Sui Guandong Xu Hai Jin Philip S. Yu 25 20 0 30 Dec 2023
Towards Automatic Support of Software Model Evolution with Large Language~Models Christof Tinnes Thomas Fuchss U. Hohenstein Sven Apel 8 1 0 19 Dec 2023
Towards Trustworthy AI Software Development Assistance Daniel Maninger Krishna Narasimhan Mira Mezini 19 3 0 14 Dec 2023
INSPECT: Intrinsic and Systematic Probing Evaluation for Code Transformers Anjan Karmakar Romain Robbes 22 4 0 08 Dec 2023
Naturalness of Attention: Revisiting Attention in Code Language Models M. Saad Tushar Sharma 28 2 0 22 Nov 2023
Pitfalls in Language Models for Code Intelligence: A Taxonomy and Survey Xinyu She Yue Liu Yanjie Zhao Yiling He Li Li C. Tantithamthavorn Zhan Qin Haoyu Wang ELM 30 13 0 27 Oct 2023
Automated Bug Generation in the era of Large Language Models Ali Reza Ibrahimzada Yang Chen Ryan Rong Reyhaneh Jabbarvand 24 3 0 03 Oct 2023
Pop Quiz! Do Pre-trained Code Models Possess Knowledge of Correct API Names? Terry Yue Zhuo Xiaoning Du Zhenchang Xing Jiamou Sun Haowei Quan Li Li Liming Zhu 29 2 0 14 Sep 2023
Large Language Models for Software Engineering: A Systematic Literature Review Xinying Hou Yanjie Zhao Yue Liu Zhou Yang Kailong Wang Li Li Xiapu Luo David Lo John C. Grundy Haoyu Wang 25 322 0 21 Aug 2023
Evaluating and Explaining Large Language Models for Code Using Syntactic Structures David Nader-Palacio Alejandro Velasco Daniel Rodríguez-Cárdenas Kevin Moran Denys Poshyvanyk 34 8 0 07 Aug 2023
Towards Understanding What Code Language Models Learned Toufique Ahmed Dian Yu Chen Huang Cathy Wang Prem Devanbu Kenji Sagae ELM 38 5 0 20 Jun 2023
Do Large Language Models Pay Similar Attention Like Human Programmers When Generating Code? Bonan Kou Shengmai Chen Zhijie Wang Lei Ma Tianyi Zhang ALM 11 13 0 02 Jun 2023
LMs: Understanding Code Syntax and Semantics for Code Analysis Wei Ma Shangqing Liu Zhihao Lin Wenhan Wang Q. Hu Ye Liu Cen Zhang Liming Nie Li Li Yang Liu 23 16 0 20 May 2023
Redundancy and Concept Analysis for Code-trained Language Models Arushi Sharma Zefu Hu Christopher Quinn Ali Jannesari 67 1 0 01 May 2023
Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond Ensheng Shi Yanlin Wang Hongyu Zhang Lun Du Shi Han Dongmei Zhang Hongbin Sun 28 41 0 11 Apr 2023
APIContext2Com: Code Comment Generation by Incorporating Pre-Defined API Documentation Ramin Shahbazi Fatemeh H. Fard 23 2 0 03 Mar 2023
Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities Wei Ma Shangqing Liu Mengjie Zhao Xiaofei Xie Wenhan Wang Q. Hu Jiexin Zhang Yang Liu 19 16 0 20 Dec 2022
DeepVulSeeker: A Novel Vulnerability Identification Framework via Code Graph Structure and Pre-training Mechanism Jin Wang Hui Xiao Shuwen Zhong Yinhao Xiao 28 11 0 23 Nov 2022
CAT-probing: A Metric-based Approach to Interpret How Pre-trained Models for Programming Language Attend Code Structure Nuo Chen Qiushi Sun Renyu Zhu Xiang Li Xuesong Lu Ming Gao 36 10 0 07 Oct 2022
AST-Probe: Recovering abstract syntax trees from hidden representations of pre-trained language models José Antonio Hernández López M. Weyssow Jesús Sánchez Cuadrado H. Sahraoui 22 22 0 23 Jun 2022
CODE-MVP: Learning to Represent Source Code from Multiple Views with Contrastive Pre-Training Xin Wang Yasheng Wang Yao Wan Jiawei Wang Pingyi Zhou Li Li Hao Wu Jin Liu 16 33 0 04 May 2022
Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviews M. Hadi Fatemeh H. Fard 13 30 0 12 Apr 2021
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 199 882 0 03 May 2018
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 228 31,244 0 16 Jan 2013