What do pre-trained code models know about code?

25 August 2021

Papers citing "What do pre-trained code models know about code?"

32 / 32 papers shown

Title
A Survey on Adversarial Machine Learning for Code Data: Realistic Threats, Countermeasures, and Interpretations Yulong Yang Haoran Fan Chenhao Lin Qian Li Zhengyu Zhao Chao Shen Xiaohong Guan AAML 43 0 0 12 Nov 2024
Personality-Guided Code Generation Using Large Language Models Y. Guo Zhenpeng Chen J. Zhang Yang Liu Yun Ma 22 0 0 16 Oct 2024
Do Current Language Models Support Code Intelligence for R Programming Language? Zixiao Zhao Fatemeh H. Fard ELM 42 0 0 10 Oct 2024
LecPrompt: A Prompt-based Approach for Logical Error Correction with CodeBERT Zhenyu Xu Victor S. Sheng KELM 18 0 0 10 Oct 2024
DeepCodeProbe: Towards Understanding What Models Trained on Code Learn Vahid Majdinasab Amin Nikanjam Foutse Khomh 38 1 0 11 Jul 2024
A Critical Study of What Code-LLMs (Do Not) Learn Abhinav Anand Shweta Verma Krishna Narasimhan Mira Mezini 40 4 0 17 Jun 2024
Advanced Detection of Source Code Clones via an Ensemble of Unsupervised Similarity Measures Jorge Martínez Gil 15 4 0 03 May 2024
Structure-aware Fine-tuning for Code Pre-trained Models Jiayi Wu Renyu Zhu Nuo Chen Qiushi Sun Xiang Li Ming Gao 35 2 0 11 Apr 2024
Investigating the Performance of Language Models for Completing Code in Functional Programming Languages: a Haskell Case Study Tim van Dam Frank van der Heijden Philippe de Bekker Berend Nieuwschepen Marc Otten M. Izadi 33 5 0 22 Mar 2024
Beyond Self-learned Attention: Mitigating Attention Bias in Transformer-based Models Using Attention Guidance Jiri Gesi Iftekhar Ahmed 35 0 0 26 Feb 2024
INSPECT: Intrinsic and Systematic Probing Evaluation for Code Transformers Anjan Karmakar Romain Robbes 22 4 0 08 Dec 2023
The Behavior of Large Language Models When Prompted to Generate Code Explanations Priti Oli Rabin Banjade Jeevan Chapagain Vasile Rus LRM 21 4 0 02 Nov 2023
Exploring the Robustness of Large Language Models for Solving Programming Problems Atsushi Shirafuji Yutaka Watanobe Takumi Ito Makoto Morishita Yuki Nakamura Yusuke Oda Jun Suzuki ELM 31 17 0 26 Jun 2023
Towards Understanding What Code Language Models Learned Toufique Ahmed Dian Yu Chen Huang Cathy Wang Prem Devanbu Kenji Sagae ELM 38 5 0 20 Jun 2023
Do Large Language Models Pay Similar Attention Like Human Programmers When Generating Code? Bonan Kou Shengmai Chen Zhijie Wang Lei Ma Tianyi Zhang ALM 11 13 0 02 Jun 2023
The EarlyBIRD Catches the Bug: On Exploiting Early Layers of Encoder Models for More Efficient Code Classification Anastasiia Grishina Max Hort Leon Moonen 22 6 0 08 May 2023
Redundancy and Concept Analysis for Code-trained Language Models Arushi Sharma Zefu Hu Christopher Quinn Ali Jannesari 70 1 0 01 May 2023
Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond Ensheng Shi Yanlin Wang Hongyu Zhang Lun Du Shi Han Dongmei Zhang Hongbin Sun 28 42 0 11 Apr 2023
One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarization Deze Wang Boxing Chen Shanshan Li Wei Luo Shaoliang Peng Wei Dong Xiang-ke Liao 28 37 0 28 Mar 2023
xASTNN: Improved Code Representations for Industrial Practice Zhiwei Xu Min Zhou Xibin Zhao Yang Chen Xi Cheng Hongyu Zhang AI4TS 19 5 0 13 Mar 2023
From Copilot to Pilot: Towards AI Supported Software Development Rohith Pudari Neil A. Ernst 13 20 0 07 Mar 2023
CrossCodeBench: Benchmarking Cross-Task Generalization of Source Code Models Changan Niu Chuanyi Li Vincent Ng Bin Luo ELM ALM 32 9 0 08 Feb 2023
Code Difference Guided Adversarial Example Generation for Deep Code Models Zhao Tian Junjie Chen Zhi Jin AAML 21 17 0 06 Jan 2023
Codex Hacks HackerRank: Memorization Issues and a Framework for Code Synthesis Evaluation Anjan Karmakar Julian Aron Prenner Marco DÁmbros Romain Robbes ELM 11 17 0 06 Dec 2022
Benchmarking Language Models for Code Syntax Understanding Da Shen Xinyun Chen Chenguang Wang Koushik Sen Dawn Song ELM 14 16 0 26 Oct 2022
CAT-probing: A Metric-based Approach to Interpret How Pre-trained Models for Programming Language Attend Code Structure Nuo Chen Qiushi Sun Renyu Zhu Xiang Li Xuesong Lu Ming Gao 36 10 0 07 Oct 2022
Learning to Learn to Predict Performance Regressions in Production at Meta M. Beller Hongyu Li V. Nair V. Murali Imad Ahmad Jürgen Cito Drew Carlson Gareth Ari Aye Wes Dyer 26 5 0 08 Aug 2022
AST-Probe: Recovering abstract syntax trees from hidden representations of pre-trained language models José Antonio Hernández López M. Weyssow Jesús Sánchez Cuadrado H. Sahraoui 22 22 0 23 Jun 2022
An Exploratory Study on Code Attention in BERT Rishab Sharma Fuxiang Chen Fatemeh H. Fard David Lo 19 25 0 05 Apr 2022
Probing Pretrained Models of Source Code Sergey Troshin Nadezhda Chirkova ELM 25 38 0 16 Feb 2022
Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviews M. Hadi Fatemeh H. Fard 13 30 0 12 Apr 2021
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 199 882 0 03 May 2018