Large Language Models for Software Engineering: A Systematic Literature Review

21 August 2023

Kailong Wang

Haoyu Wang

Papers citing "Large Language Models for Software Engineering: A Systematic Literature Review"

42 / 142 papers shown

Title
Detecting Scams Using Large Language Models Liming Jiang 19 14 0 05 Feb 2024
Deep Learning Model Reuse in the HuggingFace Community: Challenges, Benefit and Trends Mina Taraghi Gianolli Dorcelus A. Foundjem Florian Tambon Foutse Khomh 14 14 0 24 Jan 2024
Code Simulation Challenges for Large Language Models Emanuele La Malfa Christoph Weinhuber Orazio Torre Fangru Lin Samuele Marro Anthony Cohn Nigel Shadbolt Michael Wooldridge LLMAG LRM 9 8 0 17 Jan 2024
Resolving Crash Bugs via Large Language Models: An Empirical Study Xueying Du Mingwei Liu Juntao Li Hanlin Wang Xin Peng Yiling Lou LRM 6 8 0 16 Dec 2023
LLM Interactive Optimization of Open Source Python Libraries -- Case Studies and Generalization Andreas Florath 14 2 0 08 Dec 2023
A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly Yifan Yao Jinhao Duan Kaidi Xu Yuanfang Cai Eric Sun Yue Zhang PILM ELM 24 463 0 04 Dec 2023
LLM-Assisted Code Cleaning For Training Accurate Code Generators Naman Jain Tianjun Zhang Wei-Lin Chiang Joseph E. Gonzalez Koushik Sen Ion Stoica 28 20 0 25 Nov 2023
LUNA: A Model-Based Universal Analysis Framework for Large Language Models Da Song Xuan Xie Jiayang Song Derui Zhu Yuheng Huang Felix Juefei Xu Lei Ma ALM 14 1 0 22 Oct 2023
Enhancing Genetic Improvement Mutations Using Large Language Models Alexander E. I. Brownlee James Callan Karine Even-Mendoza Alina Geiger Carol Hanna Justyna Petke Federica Sarro Dominik Sobania 6 20 0 18 Oct 2023
Can GPT-4 Replicate Empirical Software Engineering Research? Jenny T Liang Carmen Badea Christian Bird R. Deline Denae Ford Nicole Forsgren Thomas Zimmermann 51 8 0 03 Oct 2023
Gotcha! This Model Uses My Code! Evaluating Membership Leakage Risks in Code Models Zhou Yang Zhipeng Zhao Chenyu Wang Jieke Shi Dongsum Kim Donggyun Han David Lo SILM AAML MIACV 20 12 0 02 Oct 2023
Large Language Model-Powered Smart Contract Vulnerability Detection: New Perspectives Sihao Hu Tiansheng Huang Fatih İlhan Selim Furkan Tekin Ling Liu 13 45 0 02 Oct 2023
Trustworthy and Synergistic Artificial Intelligence for Software Engineering: Vision and Roadmaps David Lo 14 39 0 08 Sep 2023
MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbots Gelei Deng Yi Liu Yuekang Li Kailong Wang Ying Zhang Zefeng Li Haoyu Wang Tianwei Zhang Yang Liu SILM 17 118 0 16 Jul 2023
Detecting Misuse of Security APIs: A Systematic Review Zahra Mousavi Chadni Islam Muhammad Ali Babar A. Abuadbba Kristen Moore 20 3 0 15 Jun 2023
CodeGen2: Lessons for Training LLMs on Programming and Natural Languages Erik Nijkamp A. Ghobadzadeh Caiming Xiong Silvio Savarese Yingbo Zhou 133 163 0 03 May 2023
Can Large Language Models Be an Alternative to Human Evaluations? Cheng-Han Chiang Hung-yi Lee ALM LM&MA 201 559 0 03 May 2023
Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Jiawei Liu Chun Xia Yuyao Wang Lingming Zhang ELM ALM 166 388 0 02 May 2023
Using Large Language Models to Generate JUnit Tests: An Empirical Study Mohammed Latif Siddiq Joanna C. S. Santos Ridwanul Hasan Tanvir Noshin Ulfat Fahmid Al Rifat Vinicius Carvalho Lopes ELM 48 47 0 30 Apr 2023
Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation Wenqing Zheng S. Sharan Ajay Jaiswal Kevin Wang Yihan Xi Dejia Xu Zhangyang Wang 36 24 0 28 Apr 2023
Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond Jingfeng Yang Hongye Jin Ruixiang Tang Xiaotian Han Qizhang Feng Haoming Jiang Bing Yin Xia Hu LM&MA 123 593 0 26 Apr 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 197 2,232 0 22 Mar 2023
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU Ying Sheng Lianmin Zheng Binhang Yuan Zhuohan Li Max Ryabinin ... Joseph E. Gonzalez Percy Liang Christopher Ré Ion Stoica Ce Zhang 135 208 0 13 Mar 2023
Extending Source Code Pre-Trained Language Models to Summarise Decompiled Binaries Ali Al-Kaswan Toufique Ahmed M. Izadi A. Sawant Prem Devanbu A. van Deursen SyDa 66 30 0 04 Jan 2023
Invalidator: Automated Patch Correctness Assessment via Semantic and Syntactic Reasoning Thanh Le-Cong Duc M. Luong X. Le David Lo Nhat-Hoa Tran Bui Quang-Huy Quyet-Thang Huynh 14 24 0 03 Jan 2023
When Language Model Meets Private Library Daoguang Zan Bei Chen Zeqi Lin Bei Guan Yongji Wang Jian-Guang Lou ALM 69 68 0 31 Oct 2022
On the Impossible Safety of Large AI Models El-Mahdi El-Mhamdi Sadegh Farhadkhani R. Guerraoui Nirupam Gupta L. Hoang Rafael Pinot Sébastien Rouault John Stephan 26 31 0 30 Sep 2022
AutoPruner: Transformer-Based Call Graph Pruning Thanh Le-Cong Hong Jin Kang Truong-Giang Nguyen S. A. Haryono David Lo X. Le H. Thang 25 19 0 07 Sep 2022
No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligence Chaozheng Wang Yuanhang Yang Cuiyun Gao Yun Peng Hongyu Zhang Michael R. Lyu AAML 40 129 0 24 Jul 2022
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 291 2,712 0 24 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
A Systematic Evaluation of Large Language Models of Code Frank F. Xu Uri Alon Graham Neubig Vincent J. Hellendoorn ELM ALM 188 624 0 26 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 315 8,261 0 28 Jan 2022
On the validity of pre-trained transformers for natural language processing in the software engineering domain Julian von der Mosel Alexander Trautsch Steffen Herbold 32 48 0 10 Sep 2021
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Shafiq R. Joty S. Hoi 199 1,451 0 02 Sep 2021
Measuring Coding Challenge Competence With APPS Dan Hendrycks Steven Basart Saurav Kadavath Mantas Mazeika Akul Arora ... Collin Burns Samir Puranik Horace He D. Song Jacob Steinhardt ELM AIMat ALM 189 614 0 20 May 2021
Constrained Language Models Yield Few-Shot Semantic Parsers Richard Shin C. H. Lin Sam Thomson Charles C. Chen Subhro Roy Emmanouil Antonios Platanios Adam Pauls Dan Klein J. Eisner Benjamin Van Durme 287 196 0 18 Apr 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 275 3,784 0 18 Apr 2021
DOBF: A Deobfuscation Pre-Training Objective for Programming Languages Baptiste Roziere Marie-Anne Lachaux Marc Szafraniec Guillaume Lample AI4CE 38 53 0 15 Feb 2021
CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation Shuai Lu Daya Guo Shuo Ren Junjie Huang Alexey Svyatkovskiy ... Nan Duan Neel Sundaresan Shao Kun Deng Shengyu Fu Shujie Liu ELM 186 853 0 09 Feb 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 236 1,508 0 31 Dec 2020
Code and Named Entity Recognition in StackOverflow Jeniya Tabassum Mounica Maddela Wei-ping Xu Alan Ritter 54 114 0 04 May 2020