Title
CodeVisionary: An Agent-based Framework for Evaluating Large Language Models in Code Generation Xinchen Wang Pengfei Gao Chao Peng Ruida Hu Cuiyun Gao ELM 28 0 0 18 Apr 2025
Automated detection of atomicity violations in large-scale systems Hang He Yixing Luo Chengcheng Wan Ting Su Haiying Sun G. Pu 50 0 0 01 Apr 2025
RefactorBench: Evaluating Stateful Reasoning in Language Agents Through Code Dhruv Gautam Spandan Garg Jinu Jang Neel Sundaresan Roshanak Zilouchian Moghaddam LLMAG LRM 59 2 0 10 Mar 2025
CSR-Bench: Benchmarking LLM Agents in Deployment of Computer Science Research Repositories Yijia Xiao Runhui Wang Luyang Kong Davor Golac Wei Wang LLMAG 59 0 0 10 Feb 2025
Agentic Bug Reproduction for Effective Automated Program Repair at Google Runxiang Cheng Michele Tufano Jürgen Cito J. Cambronero Pat Rondon Renyao Wei Aaron Sun S. Chandra 39 0 0 03 Feb 2025
ReFoRCE: A Text-to-SQL Agent with Self-Refinement, Format Restriction, and Column Exploration Minghang Deng Ashwin Ramachandran Canwen Xu Lanxiang Hu Zhewei Yao Anupam Datta Hao Zhang LMTD 114 1 0 02 Feb 2025
From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap Gopi Krishnan Rajbahadur G. Oliva Dayi Lin Ahmed E. Hassan 37 0 0 28 Jan 2025
Evaluating Agent-based Program Repair at Google Pat Rondon Renyao Wei J. Cambronero Jürgen Cito Aaron Sun S. Sanyam Michele Tufano S. Chandra 31 3 0 13 Jan 2025
AutoPrep: Natural Language Question-Aware Data Preparation with a Multi-Agent Framework Meihao Fan Ju Fan Nan Tang Lei Cao Guoliang Li Xiaoyong Du LMTD 115 0 0 10 Dec 2024
Targeting the Core: A Simple and Effective Method to Attack RAG-based Agents via Direct LLM Manipulation Xuying Li Zhuo Li Yuji Kosuga Yasuhiro Yoshida Victor Bian AAML 84 2 0 05 Dec 2024
Human-In-the-Loop Software Development Agents Wannita Takerngsaksiri Jirat Pasuksmit Patanamon Thongtanunam C. Tantithamthavorn Ruixiong Zhang Fan Jiang Jing Li Evan Cook K. Chen Ming Wu LLMAG 92 1 0 19 Nov 2024
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows Fangyu Lei Jixuan Chen Yuxiao Ye Ruisheng Cao Dongchan Shin ... Caiming Xiong Ruoxi Sun Qian Liu Sida I. Wang Tao Yu LMTD 74 20 0 12 Nov 2024
MdEval: Massively Multilingual Code Debugging Shukai Liu Linzheng Chai Jian Yang Jiajun Shi He Zhu ... Yu Hao Liqun Yang Guanglin Niu Ge Zhang Z. Li LRM ELM 61 6 0 04 Nov 2024
Lingma SWE-GPT: An Open Development-Process-Centric Language Model for Automated Software Improvement Yingwei Ma Rongyu Cao Yongchang Cao Y. Zhang J. Chen Yibo Liu Yuchen Liu Binhua Li Fei Huang Yongbin Li 46 5 0 01 Nov 2024
Agent-as-a-Judge: Evaluate Agents with Agents Mingchen Zhuge Changsheng Zhao Dylan R. Ashley Wenyi Wang Dmitrii Khizbullin ... Raghuraman Krishnamoorthi Yuandong Tian Yangyang Shi Vikas Chandra Jürgen Schmidhuber ELM 57 32 0 14 Oct 2024
HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scale Huy N. Phan Phong X. Nguyen Nghi D. Q. Bui LLMAG 23 10 0 09 Sep 2024
Large Language Model-Based Agents for Software Engineering: A Survey Junwei Liu Kaixin Wang Yixuan Chen Xin Peng Zhenpeng Chen Lingming Zhang Yiling Lou AI4CE LLMAG LM&Ro 37 36 0 04 Sep 2024
Diversity Empowers Intelligence: Integrating Expertise of Software Engineering Agents Kexun Zhang Weiran Yao Zuxin Liu Yihao Feng Zhiwei Liu ... Yingbo Zhou Shelby Heinecke Silvio Savarese Huan Wang Caiming Xiong LLMAG 30 16 0 13 Aug 2024
Automated Code Fix Suggestions for Accessibility Issues in Mobile Apps Forough Mehralian Titus Barik Jeff Nichols Amanda Swearngin 26 0 0 07 Aug 2024
Agentless: Demystifying LLM-based Software Engineering Agents Chunqiu Steven Xia Yinlin Deng Soren Dunn Lingming Zhang LLMAG 32 78 0 01 Jul 2024
MASAI: Modular Architecture for Software-engineering AI Agents Daman Arora Atharv Sonwane Nalin Wadhwa Abhav Mehrotra Saiteja Utpala Ramakrishna Bairi Aditya Kanade Nagarajan Natarajan LLMAG 30 14 0 17 Jun 2024
SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering John Yang Carlos E. Jimenez Alexander Wettig K. Lieret Shunyu Yao Karthik Narasimhan Ofir Press LLMAG 99 36 0 06 May 2024
AutoCodeRover: Autonomous Program Improvement Yuntong Zhang Haifeng Ruan Zhiyu Fan Abhik Roychoudhury 45 52 0 08 Apr 2024
MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolution Wei Tao Yucheng Zhou Yanlin Wang Wenqiang Zhang Hongyu Zhang Yu-Xi Cheng LLMAG 41 36 0 26 Mar 2024
ReAct: Synergizing Reasoning and Acting in Language Models Shunyu Yao Jeffrey Zhao Dian Yu Nan Du Izhak Shafran Karthik Narasimhan Yuan Cao LLMAG ReLM LRM 208 2,413 0 06 Oct 2022
CURE: Code-Aware Neural Machine Translation for Automatic Program Repair Nan Jiang Thibaud Lutellier Lin Tan NAI 123 233 0 26 Feb 2021