Using Large Language Models to Enhance Programming Error Messages

20 October 2022

Papers citing "Using Large Language Models to Enhance Programming Error Messages"

50 / 70 papers shown

Title
The Code Barrier: What LLMs Actually Understand? Serge Lionel Nikiema Jordan Samhi A. Kaboré Jacques Klein Tegawende F. Bissyande ELM 29 1 0 14 Apr 2025
Synthesizing High-Quality Programming Tasks with LLM-based Expert and Student Agents Manh Hung Nguyen Victor-Alexandru Pădurean Alkis Gotovos Sebastian Tschiatschek Adish Singla 24 0 0 10 Apr 2025
ACE-RLHF: Automated Code Evaluation and Socratic Feedback Generation Tool using Large Language Models and Reinforcement Learning with Human Feedback Tasnia Rahman Sathish A. P. Kumar S. Jha Arvind Ramanathan KELM 33 0 0 07 Apr 2025
Insights from the Frontline: GenAI Utilization Among Software Engineering Students Rudrajit Choudhuri Ambareesh Ramakrishnan Amreeta Chatterjee Bianca Trinkenreich Igor Steinmacher M. Gerosa Anita Sarma 91 3 0 20 Dec 2024
Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools James Prather Juho Leinonen Natalie Kiesler Jamie Gorson Benario Sam Lau ... Brent N. Reeves Jaromír Šavelka David H Smith IV Sven Strickroth Daniel Zingaro 81 5 0 19 Dec 2024
Breaking the Programming Language Barrier: Multilingual Prompting to Empower Non-Native English Learners James Prather B. Reeves Paul Denny Juho Leinonen Stephen MacNeil ... Thezyrie Amarouche Bailey Kimmel Jared Wright Musa Blake Gweneth Barbre 74 2 0 17 Dec 2024
Howzat? Appealing to Expert Judgement for Evaluating Human and AI Next-Step Hints for Novice Programmers Neil C. C. Brown Pierre Weill-Tessier Juho Leinonen Paul Denny Michael Kölling 77 0 0 27 Nov 2024
EDBooks: AI-Enhanced Interactive Narratives for Programming Education Steve Oney Yue Shen Fei Wu Young Suh Hong Ziang Wang Yamini Khajekar Jiacheng Zhang A. Wang AI4Ed 37 0 0 16 Nov 2024
Towards Pedagogical LLMs with Supervised Fine Tuning for Computing Education Alexandra Vassar Jake Renzella Emily Ross Andrew Taylor 41 0 0 04 Nov 2024
On the Opportunities of Large Language Models for Programming Process Data John Edwards Arto Hellas Juho Leinonen 44 14 0 01 Nov 2024
An Eye for an AI: Evaluating GPT-4o's Visual Perception Skills and Geometric Reasoning Skills Using Computer Graphics Questions Tony Haoran Feng Paul Denny Burkhard C. Wünsche Andrew Luxton-Reilly Jacqueline Whalley 23 3 0 22 Oct 2024
Synthetic Students: A Comparative Study of Bug Distribution Between Large Language Models and Computing Students Stephen MacNeil M. Rogalska Juho Leinonen Paul Denny Arto Hellas Xandria Crosland SyDa 29 2 0 11 Oct 2024
Utilizing ChatGPT in a Data Structures and Algorithms Course: A Teaching Assistant's Perspective Pooriya Jamie Reyhaneh Hajihashemi Sharareh Alipour 40 0 0 11 Oct 2024
Not the Silver Bullet: LLM-enhanced Programming Error Messages are Ineffective in Practice E. Santos Brett A. Becker 24 2 0 27 Sep 2024
Exploring LLM-Driven Explanations for Quantum Algorithms Giordano dÁloisio Sophie Fortz Carol Hanna Daniel Fortunato Avner Bensoussan Eñaut Mendiluze Usandizaga Federica Sarro LRM 19 1 0 26 Sep 2024
Evaluating the Quality of Code Comments Generated by Large Language Models for Novice Programmers Aysa Xuemo Fan Arun Balajiee Lekshmi Narayanan Mohammad Hassany Jiaze Ke ALM ELM 23 0 0 22 Sep 2024
How Novice Programmers Use and Experience ChatGPT when Solving Programming Exercises in an Introductory Course Andreas Scholl Natalie Kiesler 45 9 0 30 Jul 2024
TAMIGO: Empowering Teaching Assistants using LLM-assisted viva and code assessment in an Advanced Computing Class Anishka Iiitd Diksha Sethi Nipun Gupta Shikhar Sharma Srishti Jain Ujjwal Singhal Dhruv Kumar 31 2 0 23 Jul 2024
Integrating AI Tutors in a Programming Course Iris Ma A. Krone-Martins Cristina V. Lopes 33 3 0 14 Jul 2024
Evaluating Language Models for Generating and Judging Programming Feedback Charles Koutcheme Nicola Dainese Arto Hellas Sami Sarsa Juho Leinonen Syed Ashraf Paul Denny ELM 34 2 0 05 Jul 2024
Evaluating Contextually Personalized Programming Exercises Created with Generative AI E. Logacheva Arto Hellas James Prather Sami Sarsa Juho Leinonen 37 10 0 11 Jun 2024
Experiences from Integrating Large Language Model Chatbots into the Classroom Arto Hellas Juho Leinonen Leo Leppanen 33 4 0 07 Jun 2024
Large Language Model-Enabled Multi-Agent Manufacturing Systems Jonghan Lim Birgit Vogel-Heuser Ilya Kovalenko AI4CE LLMAG 36 2 0 04 Jun 2024
Analyzing Chat Protocols of Novice Programmers Solving Introductory Programming Tasks with ChatGPT Andreas Scholl D. Schiffner Natalie Kiesler 32 9 0 29 May 2024
The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmers James Prather Brent N. Reeves Juho Leinonen Stephen MacNeil Arisoa S. Randrianasolo Brett A. Becker Bailey Kimmel Jared Wright Ben Briggs 40 51 0 28 May 2024
Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge Charles Koutcheme Nicola Dainese Sami Sarsa Arto Hellas Juho Leinonen Paul Denny ELM ALM 47 22 0 08 May 2024
Generating Feedback-Ladders for Logical Errors in Programming using Large Language Models Hasnain Heickal Andrew Lan LRM 27 2 0 01 May 2024
Improving LLM Classification of Logical Errors by Integrating Error Relationship into Prompts Yanggyu Lee Suchae Jeong Jihie Kim 27 5 0 30 Apr 2024
Evaluating the Effectiveness of LLMs in Introductory Computer Science Education: A Semester-Long Field Study Wenhan Lyu Yimeng Wang Tingting Rachel Chung Chung Yifan Sun Yixuan Zhang 35 30 0 20 Apr 2024
Generative AI in Education: A Study of Educators' Awareness, Sentiments, and Influencing Factors Aashish Ghimire James Prather John Edwards ELM 37 25 0 22 Mar 2024
"Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students using Large Language Models Seth Bernstein Paul Denny Juho Leinonen Lauren Kan Arto Hellas Matt Littlefield Sami Sarsa Stephen MacNeil 40 9 0 14 Mar 2024
Feedback-Generation for Programming Exercises With GPT-4 Imen Azaiz Natalie Kiesler Sven Strickroth 40 20 0 07 Mar 2024
LLMs in the Heart of Differential Testing: A Case Study on a Medical Rule Engine Erblin Isaku Christoph Laaber Hassan Sartaj Shaukat Ali T. Schwitalla J. F. Nygård 49 2 0 16 Feb 2024
Enhancing Programming Error Messages in Real Time with Generative AI Bailey Kimmel Austin Geisert Lily Yaro Brendan Gipson Ronald Taylor Hotchkiss Sidney Osae-Asante Hunter Vaught Grant Wininger Chase Yamaguchi 29 12 0 12 Feb 2024
How Beginning Programmers and Code LLMs (Mis)read Each Other S. Nguyen Hannah McLean Babe Yangtian Zi Arjun Guha C. Anderson Molly Q. Feldman 28 43 0 26 Jan 2024
CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needs Majeed Kazemitabaar Runlong Ye Xiaoning Wang Austin Z. Henley Paul Denny Michelle Craig Tovi Grossman AI4Ed ELM 38 108 0 20 Jan 2024
Interactions with Prompt Problems: A New Way to Teach Programming with Large Language Models James Prather Paul Denny Juho Leinonen IV DavidH.Smith Brent N. Reeves Stephen MacNeil Brett A. Becker Andrew Luxton-Reilly Thezyrie Amarouche Bailey Kimmel AI4Ed 31 5 0 19 Jan 2024
The Effects of Generative AI on Computing Students' Help-Seeking Preferences Irene Hou Sophia Mettille Zhuo Li Owen Man Cynthia Zastudil Stephen MacNeil 38 41 0 04 Jan 2024
Understanding the Role of Large Language Models in Personalizing and Scaffolding Strategies to Combat Academic Procrastination Ananya Bhattacharjee Yuchen Zeng Sarah Yi Xu Dana Kulzhabayeva Minyi Ma ... A. Mariakakis Mary P Czerwinski Anastasia Kuzminykh Michael Liut Joseph Jay Williams AI4Ed 24 25 0 21 Dec 2023
Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course? Anishka Atharva Mehta Nipun Gupta Aarav Balachandran Dhruv Kumar Pankaj Jalote 26 7 0 12 Dec 2023
Next-Step Hint Generation for Introductory Programming Using Large Language Models Lianne Roest H. Keuning J. Jeuring LRM 33 28 0 03 Dec 2023
Decoding Logic Errors: A Comparative Study on Bug Detection by Students and Large Language Models Stephen MacNeil Paul Denny Andrew Tran Juho Leinonen Seth Bernstein Arto Hellas Sami Sarsa Joanne Kim LRM 28 16 0 27 Nov 2023
"It's not like Jarvis, but it's pretty close!" -- Examining ChatGPT's Usage among Undergraduate Students in Computer Science Ishika Joshi Ritvik Budhiraja Harshal D. Akolekar Jagat Sesh Challa Dhruv Kumar 29 27 0 16 Nov 2023
Prompt Problems: A New Programming Exercise for the Generative AI Era Paul Denny Juho Leinonen James Prather Andrew Luxton-Reilly Thezyrie Amarouche Brett A. Becker Brent N. Reeves 38 84 0 10 Nov 2023
AI-enhanced Auto-correction of Programming Exercises: How Effective is GPT-3.5? Imen Azaiz Oliver Deckarm Sven Strickroth 48 18 0 24 Oct 2023
An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions Jingyu Shi Rahul Jain Hyungjun Doh Ryo Suzuki Karthik Ramani 3DV 34 21 0 11 Oct 2023
Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validation Tung Phung Victor-Alexandru Pădurean Anjali Singh Christopher A. Brooks J. Cambronero Sumit Gulwani Adish Singla Gustavo Soares 28 39 0 05 Oct 2023
Can Language Models Employ the Socratic Method? Experiments with Code Debugging Erfan Al-Hossami Razvan Bunescu Justin Smith Ryan Teehan LRM 24 13 0 04 Oct 2023
The Robots are Here: Navigating the Generative AI Revolution in Computing Education James Prather Paul Denny Juho Leinonen Brett A. Becker Ibrahim Albluwi ... Stephen MacNeil Andrew Petersen Raymond Pettit Brent N. Reeves Jaromír Šavelka 36 193 0 01 Oct 2023
How Novices Use LLM-Based Code Generators to Solve CS1 Coding Tasks in a Self-Paced Learning Environment Majeed Kazemitabaar Xinying Hou Austin Z. Henley B. Ericson David Weintrop Tovi Grossman AI4Ed 29 89 0 25 Sep 2023