"It's Weird That it Knows What I Want": Usability and Interactions with Copilot for Novice Programmers

5 April 2023

Papers citing ""It's Weird That it Knows What I Want": Usability and Interactions with Copilot for Novice Programmers"

50 / 52 papers shown

Title
From Prompts to Propositions: A Logic-Based Lens on Student-LLM Interactions Ali Alfageeh Sadegh AlMahdi Kazemi Zarkouei Daye Nam Daniel Prol Matin Amoozadeh ... Paul Denny Juho Leinonen Michael Hilton Sruti Srinivasa Ragavan Mohammad Amin Alipour 14 0 0 25 Apr 2025
Junior Software Developers' Perspectives on Adopting LLMs for Software Engineering: a Systematic Literature Review Samuel Ferino Rashina Hoda John Grundy Christoph Treude 61 0 0 10 Mar 2025
Human-AI Experience in Integrated Development Environments: A Systematic Literature Review Agnia Sergeyuk Ilya Zakharov Ekaterina Koshchenko M. Izadi 58 0 0 08 Mar 2025
AIGCodeSet: A New Annotated Dataset for AI Generated Code Detection Basak Demirok Mucahid Kutlu DeLMO 87 0 0 21 Dec 2024
Insights from the Frontline: GenAI Utilization Among Software Engineering Students Rudrajit Choudhuri Ambareesh Ramakrishnan Amreeta Chatterjee Bianca Trinkenreich Igor Steinmacher M. Gerosa Anita Sarma 70 2 0 20 Dec 2024
LLMs Integration in Software Engineering Team Projects: Roles, Impact, and a Pedagogical Design Space for AI Tools in Computing Education Ahmed Kharrufa Sami Alghamdi Abeer Aziz Christopher Bull 16 1 0 30 Oct 2024
Survey of User Interface Design and Interaction Techniques in Generative AI Applications Reuben Luera Ryan Rossi Alexa F. Siu Franck Dernoncourt Tong Yu ... Hanieh Salehy Jian Zhao Samyadeep Basu Puneet Mathur Nedim Lipka AI4TS 55 1 0 28 Oct 2024
Intention Is All You Need Advait Sarkar 34 2 0 24 Oct 2024
How much does AI impact development speed? An enterprise-based randomized controlled trial Elise Paradis Kate Grey Quinn Madison Daye Nam A. Macvean Vahid Meimand Nan Zhang Ben Ferrari-Church Satish Chandra 25 1 0 16 Oct 2024
Students' Perceptions and Use of Generative AI Tools for Programming Across Different Computing Courses Hieke Keuning Isaac Alpizar-Chacon Ioanna Lykourentzou Lauren Beehler Christian Köppe Imke de Jong Sergey Sosnovsky 37 5 0 09 Oct 2024
Need Help? Designing Proactive AI Assistants for Programming Valerie Chen Alan Zhu Sebastian Zhao Hussein Mozannar David Sontag Ameet Talwalkar 37 4 0 06 Oct 2024
Not the Silver Bullet: LLM-enhanced Programming Error Messages are Ineffective in Practice E. Santos Brett A. Becker 24 2 0 27 Sep 2024
How Novice Programmers Use and Experience ChatGPT when Solving Programming Exercises in an Introductory Course Andreas Scholl Natalie Kiesler 23 8 0 30 Jul 2024
Pensieve Discuss: Scalable Small-Group CS Tutoring System with AI Yoonseok Yang Jack Liu J.D. Zamfirescu-Pereira John DeNero 13 0 0 24 Jul 2024
Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicity Johannes Schneider Arianna Casanova Flores Anne-Catherine Kranz 37 2 0 08 Jul 2024
Student-AI Interaction: A Case Study of CS1 students Matin Amoozadeh Daye Nam Daniel Prol Ali Alfageeh James Prather Michael Hilton Sruti Srinivasa Ragavan Mohammad Amin Alipour 27 4 0 29 Jun 2024
Using AI-Based Coding Assistants in Practice: State of Affairs, Perceptions, and Ways Forward Agnia Sergeyuk Yaroslav Golubev T. Bryksin Iftekhar Ahmed 49 10 0 11 Jun 2024
Insights from Social Shaping Theory: The Appropriation of Large Language Models in an Undergraduate Programming Course Aadarsh Padiyath Xinying Hou Amy Pang Diego Viramontes Vargas Xingjian Gu Tamara Nelson-Fromm Zihan Wu M. Guzdial B. Ericson 22 17 0 10 Jun 2024
Experiences from Integrating Large Language Model Chatbots into the Classroom Arto Hellas Juho Leinonen Leo Leppanen 20 4 0 07 Jun 2024
Analyzing Chat Protocols of Novice Programmers Solving Introductory Programming Tasks with ChatGPT Andreas Scholl D. Schiffner Natalie Kiesler 32 8 0 29 May 2024
The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmers James Prather Brent N. Reeves Juho Leinonen Stephen MacNeil Arisoa S. Randrianasolo Brett A. Becker Bailey Kimmel Jared Wright Ben Briggs 32 51 0 28 May 2024
A Transformer-Based Approach for Smart Invocation of Automatic Code Completion Aral de Moor A. van Deursen M. Izadi VLM 34 5 0 23 May 2024
Desirable Characteristics for AI Teaching Assistants in Programming Education Paul Denny Stephen MacNeil Jaromír Šavelka Leo Porter Andrew Luxton-Reilly 29 27 0 23 May 2024
"ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses Bruno Pereira Cipriano P. Alves 31 9 0 26 Apr 2024
The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmers Hussein Mozannar Valerie Chen Mohammed Alsobay Subhro Das Sebastian Zhao Dennis L. Wei Manish Nagireddy P. Sattigeri Ameet Talwalkar David Sontag ELM 38 18 0 03 Apr 2024
Generative AI in Education: A Study of Educators' Awareness, Sentiments, and Influencing Factors Aashish Ghimire James Prather John Edwards ELM 27 23 0 22 Mar 2024
Ironies of Generative AI: Understanding and mitigating productivity loss in human-AI interactions Auste Simkute Lev Tankelevitch Viktor Kewenig A. E. Scott Abigail Sellen Sean Rintel 27 20 0 17 Feb 2024
Enhancing Programming Error Messages in Real Time with Generative AI Bailey Kimmel Austin Geisert Lily Yaro Brendan Gipson Ronald Taylor Hotchkiss Sidney Osae-Asante Hunter Vaught Grant Wininger Chase Yamaguchi 11 12 0 12 Feb 2024
An Empirical Study on Usage and Perceptions of LLMs in a Software Engineering Project Sanka Rasnayaka Guanlin Wang Ridwan Shariffdeen Ganesh Neelakanta Iyer 21 26 0 29 Jan 2024
How Beginning Programmers and Code LLMs (Mis)read Each Other S. Nguyen Hannah McLean Babe Yangtian Zi Arjun Guha C. Anderson Molly Q. Feldman 25 42 0 26 Jan 2024
CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needs Majeed Kazemitabaar Runlong Ye Xiaoning Wang Austin Z. Henley Paul Denny Michelle Craig Tovi Grossman AI4Ed ELM 28 107 0 20 Jan 2024
The Effects of Generative AI on Computing Students' Help-Seeking Preferences Irene Hou Sophia Mettille Zhuo Li Owen Man Cynthia Zastudil Stephen MacNeil 30 42 0 04 Jan 2024
The Metacognitive Demands and Opportunities of Generative AI Lev Tankelevitch Viktor Kewenig Auste Simkute A. E. Scott Advait Sarkar Abigail Sellen Sean Rintel AI4CE 28 91 0 18 Dec 2023
Next-Step Hint Generation for Introductory Programming Using Large Language Models Lianne Roest H. Keuning J. Jeuring LRM 20 28 0 03 Dec 2023
Prompt Problems: A New Programming Exercise for the Generative AI Era Paul Denny Juho Leinonen James Prather Andrew Luxton-Reilly Thezyrie Amarouche Brett A. Becker Brent N. Reeves 33 80 0 10 Nov 2023
An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions Jingyu Shi Rahul Jain Hyungjun Doh Ryo Suzuki Karthik Ramani 3DV 21 21 0 11 Oct 2023
Trust in Generative AI among students: An Exploratory Study Matin Amoozadeh David Daniels Daye Nam Aayush Kumar Stella Chen Michael Hilton Sruti Srinivasa Ragavan Mohammad Amin Alipour 6 52 0 07 Oct 2023
The Robots are Here: Navigating the Generative AI Revolution in Computing Education James Prather Paul Denny Juho Leinonen Brett A. Becker Ibrahim Albluwi ... Stephen MacNeil Andrew Petersen Raymond Pettit Brent N. Reeves Jaromír Šavelka 28 191 0 01 Oct 2023
How Novices Use LLM-Based Code Generators to Solve CS1 Coding Tasks in a Self-Paced Learning Environment Majeed Kazemitabaar Xinying Hou Austin Z. Henley B. Ericson David Weintrop Tovi Grossman AI4Ed 24 86 0 25 Sep 2023
PwR: Exploring the Role of Representations in Conversational Programming YM Pradyumna Vinod Ganesan D. Arumugam Meghna Gupta Nischith Shadagopan Tanay Dixit Sameer Segal Pratyush Kumar Mohit Jain S. Rajamani 19 3 0 18 Sep 2023
Exploring the Potential of Large Language Models to Generate Formative Programming Feedback Natalie Kiesler Dominic Lohr H. Keuning 11 50 0 31 Aug 2023
Large Language Models in Introductory Programming Education: ChatGPT's Performance and Implications for Assessments Natalie Kiesler D. Schiffner ELM 10 22 0 15 Aug 2023
Promptly: Using Prompt Problems to Teach Learners How to Effectively Utilize AI Code Generators Paul Denny Juho Leinonen James Prather Andrew Luxton-Reilly Thezyrie Amarouche Brett A. Becker B. Reeves 14 29 0 31 Jul 2023
Exploring and Characterizing Large Language Models For Embedded System Development and Debugging Zachary Englhardt R. Li Dilini Nissanka Zhihan Zhang Girish Narayanswamy Joseph Breda Xin Liu Shwetak N. Patel Vikram Iyer 22 15 0 07 Jul 2023
Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses Jaromír Šavelka Arav Agarwal Marshall An Chris Bogart M. Sakr ELM 45 106 0 15 Jun 2023
Exploring the Responses of Large Language Models to Beginner Programmers' Help Requests Arto Hellas Juho Leinonen Sami Sarsa Charles Koutcheme Lilja Kujanpää Juha Sorva AI4Ed 19 67 0 09 Jun 2023
Is AI the better programming partner? Human-Human Pair Programming vs. Human-AI pAIr Programming Qianou Ma Tongshuang Wu Kenneth R. Koedinger 6 32 0 08 Jun 2023
StudentEval: A Benchmark of Student-Written Prompts for Large Language Models of Code Hannah McLean Babe S. Nguyen Yangtian Zi Arjun Guha Molly Q. Feldman Carolyn Jane Anderson ALM LRM 34 35 0 07 Jun 2023
Computing Education in the Era of Generative AI Paul Denny James Prather Brett A. Becker James Finnie-Ansley Arto Hellas Juho Leinonen Andrew Luxton-Reilly B. Reeves E. Santos Sami Sarsa 13 168 0 05 Jun 2023
Grounded Copilot: How Programmers Interact with Code-Generating Models Shraddha Barke M. James Nadia Polikarpova 142 212 0 30 Jun 2022