Date
Publisher
arXiv
The emergence of Large language models (LLMs) is expected to have a major
impact on education. This paper explores the potential of using ChatGPT, an
LLM, as a virtual Teaching Assistant (TA) in an Introductory Programming
Course. We evaluate ChatGPT's capabilities by comparing its performance with
that of human TAs in some of the important TA functions. The TA functions which
we focus on include (1) grading student code submissions, and (2) providing
feedback to undergraduate students in an introductory programming course.
Firstly, we assess ChatGPT's proficiency in grading student code submissions
using a given grading rubric and compare its performance with the grades
assigned by human TAs. Secondly, we analyze the quality and relevance of the
feedback provided by ChatGPT. This evaluation considers how well ChatGPT
addresses mistakes and offers suggestions for improvement in student solutions
from both code correctness and code quality perspectives. We conclude with a
discussion on the implications of integrating ChatGPT into computing education
for automated grading, personalized learning experiences, and instructional
support.
Study at a glance
- Question: Can ChatGPT grade code and provide feedback as effectively as human teaching assistants in an introductory programming course?
- Setting and data: Code submissions from undergraduate students in an introductory programming course.
- Method: Compares ChatGPT's grading and feedback on student code submissions to evaluations by human teaching assistants.
Why it matters
Large language models are expected to have a major impact on education. Evaluating whether ChatGPT can perform virtual teaching assistant functions, such as grading student code and providing feedback, addresses its potential role in computing education.
Key findings
- In an undergraduate introductory programming course, ChatGPT shows potential to serve as a virtual teaching assistant for grading and feedback.
- ChatGPT can grade student code submissions using a provided grading rubric.
- ChatGPT addresses student programming mistakes and offers suggestions for improvement regarding code correctness and code quality.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Who age?
Why use AI?
Study design
