Date
Publisher
arXiv
Feedback is one of the most powerful influences on student learning, with
extensive research examining how best to implement it in educational settings.
Increasingly, feedback is being generated by artificial intelligence (AI),
offering scalable and adaptive responses. Two widely studied approaches are
directive feedback, which gives explicit explanations and reduces cognitive
load to speed up learning, and metacognitive feedback which prompts learners to
reflect, track their progress, and develop self-regulated learning (SRL)
skills. While both approaches have clear theoretical advantages, their
comparative effects on engagement, confidence, and quality of work remain
underexplored. This study presents a semester-long randomised controlled trial
with 329 students in an introductory design and programming course using an
adaptive educational platform. Participants were assigned to receive directive,
metacognitive, or hybrid AI-generated feedback that blended elements of both
directive and metacognitive feedback. Results showed that revision behaviour
differed across feedback conditions, with Hybrid prompting the most revisions
compared to Directive and Metacognitive. Confidence ratings were uniformly
high, and resource quality outcomes were comparable across conditions. These
findings highlight the promise of AI in delivering feedback that balances
clarity with reflection. Hybrid approaches, in particular, show potential to
combine actionable guidance for immediate improvement with opportunities for
self-reflection and metacognitive growth.
Why it matters
While directive and metacognitive AI feedback both have clear theoretical advantages, their comparative effects on student engagement, confidence, and quality of work remain underexplored.
Key findings
- In an introductory design and programming course with 329 students, hybrid AI feedback prompted more revisions than directive or metacognitive feedback alone.
- Student confidence ratings were uniformly high across all three types of AI-generated feedback.
- Student work quality outcomes were comparable across the directive, metacognitive, and hybrid AI feedback conditions.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Who age?
Why use AI?
Study design

