Search and Filter

Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

Making AI-Generated Feedback Matter: A Large-Scale Study Of Feedback Workflows And Student Enactment

Date
Publisher
arXiv
Feedback processes strongly influence student learning, yet their educational value depends on addressing two distinct challenges: providing high-quality, timely, and individualised feedback at scale, and supporting students to interpret, evaluate, and act on that feedback productively. Generative AI offers a credible means of addressing the provision challenge, but students' uptake of AI-generated feedback remains limited. We conducted a large-scale quasi-experimental sequential cohort study comparing three AI-mediated feedback workflows across 13,037 students and 51,296 student-authored resources. In Directed Feedback (n = 3,723), students received AI-generated feedback comments without structured support. In Self-Directed Feedback (n = 3,951), students could initiate optional AI-supported dialogue. In Enacted Feedback (n = 5,363), students were prompted to select feedback suggestions, evaluate their relevance, and engage in targeted AI-supported dialogue anchored to those selections. Enacted Feedback was associated with significantly higher uptake of AI-generated feedback, with an estimated probability of 26.2%, compared with 14.1% for Directed Feedback and 0.1% for Self-Directed Feedback. It was also associated with significantly higher self-assessment confidence and submitted-work quality than both comparison conditions. These findings suggest that the educational value of AI-generated feedback depends not only on the quality of feedback comments, but also on workflows that actively structure students' enactment of feedback literacy processes. The results have implications for the design of AI feedback systems that position learners as active participants in judgement, dialogue, and improvement rather than passive recipients of comments. Overall findings show that AI access alone is insufficient; purposeful workflow design is central to productive feedback use.
Study at a glance
  • Question: How do different AI-mediated feedback workflows affect students' feedback uptake, revision counts, self-assessment confidence, and submitted-work quality?
  • Setting and data: 70 higher education course offerings across three semesters (2025–2026), 13,037 students, and 51,296 student-authored learning resources in the RiPPLE platform.
  • Method: Quasi-experimental sequential cohort study using mixed-effects regression models (binomial, negative-binomial, cumulative link, and beta GLMMs).
Why it matters

Generative AI can produce individualised feedback at scale, but student uptake remains limited. Understanding how feedback workflows support learners to actively interpret and act on comments is critical for educational value.

Key findings
  • Enacted Feedback was associated with significantly higher feedback uptake (estimated probability of 26.2%) compared with Directed Feedback (14.1%) and Self-Directed Feedback (0.1%).
  • Students in the Enacted Feedback condition made significantly more revisions (estimated 0.602 revisions per resource) than those in Directed Feedback (0.239) or Self-Directed Feedback (0.0034).
  • Enacted Feedback was associated with significantly higher self-assessment confidence and higher peer-moderated submitted-work quality than both comparison conditions.

Summary drafted with AI from the full paper and may contain errors. See the full paper for details.

What is the application?
Who is the user?
Who age?