Search and Filter

Student Evaluation Of Repeated AI Feedback Across A Semester Of Writing

Date

AI Overview

Why it matters

Generative AI is increasingly used for feedback in higher education, but evidence from repeated classroom use remains limited.

Study at a glance
  • Question: How do students evaluate repeated generative AI feedback on their reflective writing over a full semester?
  • Setting and data: Estonian university course, autumn 2025, 2,988 homework submissions from 283 first-year humanities bachelor students.
  • Method: Descriptive and mixed-effects regression analysis of student writing, AI feedback, and student appraisals, with LLM annotation and AI text detection.
  • AI tools: ChatGPT, Gemini, Claude, DeepSeek, Copilot, Grok
Key findings
  • Students found AI feedback helpful 57% of the time and actionable 53% of the time, though positive reactions declined over the semester.
  • Expressed student helpfulness was not associated with deeper reflection in their subsequent essays, with 94% of essays remaining at a descriptive reflection level.
  • An AI text detector classified 28% of essays as likely AI-generated, rising from 8.5% in the first homework to 40.3% in the thirteenth.

Summary drafted with AI from the full paper and may contain errors. See the full paper for details.

Generative AI is increasingly used for feedback in higher education, but evidence from repeated classroom use remains limited. This short paper analyses 2988 reflective essay-feedback-appraisal instances from 283 Estonian bachelor students across one semester. Students obtained and assessed feedback from a self-selected AI tool using a uniform prompt. The present analysis of the anonymized text corpus covers essay content, AI feedback, and its perceived helpfulness. Students found feedback helpful and actionable more often than not; about a tenth thought AI unhelpful, more so towards the end of the semester. We also analyzed essay reflection depth, and used a validated AI text classifier to estimate the share of essays that could be treated as likely unaided student writing. The study contributes descriptive classroom evidence on integration of AI feedback - a fast and scalable way to provide immediate writing advice, but not a self-contained route to better reflection. Benefits depend on whether students learn to use AI selectively and critically, without sliding into over-use harmful for the learning process.