Date
Publisher
arXiv
Reading assessments are essential for enhancing students' comprehension, yet many EdTech applications focus mainly on outcome-based metrics, providing limited insights into student behavior and cognition. This study investigates the use of multimodal data sources -- including eye-tracking data, learning outcomes, assessment content, and teaching standards -- to derive meaningful reading insights. We employ unsupervised learning techniques to identify distinct reading behavior patterns, and then a large language model (LLM) synthesizes the derived information into actionable reports for educators, streamlining the interpretation process. LLM experts and human educators evaluate these reports for clarity, accuracy, relevance, and pedagogical usefulness. Our findings indicate that LLMs can effectively function as educational analysts, turning diverse data into teacher-friendly insights that are well-received by educators. While promising for automating insight generation, human oversight remains crucial to ensure reliability and fairness. This research advances human-centered AI in education, connecting data-driven analytics with practical classroom applications.
Study at a glance
- Question: Can AI transform student reading and eye-tracking data into useful assessment reports for teachers?
- Setting and data: Eye-tracking data, learning outcomes, assessment content, and teaching standards.
- Method: Computational analysis of reading patterns, AI-generated report synthesis, and evaluation by educators and experts.
Why it matters
Reading assessments are essential for enhancing students' comprehension. However, many EdTech applications focus mainly on outcome-based metrics, providing limited insights into student behavior and cognition.
Key findings
- In reading assessments, large language models successfully transformed complex student behavioral and performance data into clear, actionable reports for teachers.
- Educators and experts rated the AI-generated assessment reports favorably for their clarity, accuracy, relevance, and usefulness for classroom instruction.
- Automated report generation still requires human oversight to ensure the resulting student reading insights are reliable and fair.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Who age?
Why use AI?
