Search and Filter

Coursemojo Efficacy Study Grade 6, 2024–2025 Aimsweb & TCAP

Date

AI Overview

Why it matters

Understanding how AI-powered teaching platforms affect middle school English Language Arts achievement and advance equity for historically underserved populations remains essential for instructional practice.

Study at a glance
  • Question: How does an AI-powered teaching platform affect sixth-grade English Language Arts achievement and equity outcomes?
  • Setting and data: Large, diverse Tennessee school district, 2024-2025 school year, 2,203 sixth-grade students across 12 schools, plus surveys and leader interviews.
  • Method: Quasi-experimental study with comparison group, surveys, and interviews (mixed methods).
  • AI tools: Coursemojo
Key findings
  • Sixth-grade students using Coursemojo outperformed comparison peers by 8 points on Tennessee's state standardized test (TCAP).
  • Coursemojo reduced achievement gaps by two-thirds for students with disabilities and by more than half for economically disadvantaged students.
  • More sustained implementation of at least 2.5 days per week during usage weeks was critical for maximizing benefits.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

This quasi-experimental study examined the impact of Coursemojo's AI-powered teaching platform on sixth-grade English Language Arts achievement in a large, diverse Tennessee school district during the 2024-2025 school year. The study involved 2,203 students across twelve schools, with 1,017 students using Coursemojo and 1,186 serving as comparison students. Results demonstrated significant positive effects across multiple assessment measures. Coursemojo students outperformed comparison students by 8 points on the state standardized test (TCAP) ([beta] = 7.461, p < 0.001, Hedges' g = 0.12). The platform also showed evidence of supporting more equitable outcomes, reducing achievement gaps for students with disabilities by two-thirds (from 16 to 5 points) and for economically disadvantaged students by more than half. Dosage analysis revealed that more sustained implementation of 2.5+ days per week on the weeks the program was used was critical for maximizing benefits. Survey data from 851 students and 22 teachers, along with interviews with 4 educational leaders, provided convergent evidence of positive learning impacts and effective instructional integration. Student surveys revealed that 39.7% rated Coursemojo as helping them learn "quite a bit" or "very much," while 80.0% provided high effort ratings, with persistence scores averaging 4.03 out of 5. These findings suggest that AI-powered literacy support can enhance middle school English Language Arts instruction while advancing equity outcomes for historically underserved populations.