Date
Publisher
ERIC
This quasi-experimental study examined the impact of Coursemojo's AI-powered teaching platform on sixth-grade English Language Arts achievement in a large, diverse Tennessee school district during the 2024-2025 school year. The study involved 2,203 students across twelve schools, with 1,017 students using Coursemojo and 1,186 serving as comparison students. Results demonstrated significant positive effects across multiple assessment measures. Coursemojo students outperformed comparison students by 8 points on the state standardized test (TCAP) ([beta] = 7.461, p < 0.001, Hedges' g = 0.12). The platform also showed evidence of supporting more equitable outcomes, reducing achievement gaps for students with disabilities by two-thirds (from 16 to 5 points) and for economically disadvantaged students by more than half. Dosage analysis revealed that more sustained implementation of 2.5+ days per week on the weeks the program was used was critical for maximizing benefits. Survey data from 851 students and 22 teachers, along with interviews with 4 educational leaders, provided convergent evidence of positive learning impacts and effective instructional integration. Student surveys revealed that 39.7% rated Coursemojo as helping them learn "quite a bit" or "very much," while 80.0% provided high effort ratings, with persistence scores averaging 4.03 out of 5. These findings suggest that AI-powered literacy support can enhance middle school English Language Arts instruction while advancing equity outcomes for historically underserved populations.
Study at a glance
- Question: Does using Coursemojo's AI-powered teaching platform improve sixth-grade English Language Arts achievement and advance equity?
- Setting and data: 12 schools in a large, diverse Tennessee school district, 2024-2025 school year, 2,203 sixth-grade students, 22 teachers, and 4 educational leaders.
- Method: Quasi-experimental comparison combined with student and teacher surveys and leader interviews (Mixed methods).
Why it matters
Understanding how AI-powered teaching platforms affect student achievement and equity can show whether AI tools can enhance middle school literacy instruction and support historically underserved student populations.
Key findings
- Sixth-grade students using Coursemojo scored 8 points higher on Tennessee's state standardized test (TCAP) than comparison students.
- The platform reduced achievement gaps on the state test by two-thirds for students with disabilities and by over half for economically disadvantaged students.
- Using the platform for at least 2.5 days per week during implementation weeks was critical for maximizing student learning benefits.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Who age?
Why use AI?
Study design
