Search and Filter

The Generative AI Learning Penalty: Evidence from Chinese Secondary Education

Date

AI Overview

Why it matters

Understanding how generative artificial intelligence shapes student homework productivity and academic learning is essential as secondary students increasingly adopt these tools.

Study at a glance
  • Question: How does adopting generative AI affect secondary students' homework performance and exam learning outcomes?
  • Setting and data: China, grades 7-12, 30 months of panel data covering 26,811 students across nine subjects.
  • Method: Difference-in-differences design using staggered AI adoption.
Key findings
  • AI adoption raised homework scores by 18% and cut completion time by 30%, but lowered monthly exam scores by 20% within six months.
  • High-stakes entrance-exam scores fell by 18% and 24%, with the full penalty taking about two years to emerge.
  • Learning losses were concentrated among roughly 80% of AI users showing homework outsourcing behavior, while users maintaining normal completion times experienced small losses.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

Using 30 months of panel data on 26,811 Chinese students in grades 7-12, we study how generative AI affects homework productivity and learning. The data combine monthly closed-book exams, high-school and college entrance exams, and homework scores and completion time across nine subjects. We exploit staggered AI adoption in a difference-in-differences design. AI adoption raises homework scores by 18% and reduces completion time by 30%, but lowers monthly exam scores by 20% within six months. High-stakes entrance-exam scores fall by 18 and 24%, with the full penalty emerging only after about two years. The losses are largest in social science subjects, followed by STEM and languages, and are especially large for junior students, high-achieving students, and boys. The learning losses are concentrated among roughly 80% of AI users whose behavior is consistent with homework outsourcing, as indicated by exceptionally short homework completion time coupled with high homework scores. AI users who maintain similar homework completion time as non-AI users experience small learning losses.