Search and Filter

Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

Faster Completion, Less Learning: Generative AI Reduced Study Time On Math Problems And The Knowledge They Build

Date
Publisher
arXiv
How much have students' ordinary learning processes shifted in response to generative AI, and how does that affect their durable learning outcomes? Self-report surveys show little change, while small-scale behavioral studies report widespread AI use without the scale or duration to measure learning consequences. We address both questions using a ten-year panel of $3.2$ million ALEKS learning interactions for investigating time-on-task, complemented by ALEKS PPL placement-assessment data for examining proctoring and learning outcomes, with a quasi-experimental design exploiting variation in tasks that are more susceptible to AI (text-based word problems) and less susceptible to AI (interactive graph-based problems). Learning time on AI-susceptible problems declines $2.8\%$ per quarter among college students after ChatGPT's release, cumulating to $26.9\%$ over eleven quarters; high-schoolers show $31.3\%$, middle-schoolers $9.0\%$, and Grade 5 students no detectable change. Among college students, the post-ChatGPT divergence vanishes entirely under proctoring, ruling out broad efficiency gains as the likely explanation. Logistic fixed-effects models on randomly assigned proctored retention items yield a $25\%$ cumulative decline in odds of correct response; the same estimator on non-proctored assessment produces a large opposite-signed increase -- inconsistent with any platform, cohort, or curriculum explanation. These results are among the first large-scale behavioral and outcome evidence that generative AI has altered how students study and the knowledge they build -- the population-level indicator of \emph{cognitive surrender}, with direct implications for educational research, assessment governance, and AI policy.
Study at a glance
  • Question: Has generative AI reduced student study time on math problems, and has it harmed long-term knowledge retention?
  • Setting and data: ALEKS mathematics platform, Grade 5 through college, 2015–2025, 3.2 million learning interactions and 12.2 million placement assessment response times.
  • Method: Quasi-experimental panel study comparing AI-susceptible and AI-resistant problems across pre- and post-ChatGPT periods (Fixed effects / panel regression).
Why it matters

Evidence on whether generative AI has changed student study habits and durable learning is scarce, leaving educators and policymakers to formulate AI policies without large-scale quantitative evidence about actual behavioral shifts.

Key findings
  • Learning time on AI-susceptible math word problems dropped cumulatively by 31.3% for high schoolers and 26.9% for college students after ChatGPT's release, with no change in Grade 5.
  • On randomly assigned proctored retention tests, college students' odds of correctly answering AI-susceptible questions declined by 25% over eleven quarters following ChatGPT's release.
  • The decline in study time on AI-susceptible problems completely disappeared when assessments were proctored, ruling out general student efficiency gains.

Summary drafted with AI from the full paper and may contain errors. See the full paper for details.

What is the application?
Who is the user?