Search and Filter

Chatgpt As A Cognitive Crutch: Evidence From A Randomized Controlled Trial On Knowledge Retention

Date

AI Overview

Why it matters

The rapid integration of generative artificial intelligence into higher education has outpaced empirical understanding of its effects on fundamental learning processes.

Study at a glance
  • Question: How does using ChatGPT as a study aid affect undergraduates' long-term knowledge retention?
  • Setting and data: 120 undergraduate students learning AI, tested 45 days after learning.
  • Method: Randomized controlled trial
  • AI tools: ChatGPT
Key findings
  • Students using ChatGPT scored significantly lower on a surprise 45-day retention test (57.5% correct) than those using traditional study methods (68.5% correct).
  • Unrestricted ChatGPT use appeared to impair long-term retention, likely by reducing the cognitive effort that supports durable memory.
  • While AI assistance may ease initial learning, it appears to undermine the effortful processes needed for robust learning.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

The rapid integration of generative artificial intelligence into higher education has outpaced empirical understanding of its effects on fundamental learning processes. To address this gap, this randomized controlled trial (n = 120) tested ChatGPT's impact on long-term knowledge retention in undergraduates learning AI. Participants were randomly assigned either to use ChatGPT as a study aid (AI-Assisted Group) or to use only traditional, non-AI study methods (traditional learning group). Knowledge retention was assessed with a surprise test 45 days after learning. Students who used ChatGPT scored significantly lower on the retention test (57.5 % correct) compared to those who studied traditionally (68.5 % correct), t (83) = _3.19, p = .002, Cohen's d = 0.68. This suggests that unrestricted ChatGPT use impaired long-term retention, likely by reducing the cognitive effort that supports durable memory. The findings align with cognitive offloading theory and the ‘desirable difficulties’ principle: while AI assistance may ease initial learning, it appears to undermine the effortful processes needed for robust learning. These results have important implications for how generative AI tools should be integrated into higher education.

Publication Source

Publisher
Social Sciences & Humanities Open