Date
AI Overview
Why it matters
Communicating statistical results is an important curricular goal, but educators worry students may offload important cognitive tasks to large language models, compromising their writing skill trajectories.
Study at a glance
- Question: How has undergraduate statistics students' writing style and verb usage changed since large language models became widely accessible?
- Setting and data: Carnegie Mellon University, undergraduate introductory statistics students, 2021 to 2025, 1,619 student data analysis reports.
- Method: Text and content analysis comparing student writing, AI text, and expert publications using Linear Discriminant Analysis and keyness analysis.
- AI tools: ChatGPT, GPT-4o, GPT-5 Mini, Gemini 2.5 Flash, Claude Haiku 4.5
Key findings
- Undergraduate statistics reports shifted toward a mixture of AI and expert styles, showing more informational density, longer words, and more nominalizations after large language models emerged.
- The stylistic shift toward AI models was most pronounced in the first and fifth quintiles of student reports, which correspond to the introduction and conclusion sections.
- Ten common AI verbs showed statistically significant increases in student reports, including an 8.7-fold increase in enhance, while underscore appeared 35 times after never appearing previously.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
The ability to communicate statistical results to domain experts and stakeholders is an important goal of the undergraduate statistics and data science curriculum. However, as large language models (LLMs) have become more accessible, a major concern is that students are offloading important cognitive tasks to generative AI. Using a corpus of over 1,600 undergraduate students' data analysis reports from 2021 to 2025, we show how students' writing style and verb usage have become more similar to that of LLMs. This shift is most pronounced in the first and fifth quintiles of students' reports, which roughly map onto the introduction and conclusion sections, respectively. At the same time, we demonstrate that students' writing style has become more similar to that of statistics experts with the addition of LLMs. We end by discussing the implications of our findings for statistics and data science educators. In particular, we propose alternative modes of assessment that still emphasize statistical thinking, such as targeted writing assignments for structuring a report introduction.
Research Categories
What is the application?
Who is the user?
Who age?
Why use AI?
Study design
AI tools
Publication Source
Publisher
arXiv
