Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

Predicting ChatGPT Use in Assignments: Implications for AI-Aware Assessment Design

Authors
Surajit Das,
Aleksei Eliseev
Date
Publisher
arXiv
The rise of generative AI tools like ChatGPT has significantly reshaped education, sparking debates about their impact on learning outcomes and academic integrity. While prior research highlights opportunities and risks, there remains a lack of quantitative analysis of student behavior when completing assignments. Understanding how these tools influence real-world academic practices, particularly assignment preparation, is a pressing and timely research priority. This study addresses this gap by analyzing survey responses from 388 university students, primarily from Russia, including a subset of international participants. Using the XGBoost algorithm, we modeled predictors of ChatGPT usage in academic assignments. Key predictive factors included learning habits, subject preferences, and student attitudes toward AI. Our binary classifier demonstrated strong predictive performance, achieving 80.1\% test accuracy, with 80.2\% sensitivity and 79.9\% specificity. The multiclass classifier achieved 64.5\% test accuracy, 64.6\% weighted precision, and 64.5\% recall, with similar training scores, indicating potential data scarcity challenges. The study reveals that frequent use of ChatGPT for learning new concepts correlates with potential overreliance, raising concerns about long-term academic independence. These findings suggest that while generative AI can enhance access to knowledge, unchecked reliance may erode critical thinking and originality. We propose discipline-specific guidelines and reimagined assessment strategies to balance innovation with academic rigor. These insights can guide educators and policymakers in ethically and effectively integrating AI into education.
Study at a glance
  • Question: What factors predict whether university students will use ChatGPT to complete their academic assignments?
  • Setting and data: Survey responses from 388 university students, primarily from Russia, including a subset of international participants.
  • Method: Predictive modeling using machine learning (XGBoost) on survey responses.
Why it matters

Generative AI tools like ChatGPT have sparked debates about learning outcomes and academic integrity, but quantitative analysis of student behavior during assignments is lacking. Understanding how these tools influence real-world assignment preparation is a pressing priority.

Key findings
  • Among 388 university students primarily from Russia, frequent ChatGPT use for learning new concepts correlated with potential overreliance and reduced academic independence.
  • Students' learning habits, subject preferences, and attitudes toward AI predicted their ChatGPT use on assignments with about 80 percent accuracy.
  • While generative AI can enhance access to knowledge, unchecked student reliance may erode critical thinking and originality.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

What is the application?
Who is the user?
Who age?