Date
AI Overview
Why it matters
Discrepancies between students' mental models and generative AI use can lead to misunderstandings about appropriate use and policy violations. Prior research rarely explores the underlying cognitive structures students use to make sense of AI.
Study at a glance
- Question: What mental models and knowledge types do undergraduate students hold regarding generative AI?
- Setting and data: 64 undergraduate concept maps from a required technology ethics course in an IT curriculum.
- Method: Concept map holistic scoring, inductive coding, hierarchical clustering, and qualitative analysis.
Key findings
- Hierarchical clustering revealed five mental models of generative AI: technical process based, educational tool based, transition model, consequence aware, and integrated model.
- Declarative knowledge dominated students' concept maps, showing that students mostly understood generative AI at a surface level through names, tools, and applications.
- Only 9 students integrated all three knowledge types—declarative, procedural, and conditional—while 31 concept maps relied exclusively on declarative knowledge.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
In this paper we present a study of students' mental models of generative AI (GenAI). A student's mental model of GenAI influences not only how they perceive the technology's capabilities and limitations but also how they choose to integrate it into their academic work. Whether they view it as a collaborative partner, a shortcut to complete tasks, or something in between, depends on how they conceptualize its use. This study addresses the following questions: (I) What mental models do undergraduate students hold about GenAI? and (II) What aspects of conceptual knowledge - declarative, procedural, and conditional - are present in these mental models? Sixty-four concept maps were collected from students enrolled in a course on technology ethics. Students were asked to construct concept maps representing their understanding of GenAI use. The concept maps were analyzed using a structured codebook and the analysis revealed five categories of mental models: technical process based, educational tool based, transition model, consequence aware model, integrated model. Declarative knowledge was most dominant across maps, suggesting that students largely understood GenAI primarily at a surface level - knowing its names, tools, and applications but demonstrate limited procedural understanding of how it works and limited conditional knowledge about when and why it should or should not be used. By identifying students' mental models, we can improve students' AI literacy by designing curriculum and guidelines that improve cognition while ensuring responsible and ethical use.
Research Categories
Who is the user?
Who age?
Why use AI?
Study design
Methods
Publication Source
Publisher
arXiv
