Date
AI Overview
Why it matters
Unstructured use of generative AI may encourage passive consumption of answers rather than active engagement with concepts, potentially limiting deep learning in introductory physics.
Study at a glance
- Question: How do introductory physics students perceive the impact of a structured AI problem-replication framework on their learning?
- Setting and data: SUNY Farmingdale State College, New York; 39 undergraduate students in three algebra-based introductory physics sections; end-of-semester survey.
- Method: Mixed methods survey analysis combining descriptive statistics, non-parametric correlational analysis, and inductive thematic analysis.
- AI tools: ChatGPT, Google Gemini
Key findings
- Nearly all participants (97.4%) reported improved conceptual understanding, and 97.4% rated the AI-replicated practice problems as helpful.
- Higher conceptual clarity was strongly associated with finding replication helpful, and post-engagement problem-solving self-confidence scores averaged 7.03 out of 10.
- Students highlighted benefits in conceptual clarification and structured reasoning, but noted concerns regarding occasional AI errors and misalignment with in-class instructional methods.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
The growing use of generative AI tools among students raises an important pedagogical question: how can AI be structured to promote active learning rather than passive answer-seeking? This study introduces the Physics AI-Replication (P-A.I.R.) framework, in which students identify challenging problems, use AI to explain underlying concepts and solutions, generate similar problems, and practice independently before reviewing answers. Survey data from 39 undergraduate students in algebra-based physics indicate that nearly all participants reported improved conceptual understanding following engagement with P-A.I.R. across the semester, and self-confidence scores were consistently above the scale midpoint (mean = 7.03; range 5-9). A strong association between conceptual clarity and replication helpfulness (Spearman r = 0.582, p < 0.001) supports the framework's design. Qualitative findings highlight conceptual clarification and structured problem-solving. These results suggest that P-A.I.R. offers a practical approach for integrating AI into physics learning.
Research Categories
What is the application?
Who is the user?
Who age?
Why use AI?
Study design
Methods
AI tools
Publication Source
Publisher
arXiv
