Date
Publisher
arXiv
AI has become a partner in how people learn about, do, and engage with science, and the partnership takes three forms: a scientist works with a co-scientist whose output must be checked; a member of the public looks something up to decide whether a diet works or whether to fit solar panels; and a student takes up an inquiry with AI in a science class. Across all three, one thing decides whether the partnership helps or harms: whether the human evaluates what the AI returns or takes it on trust. I argue that this evaluation -- epistemic vigilance calibrated to how far a fallible source can be trusted -- is, given adequate prior knowledge, the binding constraint on productive augmentation. You can hand the AI a great deal precisely because you stay vigilant; vigilance makes generative partnership safe, so it licenses augmentation rather than restricting it. Vigilance is already invoked in science education but under-specified for the AI case; I specify its components, the mechanism tying it to learning, and a way to measure it without soliciting the evaluation it is meant to detect. What is distinctive is that the machine's fluent, confident prose reads as trustworthy whether or not it is, so its surface works against the human evaluating it. The argument bears hardest on education: the integrated conceptual knowledge instruction aims to foster forms only under deep processing, and vigilance sets how deeply a claim is processed, so it is the precondition for learning with AI. The design factors the field reports matter through whether they engage the learner's evaluation; none works around it. Untested is vigilance as a measured disposition, above all where the AI is confidently wrong. Because it is unevenly distributed, integrating AI uniformly is likely to widen the gap between better- and less-prepared students. I close on how it might be built by fading support as the learner takes over.
Study at a glance
- Question: How does human epistemic vigilance determine whether working with artificial intelligence helps or harms learning in science?
- Setting and data: Not stated in the paper
- Method: Conceptual analysis and theoretical framework development
Why it matters
Students and citizens increasingly use generative AI for science, but the machine's fluent, confident prose easily masks errors. Understanding when and how humans critically evaluate AI claims is essential for preventing learning loss and misplaced trust.
Key findings
- Epistemic vigilance, evaluating AI output against prior knowledge rather than accepting fluent surface cues, is the binding constraint on productive learning with AI.
- Integrated conceptual science knowledge forms only under deep processing, which is triggered when a learner notices contradictions rather than delegating thinking to AI.
- Uniformly introducing AI across classrooms is predicted to widen achievement gaps because the prior knowledge and disposition needed to evaluate AI outputs are unequally distributed.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Why use AI?
Study design
