Breadcrumb
- Home
- AI Hub For Education
- Research Study Repository
- Outcomes – Literacy
Search and Filter
The Repository
Outcomes – Literacy
Research synthesis is AI-generated, human reviewed. Updated 11/2026.
Displaying 1 - 30 of 274
When Evaluators Cry Wolf: Lessons From Production LLM-As-Judge Evaluation In Educational AI
Chris Rohlfs, Rodrigo Vergara Bosse, Priscilla Rain Hopper, Keanon O'Keefe, Patrick Russell. (09/2026). arXiv.
Across 21 deployed evaluators, the calibration strategy cut confirmed false-positive flags by 99% and raised per-flag precision from 0.6% to 48.9%.
Characterizing LLM-Based Family Education Through The Lens Of Activity Theory: A Scoping Review Of The Hci Literature
Lan Luo, Yuqi Liang, Jie Cai, Anqi Wang, Dongyijie Primo Pan, Muzhi Zhou, Chun Yu, Pan Hui. (09/2026). arXiv.
Most reviewed studies focused on child–parent interaction (83%) and centered on language, narrative, AI literacy, and relational development rather than mathematical or scientific inquiry.
Studentbench: AI And Human Tutoring Yield Equivalent Gre Learning Gains
Curtis Northcutt, Inaara Hasmani, Kevin Feng, Trevor Khangi, Andreas Plesner, Jonas Mueller. (09/2026). arXiv.
AI tutoring produced learning gains statistically equivalent to expert human tutoring on the combined GRE assessment (p=.015).
Who Acts, Who Knows, Who Answers? A Corpus-Assisted Discourse Analysis Of Agency, Epistemic Responsibility, And Accountability In Generative AI Higher Education Research
Biranchi Poudyal. (09/2026). arXiv.
AI was the most frequently named actor, appearing 2,050 times and in 447 predicate associations, with 78.7% involving functional action rather than knowledge or judgment.
Little Impact Of ChatGPT On High School Test Scores
Nick Huntington-Klein. (09/2026). arXiv.
Higher educational ChatGPT use had an insignificant effect on high school test scores that was close to zero, bounded below roughly 0.04 standard deviations.
Instructional Objectives Completed And Skill-Specific Early Reading Growth In A Digital Reading Tutor
Nicholas A. Gage. (09/2026). EdArXiv.
Each additional 10 objectives completed predicted a 3.15 percentile point gain on composite reading scores (g = 0.10).
Dose, Not Access: Digital Reading Tutor Use And Early Reading Growth
Nicholas A. Gage. (09/2026). EdArXiv.
High-dose users averaging at least 15 minutes weekly outperformed near-zero users on end-of-year DIBELS reading composite scores by a medium effect size.
Enhancing Procedural Writing Through Personalized Example Retrieval: A Case Study On Cooking Recipes
Paola Mejia-Domenzain, Jibril Frej, Seyed Parsa Neshaei, Luca Mouchel, Tanya Nazaretsky, Thiemo Wambsganss, Antoine Bosselut, Tanja Kaser. (09/2026). arXiv.
Participants receiving adaptive feedback improved their recipe writing quality and completeness significantly more than those without adaptive feedback.
Tinker Tales: A Tangible Dialogue System For Child-AI Co-Creative Storytelling
Nayoung Choi, Jiseung Hong, Peace Cyebukayire, Ikseon Choi, Jinho D. Choi. (09/2026). arXiv.
Educationally scaffolded questions elicited narrative contributions in 90% to 100% of exchanges, compared to only 37% for general elaboration questions.
How Students (Really) Use ChatGPT: Uncovering Experiences Among Undergraduate Students
Tawfiq Ammari, Meilun Chen, S M Mehedi Zaman, Kiran Garimella. (08/2026). arXiv.
System apologies by ChatGPT were the single strongest positive predictor of students returning the next week, outweighing every task-completion factor.
Does Generative AI Narrow Education-Based Productivity Gaps? Evidence From A Randomized Experiment
Guillermo Cruces, Diego Fernandez Meijide, Sebastian Galiani, Ramiro Galvez, Maria Lombardi. (08/2026). arXiv.
AI assistance closed about three-quarters of the baseline performance gap between higher- and lower-education participants, raising scores for both groups but with substantially larger gains for lower-education adults.
Eduzone: A Framework For Evaluating LLM Safety For K-12 Students And Teachers
Junyeong Park, Jieun Han, Haneul Yoo, So-Yeon Ahn, Jinsung Yoon, Alice Oh. (08/2026). arXiv.
Models were more vulnerable to education-specific risks than conventional harms, with average attack success rates reaching 80.3% for student academic misconduct and 73.0% for excessive cognitive load.
The Agency Gap In AI-Supported Writing: How Reactive And Proactive Agent Designs Shape Multimodal Reasoning
Yueqiao Jin, Kaixun Yang, Roberto Martinez-Maldonado, Dragan Gašević, Lixiang Yan. (07/2026). arXiv.
Proactive AI dialogues fostered stronger connections among conceptual reasoning, evidence use, and constructive engagement, whereas reactive interactions were more factual and procedural.
A Framework For Developing University Policies On Generative AI Governance: A Cross-National Comparative Study
Ming Li, Qin Xie, Ariunaa Enkhtur, Shuoyang Meng, Lilan Chen, Beverley Anne Yamamoto, Fei Cheng, Masayuki Murakami. (07/2026). arXiv.
All 31 sampled U.S. universities issued guidelines emphasizing faculty autonomy and practical applications, whereas 27 Japanese universities adopted a cautious, government-aligned model and only 6 Chinese universities published institutional guidelines.
Generative AI And Agency In Education: A Critical Scoping Review And Thematic Analysis
Jasper Roe, Mike Perkins. (07/2026). arXiv.
Literature on educational generative AI focuses on three primary themes: control in digital spaces, variable engagement and access, and changing notions of human-AI agency.
AI-Integrated Scientific Inquiry: A Practice-Centered Vision For Science Education
Arne Bewersdorff, Matias Rojas, Xiaoming Zhai. (07/2026). arXiv.
Artificial intelligence can be integrated into science education as simplified, pedagogically bounded scientific tools mapped directly onto established Next Generation Science Standards practices.
From Novelty To Normalisation: Tracking Changing Perceptions Of AI In Higher Education, 2024-2026
Juliana Gerard, Morgan Macleod, Kelly Norwood, Aisling Reid, Muskaan Singh. (07/2026). arXiv.
Familiarity and practical experience with AI tools increased across students and staff between 2024 and 2026, shifting AI from a novelty into routine academic practice.
Generative AI Can Harm Teaching
Alp Sungu, Benjamin Lira, Angela Lee Duckworth. (07/2026). SSRN.
Providing teachers with an AI support tool reduced student intrinsic motivation by 0.11 standard deviations, with students rating courses as less enjoyable, interesting, and important.
Cost-Efficient Generative AI Summarization For Scalable Automated Essay Scoring In Educational Assessment
Haowei Hua. (07/2026). arXiv.
GPT-5 mini achieved the highest human-machine scoring agreement (QWK of 0.8435), slightly outperforming full GPT-5 (0.8350) and GPT-5 nano (0.8332).
Student Evaluation Of Repeated AI Feedback Across A Semester Of Writing
Andres Karjus, Janika Leoste, Tiia Õun. (07/2026). arXiv.
Students found AI feedback helpful 57% of the time and actionable 53% of the time, though positive reactions declined over the semester.
How Well Does AI-Generated Feedback Work? Intrinsic And Extrinsic Evaluation Across More Than 20,000 Efl Essay Drafts
Steven Coyne, Diana Galvan-Sosa, Ryan Spring, Machi Shimmei, Michael Zock, Keisuke Sakaguchi, Kentaro Inui. (07/2026). arXiv.
Expert teacher ratings of feedback quality did not significantly align with students' thumbs-up or thumbs-down ratings (p=0.0625).
Measuring How Students Rely On Generative AI In Academic Writing: Development And Multi-Source Validation Of The Generative AI Reliance Types Scale (Genai-Rts)
Shahin Hossain, Tukhbita Afroz Nawmi. (07/2026). arXiv.
A five-factor structure fit student writing reliance best, distinguishing deliberate use, critical evaluation, instrumental reliance, dependent reliance, and dialogic reliance.
Learning In Blocks: A Multi Agent Debate Assisted Personalized Adaptive Learning Framework For Language Learning
Nicy Scaria, Silvester John Joseph Kennedy, Deepak Subramani. (07/2026). arXiv.
Combining multi-agent debate scoring and recommendations with mastery-based progression and spaced review yielded significantly higher gains across grammar, vocabulary, and communication than feedback alone.
How Annotation Trains Annotators: Competence Development In Social Influence Recognition
Maciej Markiewicz, Beata Bajcar, Wiktoria Mieleszczenko-Kowszewicz, Aleksander Szczęsny, Tomasz Adamczyk, Grzegorz Chodak, Karolina Ostrowska, Aleksandra Sawczuk, Jolanta Babiak, Jagoda Szklarczyk, Przemyslaw Kazienko. (07/2026). arXiv.
Annotators became significantly faster, reducing average annotation time from 6.56 to 5.86 minutes per text, while their self-perceived competence and confidence increased significantly.
The Generative AI Learning Penalty: Evidence from Chinese Secondary Education
David Stromberg, Victor Lei, Yanhui Wu. (07/2026). SSRN.
AI adoption raised homework scores by 18% and cut completion time by 30%, but lowered monthly exam scores by 20% within six months.
Comparing Teacher And AI-Generated Feedback In The Writing Classroom: Experimental Results From Secondary School Classrooms
Jennifer Meyer, Marlene Steinbach, Ronja Schiller, Ute Mertens, Nils-Jonathan Schaller, Andrea Horbach, Johanna Fleckenstein, Olaf Köller, Rene F. Kizilcec, Thorben Jansen. (06/2026). Proceedings of the 13th ACM Conference on Learning @ Scale (L@S ’26).
Performance differences between teacher feedback and AI-generated feedback were small and neither statistically nor practically significant.
AI In The Wild: A Large Scale Analysis Of Authentic Interactions Of College Students With Generative AI
Taelin Karidi, Ofra Amir, Ido Roll. (06/2026). arXiv.
Student interactions concentrated in recurring patterns, with roughly half directed toward the task or domain, about 30% toward AI output, and about 20% toward students' own work.
An Empirical Study To Understand How Students Use ChatGPT For Writing Essays
Andrew Jelson, Daniel Manesh, Alice Jang, Daniel Dunlap, Young-Ho Kim, Sang Won Lee. (06/2026). arXiv.
Over half of participants used queries delegating the entire writing process, with 19.5% submitting essays that were entirely written by ChatGPT through iterative prompting or direct generation.
The Impact Of Generative Artificial Intelligence On Academic Development Of Chinese Students In Humanities And Social Sciences
Lei Fan, Fangxue Liu. (06/2026). arXiv.
Most surveyed students reported improvements in learning efficiency (96.07%), academic performance (79.45%), and active learning motivation (65.03%) from using generative AI.
Analyzing Students' Statistics Writing Before And After The Emergence Of Large Language Models
Sara Colando, Erin Franke, Gordon Weinberg, Alex Reinhart. (06/2026). arXiv.
Undergraduate statistics reports shifted toward a mixture of AI and expert styles, showing more informational density, longer words, and more nominalizations after large language models emerged.
