Breadcrumb
- Home
- AI Hub For Education
- Research Study Repository
- Outcomes – Other Academic
Search and Filter
The Repository
Outcomes – Other Academic
Research synthesis is AI-generated, human reviewed. Updated 11/2026.
Displaying 1 - 30 of 864
Calibrating LLM Tutor Initiation to Learner Expertise: Proactive and Reactive Support for Computational Thinking
Arun Rai, Liwei Chen, Balasubramaniam Ramesh, Cynthia Breazeal, Yuan Long, Benjamin M. Ampel, Andrea Aria. (11/2026). SSRN.
Overall, there was no average treatment effect on computational thinking across all 90 students.
Prompt-Based Emotional Scaffolding In Generative AI: Effects On Self-Regulated Learning And Socio-Emotional Outcomes
Elena-Alexandra Diordiev, Valdemar Aksel Stenberdt, Guido Makransky. (10/2026). British Journal of Educational Technology.
Students across all conditions improved in conceptual knowledge and transfer from pretest to posttest, with no significant differences between conditions in post-to-follow-up changes.
Supporting Perspective Acquisition And Opinion Formation On Societal Issues Through AI-Generated Japanese Rap Battle Debates
Ryota Mibayashi, Toru Urakawa, Dai Takanashi, Tomoya Morohoshi, Kanata Yamagishi, Ryuho Sekikawa, Yasuhiko Nishimura, Yuta Takeuchi, Hideaki Tamori, Takehiro Yamamoto, Hidenari Kiyomitsu, Hiroaki Ohshima. (10/2026). arXiv.
Watching 1.5-minute rap battle debates nearly doubled the number of opinions and discussion points identified by participants, rising from 254 to 501 points.
Experimental Evidence on the Learning Impact of Generative AI
Zara Contractor, German Reyes. (10/2026). arXiv.
AI access increased immediate test scores by 7.2 percentage points (0.28 standard deviations), and a smaller gain of 3.9 percentage points persisted one week later.
The Effects Of Course-Integrated AI Tutoring On Student Performance And Engagement: A Randomized University Trial
Jing Liu, Tracy Sweet, Marty Haoyuan Chen, Jonathan Engelberg, Megan C. Masters, Martyn Clark, Axel Persaud, Alia Lancaster, Jeffrey Hollingsworth, Jennifer King Rice. (10/2026). EdWorking Papers.
Among sections of the same course, access to the AI tutor reduced final grades by 0.37 standard deviations and learning management system participation by 0.90 standard deviations.
When Evaluators Cry Wolf: Lessons From Production LLM-As-Judge Evaluation In Educational AI
Chris Rohlfs, Rodrigo Vergara Bosse, Priscilla Rain Hopper, Keanon O'Keefe, Patrick Russell. (09/2026). arXiv.
Across 21 deployed evaluators, the calibration strategy cut confirmed false-positive flags by 99% and raised per-flag precision from 0.6% to 48.9%.
Critical Thinking With Generative AI: A Constraint-First Design Pilot Of A Thinking-Partner Intervention
Fatima Tuz Zahra, Jiangen He, David Matthew Bowers, Wei Wang. (09/2026). arXiv.
Undergraduate students showed significant gains on all ten statistics learning dimensions and on eight of nine AI literacy dimensions after the semester-long intervention.
Fairness Theatre: Evaluating Post-Hoc Fairness Interventions In Vendor-Controlled Early Warning Systems
Kelly McConvey, Angelina Zhai, Rebecca Li, Shion Guha. (09/2026). arXiv.
Post-hoc fairness interventions redistributed disparities without consistently reducing them, leaving error burdens for marginalized groups intact or worse while dashboard metrics appeared to improve.
Making The Invisible Visible: A Framework For Reflective AI Use In Software Engineering Education
Ali Shakiba, Thomas Chaffey. (09/2026). arXiv.
Retained students reported high perceived utility of AI assistance (mean 4.42/5) and high confidence in evaluating AI-generated outputs (mean 4.52/5).
AI-Based Scoring Systematically Underestimates Conceptual Understanding Of Linguistically Weak Students' Explanations In Physics
Markus Sebastian Feser, Paul Tschisgale. (09/2026). arXiv.
Across all 11 AI scoring approaches, lower writing quality was associated with 1.3- to 3.9-times higher odds of underestimating students' conceptual understanding in physics.
"Code Is Cheap. Show Me The Talk.": Lessons From Teaching And Managing AI Coding Tool Usage In A Visualization Course
Zhongzheng Xu, Taehyun Yang, Fumeng Yang. (09/2026). arXiv.
About half of students' prompts in AI-coding labs focused on refining existing charts, while generating new code accounted for roughly one third of turns.
Faster But Not Wiser: Github Copilot Decouples Programming Performance From Code Comprehension In Brownfield Tasks
Yunhan Qiao, Md Istiak Hossain Shihab, Summit Haque, Christopher Hundhausen. (09/2026). arXiv.
Copilot reduced completion time by 50.7 percent and increased passed tests by 71.4 percent, but participants showed no corresponding improvement in overall comprehension.
LLM-As-A-Judge Validity Is Strongly Task-Dependent Across Physics Assessment Formats
Will Yeadon, Tom Hardy, Paul Mackay, and Elise Agra. (09/2026). arXiv.
AI models showed robust rank-order agreement with human marks on structured questions and code-based plots, but achieved near-zero rank-order agreement when marking short-form physics essays.
Psychological Factors Influencing University Students' Trust In AI-Based Learning Assistants
Ezgi Dagtekin, Ercan Erkalkan. (09/2026). arXiv.
Higher cognitive appraisals, such as perceived competence, accuracy, and usefulness, are consistently associated with increased trust, continuance intention, and perceived learning support.
Beyond Simple Input-Output Assessment Tasks: Leveraging Automated Programming Assessment For Non-Trivial Courses
Artur Jordao. (09/2026). arXiv.
More than 60% of surveyed students fully agreed that the automated grading exercises improved the integration of theory and practice.
Characterizing LLM-Based Family Education Through The Lens Of Activity Theory: A Scoping Review Of The Hci Literature
Lan Luo, Yuqi Liang, Jie Cai, Anqi Wang, Dongyijie Primo Pan, Muzhi Zhou, Chun Yu, Pan Hui. (09/2026). arXiv.
Most reviewed studies focused on child–parent interaction (83%) and centered on language, narrative, AI literacy, and relational development rather than mathematical or scientific inquiry.
Judgment-Centred Software Engineering Education: A Post-Hype Review And Framework For AI-Augmented Learning
Qusay H. Mahmoud. (09/2026). arXiv.
Generative AI can improve access to explanations and practice, but effects on assessed learning are highly uneven and depend on scaffolding, prior knowledge, and task design.
Studentbench: AI And Human Tutoring Yield Equivalent Gre Learning Gains
Curtis Northcutt, Inaara Hasmani, Kevin Feng, Trevor Khangi, Andreas Plesner, Jonas Mueller. (09/2026). arXiv.
AI tutoring produced learning gains statistically equivalent to expert human tutoring on the combined GRE assessment (p=.015).
Towards Synergistic Teacher-AI Interactions With Generative Artificial Intelligence
Mutlu Cukurova, Wannapon Suraworachet, Qi Zhou, Sahan Bulathwela. (09/2026). arXiv.
Among reviewed generative AI studies supporting teachers, operational teaming was most common (62.5%), followed by transactional (17.5%), situational (17.5%), and praxical teaming (2.5%).
Little Impact Of ChatGPT On High School Test Scores
Nick Huntington-Klein. (09/2026). arXiv.
Higher educational ChatGPT use had an insignificant effect on high school test scores that was close to zero, bounded below roughly 0.04 standard deviations.
From Content Generation To Learning Support: Pedagogy-Guided Generative Video Tutors For STEM Learning
Xinchen Ma, Shuimu Wang, Gaole He, Yanbin Zhang, Chunyang Wang, Yunshi Lan, Weining Qian. (09/2026). arXiv.
The PIVOT framework generates educational videos with pedagogically aligned content, clear and engaging presentation, and coherent instructional flow across four STEM domains.
When AI Tutors Speak: Evidence From A Randomized Field Experiment
Shihao Yang, Marshall Van Alstyne, Chrysanthos Dellarocas. (09/2026). arXiv.
Students assigned to the structured AI tutor gained 6.63 more points on a 55-point assessment than peers in the holdout group.
A Workshop Series For Effective Use Of AI In Uncertain Times: Building A Physics Faculty Learning Community
David Perl-Nussbaum, Noah D. Finkelstein. (09/2026). arXiv.
Faculty most valued collectively airing a shared challenge, reviewing cross-course student data, and surfacing concerns, with all participants expressing interest in continuing the learning community.
Aware But Unprepared: Measuring The Security Awareness-Behavior Gap In Student Use Of LLM-Generated Code With Bifrost
Jaehwan Park, Seonhye Park, Kyungchan Lim, Doowon Kim, Doowon Kim. (09/2026). arXiv.
Over 95% of undergraduate students accepted insecure AI-generated code during programming tasks, despite 83.6% having completed security coursework.
Reducing Barriers To Academic Support: Evaluating A Course-Specific RAG System For Addressing Help-Seeking Disparities In Higher Education
Andy Gray, Jake Hobbs. (09/2026). arXiv.
Most students agreed Beacon made private help-seeking easier (86.7%) and could benefit learners with low confidence (93.3%) or concerns about judgement (80%).
Artificial Intelligence Driven Physics Assignments Using Context Prompts
Miguel Rodriguez, Peter Wulff. (09/2026). arXiv.
Context-prompted assignments helped students move beyond answer-seeking to connect introductory physics concepts directly to their jobs, hobbies, and everyday lives.
Biased AI Improves Human Performance But Reduces Perceived Helpfulness
Shiyang Lai, Jiwoong Choi, Junsol Kim, Nadav Kunievsky, Yujin Potter, James Evans. (09/2026). arXiv.
Biased AI assistants improved or preserved human performance relative to default and neutral AI across fact-checking, investment, and graduate coding tasks.
AI-Assisted Assessment Of Experimental Physics Laboratory Reports: Potential, Limitations, And Support For Teaching Practice
Marcos Abreu, Cecilia Stari, Arturo C. Marti. (09/2026). arXiv.
Differences between AI and instructor assessments may stem from difficulties retrieving and interpreting equations, graphs, tables, and units rather than purely reasoning limitations.
Your Programming Students' Cognition With ChatGPT: Higher Performance, Lower Retention, And Reduced Ownership
Christian Bergh, Benjamin Tag, Alexandra Vassar, Jake Renzella. (09/2026). arXiv.
ChatGPT-assisted students achieved higher coding scores (89% vs. 69%), but scored significantly lower on recall quizzes immediately (41% vs. 53%) and 48 hours later (39% vs. 52%).
Teaching AI, Robotics, & Community: A Hubs-Based K-12 Education Framework For Reaching Rural Schools
Maxwell J. Jacobson, Gustavo Rodriguez-Rivera, Petros Drineas, Yexiang Xue. (09/2026). arXiv.
A simulation under moderate conditions projected the framework would reach 74% of Indiana's 1,925 public K-12 schools and create 992 robotics programs over 40 years, compared to 161 under natural growth.
