Model or benchmark evaluation

Studies tagged with AI from their full text or abstract; see each study for details.

Showing 1 - 30 of 614 studies

When Evaluators Cry Wolf: Lessons From Production LLM-As-Judge Evaluation In Educational AI

Chris Rohlfs, Rodrigo Vergara Bosse, Priscilla Rain Hopper, Keanon O'Keefe, Patrick Russell. (09/2026). arXiv. https://arxiv.org/abs/2609.28478v2
Fairness Theatre: Evaluating Post-Hoc Fairness Interventions In Vendor-Controlled Early Warning Systems

Kelly McConvey, Angelina Zhai, Rebecca Li, Shion Guha. (09/2026). arXiv. https://arxiv.org/abs/2609.38552v1
Early Prediction Of AI-Assisted Cheating Risk In Online Exams Through Learning Analytics

Gokhan Akcapınar. (09/2026). arXiv. https://arxiv.org/abs/2609.37280v1
AI-Based Scoring Systematically Underestimates Conceptual Understanding Of Linguistically Weak Students' Explanations In Physics

Markus Sebastian Feser, Paul Tschisgale. (09/2026). arXiv. https://arxiv.org/abs/2607.28210v2
LLM-As-A-Judge Validity Is Strongly Task-Dependent Across Physics Assessment Formats

Will Yeadon, Tom Hardy, Paul Mackay, and Elise Agra. (09/2026). arXiv. https://arxiv.org/abs/2603.14732v3
A Benchmark For LLM'S Understanding Of Middle School And High School Science Topics

Noah L. Schroeder, Yessy Eka Ambarwati, Yuji Zhang, ChengXiang Zhai. (09/2026). arXiv. https://arxiv.org/abs/2609.32020v1
Evaluation Of Pre-Trained Models For Pedagogical Assessment Of Novel AI-Assisted Educational Questions

Michael Lawrence Castanares, Princess Ventures, Allan Tan. (09/2026). arXiv. https://arxiv.org/abs/2609.27749v1
Studentbench: AI And Human Tutoring Yield Equivalent Gre Learning Gains

Curtis Northcutt, Inaara Hasmani, Kevin Feng, Trevor Khangi, Andreas Plesner, Jonas Mueller. (09/2026). arXiv. https://arxiv.org/abs/2609.28470?utm_source=chatgpt.com
From Content Generation To Learning Support: Pedagogy-Guided Generative Video Tutors For STEM Learning

Xinchen Ma, Shuimu Wang, Gaole He, Yanbin Zhang, Chunyang Wang, Yunshi Lan, Weining Qian. (09/2026). arXiv. https://arxiv.org/abs/2609.24083v1
A Course Intelligence Platform For Higher Education: Lessons From AI-Assisted Course Evaluation

Bo Yuan, Jiazi Hu, Haimei Zhao. (09/2026). arXiv. https://arxiv.org/abs/2411.02455v3
I Code Or AI Code: A Comparative Evaluation Of AI-Rated Scores In Classroom Observations

Yasmin Fong, Jane Xiang, Tak-Yue Dickson Chan, Kerry Lee, Eva Yi Hung Lau. (09/2026). arXiv. https://arxiv.org/abs/2609.18274v1
The Role Of Implicit And Explicit Demographic Signals In Large Language Model-Based Student Assessment

Donya Rooein, Luca Benedetto, Dirk Hovy. (09/2026). arXiv. https://arxiv.org/abs/2609.16993v1
Towards Scalable Measurement Of Durable Skills

Amir Globerson, Amy Keeling, Anisha Choudhury, Anna Iurchenko, Aviad Segal, Avinatan Hassidim, Ayça Çakmakli, Ben Gomes, Benn Witt, Cathy Cheunga, Cristine Legare, Diana Akrong, Eliad Carmi, Elisabeth Bauer, Gal Elidan, Hadas Gelbart, Hairong Mu, Katherine Chou, Lev Borovoi, Nir Kerem, Niv Efron, Noa Kerrem Gilo, Preeti Singh, Rajvi Kapadia, Rena Levitt, Roni Rabin, Ronit Levavi Morad, Rotem Yulzary, Shashank Agarwal, Sophie Allweis, Tracey Lee-Joe, Tzvika Stein, Yael Bar Moshe, Yael Haramaty, Yaniv Carmel, Yishay Mor, Yoav Bar Sinai, Yoav Bergner, Yossi Matias, Yuri Lev. (09/2026). arXiv. https://arxiv.org/abs/2609.15864v1
Limits Of LLM Text Detectors In Education

Lukas Gehring, Benjamin PaaBen. (09/2026). arXiv. https://arxiv.org/abs/2508.08096v2
Generative AI Performance In Core Undergraduate Mathematics: A Curriculum-Level Case Study

Benjamin J. Walker, Nikoleta Kalaydzhieva, Beatriz Navarro Lameda, Ruth A. Reynolds. (09/2026). arXiv. https://arxiv.org/abs/2509.13359v4
A Human-In-The-Loop Framework For AI-Assisted Scoring In Large-Scale Writing Assessment

María Eugenia Curi, German Capdehourat, Isabel Amigo, Magdalena Romano, Rosana Serra, Adrian Silveira, Andres Peri. (09/2026). arXiv. https://arxiv.org/abs/2609.05143v1
Eduguard: A Safe RAG-Based LLM Tutor For Programming Education

S M Asif Hossain, Ruksat Khan Shayoni, M. F. Mridha, Jungpil Shin. (09/2026). arXiv. https://arxiv.org/abs/2607.15738v2
A Prompt-Engineering Approach To Develop Scalable, Flexible, And Real-Time Hybrid Micro-Level Personalization In A General Purpose AI Teaching Assistant

Saptarshi Basu, Sandeep Kakar, Ashok Goel. (09/2026). arXiv. https://arxiv.org/abs/2609.03402v1
Beyond Helpfulness: A Teaching-Over-Solving Diagnostic For Measuring Educational Impact In LLM Tutors

Junyi Yao, Zihao Zheng, Baichuan Li. (08/2026). arXiv. https://arxiv.org/abs/2606.16206v2
When Saying No Makes Better Videos: Designing Dual Gatekeeping For Pedagogically Grounded AI Content Creation

Yearim Kim, Injun Baek, Nojun Kwak. (08/2026). arXiv. https://arxiv.org/abs/2608.19812v2
Learning To Prompt: Improving Student Engagement With Adaptive LLM-Based High-School Tutoring

Po-Chin Chang, Nicholas Hogan, Aske Plaat, Michiel T. van der Meer. (08/2026). arXiv. https://arxiv.org/abs/2606.20138v2
ChatGPT Solves All Tested Qiskit Homework Assignments

Alexei Kaltchenko, Gurnivaj Tiwana. (08/2026). arXiv. https://arxiv.org/abs/2608.19707v1
Large-Scale AI Grading Of Handwritten Physics Assessments: Score Agreement And Olympiad Team Selection Outcomes

Praveen Pathak, Siddharth Tiwary, Charudatt Kadolkar, Vijay Singh, David J. Rakestraw, Shirish Pathare, Anwesh Mazumdar. (08/2026). arXiv. https://arxiv.org/abs/2608.20521v1
Mitigating AI Risks In Computing Education Via LLM-Driven Lecture Video Curation

Owen Tang, Alexandra Vassar, Jake Renzella. (08/2026). arXiv. https://arxiv.org/abs/2608.16131v1
Revisiting The Performance Of Generative Artificial Intelligence On Introductory Object-Oriented Programming Assessments: Insights From 2026

Marina Lepp, Joosep Kaimre. (08/2026). arXiv. https://arxiv.org/abs/2608.16318v1
Do Assessment Instruments Measure The Same Thing For Humans And LLMs? A Latent Structure Analysis

Alona Strugatski, Licol Zeinfeld, Giora Alexandron. (08/2026). arXiv. https://arxiv.org/abs/2608.15630v1
INSIDE the Student's Mind: Jointly Modeling Latent Reasoning and Action in LLM Student Simulators

Rose Niousha, Minwoo Kang, Narges Norouzi. (08/2026). arXiv. https://arxiv.org/abs/2608.10492v2
Semantic Variability Of LLM-Generated Replies Across LLMs: Implications For Designing Conversation-Based Assessment

Jiangang Hao. (08/2026). arXiv. https://arxiv.org/abs/2608.24920v1
Probing AI-Generated Physics Solutions And Preparing Students To Critique Them

Nikhil Sanjay Borse, Amir Bralin, Sean Savage, N. Sanjay Rebello. (08/2026). arXiv. https://arxiv.org/abs/2608.12533v1
Methodologies For Improving The Quality Of AI Tutoring In K-12 Education

Tushar Udeshi, Anna Khazenzon, Kabir Khan, Nick Breen, RJ Corwin, Chris DiGiano, Kodi Weatherholtz, Marek Zaluski. (08/2026). arXiv. https://arxiv.org/abs/2608.11259v1