Breadcrumb
- Home
- AI Hub For Education
- Research Study Repository
- Impact – Randomized Controlled Trial
Impact – Randomized Controlled Trial
Research synthesis is AI-generated, human reviewed. Updated 05/2026.
Displaying 91 - 112 of 112
The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters' Exam Performances
Allen Nie, Yash Chandak, Miroslav Suzara, Ali Malik, Juliette Woodrow, Matt Peng, Mehran Sahami, Emma Brunskill, Chris Piech. (04/2024). MyIDEAS. https://ideas.repec.org/p/osf/osfxxx/qy8zd.html
Teach AI How to Code: Using Large Language Models as Teachable Agents for Programming Education
Hyoungwook Jin, Seonghee Lee, Hyungyu Shin, Juho Kim. (03/2024). arXiv. http://arxiv.org/pdf/2309.14534v3
Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform
Dorottya Demszky, Rose E. Wang, Sean Geraghty, Carol Yu. (03/2024). ACM Digital Library. https://dl.acm.org/doi/10.1145/3636555.3636924
Mathemyths: Leveraging Large Language Models to Teach Mathematical Language through Child-AI Co-Creative Storytelling
Chao Zhang, Xuechen Liu, Katherine Ziska, Soobin Jeon, Chi-Lin Yu, Ying Xu. (02/2024). arXiv. http://arxiv.org/pdf/2402.01927v2
The Impact of Student-AI Collaborative Feedback Generation on Learning Outcomes
Anjali Singh, Christopher Brooks, Xu Wang. (12/2023). OpenReview. https://openreview.net/forum?id=IQZ2dcsVq0
Challenges and Opportunities of Moderating Usage of Large Language Models in Education
Lars Krupp, Steffen Steinert, Maximilian Kiefer-Emmanouilidis, Karina E. Avila, Paul Lukowicz, Jochen Kuhn, Stefan KŸchemann, Jakob Karolus. (12/2023). arXiv. http://arxiv.org/pdf/2312.14969v1
Improving Teachers' Questioning Quality through Automated Feedback: A Mixed-Methods Randomized Controlled Trial in Brick-and-Mortar Classrooms
Dorottya Demszky, Jing Liu, Heather C. Hill, Shyamoli Sanghi, Ariel Chung. (11/2023). EdWorkingPapers. https://files.eric.ed.gov/fulltext/ED638993.pdf
Math Education With Large Language Models: Peril or Promise?
Harsh Kumar, David M. Rothschild, Daniel G. Goldstein, Jake M. Hofman. (11/2023). SSRN. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4641653
AI Chatbots as Multi-Role Pedagogical Agents: Transforming Engagement in CS Education
Cassie Chen Cao, Zijian Ding, Jionghao Lin, Frank Hopfgartner. (08/2023). arXiv. https://arxiv.org/pdf/2308.03992
Experimental evidence on the productivity effects of generative artificial intelligence
Shakked Noy, Whitney Zhang. (07/2023). Science. https://www.science.org/doi/10.1126/science.adh2586
GPTeach: Interactive TA Training with GPT-based Students
Julia M. Markel, Steven G. Opferman, James A. Landay, Chris Piech. (07/2023). ACM Digital Library. https://dl.acm.org/doi/10.1145/3573051.3593393
M-Powering Teachers: Natural Language Processing Powered Feedback Improves 1:1 Instruction and Student Outcomes
Dorottya Demszky, Jing Liu. (07/2023). EdWorkingPapers. https://edworkingpapers.com/sites/default/files/ai23-759-v2.pdf
The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation
Ramazan Yilmaz, Fatma Gizem Karaoglan Yilmaz. (06/2023). Computers and Education, Artificial Intelligence. https://www.sciencedirect.com/science/article/pii/S2666920X23000267
Interaction With a Television Character Powered by Artificial Intelligence Promotes Children's Science Learning
Ying Xu, Julian Levine, Valery Vigil, Daniel Ritchie, Shan Zhang, Trisha Thomas, Carlos Barrera, Michelle Meza, Andres Sebastian Bustamante, Mark Warschauer. (04/2023). EdArXiv. https://osf.io/preprints/edarxiv/m3ej9
Home-Tutoring Services Assisted with Technology: Investigating the Role of Artificial Intelligence Using a Randomized Field Experiment
Jun Hyung Kim, Minki Kim, Do Won Kwak, Sol Lee. (09/2021). Sage. https://journals.sagepub.com/doi/full/10.1177/00222437211050351
Artificial Intelligence, Teacher Tasks and Individualized Pedagogy
Bruno Ferman, Lycia Lima, Flavio Rivas. (02/2021). IDEAS. https://ideas.repec.org/p/osf/socarx/qw249.html
Experimental Evidence on Artificial Intelligence in the Classroom
Ferman, Bruno and Lima, Lycia and Riva, Flavio. (11/2020). RePEc. https://ideas.repec.org/p/pra/mprapa/103934.html
Student Learning Benefits Of A Mixed-Reality Teacher Awareness Tool In AI-Enhanced Classrooms
Kenneth Holstein, Bruce M. McLaren, Vincent Aleven. (06/2018). International Conference on Artificial Intelligence in Education. https://link.springer.com/chapter/10.1007/978-3-319-93843-1_12
Thinking-Fast, Slow, and Artificial: How AI is Reshaping Human Reasoning and the Rise of Cognitive Surrender
Steven D. Shaw, Gideon Nave. (01/1970). arXiv. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=6097646
From Chalkboards to Chatbots: Evaluating the Impact of Generative AI on Learning Outcomes in Nigeria
Mart¬ín De Simone, Federico Tiberti, Maria Barron Rodriguez, Federico Manolio, Wuraola Mosuro, Eliot Jolomi Dikoru. (01/1970). arXiv. https://documents.worldbank.org/en/publication/documents-reports/documentdetail…
AI Assistance Reduces Persistence and Hurts Independent Performance
Grace Liu, Brian Christian, Tsvetomira Dumbalska, Michiel A. Bakker, Rachit Dubey. (01/1970). arXiv. https://arxiv.org/abs/2604.04721
AI For Proactive Mental Health: A Longitudinal, Multi-Institutional Trial
Julie Y. A. Cachia, Xuan Zhao, John Hunter, Delancey Wu, Eta Lin, Julian De Freitas. (). Harvard Business School. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5718163

