Breadcrumb
- Home
- Generative AI For Education Hub
- Research Study Repository
- Impact – Randomized Controlled Trial
Search and Filter
Submit a research study
Contribute to the repository:
Impact – Randomized Controlled Trial
Research synthesis is AI-generated, human reviewed. Updated 09/2025.
Displaying 61 - 90 of 91
Computational Language Analysis Reveals that Process-Oriented Thinking About Belonging Aids the College Transition
Dorottya Demszky, C. Lee Williams, Shannon T. Brady, Shashanka Subrahmanya, Eric Gaudiello, Gregory M. Walton, Johannes C. Eichstaedt. (09/2024). EdWorkingPapers. https://edworkingpapers.com/sites/default/files/ai24-1033.pdf
Mentigo: An Intelligent Agent for Mentoring Students in the Creative Problem Solving Process
Siyu Zha, Yujia Liu, Chengbo Zheng, Jiaqi XU, Fuze Yu, Jiangtao Gong, Yingqing XU. (09/2024). arXiv. http://arxiv.org/pdf/2409.14228v1
Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perception
Harsh Kumar, Ilya Musabirov, Mohi Reza, Jiakai Shi, Xinyuan Wang, Joseph Jay Williams, Anastasia Kuzminykh, Michael Liut. (08/2024). arXiv. http://arxiv.org/pdf/2310.13712v3
Generative AI enhances individual creativity but reduces the collective diversity of novel content
Anil R. Doshi, Oliver P. Hauser. (07/2024). ScienceAdvances. https://www.science.org/doi/10.1126/sciadv.adn5290
Generative AI Can Harm Learning
Hamsa Bastani, Osbert Bastani, Alp Sungu, Haosen Ge, Ozge Kabaci, Rei Mariman. (07/2024). SSRN. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4895486
Using Llms To Bring Evidence-Based Feedback Into The Classroom: AI-Generated Feedback Increases Secondary Students' Text Revision, Motivation, And Positive Emotions
Jennifer Meyer, Thorben Jansen, Ronja Schiller, Lucas W. Liebenow, Marlene Steinbach, Andrea Horbach, Johanna Fleckenstein. (06/2024). Computers and Education: Artificial Intelligence. https://www.sciencedirect.com/science/article/pii/S2666920X23000784
Effectiveness of Using ChatGPT as a Tool to Strengthen Benefits of the Flipped Learning Strategy
Gilberto Huesca, Yolanda Mart’nez-Trevi–o, JosŽ Mart’n Molina-Espinosa, Ana Raquel Sanrom‡n-Calleros, Roberto Mart’nez-Rom‡n, Eduardo Antonio Cendejas-Castro and Raime Bustos. (06/2024). Education Sciences. https://www.mdpi.com/2227-7102/14/6/660
Effective and Scalable Math Support: Experimental Evidence on the Impact of an AI- Math Tutor in Ghana
Owen Henkel, Hannah Horne-Robinson, Nessie Kozhakhmetova, Amanda Lee. (05/2024). arXiv. https://arxiv.org/pdf/2402.09809
ChatGPT-generated help produces learning gains equivalent to human tutor-authored help on mathematics skills
Zachary A. Pardos, Shreya Bhandari. (05/2024). PLOS ONE. https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0304013
AI Tutoring Outperforms Active Learning
Gregory Kestin, Kelly Miller, Anna Klales, Timothy Milbourne, Gregorio Ponti. (05/2024). Research Square. https://www.researchsquare.com/article/rs-4243877/v1
Improving Teaching at Scale: Can AI Be Incorporated Into Professional Development to Create Interactive, Personalized Learning for Teachers?
Yasemin Copur-Gencturk, Jingxian Li, Sebnem Atabas. (05/2024). American Educational Research Journal. https://journals.sagepub.com/doi/full/10.3102/00028312241248514
Chatbot dialogic reading boosts comprehension for Chinese kindergarteners with higher language skills
Xi Cheng, Li Yin, Chaochao Lin, Zhaoning Shi, Hanxiao Zheng, Leqi Zhu, Xiabi Liu, Keran Chen, Rui Dong. (04/2024). ScienceDirect. https://www.sciencedirect.com/science/article/abs/pii/S0022096523002187
The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters' Exam Performances
Allen Nie, Yash Chandak, Miroslav Suzara, Ali Malik, Juliette Woodrow, Matt Peng, Mehran Sahami, Emma Brunskill, Chris Piech. (04/2024). MyIDEAS. https://ideas.repec.org/p/osf/osfxxx/qy8zd.html
Teach AI How to Code: Using Large Language Models as Teachable Agents for Programming Education
Hyoungwook Jin, Seonghee Lee, Hyungyu Shin, Juho Kim. (03/2024). arXiv. http://arxiv.org/pdf/2309.14534v3
Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform
Dorottya Demszky, Rose E. Wang, Sean Geraghty, Carol Yu. (03/2024). ACM Digital Library. https://dl.acm.org/doi/10.1145/3636555.3636924
Mathemyths: Leveraging Large Language Models to Teach Mathematical Language through Child-AI Co-Creative Storytelling
Chao Zhang, Xuechen Liu, Katherine Ziska, Soobin Jeon, Chi-Lin Yu, Ying Xu. (02/2024). arXiv. http://arxiv.org/pdf/2402.01927v2
The Impact of Student-AI Collaborative Feedback Generation on Learning Outcomes
Anjali Singh, Christopher Brooks, Xu Wang. (12/2023). OpenReview. https://openreview.net/forum?id=IQZ2dcsVq0
Challenges and Opportunities of Moderating Usage of Large Language Models in Education
Lars Krupp, Steffen Steinert, Maximilian Kiefer-Emmanouilidis, Karina E. Avila, Paul Lukowicz, Jochen Kuhn, Stefan KŸchemann, Jakob Karolus. (12/2023). arXiv. http://arxiv.org/pdf/2312.14969v1
Math Education With Large Language Models: Peril or Promise?
Harsh Kumar, David M. Rothschild, Daniel G. Goldstein, Jake M. Hofman. (11/2023). SSRN. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4641653
Improving Teachers' Questioning Quality through Automated Feedback: A Mixed-Methods Randomized Controlled Trial in Brick-and-Mortar Classrooms
Dorottya Demszky, Jing Liu, Heather C. Hill, Shyamoli Sanghi, Ariel Chung. (11/2023). EdWorkingPapers. https://files.eric.ed.gov/fulltext/ED638993.pdf
AI Chatbots as Multi-Role Pedagogical Agents: Transforming Engagement in CS Education
Cassie Chen Cao, Zijian Ding, Jionghao Lin, Frank Hopfgartner. (08/2023). arXiv. https://arxiv.org/pdf/2308.03992
M-Powering Teachers: Natural Language Processing Powered Feedback Improves 1:1 Instruction and Student Outcomes
Dorottya Demszky, Jing Liu. (07/2023). EdWorkingPapers. https://edworkingpapers.com/sites/default/files/ai23-759-v2.pdf
GPTeach: Interactive TA Training with GPT-based Students
Julia M. Markel, Steven G. Opferman, James A. Landay, Chris Piech. (07/2023). ACM Digital Library. https://dl.acm.org/doi/10.1145/3573051.3593393
Experimental evidence on the productivity effects of generative artificial intelligence
Shakked Noy, Whitney Zhang. (07/2023). Science. https://www.science.org/doi/10.1126/science.adh2586
The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation
Ramazan Yilmaz, Fatma Gizem Karaoglan Yilmaz. (06/2023). Computers and Education, Artificial Intelligence. https://www.sciencedirect.com/science/article/pii/S2666920X23000267
Interaction With a Television Character Powered by Artificial Intelligence Promotes Children's Science Learning
Ying Xu, Julian Levine, Valery Vigil, Daniel Ritchie, Shan Zhang, Trisha Thomas, Carlos Barrera, Michelle Meza, Andres Sebastian Bustamante, Mark Warschauer. (04/2023). EdArXiv. https://osf.io/preprints/edarxiv/m3ej9
Home-Tutoring Services Assisted with Technology: Investigating the Role of Artificial Intelligence Using a Randomized Field Experiment
Jun Hyung Kim, Minki Kim, Do Won Kwak, Sol Lee. (09/2021). Sage. https://journals.sagepub.com/doi/full/10.1177/00222437211050351
Artificial Intelligence, Teacher Tasks and Individualized Pedagogy
Bruno Ferman, Lycia Lima, Flavio Rivas. (02/2021). IDEAS. https://ideas.repec.org/p/osf/socarx/qw249.html
Experimental Evidence on Artificial Intelligence in the Classroom
Ferman, Bruno and Lima, Lycia and Riva, Flavio. (11/2020). RePEc. https://ideas.repec.org/p/pra/mprapa/103934.html
Student Learning Benefits Of A Mixed-Reality Teacher Awareness Tool In AI-Enhanced Classrooms
Kenneth Holstein, Bruce M. McLaren, Vincent Aleven. (06/2018). International Conference on Artificial Intelligence in Education. https://link.springer.com/chapter/10.1007/978-3-319-93843-1_12
