Breadcrumb
- Home
- AI Hub For Education
- Research Study Repository
- Impact – Randomized Controlled Trial
Impact – Randomized Controlled Trial
Research synthesis is AI-generated, human reviewed. Updated 09/2025.
Displaying 61 - 90 of 99
Beware of Metacognitive Laziness: Effects of Generative Artificial Intelligence on Learning Motivation, Processes, and Performance
Yizhou Fan, Luzhen Tang, Huixiao Le, Kejie Shen, Shufang Tan, Yueying Zhao, Yuan Shen, Xinyu Li, Dragan Gasevic. (12/2024). arXiv. https://arxiv.org/pdf/2412.09315
Augmenting Minds Or Automating Skills? The Differential Role Of Human Capital In Generative Ai's Impact On Creative Tasks
Meiling Huang, Ming Jin, Ning Li. (12/2024). arXiv. https://arxiv.org/pdf/2412.03963
Exploring the Effectiveness of AI Course Assistants on the Student Learning Experience
George Hanshaw, Joanna Vance, Craig Brewer. (11/2024). Open Praxis. https://openpraxis.org/articles/719/files/6765805344fd4.pdf
Cognitive ease at a cost: LLMs reduce mental effort but compromise depth in student scientific inquiry
Matthias Stadler, Maria Bannert, Michael Sailer. (11/2024). Computers in Human Behavior. https://www.sciencedirect.com/science/article/pii/S0747563224002541?via%3Dihub
PromptHive: Bringing Subject Matter Experts Back to the Forefront with Collaborative Prompt Engineering for Educational Content Creation
Mohi Reza, Ioannis Anastasopoulos, Shreya Bhandari, Zachary A. Pardos. (10/2024). arXiv. http://arxiv.org/pdf/2410.16547v1
Emotionally Enriched Feedback Via Generative AI
Omar Alsaiari, Nilufar Baghaei, Hatim Lahza, Jason M. Lodge, Marie Boden, Hassan Khosravi. (10/2024). arXiv. https://arxiv.org/pdf/2410.15077
PAIGE: Examining Learning Outcomes and Experiences with Personalized AI-Generated Educational Podcasts
Tiffany D. Do, Usama Bin Shafqat, Elsie Ling, Nikhil Sarda. (10/2024). arXiv. https://arxiv.org/pdf/2409.04645
Mentigo: An Intelligent Agent for Mentoring Students in the Creative Problem Solving Process
Siyu Zha, Yujia Liu, Chengbo Zheng, Jiaqi XU, Fuze Yu, Jiangtao Gong, Yingqing XU. (09/2024). arXiv. http://arxiv.org/pdf/2409.14228v1
GPT-4 as a Homework Tutor can Improve Student Engagement and Learning Outcomes
Alessandro Vanzo, Sankalan Pal Chowdhury, Mrinmaya Sachan. (09/2024). arXiv. https://arxiv.org/pdf/2409.15981
Computational Language Analysis Reveals that Process-Oriented Thinking About Belonging Aids the College Transition
Dorottya Demszky, C. Lee Williams, Shannon T. Brady, Shashanka Subrahmanya, Eric Gaudiello, Gregory M. Walton, Johannes C. Eichstaedt. (09/2024). EdWorkingPapers. https://edworkingpapers.com/sites/default/files/ai24-1033.pdf
Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perception
Harsh Kumar, Ilya Musabirov, Mohi Reza, Jiakai Shi, Xinyuan Wang, Joseph Jay Williams, Anastasia Kuzminykh, Michael Liut. (08/2024). arXiv. http://arxiv.org/pdf/2310.13712v3
Generative AI enhances individual creativity but reduces the collective diversity of novel content
Anil R. Doshi, Oliver P. Hauser. (07/2024). ScienceAdvances. https://www.science.org/doi/10.1126/sciadv.adn5290
Generative AI Can Harm Learning
Hamsa Bastani, Osbert Bastani, Alp Sungu, Haosen Ge, Ozge Kabaci, Rei Mariman. (07/2024). SSRN. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4895486
Effectiveness of Using ChatGPT as a Tool to Strengthen Benefits of the Flipped Learning Strategy
Gilberto Huesca, Yolanda Mart’nez-Trevi–o, JosŽ Mart’n Molina-Espinosa, Ana Raquel Sanrom‡n-Calleros, Roberto Mart’nez-Rom‡n, Eduardo Antonio Cendejas-Castro and Raime Bustos. (06/2024). Education Sciences. https://www.mdpi.com/2227-7102/14/6/660
Using Llms To Bring Evidence-Based Feedback Into The Classroom: AI-Generated Feedback Increases Secondary Students' Text Revision, Motivation, And Positive Emotions
Jennifer Meyer, Thorben Jansen, Ronja Schiller, Lucas W. Liebenow, Marlene Steinbach, Andrea Horbach, Johanna Fleckenstein. (06/2024). Computers and Education: Artificial Intelligence. https://www.sciencedirect.com/science/article/pii/S2666920X23000784
AI Tutoring Outperforms Active Learning
Gregory Kestin, Kelly Miller, Anna Klales, Timothy Milbourne, Gregorio Ponti. (05/2024). Research Square. https://www.researchsquare.com/article/rs-4243877/v1
Improving Teaching at Scale: Can AI Be Incorporated Into Professional Development to Create Interactive, Personalized Learning for Teachers?
Yasemin Copur-Gencturk, Jingxian Li, Sebnem Atabas. (05/2024). American Educational Research Journal. https://journals.sagepub.com/doi/full/10.3102/00028312241248514
ChatGPT-generated help produces learning gains equivalent to human tutor-authored help on mathematics skills
Zachary A. Pardos, Shreya Bhandari. (05/2024). PLOS ONE. https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0304013
Effective and Scalable Math Support: Experimental Evidence on the Impact of an AI- Math Tutor in Ghana
Owen Henkel, Hannah Horne-Robinson, Nessie Kozhakhmetova, Amanda Lee. (05/2024). arXiv. https://arxiv.org/pdf/2402.09809
Chatbot dialogic reading boosts comprehension for Chinese kindergarteners with higher language skills
Xi Cheng, Li Yin, Chaochao Lin, Zhaoning Shi, Hanxiao Zheng, Leqi Zhu, Xiabi Liu, Keran Chen, Rui Dong. (04/2024). ScienceDirect. https://www.sciencedirect.com/science/article/abs/pii/S0022096523002187
The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters' Exam Performances
Allen Nie, Yash Chandak, Miroslav Suzara, Ali Malik, Juliette Woodrow, Matt Peng, Mehran Sahami, Emma Brunskill, Chris Piech. (04/2024). MyIDEAS. https://ideas.repec.org/p/osf/osfxxx/qy8zd.html
Teach AI How to Code: Using Large Language Models as Teachable Agents for Programming Education
Hyoungwook Jin, Seonghee Lee, Hyungyu Shin, Juho Kim. (03/2024). arXiv. http://arxiv.org/pdf/2309.14534v3
Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform
Dorottya Demszky, Rose E. Wang, Sean Geraghty, Carol Yu. (03/2024). ACM Digital Library. https://dl.acm.org/doi/10.1145/3636555.3636924
Mathemyths: Leveraging Large Language Models to Teach Mathematical Language through Child-AI Co-Creative Storytelling
Chao Zhang, Xuechen Liu, Katherine Ziska, Soobin Jeon, Chi-Lin Yu, Ying Xu. (02/2024). arXiv. http://arxiv.org/pdf/2402.01927v2
The Impact of Student-AI Collaborative Feedback Generation on Learning Outcomes
Anjali Singh, Christopher Brooks, Xu Wang. (12/2023). OpenReview. https://openreview.net/forum?id=IQZ2dcsVq0
Challenges and Opportunities of Moderating Usage of Large Language Models in Education
Lars Krupp, Steffen Steinert, Maximilian Kiefer-Emmanouilidis, Karina E. Avila, Paul Lukowicz, Jochen Kuhn, Stefan KŸchemann, Jakob Karolus. (12/2023). arXiv. http://arxiv.org/pdf/2312.14969v1
Math Education With Large Language Models: Peril or Promise?
Harsh Kumar, David M. Rothschild, Daniel G. Goldstein, Jake M. Hofman. (11/2023). SSRN. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4641653
Improving Teachers' Questioning Quality through Automated Feedback: A Mixed-Methods Randomized Controlled Trial in Brick-and-Mortar Classrooms
Dorottya Demszky, Jing Liu, Heather C. Hill, Shyamoli Sanghi, Ariel Chung. (11/2023). EdWorkingPapers. https://files.eric.ed.gov/fulltext/ED638993.pdf
AI Chatbots as Multi-Role Pedagogical Agents: Transforming Engagement in CS Education
Cassie Chen Cao, Zijian Ding, Jionghao Lin, Frank Hopfgartner. (08/2023). arXiv. https://arxiv.org/pdf/2308.03992
M-Powering Teachers: Natural Language Processing Powered Feedback Improves 1:1 Instruction and Student Outcomes
Dorottya Demszky, Jing Liu. (07/2023). EdWorkingPapers. https://edworkingpapers.com/sites/default/files/ai23-759-v2.pdf

