Search and Filter

Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

The Role Of Instructional Guidance In Generative AI-Assisted Learning: Empirical Evidence From Construction Engineering Education

Date
Publisher
arXiv
Generative artificial intelligence (AI) is increasingly used to support self-directed learning, yet student interaction with such systems often remains unstructured, limiting engagement in deeper cognitive processes. This study examines how instructional guidance shapes student and AI interaction in construction education. A five-step prompting framework grounded in Generative Learning Theory (GLT) is introduced to guide learner interaction during review activities. A controlled experiment compares three learning conditions: slide-based learning, unprompted AI-supported learning, and prompted AI-supported learning. Learning performance is assessed using multiple-choice and open-ended tasks, and user experience is measured using the User Experience Questionnaire (UEQ). Performance differences are concentrated on tasks requiring explanation and reasoning. The prompted condition achieves higher open-ended scores, with an improvement of approximately 2 or 3 points on a scale of 18 (p < 0.01), while no significant differences are observed in multiple-choice performance. The unprompted condition remains comparable to slide-based learning. These findings indicate that the effectiveness of AI-supported learning depends on how interaction is structured. The proposed framework provides a basis for integrating learning science principles into generative AI systems for construction education.
Study at a glance
  • Question: Does structured prompting improve students' learning outcomes and user experience when studying with generative AI?
  • Setting and data: Michigan Technological University, 95 undergraduate students without prior construction management or BIM coursework.
  • Method: Randomized controlled trial (online controlled experiment)
Why it matters

Students often interact with generative AI without structured guidance, which may lead to superficial learning instead of deeper understanding, yet experimental evidence comparing guided and unguided AI learning remains limited.

Key findings
  • Guided students using structured prompts scored significantly higher on open-ended reasoning tasks (12.41 out of 18) than unprompted AI users (10.45) and slide-based learners (9.68).
  • Multiple-choice scores did not differ significantly across groups, showing that basic recall was comparable whether students used slides, unprompted AI, or prompted AI.
  • Prompted AI users reported higher clarity and dependability than control participants, while perceived efficiency and novelty remained similar or declined across groups.

Summary drafted with AI from the full paper and may contain errors. See the full paper for details.

What is the application?
Who is the user?
Who age?