Date
Publisher
arXiv
As generative AI becomes increasingly integrated into higher education, understanding how students engage with these technologies is essential for responsible adoption. This study evaluates the Educational AI Hub, an AI-powered learning framework, implemented in undergraduate civil and environmental engineering courses at a large R1 public university. Using a mixed-methods design combining pre- and post-surveys, system usage logs, and qualitative analysis of students' AI interactions, the research examines perceptions of trust, ethics, usability, and learning outcomes. Findings show that students valued the AI assistant for its accessibility and comfort, with nearly half reporting greater ease using it than seeking help from instructors or teaching assistants. The tool was most helpful for completing homework and understanding concepts, though views on its instructional quality were mixed. Ethical uncertainty, particularly around institutional policy and academic integrity, emerged as a key barrier to full engagement. Overall, students regarded AI as a supplement rather than a replacement for human instruction. The study highlights the importance of usability, ethical transparency, and faculty guidance in promoting meaningful AI engagement. A total of 71 students participated across two courses, generating over 600 AI interactions and 100 survey responses that provided both quantitative and contextual insights into learning engagement.
Study at a glance
- Question: How do engineering students perceive and interact with an AI-powered learning assistant across usability, ethics, and academic tasks?
- Setting and data: Two undergraduate civil and environmental engineering courses at a large Midwestern R1 public university, 65 participating students, over 600 interactions.
- Method: Mixed methods combining pre- and post-surveys, system usage logs, and qualitative analysis of student chatbot queries.
Why it matters
Few empirical studies examine generative AI in discipline-specific engineering education where ethical trust and usability intersect. Understanding how students interact with AI is essential to ensure responsible adoption and integration in higher education.
Key findings
- Most students found the AI tool more convenient (68%) and comfortable (47%) than asking human instructors, but only 17% rated its instructional quality as better.
- A majority of students (58%) worried about being accused of academic misconduct when using AI, and distrust in AI was significantly associated with lower system usage.
- Students mostly used the AI assistant for chatbot messaging rather than structured activities, with queries predominantly seeking software help (40.4%) and conceptual clarification (30.4%).
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Who age?
Why use AI?
Study design
