Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

AI-University: An LLM-based platform for instructional alignment to scientific classrooms

Authors
Mostafa Faghih Shojaei,
Rahul Gulati,
Benjamin A. Jasperson,
Shangshang Wang,
Simone Cimolato,
Dangli Cao,
Willie Neiswanger,
Krishna Garikipati
Date
Publisher
arXiv
We introduce AI University (AI-U), a flexible framework for AI-driven course content delivery that adapts to instructors' teaching styles. At its core, AI-U fine-tunes a large language model (LLM) with retrieval-augmented generation (RAG) to generate instructor-aligned responses from lecture videos, notes, and textbooks. Using a graduate-level finite-element-method (FEM) course as a case study, we present a scalable pipeline to systematically construct training data, fine-tune an open-source LLM with Low-Rank Adaptation (LoRA), and optimize its responses through RAG-based synthesis. Our evaluation - combining cosine similarity, LLM-based assessment, and expert review - demonstrates strong alignment with course materials. We also have developed a prototype web application, available at this https URL, that enhances traceability by linking AI-generated responses to specific sections of the relevant course material and time-stamped instances of the open-access video lectures. Our expert model is found to have greater cosine similarity with a reference on 86% of test cases. An LLM judge also found our expert model to outperform the base Llama 3.2 model approximately four times out of five. AI-U offers a scalable approach to AI-assisted education, paving the way for broader adoption in higher education. Here, our framework has been presented in the setting of a class on FEM - a subject that is central to training PhD and Master students in engineering science. However, this setting is a particular instance of a broader context: fine-tuning LLMs to research content in science.
Study at a glance
  • Question: Can an AI system be designed to match an instructor's specific teaching style and course materials?
  • Setting and data: A graduate-level engineering course, using materials including lecture videos, notes, and textbooks.
  • Method: Technical evaluation combining automated text comparisons (cosine similarity), AI-based assessment, and expert review.
Why it matters

AI-assisted education requires scalable ways to deliver course content that adapts to instructors' teaching styles. Systems must reliably generate aligned responses directly from specific classroom materials, including lecture videos, notes, and textbooks.

Key findings
  • In a graduate-level engineering course, a tailored instructional AI matched course reference materials more closely in 86% of test cases.
  • An automated evaluation found that the course-adapted AI outperformed a standard, general-purpose model approximately four times out of five.
  • Expert reviews and testing demonstrated that the AI generated responses that strongly aligned with the instructor's course materials.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

Who is the user?
Who age?