Date
Publisher
arXiv
\Abstract{In the realm of education, student evaluation holds equal
significance as imparting knowledge. To be evaluated, students usually need to
go through text-based academic assessment methods. Instructors need to make
diverse sets of questions that need to be fair for all students to prove their
adequacy over a particular topic. This can prove to be quite challenging as
they may need to manually go through several different lecture materials. Our
objective is to make this whole process much easier by implementing Automatic
Question Answer Generation /(AQAG), using fine-tuned generative LLM. For
tailoring the instructor's preferred question style (MCQ, conceptual, or
factual questions), prompt Engineering (PE) is being utilized. In this
research, we propose to leverage unsupervised learning methods in NLP,
primarily focusing on the English language. This approach empowers the base
Meta-Llama 2-7B model to integrate RACE dataset as training data for the
fine-tuning process. Creating a customized model that will offer efficient
solutions for educators, instructors, and individuals engaged in text-based
evaluations. A reliable and efficient tool for generating questions and answers
can free up valuable time and resources, thus streamlining their evaluation
processes.}
Study at a glance
- Question: Can an artificial intelligence tool automatically create test questions and answers to help teachers evaluate students?
- Setting and data: English-language RACE dataset.
- Method: Trains an artificial intelligence model to generate test questions (unsupervised learning).
Why it matters
Evaluating students requires diverse and fair question sets. However, manually reviewing multiple lecture materials to create these text-based assessments is challenging for instructors.
Key findings
- In English-language text-based assessments, an adapted generative AI tool can automatically produce questions and answers to support educators evaluating student learning.
- Carefully designed instructions enable the AI model to customize question styles, generating multiple-choice, conceptual, or factual questions to match instructor preferences.
- Automated question and answer generation can free up valuable time and resources for educators by streamlining the evaluation creation process.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Who age?
Why use AI?
Study design
