Search and Filter

Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

Automatic Question & Answer Generation Using Generative Large Language Model (LLM)

Authors
A.S.M Mehedi Hasan,
Md. Alvee Ehsan,
Kefaya Benta Shahnoor,
Syeda Sumaiya Tasneem
Date
Publisher
arXiv
\Abstract{In the realm of education, student evaluation holds equal significance as imparting knowledge. To be evaluated, students usually need to go through text-based academic assessment methods. Instructors need to make diverse sets of questions that need to be fair for all students to prove their adequacy over a particular topic. This can prove to be quite challenging as they may need to manually go through several different lecture materials. Our objective is to make this whole process much easier by implementing Automatic Question Answer Generation /(AQAG), using fine-tuned generative LLM. For tailoring the instructor's preferred question style (MCQ, conceptual, or factual questions), prompt Engineering (PE) is being utilized. In this research, we propose to leverage unsupervised learning methods in NLP, primarily focusing on the English language. This approach empowers the base Meta-Llama 2-7B model to integrate RACE dataset as training data for the fine-tuning process. Creating a customized model that will offer efficient solutions for educators, instructors, and individuals engaged in text-based evaluations. A reliable and efficient tool for generating questions and answers can free up valuable time and resources, thus streamlining their evaluation processes.}
Study at a glance
  • Question: Can an artificial intelligence tool automatically create test questions and answers to help teachers evaluate students?
  • Setting and data: English-language RACE dataset.
  • Method: Trains an artificial intelligence model to generate test questions (unsupervised learning).
Why it matters

Evaluating students requires diverse and fair question sets. However, manually reviewing multiple lecture materials to create these text-based assessments is challenging for instructors.

Key findings
  • In English-language text-based assessments, an adapted generative AI tool can automatically produce questions and answers to support educators evaluating student learning.
  • Carefully designed instructions enable the AI model to customize question styles, generating multiple-choice, conceptual, or factual questions to match instructor preferences.
  • Automated question and answer generation can free up valuable time and resources for educators by streamlining the evaluation creation process.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

Who is the user?