Date
Publisher
arXiv
The development of Automatic Question Generation (QG) models has the
potential to significantly improve educational practices by reducing the
teacher workload associated with creating educational content. This paper
introduces a novel approach to educational question generation that controls
the topical focus of questions. The proposed Topic-Controlled Question
Generation (T-CQG) method enhances the relevance and effectiveness of the
generated content for educational purposes. Our approach uses fine-tuning on a
pre-trained T5-small model, employing specially created datasets tailored to
educational needs. The research further explores the impacts of pre-training
strategies, quantisation, and data augmentation on the model's performance. We
specifically address the challenge of generating semantically aligned questions
with paragraph-level contexts, thereby improving the topic specificity of the
generated questions. In addition, we introduce and explore novel evaluation
methods to assess the topical relatedness of the generated questions. Our
results, validated through rigorous offline and human-backed evaluations,
demonstrate that the proposed models effectively generate high-quality,
topic-focused questions. These models have the potential to reduce teacher
workload and support personalised tutoring systems by serving as bespoke
question generators. With its relatively small number of parameters, the
proposals not only advance the capabilities of question generation models for
handling specific educational topics but also offer a scalable solution that
reduces infrastructure costs. This scalability makes them feasible for
widespread use in education without reliance on proprietary large language
models like ChatGPT.
Study at a glance
- Question: Can an AI model be trained to automatically generate questions focused on specific educational topics?
- Setting and data: Specially created datasets tailored to educational needs.
- Method: AI model development tested through automated and human evaluations.
Why it matters
Automatic question generation can reduce the teacher workload associated with creating educational content. However, generating topic-focused questions that align semantically with paragraph-level contexts remains a challenge.
Key findings
- A topic-controlled model effectively generated high-quality, relevant educational questions aligned with specific paragraph contexts.
- Targeting specific topics enhanced the educational relevance and topic alignment of questions generated from reading passages.
- A smaller model design reduced infrastructure costs while generating focused questions without relying on commercial tools like ChatGPT.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Why use AI?
Study design
