Date
Publisher
arXiv
The growth of Massive Open Online Courses (MOOCs) presents significant challenges for personalized learning, where concept recommendation is crucial. Existing approaches typically rely on heterogeneous information networks or knowledge graphs to capture conceptual relationships, combined with knowledge tracing models to assess learners' cognitive states. However, these methods face significant limitations due to their dependence on high-quality structured knowledge graphs, which are often scarce in real-world educational scenarios. To address this fundamental challenge, this paper proposes CLLMRec, a novel framework that leverages Large Language Models through two synergistic technical pillars: Semantic Alignment and Prerequisite Knowledge Distillation. The Semantic Alignment component constructs a unified representation space by encoding unstructured textual descriptions of learners and concepts. The Prerequisite Knowledge Distillation paradigm employs a teacher-student architecture, where a large teacher LLM (implemented as the Prior Knowledge Aware Component) extracts conceptual prerequisite relationships from its internalized world knowledge and distills them into soft labels to train an efficient student ranker. Building upon these foundations, our framework incorporates a fine-ranking mechanism that explicitly models learners' real-time cognitive states through deep knowledge tracing, ensuring recommendations are both structurally sound and cognitively appropriate. Extensive experiments on two real-world MOOC datasets demonstrate that CLLMRec significantly outperforms existing baseline methods across multiple evaluation metrics, validating its effectiveness in generating truly cognitive-aware and personalized concept recommendations without relying on explicit structural priors.
Study at a glance
- Question: Can large language models recommend learning concepts by extracting prerequisite relationships without needing pre-constructed knowledge graphs?
- Setting and data: Two public online learning datasets: ASSIST09 (3,322 learners, 187,914 interactions) and ASSIST12 (24,155 learners, 1,853,338 interactions).
- Method: Model development and comparative evaluation against baseline recommendation algorithms across five random seeds.
Why it matters
Personalized concept recommendation in online learning typically requires high-quality structured knowledge graphs, which are often scarce, static, and sparse for long-tail concepts.
Key findings
- CLLMRec significantly outperformed existing baseline methods across both datasets, achieving a top-1 hit rate of 0.6359 on ASSIST09, a 153% relative improvement over the best baseline.
- On the ASSIST12 dataset, CLLMRec reached a top-1 hit rate of 0.5365, outperforming the strongest baseline model BERT4Rec at 0.2540.
- Ablation experiments showed that removing real-time cognitive state tracking caused significant performance drops, confirming that cognitive awareness is essential alongside prerequisite distillation.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Why use AI?
Study design
