Search and Filter

Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

Generative Large Language Models for Knowledge Representation: A Systematic Review of Concept Map Generation

Date
Publisher
arXiv
The rise of generative large language models (LLMs) has opened new opportunities for automating knowledge representation through concept maps, a long-standing pedagogical tool valued for fostering meaningful learning and higher-order thinking. Traditional construction of concept maps is labor-intensive, requiring significant expertise and time, limiting their scalability in education. This review systematically synthesizes the emerging body of research on LLM-enabled concept map generation, focusing on two guiding questions: (a) What methods and technical features of LLMs are employed to construct concept maps? (b) What empirical evidence exists to validate their educational utility? Through a comprehensive search across major databases and AI-in-education conference proceedings, 28 studies meeting rigorous inclusion criteria were analyzed using thematic synthesis. Findings reveal six major methodological categories: human-in-the-loop systems, weakly supervised learning models, fine-tuned domain-specific LLMs, pre-trained LLMs with prompt engineering, hybrid systems integrating knowledge bases, and modular frameworks combining symbolic and statistical tools. Validation strategies ranged from quantitative metrics (precision, recall, F1-score, semantic similarity) to qualitative evaluations (expert review, learner feedback). Results indicate LLM-generated maps hold promise for scalable, adaptive, and pedagogically relevant knowledge visualization, though challenges remain regarding validity, interpretability, multilingual adaptability, and classroom integration. Future research should prioritize interdisciplinary co-design, empirical classroom trials, and alignment with instructional practices to realize their full educational potential.
Study at a glance
  • Question: How are generative large language models used to create concept maps, and what evidence validates their educational utility?
  • Setting and data: 28 peer-reviewed journal and conference papers published between 2018 and 2025 across scholarly databases.
  • Method: Systematic review using thematic synthesis following PRISMA guidelines.
Why it matters

Traditional concept map construction is labor-intensive and requires substantial expertise and time, limiting scalability in education. Generative large language models could automate knowledge structuring, but existing literature remains fragmented with limited empirical evidence.

Key findings
  • Researchers use six major approaches to generate concept maps: human-in-the-loop, weakly supervised learning, domain-specific fine-tuning, prompt engineering, hybrid knowledge base integration, and modular frameworks.
  • Concept maps created through domain-specific fine-tuning and hybrid models achieved stronger technical validity and fewer hallucinations than maps built using simple zero-shot prompting.
  • Very few studies have evaluated these AI-generated concept maps in real classroom settings or measured their impact on actual student learning outcomes.

Summary drafted with AI from the full paper and may contain errors. See the full paper for details.

Who is the user?
Study design