Date
AI Overview
Why it matters
Sharing open research datasets supports reproducibility, fosters collaboration, and increases trust in educational research findings, yet the availability of open datasets and data-sharing practices across learning analytics remains unclear.
Study at a glance
- Question: Which open datasets are available in learning analytics research, and how can researchers better share their data?
- Setting and data: 1,125 full and short papers published at LAK, EDM, and AIED conferences, 2020–2024.
- Method: Systematic literature survey (following PRISMA guidelines) and descriptive analysis.
- AI tools: NotebookLM
Key findings
- Only 19% of eligible papers (204 of 1,076) featured an open dataset, yielding 172 unique public datasets.
- Most open datasets focused on K-12 and university students, centered on STEM and language learning, and originated from the United States.
- Only half of the datasets listed as available upon request were actually provided when requested by the researchers.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
Open datasets play a crucial role in three research domains that intersect data science and education: learning analytics, educational data mining, and artificial intelligence in education. Researchers in these domains apply computational methods to analyze data from educational contexts, aiming to better understand and improve teaching and learning. Providing open datasets alongside research papers supports reproducibility, collaboration, and trust in research findings. It also provides individual benefits for authors, such as greater visibility, credibility, and citation potential. Despite these advantages, the availability of open datasets and the associated practices within the learning analytics research communities, especially at their flagship conference venues, remain unclear. We surveyed available datasets published alongside research papers in learning analytics. We manually examined 1,125 papers from three flagship conferences (LAK, EDM, and AIED) over the past five years. We discovered, categorized, and analyzed 172 datasets used in 204 publications. Our study presents the most comprehensive collection and analysis of open educational datasets to date, along with the most detailed categorization. Of the 172 datasets identified, 143 were not captured in any prior survey of open data in learning analytics. We provide insights into the datasets' context, analytical methods, use, and other properties. Based on this survey, we summarize the current gaps in the field. Furthermore, we list practical recommendations, advice, and 8-item guidelines under the acronym PRACTICE with a checklist to help researchers publish their data. Lastly, we share our original dataset: an annotated inventory detailing the discovered datasets and the corresponding publications. We hope these findings will support further adoption of open data practices in learning analytics communities and beyond.
Research Categories
What is the application?
Who is the user?
Why use AI?
Study design
AI tools
Publication Source
Publisher
arXiv
