Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

Towards responsible AI for education: Hybrid human-AI to confront the Elephant in the room

Authors
Danial Hooshyar,
Gustav Sir,
Yeongwook Yang,
Eve Kikas,
Raija Hamalainen,
Tommi Karkkainen,
Dragan Gasevic,
Roger Azevedo
Date
Publisher
arXiv
Despite significant advancements in AI-driven educational systems and ongoing calls for responsible AI for education, several critical issues remain unresolved -- acting as the elephant in the room within AI in education, learning analytics, educational data mining, learning sciences, and educational psychology communities. This critical analysis identifies and examines nine persistent challenges that continue to undermine the fairness, transparency, and effectiveness of current AI methods and applications in education. These include: (1) the lack of clarity around what AI for education truly means -- often ignoring the distinct purposes, strengths, and limitations of different AI families -- and the trend of equating it with domain-agnostic, company-driven large language models; (2) the widespread neglect of essential learning processes such as motivation, emotion, and (meta)cognition in AI-driven learner modelling and their contextual nature; (3) limited integration of domain knowledge and lack of stakeholder involvement in AI design and development; (4) continued use of non-sequential machine learning models on temporal educational data; (5) misuse of non-sequential metrics to evaluate sequential models; (6) use of unreliable explainable AI methods to provide explanations for black-box models; (7) ignoring ethical guidelines in addressing data inconsistencies during model training; (8) use of mainstream AI methods for pattern discovery and learning analytics without systematic benchmarking; and (9) overemphasis on global prescriptions while overlooking localised, student-specific recommendations. Supported by theoretical and empirical research, we demonstrate how hybrid AI methods -- specifically neural-symbolic AI -- can address the elephant in the room and serve as the foundation for responsible, trustworthy AI systems in education.
Study at a glance
  • Question: What key challenges undermine AI in education, and how can human-AI approaches help address them?
  • Setting and data: Not stated in the abstract
  • Method: Critical analysis supported by theoretical and empirical research
Why it matters

Despite advancements in AI-driven educational systems, persistent challenges continue to undermine their fairness, transparency, and effectiveness. These unresolved issues include neglecting essential learning processes, lacking stakeholder involvement, and equating educational AI with company-driven large language models.

Key findings
  • In educational systems, nine persistent challenges undermine the fairness, transparency, and effectiveness of current AI tools.
  • Existing educational AI frequently overlooks essential learning processes like student motivation, emotion, and metacognition while failing to provide student-specific recommendations.
  • Hybrid artificial intelligence methods can address these persistent challenges and provide a foundation for responsible, trustworthy tools in education.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

Who is the user?