Date
Publisher
arXiv
The rapid integration of generative artificial intelligence into education has driven digital transformation in e-teaching, yet user perceptions of AI educational apps remain underexplored. This study performs a sentiment-driven evaluation of user reviews from top AI ed-apps on the Google Play Store to assess efficacy, challenges, and pedagogical implications. Our pipeline involved scraping app data and reviews, RoBERTa for binary sentiment classification, GPT-4o for key point extraction, and GPT-5 for synthesizing top positive/negative themes. Apps were categorized into seven types (e.g., homework helpers, math solvers, language tools), with overlaps reflecting multifunctional designs. Results indicate predominantly positive sentiments, with homework apps like Edu AI (95.9% positive) and Answer.AI (92.7%) leading in accuracy, speed, and personalization, while language/LMS apps (e.g., Teacher AI at 21.8% positive) lag due to instability and limited features. Positives emphasize efficiency in brainstorming, problem-solving, and engagement; negatives center on paywalls, inaccuracies, ads, and glitches. Trends show that homework helpers outperform specialized tools, highlighting AI's democratizing potential amid risks of dependency and inequity. The discussion proposes future ecosystems with hybrid AI-human models, VR/AR for immersive learning, and a roadmap for developers (adaptive personalization) and policymakers (monetization regulation for inclusivity). This underscores generative AI's role in advancing e-teaching by enabling ethical refinements that foster equitable, innovative environments. The full dataset is available here(https://github.com/erfan-nourbakhsh/GenAI-EdSent).
Study at a glance
- Question: What do user reviews reveal about the performance, benefits, and challenges of top AI educational apps?
- Setting and data: Google Play Store user reviews and metadata for top AI educational apps, up to November 2025.
- Method: Sentiment classification and thematic text analysis using natural language processing and large language models.
Why it matters
Generative AI is transforming digital education, but real-world user perceptions of AI educational apps remain underexplored. Traditional surveys and interviews offer limited scalability, leaving a gap in understanding authentic user experiences.
Key findings
- Most apps received predominantly positive feedback, led by homework helper apps such as Edu AI (95.9% positive) and Answer.AI (92.7% positive).
- Positive sentiments highlighted efficiency, quick problem-solving, step-by-step explanations, and engagement, while homework helpers averaged over 80 percent positive ratings.
- Learning management systems and language tools lagged behind, with Teacher AI receiving only 21.8 percent positive sentiment due to paywalls, technical instability, and inaccurate answers.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who age?
Why use AI?
Study design
