Date
Publisher
arXiv
Teachers' trust in artificial intelligence (AI) in education depends on how they balance its perceived benefits and risks. Yet global discussions about scaling AI in education rely on fragmented evidence, as most studies of teachers' perceptions focus on single countries or small samples. This lack of representative cross-national evidence limits both theory building and policy development. At the same time, large language models (LLMs) are increasingly used in research, policy, and teachers' professional workflows, despite limited validation in education. To address these gaps, we conduct a large-scale audit of LLM alignment with teachers' perceptions of AI by combining representative international survey data with systematic model evaluation. Using OECD TALIS data from 55 countries and territories, we measure cross-national variation in teachers' perceived benefits and risks of AI. We then benchmark responses from eight state-of-the-art LLMs across four providers under both general and country-specific prompting, comparing higher- and lower-reasoning models. Results reveal substantial cross-national variation in teacher perceptions that is not reliably reflected in LLM outputs. Models compress country differences, overestimate both benefits and risks, and show limited gains from identity prompting or enhanced reasoning. This misalignment matters because LLM-generated guidance and professional discourse increasingly shape how teachers learn about and discuss AI, potentially influencing trust and future adoption decisions. Our findings caution against treating LLM outputs as substitutes for direct engagement with teachers when informing global AI-in-education initiatives. At the same time, some models (e.g., Gemini 3 Fast) partially capture cross-national ranking patterns, suggesting a complementary role in hypothesis generation and exploratory comparative analysis.
Study at a glance
- Question: How accurately do leading large language models reflect teachers' perceptions of AI benefits and risks across countries?
- Setting and data: 55 countries and territories, 278,383 in-service teachers (primarily lower secondary), 2023–2024 TALIS cycle, alongside eight large language models.
- Method: Benchmarking LLM survey simulations against nationally representative survey data (algorithmic audit).
Why it matters
Global discussions about scaling AI in education rely on fragmented evidence from single countries. Meanwhile, large language models are increasingly used as proxies for stakeholder views despite lacking validation against representative international teacher perceptions.
Key findings
- Most tested language models overestimated both the benefits and risks of AI, placing teacher perspectives into an extreme high-benefit and high-risk profile that no surveyed country actually exhibited.
- Prompting models with national teacher identities failed to reliably align responses with local views and compressed real-world differences across countries, though Gemini 3 Flash partially captured country benefit rankings.
- Models with explicit reasoning capabilities did not consistently improve alignment or responsiveness to country prompting compared to non-reasoning versions, and sometimes increased deviations from actual teacher responses.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
Why use AI?
Study design
