Date
AI Overview
Why it matters
Generative AI is increasingly deployed across public sectors in developing countries on the premise that it makes workers faster, but evidence is needed on whether it actually saves time.
Study at a glance
- Question: Does providing generative AI licenses and training save teachers time or improve their skills?
- Setting and data: 1,269 sixth-grade teachers across 390 public schools in Lima, Peru.
- Method: Randomized controlled trial (randomized trial)
Key findings
- Providing AI licenses, training, and follow-up sharply increased AI adoption but saved teachers no time on any of their core tasks.
- Trained teachers wrote markedly better prompts, including on an independently designed rubric, and were sharper at identifying weak AI outputs.
- Skill gains were largest for older teachers who began furthest behind, narrowing rather than widening skill gaps.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
Generative AI is being deployed across the public sectors of developing countries on the premise that it makes workers faster. This paper tests this in a randomized trial with 1,269 sixth-grade teachers across 390 public schools in Lima, Peru. A low-cost program—a one-day training, an AI license, and eight months of light-touch follow-up—raised adoption sharply yet saved teachers no time on any of their core tasks, with precisely estimated nulls throughout. The gains lay elsewhere: treated teachers wrote markedly better prompts, including on a rubric designed independently of the training, and were sharper at catching weak AI outputs. These gains were largest for older teachers, who began furthest behind, narrowing rather than widening skill gaps. Taken together, the results indicate that AI training primarily develops the skills needed to generate and evaluate high-quality AI outputs, rather than reducing the time teachers spend on their work.
Research Categories
What is the application?
Who is the user?
Who age?
Study design
Methods
Publication Source
Publisher
World Bank
