Date
AI Overview
Why it matters
Little is known about how often applicants use AI, how it affects application quality, and whether it impacts admission decisions. Without evidence, admissions offices struggle to set and enforce policies.
Study at a glance
- Question: How often do applicants use AI on admissions essays, and does it affect essay quality and admission outcomes?
- Setting and data: 7,462 applications to a competitive U.S. public policy master's program, 2020–2025; rating experiment with 5 admissions officers.
- Method: Double machine learning, panel regression with controls, and an evaluation experiment with admissions staff.
- AI tools: ChatGPT, gpt-5-nano, gpt-5-mini, GPTZero, Pangram, Microsoft Document Intelligence
Key findings
- By 2025, 56% of applicants submitted at least one primarily AI-generated essay—reaching 69.3% among international applicants—despite an explicit prohibition against AI use.
- The availability of AI assistants improved writing quality, particularly mechanical aspects like grammar and style for international applicants, but yielded more modest gains on substantive dimensions.
- Applicants submitting AI-written essays faced an estimated 1.5 to 2.6 percentage-point penalty in admission probability per essay, consistent with admissions officers recognizing and downgrading AI writing.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
AI is rapidly transforming higher education, including the application process, yet relatively little is known about its use and consequences. To help close this gap, we analyze nearly 7{,}500 applications submitted between 2020 and 2025 to a large public policy master's program in the United States. We find that in the 2025 admissions cycle, the majority of applicants submitted at least one essay that was primarily AI-generated---despite an explicit prohibition against using AI. Leveraging the abrupt introduction of ChatGPT in November 2022, we find that the availability of AI assistants improved the writing quality of submitted essays. These improvements, however, came with an apparent AI penalty: Applicants submitting AI-written essays were admitted less often than comparable non-users. To help explain this penalty, we conduct an experiment with admissions officers, finding that they can often recognize AI writing and rate essays they believe to be AI-generated lower than essays they believe to be human generated. These findings indicate that AI is changing both how applicants write and how that writing is evaluated, raising questions about whether admissions practices and policies designed for a pre-AI era remain appropriate.
Research Categories
What is the application?
Who age?
Why use AI?
Study design
AI tools
Publication Source
Publisher
arXiv
