Search and Filter

Identifying, Explaining, And Correcting Ableist Language With AI

Date

AI Overview

Why it matters

Nuanced ableist language perpetuates harmful stereotypes yet remains difficult to recognize. Relying exclusively on disabled advocates to correct others' language places an inequitable burden of labor on marginalized communities.

Study at a glance
  • Question: Do disabled participants prefer AI or human annotators for identifying, explaining, and correcting subtle ableist language?
  • Setting and data: Online surveys via Prolific with college-educated disabled adults: 110 participants in Study 1 and 106 participants in Study 2 across seven disability categories.
  • Method: Mixed methods survey experiment comparing crowdsourced human baseline annotations and AI-generated annotations with quantitative ratings and qualitative thematic coding.
  • AI tools: ChatGPT, GPT-4o
Key findings
  • Disabled participants significantly preferred the AI annotator (43.9%) over the human baseline annotator (23.4%), while 32.7% expressed no preference.
  • Participants showed statistically equivalent sentence-level agreement with both AI and human annotators across identification, explanation, and correction tasks, averaging 72.3%.
  • Qualitative feedback showed participants praised the AI's clarity and structure, but valued human annotations for emotional depth, lived experience, and cultural grounding.

Summary drafted with AI from the full paper and may contain errors. See the full paper for details.

Ableist language perpetuates harmful stereotypes and exclusion, yet its nuanced nature makes it difficult to recognize and address. Artificial intelligence could serve as a powerful ally in the fight against ableist language, offering tools that detect and suggest alternatives to biased terms. This two-part study investigates the potential of large language models (LLMs), specifically ChatGPT, to rectify ableist language and educate users about inclusive communication. We compared GPT-4o generations with crowdsourced annotations from trained disability community members, then invited disabled participants to evaluate both. Participants reported equal agreement with human and AI annotations but significantly preferred the AI, citing its narrative consistency and accessible style. At the same time, they valued the emotional depth and cultural grounding of human annotations. These findings highlight the promise and limits of LLMs in handling culturally sensitive content. Our contributions include a dataset of nuanced ableism annotations and design considerations for inclusive writing tools.