Repository Feedback

Your feedback helps us improve the repository's content relevance and usability. Please share your thoughts to help us better serve researchers and practitioners.

Submit feedback

Submit a research study

Contribute to the repository:

Add a paper

Foundation Models in Augmentative and Alternative Communication: Opportunities and Challenges

Authors
Ambra Di Paola,
Serena Muraro,
Roberto Marinelli,
Christian Pilato
Date
Publisher
arXiv
Augmentative and Alternative Communication (AAC) are essential techniques that help people with communication disabilities. AAC demonstrates its transformative power by replacing spoken language with symbol sequences. However, to unlock its full potential, AAC materials must adhere to specific characteristics, placing the onus on educators to create custom-tailored materials and symbols. This paper introduces AMBRA (Pervasive and Personalized Augmentative and Alternative Communication based on Federated Learning and Generative AI), an open platform that aims to leverage the capabilities of foundation models to tackle many AAC issues, opening new opportunities (but also challenges) for AI-enhanced AAC. We thus present a compelling vision--a roadmap towards a more inclusive society. By leveraging the capabilities of modern technologies, we aspire to not only transform AAC but also guide the way toward a world where communication knows no bounds.
Study at a glance
  • Question: How can artificial intelligence foundation models improve communication tools for people with disabilities?
  • Setting and data: Not stated in the abstract
  • Method: Introduction and description of a proposed platform and conceptual roadmap
Why it matters

To unlock the full potential of Augmentative and Alternative Communication, materials must meet specific characteristics. This places the onus on educators to create custom-tailored materials and symbols for people with communication disabilities.

Key findings
  • Generative AI and foundation models can help address key communication challenges by personalizing augmentative and alternative communication materials for people with disabilities.
  • Effective augmentative and alternative communication currently places a substantial burden on educators to manually create custom-tailored symbols and materials.
  • Applying foundation models to alternative communication introduces new challenges alongside opportunities for building more inclusive communication tools.

Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.

Who is the user?