Date
Publisher
arXiv
Preschool children with language vulnerabilities -- such as developmental
language disorders or immigration related language challenges -- often require
support to strengthen their expressive language skills. Based on the principle
of implicit learning, speech-language therapists (SLTs) typically embed target
morphological structures (e.g., third person -s) into everyday interactions or
game-based learning activities. Educators are recommended by SLTs to do the
same. This approach demands precise linguistic knowledge and real-time
production of various morphological forms (e.g., "Daddy wears these when he
drives to work"). The task becomes even more demanding when educators or parent
also must keep children engaged and manage turn-taking in a game-based
activity. In the TalBot project our multiprofessional team have developed an
application in which the Furhat conversational robot plays the word retrieval
game "Alias" with children to improve language skills. Our application
currently employs a large language model (LLM) to manage gameplay, dialogue,
affective responses, and turn-taking. Our next step is to further leverage the
capacity of LLMs so the robot can generate and deliver specific morphological
targets during the game. We hypothesize that a robot could outperform humans at
this task. Novel aspects of this approach are that the robot could ultimately
serve as a model and tutor for both children and professionals and that using
LLM capabilities in this context would support basic communication needs for
children with language vulnerabilities. Our long-term goal is to create a
robust LLM-based Robot-Assisted Language Learning intervention capable of
teaching a variety of morphological structures across different languages.
Study at a glance
- Question: Can an LLM-powered conversational robot support language interventions and deliver targeted morphological structures during word games for preschool children?
- Setting and data: Finland; 13 preschool children (ages 5.5–6.5) with language vulnerabilities and 7 educators (4 educators, 3 educator students); tested in 2024.
- Method: Prototype development, iterative testing, and educator interviews (System development and user study).
Why it matters
Preschool educators often struggle to spontaneously provide the consistent, varied linguistic models needed to support children with language vulnerabilities during everyday activities.
Key findings
- Tests showed the TalBot prototype successfully managed three-player turn-taking and used contextual cues to interpret children's mispronunciations or speech recognition errors.
- The integrated LLM steered off-topic child responses back to the target guessing game without relying on rigid, pre-programmed rules.
- The system dynamically generated customized game clues and facial expressions to deliver structured linguistic input without exhausting pre-set content.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who age?
Why use AI?
Study design
