Date
Publisher
arXiv
Finding balanced ways to employ Large Language Models (LLMs) in education is
a challenge due to inherent risks of poor understanding of the technology and
of a susceptible audience. This is particularly so with younger children, who
are known to have difficulties with pervasive screen time. Working with a
tangible programming robot called Cubetto, we propose an approach to benefit
from the capabilities of LLMs by employing such models in the preparation of
personalised storytelling, necessary for preschool children to get accustomed
to the practice of commanding the robot. We engage in action research to
develop an early version of a formalised process to rapidly prototype game
stories for Cubetto. Our approach has both reproducible results, because it
employs open weight models, and is model-agnostic, because we test it with 5
different LLMs. We document on one hand the process, the used materials and
prompts, and on the other the learning experience and outcomes. We deem the
generation successful for the intended purposes of using the results as a
teacher aid. Testing the models on 4 different task scenarios, we encounter
issues of consistency and hallucinations and document the corresponding
evaluation process and attempts (some successful and some not) to overcome
these issues. Importantly, the process does not expose children to LLMs
directly. Rather, the technology is used to help teachers easily develop
personalised narratives on children's preferred topics. We believe our method
is adequate for preschool classes and we are planning to further experiment in
real-world educational settings.
Study at a glance
- Question: Can open-weight large language models help teachers rapidly prototype personalized game stories for a preschool tangible programming robot?
- Setting and data: Prompts tested across four task scenarios pairing the Cubetto robot with commonplace toys, using five open-weight models running locally.
- Method: Action research using rapid prototyping and prompt engineering across seven generation rounds.
Why it matters
Using large language models in education risks harming young children who are sensitive to screen time. Teachers need support creating repetitive, personalized stories to help preschoolers adopt screen-free tangible programming robots without direct child exposure.
Key findings
- All five tested models successfully generated structured, actionable activity descriptions that can serve as creativity prompts for teachers rather than proof-read guides.
- Models frequently suffered from trimmed responses, hallucinations of nonexistent robot command blocks, and incomplete material lists, though explicit prompting successfully eliminated command-related errors.
- Mistral and Qwen adapted to requested response length limits, whereas Gemma, Llama, and oLMo consistently exceeded response token buffers.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Who age?
Why use AI?
Study design
