Search and Filter

An Evaluation Of AI-Supported Evidence-Based Learning For Public Speaking Skill Development

Date

AI Overview

Why it matters

Public speaking causes anxiety, yet traditional coaching is limited by time and subjectivity. Existing AI speech tools typically offer generic feedback lacking speech context and fail to provide model speech examples to support learning.

Study at a glance
  • Question: Can context-aware AI feedback and revised model speech examples improve public speaking performance and reduce speaking anxiety?
  • Setting and data: Seven undergraduate students aged 21 to 23 at the University of Moratuwa, Sri Lanka, practicing over one to three weeks.
  • Method: Pilot user study with pre- and post-intervention evaluations, speech analysis, and questionnaires.
  • AI tools: GPT-4o, Context-Aware AI Speech Coach
Key findings
  • All seven undergraduate participants improved their overall speech evaluation scores, with relative gains ranging from 6.5% to 120.0%.
  • Public speaking anxiety dropped across all participants, with scores decreasing between 15.3% and 34.4%, leading six participants to transition to low anxiety.
  • Filler word usage decreased for all participants, with relative drops ranging from 25.0% to 100.0% alongside positive ratings for the AI-generated model speeches.

Summary drafted with AI from the full paper and may contain errors. See the full paper for details.

Public speaking is an essential skill in academic and professional contexts, but it often causes anxiety. Although several AI-based speech coaching tools exist, they typically provide generic feedback and lack model speeches for learning. This study addresses these gaps by developing a system that incorporates speech context into evaluation criteria, enabling more tailored feedback. It also generates improved model speeches in both text and audio formats to support example-based learning. The system was evaluated in a pilot study with seven undergraduate students over one to three weeks. Participants used the system repeatedly and practiced the same speech at least three times. Results showed improvements in public speaking performance for all participants. Filler word usage decreased, and anxiety levels dropped by 15.3% to 34.4%. Participants found the context-aware feedback and revised speeches useful and confidence-building. These findings suggest that context-aware feedback and model speeches can enhance public speaking skills and reduce anxiety. Future studies could explore video-based analysis of physical behavior during speeches.