Date
Publisher
arXiv
While ChatGPT has significantly impacted education by offering personalized resources for students, its integration into educational settings poses unprecedented risks, such as inaccuracies and biases in AI-generated content, plagiarism and over-reliance on AI, and privacy and security issues. To help teachers address such risks, we conducted a two-phase iterative design process that comprises surveys, interviews, and prototype demonstration involving six EFL (English as a Foreign Language) teachers, who integrated ChatGPT into semester-long English essay writing classes. Based on the needs identified during the initial survey and interviews, we developed a prototype of Prompt Analytics Dashboard (PAD) that integrates the essay editing history and chat logs between students and ChatGPT. Teacher's feedback on the prototype informs additional features and unmet needs for designing future PAD, which helps them (1) analyze contextual analysis of student behaviors, (2) design an overall learning loop, and (3) develop their teaching skills.
Study at a glance
- Question: How can dashboards be designed to help English teachers analyze student interactions with ChatGPT in writing classes?
- Setting and data: Six English as a Foreign Language teachers in semester-long English essay writing classes.
- Method: Two-phase iterative design process using surveys, interviews, and prototype demonstrations.
Why it matters
While ChatGPT offers personalized resources for students, its integration into educational settings poses unprecedented risks, including inaccuracies, bias, plagiarism, over-reliance on AI, and privacy issues. Teachers need help addressing these risks.
Key findings
- In semester-long English writing classes, six foreign-language teachers reported that an analytics dashboard combining essay edits and chat logs helped contextualize student behaviors.
- Teachers reported that the prompt analytics dashboard helped them design an overall learning loop.
- Teachers indicated that using the dashboard helped them develop their teaching skills while identifying unmet needs for future analytics tools.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Who age?
Why use AI?
