Date
Publisher
arXiv
ChatGPT is a state-of-the-art (SOTA) chatbot. Although it has potential to
support English as a foreign language (EFL) students' writing, to effectively
collaborate with it, a student must learn to engineer prompts, that is, the
skill of crafting appropriate instructions so that ChatGPT produces desired
outputs. However, writing an appropriate prompt for ChatGPT is not
straightforward for non-technical users who suffer a trial-and-error process.
This paper examines the content of EFL students' ChatGPT prompts when
completing a writing task and explores patterns in the quality and quantity of
the prompts. The data come from iPad screen recordings of secondary school EFL
students who used ChatGPT and other SOTA chatbots for the first time to
complete the same writing task. The paper presents a case study of four
distinct pathways that illustrate the trial-and-error process and show
different combinations of prompt content and quantity. The cases contribute
evidence for the need to provide prompt engineering education in the context of
the EFL writing classroom, if students are to move beyond an individual
trial-and-error process, learning a greater variety of prompt content and more
sophisticated prompts to support their writing.
Study at a glance
- Question: How do secondary school English learners craft prompts when using ChatGPT for a writing task?
- Setting and data: iPad screen recordings of secondary school English as a foreign language students using chatbots for a writing task.
- Method: Case study of four distinct student pathways.
Why it matters
Although ChatGPT has potential to support EFL students' writing, effective collaboration requires prompt engineering skills. However, writing an appropriate prompt is not straightforward for non-technical users who suffer a trial-and-error process.
Key findings
- In a secondary school English as a foreign language writing task, students demonstrated four distinct pathways combining different prompt amounts and content.
- Students using the chatbot for the first time relied on a trial-and-error process to generate their desired writing outputs.
- Creating appropriate instructions for the chatbot was not straightforward for these non-technical learners.
Summary drafted with AI from the paper’s abstract and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Who age?
Why use AI?
Study design
