Date
Publisher
arXiv
Recently, computer scientists have developed large language models (LLMs) by
training prediction models with large-scale language corpora and human
reinforcements. The LLMs have become one promising way to implement artificial
intelligence with accuracy in various fields. Interestingly, recent LLMs
possess emergent functional features that emulate sophisticated human
cognition, especially in-context learning and the chain of thought, which were
unavailable in previous prediction models. In this paper, I will examine how
LLMs might contribute to moral education and development research. To achieve
this goal, I will review the most recently published conference papers and
ArXiv preprints to overview the novel functional features implemented in LLMs.
I also intend to conduct brief experiments with ChatGPT to investigate how LLMs
behave while addressing ethical dilemmas and external feedback. The results
suggest that LLMs might be capable of solving dilemmas based on reasoning and
revising their reasoning process with external input. Furthermore, a
preliminary experimental result from the moral exemplar test may demonstrate
that exemplary stories can elicit moral elevation in LLMs as do they among
human participants. I will discuss the potential implications of LLMs on
research on moral education and development with the results.
Study at a glance
- Question: Can large language models simulate moral reasoning, adapt to feedback, and respond to moral exemplar stories?
- Setting and data: ChatGPT (May 24 version) prompted with moral tasks, compared to survey data from 1,596 undergraduate students.
- Method: Benchmarking simulation and qualitative prompt experiments comparing model responses with undergraduate survey data.
Why it matters
Educational researchers need to examine whether large language models can simulate human moral reasoning, emotion, and learning to assist empirical and practical research in moral education.
Key findings
- ChatGPT achieved a postconventional reasoning score of 45.83 on the behavioral Defining Issues Test, falling at the 40th percentile of undergraduate student benchmark scores.
- When exposed to moral lessons from Martin Luther King, Jr.'s writing, ChatGPT updated its ethical decision and supporting rationale to align with postconventional reasoning.
- ChatGPT accurately evaluated relatable and attainable moral exemplar stories as more replicable, relatable, and morally elevating from a US college student perspective.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Who age?
Why use AI?
Study design
