Date
Publisher
arXiv
Teachers' emotional states are critical in educational scenarios, profoundly impacting teaching efficacy, student engagement, and learning achievements. However, existing studies often fail to accurately capture teachers' emotions due to the performative nature and overlook the critical impact of instructional information on emotional expression. In this paper, we systematically investigate teacher sentiment analysis by building both the dataset and the model accordingly. We construct the first large-scale teacher multimodal sentiment analysis dataset, T-MED. To ensure labeling accuracy and efficiency, we employ a human-machine collaborative labeling process. The T-MED dataset includes 14,938 instances of teacher emotional data from 250 real classrooms across 11 subjects ranging from K-12 to higher education, integrating multimodal text, audio, video, and instructional information. Furthermore, we propose a novel asymmetric attention-based multimodal teacher sentiment analysis model, AAM-TSA. AAM-TSA introduces an asymmetric attention mechanism and hierarchical gating unit to enable differentiated cross-modal feature fusion and precise emotional classification. Experimental results demonstrate that AAM-TSA significantly outperforms existing state-of-the-art methods in terms of accuracy and interpretability on the T-MED dataset.
Study at a glance
- Question: Can combining audio, text, video descriptions, and instructional context improve automated teacher emotion analysis?
- Setting and data: Public MOOC video clips from 250 classrooms across 11 subjects, covering K-12 to higher education, totaling 14,938 samples and over 200 teachers.
- Method: Dataset construction via human-machine collaborative annotation; benchmark evaluation comparing an asymmetric multimodal neural network (AAM-TSA) against nine baseline models.
Why it matters
Teachers' emotional states influence teaching efficacy and student learning. However, existing sentiment models often fail to capture emotions due to teaching's performative nature and omit crucial instructional context.
Key findings
- The AAM-TSA model achieved 86.84% weighted accuracy and an 86.37% weighted F1 score, outperforming the best baseline by 5.93 and 6.56 percentage points.
- AAM-TSA raised F1 scores across teacher-specific emotions, reaching 60.00% for enthusiasm, 75.76% for patience, and 91.16% for expectation.
- Modality tests revealed audio carried the strongest emotional signal alone (77.29% accuracy), while replacing raw video with language-model-generated visual descriptions improved accuracy by 0.87 percentage points.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who is the user?
Who age?
Why use AI?
Study design
