Does AI Contribute to Redesigning Teacher Assessment Literacy? An Empirical Study across Four School Grades
Maria Vittoria Isidori, University of L’Aquila (Italy)
Valentina Di Michele, University of L’Aquila (Italy)
Cinzia Referza, Università degli Studi dell'Aquila (Italy)
Abstract
Teacher assessment competence – understood as the set of knowledge, skills, and practices that enable teachers to design, implement, and interpret assessment effectively – represents a fundamental professional competence (Yang, 2024). The use of an AI-based toolkit modifies teachers' assessment practices (differentiation, feedback, accessibility), with variations across school levels (Bower and Torrington, 2024; Isidori et All., 2025a).
We analyzed 62 teaching projects (preschool n=18, primary n=16, lower secondary n=14, upper secondary n=14), developed by teachers working in subgroups. Teachers integrated an AI toolkit (LLMs, generative platforms, interactive quizzes). Four parameters were measured: differentiated assessment, formative feedback, voice recordings (accessibility), and explicit AI documentation. Impact was assessed using a structured coding scheme (presence/absence). The distribution was balanced; light statistical weighting and sensitivity analysis were applied.
Secondary school teachers showed marked resistance to applying the toolkit. After weighting:
- Differentiation: 72% in preschool/primary vs 21% in secondary.
- Formative feedback: 38% in primary vs 14% in secondary.
- Multimodal accessibility: 56% in preschool vs 4% in secondary.
Reported resistances include: distrust in AI, preference for traditional assessment, and the perception that accessibility is unnecessary in secondary school.
AI can redesign assessment competence, but secondary teachers' resistance limits its impact. Professional development pathways must address cultural and motivational barriers.
|
Keywords |
assessment competence, AI generative, formation teacher, personalization |
|
REFERENCES |
[1] M. Bower – J. Torrington, How should we change teaching and assessment in response to increasingly powerful generative artificial intelligence? Outcomes of the ChatGPT teacher survey, «Education and Information Technologies», 29 (2024), 12, pp. 15403-15439. [2] Isidori, Maria Vittoria; Muccini, Henry; Evangelista, Clara (2025) Generative intelligence: a possible redefinition of teaching and formative assessment. A survey among teacher trainees. Giornale italiano di educazione alla salute, sport e didattica inclusiva, 9(1). [3] Yang, D. (2024). Theoretical model of teachers' assessment competencies: Connotation, structure and performance. Education Science, 40(4), 73-79. |
The Future of Education




























