“Anything You Can Do (A)I Can Do Better”: Bloom’s 2 Sigma Problem and the Case for Replacing Human Tutors with Computers In Language Learning
M. Gregory Tweedie, University of Calgary in Qatar (Qatar)
Abstract
Influential educational psychologist Bemjamin Bloom identified, as early as 1984, the “2 sigma problem”: namely that the average student tutored one-to-one performed two standard deviations better than those students taught in classroom settings. While Bloom acknowledged that one-to-one tutoring for all students was not practically possible for educational systems, he challenged educators to “find methods of group instruction as effective as one-to-one tutoring”. This presentation will argue that the rise of artificial intelligence technologies and specifically intelligent tutoring systems - for the first time since Bloom first identified the 2 sigma problem – provide a practical means of personalized and customized instruction which may address the limitations of a group classroom environment. The presentation will begin with an explanation of the research underlying Bloom’s 2 sigma problem, including a description of the mastery learning techniques which are understood to provide significant variance in improving student performance. Following that, the presenter will show how several intelligent tutoring systems currently in use are employing mastery learning methods, and how these might be applied to learner feedback in the context of language learning, and in particular, assessment of learning. The presenter will conclude by theorizing about the diminishing role of human tutors in light of these new technologies and consider the implications of this from a historical perspective on technological innovation and adoption in education.
Keywords |
Artificial intelligence in education (AIED); explainable artificial intelligence (XAI); private tutoring; shadow education system; assessment of learning |
REFERENCES |
[1] Ahmad, N., Murugesan, S., & Kshetri, N. (2023). Generative Artificial Intelligence and the education sector. Computer, 56(6), 72-76. https://doi.org/10.1109/MC.2023.3263576 [2] Bloom, B.S. (1984). The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring. Educational Researcher, 13(6), 4-16. https://doi.org/10.3102/0013189X013006004 [3] Meyer, J. G., Urbanowicz, R. J., Martin, P. C. N., O’Connor, K., Li, R., Peng, P.-C., . . . Moore, J. H. (2023). ChatGPT and large language models in academia: opportunities and challenges. BioData Mining, 16(1). https://doi.org/10.1186/s13040-023-00339-9 [4] Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., . . . Gašević, D. (2022). Explainable Artificial Intelligence in education. Computers and Education: Artificial Intelligence, 3, 100074. https://doi.org/10.1016/j.caeai.2022.100074 |