Learning to Teach AI: Design and Validation of a Questionnaire on Artificial Intelligence Training for Teachers
Manuel Reina-Parrado
,
Pedro Román-Graván
,
Carlos Hervás-Gómez
This study aims to design, produce, and validate an information collection instrument to evaluate the opinions of teachers at non-university education.
- Pub. date: January 15, 2025
- Online Pub. date: January 08, 2025
- Pages: 249-265
- 528 Downloads
- 2902 Views
- 0 Citations
Abstract:
This study aims to design, produce, and validate an information collection instrument to evaluate the opinions of teachers at non-university educational levels on the quality of training in artificial intelligence (AI) applied to education. The questionnaire was structured around five key dimensions: (a) knowledge and previous experience in AI, (b) perception of the benefits and applications of AI in education, (c) AI training, and (d) expectations of the courses and (e) impact on teaching practice. Validation was performed through expert judgment, which ensured the internal validity and reliability of the instrument. Statistical analyses, which included measures of central tendency, dispersion, and internal consistency, yielded a Cronbach's alpha of .953, indicating excellent reliability. The findings reveal a generally positive attitude towards AI in education, emphasizing its potential to personalize learning and improve academic outcomes. However, significant variability in teachers' training experiences underscores the need for more standardized training programs. The validated questionnaire emerges as a reliable tool for future research on teachers' perceptions of AI in educational contexts. From a practical perspective, the validated questionnaire provides a structured framework for assessing teacher training programs in AI, offering valuable insights for improving educational policies and program design. It enables a deeper exploration of educational AI, a field still in its early stages of research and implementation. This tool supports the development of targeted training initiatives, fostering more effective integration of AI into educational practices.
Keywords: Artificial intelligence, continuous training, professional recycling, ICT, training courses.
References
Baek, C., Tate, T., & Warschauer, M. (2024). "ChatGPT seems too good to be true": College students’ use and perceptions of generative AI. Computers and Education: Artificial Intelligence, 7, Article 100294. https://doi.org/10.1016/j.caeai.2024.100294
Barahona, S., Centella, P., Gual-Arnau, X., Ibáñez, M. V., & Simó, A. (2018). Generalized linear models for geometrical current predictors: An application to predict garment fit. arXiv. https://doi.org/10.48550/arXiv.1803.03019
Bland, J. M., & Altman, D. G. (1996). Statistics notes: Measurement error and correlation coefficients. BMJ, 313, Article 41. https://doi.org/10.1136/bmj.313.7048.41
Chang, C.-Y., Hwang, G.-J., & Gau, M.-L. (2022). Promoting students' learning achievement and self-efficacy: A mobile chatbot approach for nursing training. British Journal of Educational Technology, 53, 171-188. https://doi.org/10.1111/bjet.13158
Chatterjee, S., & Bhattacharjee, K. K. (2020). Adoption of artificial intelligence in higher education: A quantitative analysis using structural equation modelling. Education and Information Technologies, 25, 3443-3463. https://doi.org/10.1007/s10639-020-10159-7
Cruz-Jesus, F., Castelli, M., Oliveira, T., Mendes, R., Nunes, C., Sa-Velho, M., & Rosa-Louro, A. (2020). Using artificial intelligence methods to assess academic achievement in public high schools of a European Union country. Heliyon, 6(6), Article 04081. https://doi.org/10.1016/j.heliyon.2020.e04081
DeCarlo, L. T. (1997). On the meaning and use of kurtosis. Psychological Methods, 2(3), 292–307. https://doi.org/10.1037/1082-989X.2.3.292
Druzhinina, O. V., Karpacheva, I. A., Masina, O. N., & Petrov, A. A. (2021). Development of an integrated complex of knowledge base and tools of expert systems for assessing knowledge of students in mathematics within the framework of a hybrid intelligent learning environment. International Journal of Education and Information Technologies, 15, 122-129. https://doi.org/10.46300/9109.2021.15.12
Fabián, Z. (2019). Mean, mode or median? The score mean. Communications in Statistics - Theory and Methods, 37(2), 119-132. https://doi.org/10.1080/03610926.2019.1666142
Fleischmann, K. (2024). Generative artificial intelligence in graphic design education: A student perspective [L'intelligence artificielle générative dans l'enseignement du graphisme: Le point de vue d'un étudiant]. Canadian Journal of Learning and Technology, 50(1), 1-17. https://doi.org/10.21432/cjlt28618
Garcia Corretjer, M. A. (2022). On the relationship between people, objects, and interactive technologies: Transforming digital and physical experiences through the process of realizing empathy [Doctoral dissertation, Universitat Ramon Llull]. TDX http://hdl.handle.net/10803/675718
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023). How does ChatGPT perform on the United States medical licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Medical Education, 9, Article e45312. https://doi.org/10.2196/45312
Guggemos, J. (2024). To fear or not to fear – Human resource development professionals’ positioning towards artificial intelligence with a focus on augmentation. Computers and Education: Artificial Intelligence, 7, Article 100260. https://doi.org/10.1016/j.caeai.2024.100260
Harati, H., Sujo-Montes, L., Tu, C.-H., Armfield, S. J. W., & Yen, C.-J. (2021). Assessment and learning in knowledge spaces (ALEKS) adaptive system impact on students' perception and self-regulated learning skills. Education Sciences, 11(10), Article 603. https://doi.org/10.3390/educsci11100603
How, M.-L., & Hung, W. L. D. (2019). Educing AI-thinking in science, technology, engineering, arts, and mathematics (STEAM) education. Education Sciences, 9(3), Article 184. https://doi.org/10.3390/educsci9030184
Jara, I., & Ochoa, J. M. (2020). Uses and effects of artificial intelligence in education. Inter-American Development Bank. https://doi.org/10.18235/0002380
Jeong, G. H. (2020). Artificial intelligence, machine learning, and deep learning in women's health nursing. Korean Journal of Women Health Nursing, 26(1), 5-9. https://doi.org/10.4069/kjwhn.2020.03.11
Jokhan, A., Chand, A. A., Singh, V., & Mamun, K. A. (2022). Increased digital resource consumption in higher educational institutions and the artificial intelligence role in informing decisions related to student performance. Sustainability, 14(4), Article 2377. https://doi.org/10.3390/su14042377
Joudieh, N., Harb, H., Zaki, C., Ramadan, A., Saker, L., Mostafa, N., & Tannoury, L. (2024). Higher education in the era of artificial intelligence: Academic freedom as a case study. Discover Sustainability, 5, Article 220. https://doi.org/10.1007/s43621-024-00425-w
Kadhim, M. K., & Hassan, A. K. (2020). Towards intelligent e-learning systems: A hybrid model for predicting the learning continuity in Iraqi higher education. Webology, 17(2), 172-188. https://doi.org/10.14704/WEB/V17I2/WEB17023
Kanglang, L., & Afzaal, M. (2021). Artificial intelligence (AI) and translation teaching: A critical perspective on the transformation of education. International Journal of Educational Sciences, 33(1–3), 64-73. https://doi.org/10.31901/24566322.2021/33.1-3.1159
Khan, I., Ahmad, A. R., Jabeur, N., & Mahdi, M. N. (2021). An artificial intelligence approach to monitor student performance and devise preventive measures. Smart Learning Environments, 8, Article 17. https://doi.org/10.1186/s40561-021-00161-y
Khasawneh, M. A. S. (2024). Teacher opinions on the role of educational robots in enhancing programming skills among hearing-impaired students. International Journal of Learning, Teaching and Educational Research, 23(5), 309-322. https://doi.org/10.26803/ijlter.23.5.16
Kubsch, M., Czinczel, B., Lossjew, J., Wyrwich, T., Bednorz, D., Bernholt, S., Fiedler, D., Strauß, S., Cress, U., Drachsler, H., Neumann, K., & Rummel, N. (2022). Toward learning progression analytics — Developing learning environments for the automated analysis of learning using evidence-centered design. Frontiers in Education, 7, Article 981910. https://doi.org/10.3389/feduc.2022.981910
Kuleto, V., Ilić, M., Dumangiu, M., Ranković, M., Martins, O. M. D., Păun, D., & Mihoreanu, L. (2021). Exploring opportunities and challenges of artificial intelligence and machine learning in higher education institutions. Sustainability, 13(18) Article 10424. https://doi.org/10.3390/su131810424
Lampos, V., Mintz, J., & Qu, X. (2021). An artificial intelligence approach for selecting effective teacher communication strategies in autism education. NPJ Science of Learning, 6, Article 25. https://doi.org/10.1038/s41539-021-00102-x
Lee, D., & Yeo, S. (2022). Developing an AI-based chatbot for practicing responsive teaching in mathematics. Computers and Education, 191, Article 104646. https://doi.org/10.1016/j.compedu.2022.104646
Li, J., Wang, X., Ahmad, S., Huang, X., & Khan, Y. A. (2023). Optimization of investment strategies through machine learning. Heliyon, 9(5), Article e16155. https://doi.org/10.1016/j.heliyon.2023.e16155
Luckin, R., & Cukurova, M. (2019). Designing educational technologies in the age of AI: A learning sciences-driven approach. British Journal of Educational Technology, 50(6), 2824-2838. https://doi.org/10.1111/bjet.12861
Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. Pearson.
Marques, L. S., Gresse von Wangenheim, C., & Hauck, J. C. R. (2020). Teaching machine learning in school: A systematic mapping of the state of the art. Informatics in Education, 19(2), 283-321. https://doi.org/10.15388/INFEDU.2020.14
Means, B., Bakia, M., & Murphy, R. (2014). Learning online: What research tells us about whether, when and how. Routledge. https://doi.org/10.4324/9780203095959
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric Theory (3rd ed.). McGraw-Hill.
Palasundram, K., Sharef, N. M., Nasharuddin, N. A., Kasmiran, K. A., & Azman, A. (2019). Sequence to sequence model performance for education chatbot. International Journal of Emerging Technologies in Learning, 14(24), 56-68. https://doi.org/10.3991/ijet.v14i24.12187
Pikhart, M., & Klímová, B. (2020). eLearning 4.0 as a sustainability strategy for generation z language learners: Applied linguistics of second language acquisition in younger adults. Societies, 10(2), Article 38. https://doi.org/10.3390/soc10020038
Pozdniakov, S., Brazil, J., Abdi, S., Bakharia, A., Sadiq, S., Gašević, D., Denny, P., & Khosravi, H. (2024). Large language models meet user interfaces: The case of provisioning feedback. Computers and Education: Artificial Intelligence, 7, Article 100289. https://doi.org/10.1016/j.caeai.2024.100289
Punie, Y. (Ed.)., & Redecker, C. (2017). European framework for the digital competence of educators: DigCompEdu. Publications Office of the European Union. https://publications.jrc.ec.europa.eu/repository/handle/JRC107466
Rodríguez-García, J. D., Moreno-León, J., Román-González, M., & Robles, G. (2020). LearningML: A tool to foster computational thinking skills through practical artificial intelligence projects. Journal of Distance Education, 20(63), Article 07. https://doi.org/10.6018/RED.410121
Sanusi, I. T., Ayanwale, M. A., & Tolorunleke, A. E. (2024). Investigating pre-service teachers’ artificial intelligence perception from the perspective of planned behavior theory. Computers and Education: Artificial Intelligence, 6, Article 100202. https://doi.org/10.1016/j.caeai.2024.100202
Selwyn, N. (2017). Education and technology: Key issues and debates (2nd ed.). Bloomsbury Academic.
Sharma, K., Papamitsiou, Z., & Giannakos, M. (2019). Building pipelines for educational data using AI and multimodal analytics: A "grey-box" approach. British Journal of Educational Technology, 50(6), 3004-3031. https://doi.org/10.1111/bjet.12854
Singh, S. V., & Hiran, K. K. (2022). The impact of AI on teaching and learning in higher education technology. Journal of Higher Education Theory and Practice, 22(13), 135-148. https://doi.org/10.33423/jhetp.v22i13.5514
Soysal, D., Bani-Yaghoub, M., & Riggers-Piehl, T. A. (2022). A machine learning approach to evaluate variables of math anxiety in STEM students. Pedagogical Research, 7(2), Article em0125. https://doi.org/10.29333/pr/11978
Stadelmann, T., Keuzenkamp, J., Grabner, H., & Würsch, C. (2021). The AI-Atlas: Didactics for teaching AI and machine learning on-site, online, and hybrid. Education Sciences, 11(7), Article 318. https://doi.org/10.3390/educsci11070318
Stöhr, C., Ou, A. W., & Malmström, H. (2024). Perceptions and usage of AI chatbots among students in higher education across genders, academic levels, and fields of study. Computers and Education: Artificial Intelligence, 7, Article 100259. https://doi.org/10.1016/j.caeai.2024.100259
Stokel-Walker, C. (2022). AI bot ChatGPT writes smart essays — should academics worry? Nature. Advance online publication. https://doi.org/10.1038/d41586-022-04397-7
Su, J., Zhong, Y., & Ng, D. T. K. (2022). A meta-review of literature on educational approaches for teaching AI at the K-12 levels in the Asia-Pacific region. Computers and Education: Artificial Intelligence, 3, Article 100065. https://doi.org/10.1016/j.caeai.2022.100065
Talan, T. (2021). Artificial Intelligence in Education: A bibliometric study. International Journal of Research in Education and Science, 7(3), 822-837. https://doi.org/10.46328/ijres.2409
Thompson, A., Gallacher, A., & Howarth, M. (2018). Stimulating task interest: Human partners or chatbots? In P. Taalas, J. Jalkanen, L. Bradley, & S. Thouësny (Eds.), Future-proof CALL: Language learning as exploration and encounters (pp. 302-306). EUROCALL. https://doi.org/10.14705/rpnet.2018.26.854
Trochim, W. M. K., & Donnelly, J. P. (2006). The research methods knowledge base (3rd ed.). Atomic Dog Publishing.
Vázquez-Cano, E., Mengual-Andrés, S., & López-Meneses, E. (2021). Chatbot to improve learning punctuation in Spanish and to enhance open and flexible learning environments. International Journal of Educational Technology in Higher Education, 18, Article 33. https://doi.org/10.1186/s41239-021-00269-8
Vieluf, S., Kaplan, D., Klieme, E., & Bayer, S. (2012). Teaching practices and pedagogical innovation: Evidence from TALIS. OECD Publishing. https://doi.org/10.1787/9789264123540-en
Vijayakumar, R., Bhuvaneshwari, B., Adith, S., & Deepika, M. (2019). AI-based student bot for academic information system using machine learning. International Journal of Scientific Research in Computer Science, Engineering and Information Technology, 5(2), 590-596. https://doi.org/10.32628/cseit1952171
Winkler, R., & Söllner, M. (2018). Unleashing the potential of chatbots in education: A state-of-the-art analysis. In Proceedings of the Academy of Management Annual Meeting (AOM). https://www.alexandria.unisg.ch/publications/254848
Zammit, M., Voulgari, I., Liapis, A., & Yannakakis, G. N. (2022). Learn to machine learn via games in the classroom. Frontiers in Education, 7, Article 913530. https://doi.org/10.3389/feduc.2022.913530
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? International Journal of Educational Technology in Higher Education, 16, Article 39. https://doi.org/10.1186/s41239-019-0171-0