logo logo European Journal of Educational Research

EU-JER is is a, peer reviewed, online academic research journal.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

Eurasian Society of Educational Research
Eurasian Society of Educational Research
Christiaan Huygensstraat 44, Zipcode:7533XB, Enschede, THE NETHERLANDS
Eurasian Society of Educational Research
Headquarters
Christiaan Huygensstraat 44, Zipcode:7533XB, Enschede, THE NETHERLANDS
Research Article

The Development of Teacher Performance Assessment Instruments in Boarding School

Minhayati Saleh , Kumaidi Kumaidi , Sudji Munadi , Ahmad Mardalis , Joko Subando

The objective of this study is to create a tool for evaluating teachers’ effectiveness in boarding schools. Planning and preparation stages, ins.

T

The objective of this study is to create a tool for evaluating teachers’ effectiveness in boarding schools. Planning and preparation stages, instrument testing, and measurements were used in this study to implement research on the creation of the Mardapi model instrument. In order to generate instrument items, the planning and preparation stage tasks included a literature assessment of teacher performance appraisal manuals. Data were gathered utilizing documentation approaches, and descriptive and qualitative analysis was performed. Six specialists validated the built instruments, which were subsequently put through limited testing at two boarding schools and extensive trials at nine boarding schools in Surakarta residency area. The Aiken formula was used to examine the expert’s evaluation data, and confirmatory factor analysis was used to analyze the test results. The results of this study indicate that the instrument for assessing teacher performance in boarding schools meets the validity criteria. This is indicated by the existence of loading factor values ranging from .51 to .72 (>.4) and t-sign values ranging from 4.75 to 9.25 (>1.96) and meeting the requirements of a fit model since Chi-square = 1307.95 < 2524 (2*df), p-value = .17956 (>.05), and RSMEA value = .014 (<.08). The instrument items are reliable assessment packages, and this is shown by the reliability value of omega .967 > .70. Because there is a guarantee of validity and reliability, the test can be used to further assess teacher performance in boarding schools.

Keywords: Assessment, boarding school, teacher’s performance.

cloud_download PDF
Cite
Article Metrics
Views
383
Download
1361
Citations
Crossref
0

Scopus
0

References

Abd Hamid, H. S., & Sulaiman, M. K. (2016). Factor structure of statistics anxiety rating scale (stars): EFA and CFA using Malaysian undergraduate psychology students. In C. Fook, G. Sidhu, S. Narasuman, L. Fong & S. Abdul Rahman (Eds.), 7th International Conference on University Learning and Teaching (InCULT 2014) Proceedings (pp. 149–156). Springer. https://doi.org/10.1007/978-981-287-664-5_13

Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131-142. https://doi.org/10.1177/0013164485451012

Akyuz, D. (2018). Measuring technological pedagogical content knowledge (TPACK) through performance assessment. Computers & Education, 125, 212-225. https://doi.org/10.1016/j.compedu.2018.06.012

Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214-221. https://doi.org/10.1016/j.sapharm.2018.03.066

Al-Zarnuji, B. A. I. (1996). Ta'lim al-muta'allim tariq al-ta'allum [Teaching students with learning methods]. Maktabah Al-Bushra. [In Arabic]

Angeli, C., Valanides, N., & Christodoulou, A. (2016). Theoretical considerations of technological pedagogical content knowledge. In M. C. Herring, M. J. Koehler & P. Mishra (Eds.), Handbook of technological pedagogical content knowledge (TPACK) for educators, (2nd ed., pp. 21-42). Routledge.

Ayu, S. M., & Marzuki, M. (2017). An assessment model of Islamic religion education teacher personality competence. Research and Evaluation in Education, 3(1), 77-91. https://doi.org/10.21831/reid.v3i1.14029

Bereczki, E. O., & Kárpáti, A. (2018). Teachers’ beliefs about creativity and its nurture: A systematic review of the recent research literature. Educational Research Review, 23, 25-56. https://doi.org/10.1016/j.edurev.2017.10.003

Bertule, D., Dudareva, I., Namsone, D., Cakane, L., & Butkevica, A. (2019). Framework of teacher performance assessment to support teaching 21st century skills. In E. Sheninger & B. Oakley (Eds), INTED2019- Proceedings of the 13th International Technology, Education and Development Conference (pp. 5742-5752). IATED. https://doi.org/10.21125/inted.2019.1410

Breitsohl, H. (2019). Beyond ANOVA: An introduction to structural equation models for experimental designs. Organizational Research Methods, 22(3), 649-677. https://doi.org/10.1177/1094428118754988

Buehl, M. M., & Beck, J. S. (2015). The relationship between teachers’ beliefs and teachers’ practices. In H. Fives & M. G. Gill (Eds.), International handbook of research on teachers’ beliefs (Vol. 1, pp. 66-82). Routledge.

Camras, L. A., & Halberstadt, A. G. (2017). Emotional development through the lens of affective social competence. Current Opinion in Psychology, 17, 113-117. https://doi.org/10.1016/j.copsyc.2017.07.003

Child, B. J. (2018). The boarding school as metaphor. Journal of American Indian Education, 57(1), 37-57. https://doi.org/10.1353/jaie.2018.a798599

Choi, C. H., & You, Y. Y. (2017). The study on the comparative analysis of EFA and CFA. Journal of Digital Convergence, 15(10), 103-111. https://doi.org/10.14400/JDC.2017.15.10.103

Demir, E. (2016). Evaluation of professional personality competence of physical education teachers working in secondary schools by students. Journal of Education and Training Studies, 4(2), 60-66. https://doi.org/doi:10.11114/jets.v4i2.1116

Evens, M., Elen, J., & Depaepe, F. (2015). Developing pedagogical content knowledge: Lessons learned from intervention studies. Education Research International, 2015, Article 790417. https://doi.org/10.1155/2015/790417

Fakhriyah, F., Masfuah, S., & Mardapi, D. (2019). Developing scientific literacy-based teaching materials to improve students computational thinking skills. Jurnal Pendidikan IPA Indonesia, 8(4), 482-491. https://doi.org/10.15294/jpii.v8i4.19259

Fan, Y., Chen, J., Shirkey, G., John, R., Wu, S. R., Park, H., & Shao, C. (2016). Applications of structural equation modeling (SEM) in ecological studies: an updated review. Ecological Processes, 5, Article 19. https://doi.org/10.1186/s13717-016-0063-3

Fathurrochman, I., Danim, S., Ab, S. A., Kurniah, N., & Ristianti, D. H. (2021). Theoretical review of the implementation islamic boarding school curriculum management in Indonesia. International Journal of Education Research and Development, 1(1), 1-15. https://doi.org/10.52760/ijerd.v1i1.2

Fauth, B., Decristan, J., Decker, A.-T., Büttner, G., Hardy, I., Klieme, E., & Kunter, M. (2019). The effects of teacher competence on student outcomes in elementary science education: The mediating role of teaching quality. Teaching and Teacher Education, 86, Article 102882. https://doi.org/10.1016/j.tate.2019.102882

Fauzi, I., Ubaidillah, U., Indrianto, N., Aminulloh, A., & Asshuwaifiyah, U. (2022). The pattern of development of competence, commitment, and motivation of teachers in pesantren. AL-TANZIM: Jurnal Manajemen Pendidikan Islam, 6(4), 1175-1189. https://doi.org/10.33650/al-tanzim.v6i4.3703

From, J. (2017). Pedagogical digital competence-between values, knowledge and skills. Higher Education Studies, 7(2), 43-50. https://doi.org/doi:10.5539/hes.v7n2p43

Gómez López, L. F., & Valdés, M. G. (2019). La evaluación del desempeño docente en la educación superior [The evaluation of teacher performance in higher education]. Propositos y Representaciones, 7(2), 499-515. https://doi.org/10.20511/pyr2019.v7n2.255

Hakim, A. (2015). Contribution of competence teacher (pedagogical, personality, professional competence and social) on the performance of learning. The International Journal of Engineering and Science, 4(2), 1-12. https://bit.ly/3LsCloI

Hakim, L. (2017). Development strategy of pedagogical competence to improve professionalism of Islamic education teacher. Jurnal Pendidikan Islam, 3(2), 207-220. https://doi.org/10.15575/jpi.v3i2.1406

Hartini, S., Bhakti, C. P., Hartanto, D., & Ghiffari, M. A. N. (2018). Teacher pedagogic competency development model: a literature review. In Saefurrohman, M. Muhammad, A. Adita & L. Y. Risnani (Eds.), Proceedings of the 5th Asia Pasific Education Conference (AECON 2018) (pp. 211-215). Atlantis Press. https://doi.org/10.2991/aecon-18.2018.40

Hasmayni, B., Siregar, F. H., & Aziz, A. (2019). Establishment of character through boarding school education in students in pondok pesantren. In B. Sinaga, R. Husein & J. Rajagukguk (Eds.), Proceedings of the 4th Annual International Seminar on Transformative Education and Educational Leadership (AISTEEL 2019) (pp. 318-321). Atlantis Press. https://doi.org/10.2991/aisteel-19.2019.51

Heale, R., & Twycross, A. (2015). Validity and reliability in quantitative studies. Evidence-Based Nursing, 18(3), 66-67. https://doi.org/10.1136/eb-2015-102129

Hébert, C. (2017). What do we really know about the edTPA? Research, PACT, and packaging a local teacher performance assessment for national use. The Educational Forum, 81(1), 68-82. https://doi.org/10.1080/00131725.2016.1242680

Hirn, S. L., Thomas, J., & Zoelch, C. (2019). The role of empathy in the development of social competence: a study of German school leavers. International Journal of Adolescence and Youth, 24(4), 395-407. https://doi.org/10.1080/02673843.2018.1548361

Husna, F., Yunus, N. R., & Gunawan, A. (2021). Indonesian legal politics of Islamic boarding school curriculum regulation. SALAM: Jurnal Sosial dan Budaya Syar-i, 8(5), 1675-1692. https://doi.org/10.15408/sjsbs.v8i5.22877

Ilyasin, M. (2020). Transformation of learning management: Integrative study of Islamic boarding school curriculum. Dinamika Ilmu, 20(1), 13-22. https://doi.org/10.21093/di.v20i1.2006

Indra, H. (2017). Salafiyah curriculum at Islamic boarding school in the globalization era. TARBIYA: Journal of Education in Muslim Society, 4(1), 74-88. https://doi.org/10.15408/tjems.v4i1.4960

Ismiatun, A. N., & Andrisyah, A. (2021). Improving early childhood education teacher profesional competence through steam based learning plan training. Journal of Character Education Society, 4(2), 261-270. https://bit.ly/JCES_4068

Japar, M., & Fadhillah, D. N. (2019). Teacher competence: the implementation of scientific approach in civic education learning. In S. Ulfa, Sunaryono, A. Tauqif & A. P. Wibawa (Eds.), Proceedings of the 2nd International Conference on Learning Innovation - ICLI (pp. 114-120). Scitepress. https://doi.org/10.5220/0008408601140120

Jaros, S. J., Jermier, J. M., Koehler, J. W., & Sincich, T. (2017). Effects of continuance, affective, and moral commitment on the withdrawal process: An evaluation of eight structural equation models. Academy of Management Journal, 36(5), 951-995. https://journals.aom.org/doi/10.5465/256642

Kaiser, G., Blömeke, S., König, J., Busse, A., Döhrmann, M., & Hoth, J. (2017). Professional competencies of (prospective) mathematics teachers—Cognitive versus situated approaches. Educational Studies in Mathematics, 94, 161-182. https://doi.org/10.1007/s10649-016-9713-8

Kementerian Pendidikan dan Kebudayaan [Ministry of Education and Culture]. (2016). Pedoman pengelolaan penilaian kinerja guru tahun 2016 [Teacher performance assessment guidelines in 2016]. https://bit.ly/45jc3y0

Khreisat, M. N., & Mugableh, A. I. (2020). Multidimensionality of EFL recreational reading attitudes: An EFA and CFA approach. Journal of Research in Applied Linguistics, 11(2), 57-69. https://bit.ly/JRAL_15946

Kusumaningrum, D. E., Sumarsono, R. B., & Gunawan, I. (2019). Professional ethics and teacher teaching performance: Measurement of teacher empowerment with a soft system methodology approach. International Journal of Innovation, Creativity and Change, 5(4), 611-624. https://bit.ly/ijicc_54216

Laiser, S., & Makewa, L. N. (2016). The influence of boarding school to young children: A case of two boarding schools in Hai District in Kilimanjaro, Tanzania. International Journal of Education and Research, 4(6), 73-84. https://bit.ly/42hBei9

Lazarides, R., Gaspard, H., & Dicke, A.-L. (2019). Dynamics of classroom motivation: Teacher enthusiasm and the development of math interest and teacher support. Learning and Instruction, 60, 126-137. https://doi.org/10.1016/j.learninstruc.2018.01.012

L'Ecuyer, K. M., Subramaniam, D. S., & Reangsing, C. (2020). Development of the Preceptor Self-Assessment Tool and use of the content validity index. The Journal of Continuing Education in Nursing, 51(10), 469-476. https://doi.org/10.3928/00220124-20200914-09

Marsh, H. W., Guo, J., Dicke, T., Parker, P. D., & Craven, R. G. (2020). Confirmatory factor analysis (CFA), exploratory structural equation modeling (ESEM), and set-ESEM: optimal balance between goodness of fit and parsimony. Multivariate Behavioral Research, 55(1), 102-119. https://doi.org/10.1080/00273171.2019.1602503

Mishra, M. (2016). Confirmatory factor analysis (CFA) as an analytical technique to assess measurement error in survey research: A review. Paradigm, 20(2), 97-112. https://doi.org/10.1177/0971890716672933

Mohamad, M. M., Sulaiman, N. L., Sern, L. C., & Salleh, K. M. (2015). Measuring the validity and reliability of research instruments. Procedia-Social and Behavioral Sciences, 204, 164-171. https://doi.org/10.1016/j.sbspro.2015.08.129

Murray, A. L., Booth, T., Eisner, M., Obsuth, I., & Ribeaud, D. (2019). Quantifying the strength of general factors in psychopathology: A comparison of CFA with maximum likelihood estimation, BSEM, and ESEM/EFA bifactor approaches. Journal of Personality Assessment, 101(6), 631-643. https://doi.org/10.1080/00223891.2018.1468338

Nuraini, U., Nagari, P. M., Nuris, D. M., & Han, C. G. K. (2021). Developing teachers’ social and personality competencies in online teaching: A new challenge. In A. Appolloni, F. Caracciolo, Z. Ding, P. Gogas, G. Huang, G. Nartea, T. Ngo & W. Strielkowski (Eds.), Proceedings of the Sixth Padang International Conference on Economics Education, Economics, Business and Management, Accounting and Entrepreneurship (PICEEBA 2020) (pp. 345-350). Atlantis Press. https://doi.org/10.2991/aebmr.k.210616.052

Pahrudin, P., Martono, T., & Murtini, W. (2016). The effect of pedagogic competency, personality, professional and social competency teacher to study achievement of economic lesson in state senior high school of east lombok district academic year 2015/2016. Proceeding of the International Conference on Teacher Training and Education, 2(2), 332–345. https://jurnal.uns.ac.id/ictte/article/view/8192

Perry, J. L., Nicholls, A. R., Clough, P. J., & Crust, L. (2015). Assessing model fit: Caveats and recommendations for confirmatory factor analysis and exploratory structural equation modeling. Measurement in Physical Education and Exercise Science, 19(1), 12-21. https://doi.org/10.1080/1091367X.2014.952370

Polit, D. F. (2015). Assessing measurement in health: Beyond reliability and validity. International Journal of Nursing Studies, 52(11), 1746-1753. https://doi.org/10.1016/j.ijnurstu.2015.07.002

Prasetyo, M. A. M. (2016). The relationship between kyai managerial competence, the management based Islamic boarding school (MBIBS), and the educator‟ s performance in Islamic boarding school: Approach concept. In A. Masum, Sarbini, Achyani, N. Suseno & A. Sujarwanto (Eds.), Proceedings of the First International Conference on Education (ICONLEE2016) (pp. 64-69). Lembaga Penelitian UM Metro. https://bit.ly/3MNzS8Y

Putra, S. D., Borman, R. I., & Arifin, G. H. (2022). Assessment of teacher performance in SMK Informatika Bina Generasi using electronic-based rating scale and weighted product methods to determine the best teacher performance. International Journal of Informatics, Economics, Management and Science, 1(1), 55-62. https://doi.org/10.52362/ijiems.v1i1.693

Quaigrain, K., & Arhin, A. K. (2017). Using reliability and item analysis to evaluate a teacher-developed test in educational measurement and evaluation. Cogent Education, 4(1), Article 1301013. https://doi.org/10.1080/2331186X.2017.1301013

Rahayu, W. P., Churiyah, M., Martha, J. A., & Basuki, A. (2020). Analysis professional and pedagogic competencies on professional teacher education participants in position phase 1 study programs of business and marketing education. Journal of Education and Social Science, 14(1), 19-28. https://bit.ly/JESOC_203

Ramadhan, S., Mardapi, D., Prasetyo, Z. K., & Utomo, H. B. (2019). The development of an instrument to measure the higher order thinking skill in physics. European Journal of Educational Research, 8(3), 743-751. https://doi.org/10.12973/eu-jer.8.3.743

Retnowati, T. H., Mardapi, D., Kartowagiran, B., & Hamdi, S. (2021). A model of lecturer performance evaluation: Sustainable lecturer performance mapping. International Journal of Instruction, 14(2), 83-102. https://doi.org/10.29333/iji.2021.1426a

Rusilowati, U., & Wahyudi, W. (2020). The significance of educator certification in developing pedagogy, personality, social and professional competencies. In A. Rachmiatie, D. M. Sodik, D. Ahmadi, I. J. Triwardhani, A. Satriani, R. Adwiyah & Alhamuddin (Eds.), Proceedings of the 2nd Social and Humaniora Research Symposium (SoRes 2019) (pp. 446-451). Atlantis Press. https://doi.org/10.2991/assehr.k.200225.095

Saidah, U., Bin-Tahir, S. Z., & Mufidah, N. (2018). Arabic teachers’competence: A case of madrasah schools in Maluku. Ijaz Arabi Journal of Arabic Learning, 1(2), 139-150. https://doi.org/10.18860/ijazarabi.v1i2.5584

Salminen, J., Pakarinen, E., Poikkeus, A.-M., Laakso, M.-L., & Lerkkanen, M.-K. (2022). Teacher-child interactions as a context for developing social competence in toddler classrooms. Journal of Early Childhood Education Research, 11(1), 38-67. https://bit.ly/3NC9Ast

Santoso, F. W., Nurdyansyah, N., & Churrahman, T. (2020). The effect of teacher's social competence on increasing human resources at SMP Muhammadiyah 9 Tanggulangin boarding school. Proceedings of The ICECRS, 6. https://doi.org/10.21070/icecrs2020384

Setiawan, A., Mardapi, D., Supriyoko, & Andrian, D. (2019). The development of instrument for assessing students' affective domain using self-and peer-assessment models. International Journal of Instruction, 12(3), 425-438. https://doi.org/10.29333/iji.2019.12326a

Shrotryia, V. K., & Dhanda, U. (2019). Content validity of assessment instrument for employee engagement. Sage Open, 9(1), 1-7. https://doi.org/10.1177/2158244018821751

Shujja, S., & Malik, F. (2015). Social competence scale for adolescents (SCSA): Development and validation within cultural perspective. Journal of Behavioural Sciences, 25(1), 59-77. https://bit.ly/41UBlk0

Simons, M., Meeus, W., & T'Sas, J. (2017). Measuring media literacy for media education: development of a questionnaire for teachers' competencies. Journal of Media Literacy Education, 9(1), 99-115. https://doi.org/10.23860/JMLE-2017-9-1-7

Souza, A. C. d., Alexandre, N. M. C., & Guirardello, E. d. B. (2017). Psychometric properties in instruments evaluation of reliability and validity. Epidemiologia e Servicos de Saude, 26(3), 649-659. https://doi.org/10.5123/S1679-49742017000300022

Stacey, M., Talbot, D., Buchanan, J., & Mayer, D. (2020). The development of an Australian teacher performance assessment: Lessons from the international literature. Asia-Pacific Journal of Teacher Education, 48(5), 508-519. https://doi.org/10.1080/1359866X.2019.1669137

Stalikas, A., Kyriazos, T. A., Yotsidi, V., & Prassa, K. (2018). Using bifactor EFA, bifactor CFA and exploratory structural equation modeling to validate factor structure of the Meaning in Life Questionnaire, Greek Version. Psychology, 9(03), 348-371. https://doi.org/10.4236/psych.2018.93022

Stronge, J. H. (2018). Qualities of effective teachers. ASCD. https://bit.ly/41sYqcG

Subando, J., Kartawagiran, B., & Munadi, S. (2021). Development of curriculum evaluation model as a foundation in strengthening the ideology of Al-Irsyad education. Journal of Research and Educational Research Evaluation, 10(2), 86-99. https://doi.org/10.15294/jere.v10i2.52676

Subando, J., Kartowagiran, B., & Munadi, S. (2020). The development of instrument for evaluating the process of strengthening religion ideology. In M. Salimi & D. A. Nugraha (Eds.), Proceedings of the 4th International Conference on Learning Innovation and Quality Education, September 2020 (pp. 1-8). ACM. https://doi.org/10.1145/3452144.3452207

Subando, J., Kartowagiran, B., & Munadi, S. (2021). Development of curriculum design evaluation instruments in strengthening Al-Irsyad ideology in Indonesia. International Journal of Evaluation and Research in Education, 10(4), 1426-1435. https://doi.org/10.11591/ijere.v10i4.21758  

Sumaryanta, Mardapi, D., Sugiman, & Herawan, T. (2018). Assessing teacher competence and its follow-up to support professional development sustainability. Journal of Teacher Education for Sustainability, 20(1), 106-123. https://doi.org/10.2478/jtes-2018-0007

Taherdoost, H. (2016). Validity and reliability of the research instrument; how to test the validation of a questionnaire/survey in a research. How to test the validation of a questionnaire/survey in a research. International Journal of Academic Research in Management, 5(3), 28-36. http://doi.org/10.2139/ssrn.3205040  

Temnyatkina, O., & Tokmeninova, D. (2018). Modern approaches to teacher performance assessment. An overview of foreign publications. Educational Studies Moscow, 1(3), 180-195. https://doi.org/10.17323/1814-9545-2018-3-180-195 [In Russian]

Thahir, M. (2014). The role and function of Islamic boarding school: An Indonesian context. Tawarikh, 5(2), 197-208. https://bit.ly/3DFjjrE

Ulum, S., Mispani, M., Jaenullah, J., & Thohir, M. (2021). The public perception of Islamic education at Wali Songo Islamic boarding school Sukajadi village, Bumiratu Nuban district. Bulletin of Pedagogical Research, 1(2), 187-197. https://doi.org/10.51278/bpr.v1i2.190

Utami, D. R. F., Latiana, L., & Pranoto, Y. K. S. (2020). A study on the influence of personality and social competencies on the performance of kindergarten teachers based on the principal's assessment. Journal of Primary Education, 9(1), 92-98. https://bit.ly/3OPBvEf

Van Driel, J. (2021). Developing science teachers’ pedagogical content knowledge. In C. Milne & K. Scantlebury (Eds.), Science teachers’ knowledge development (pp. 1-37). Brill. https://doi.org/10.1163/9789004505452_001  

Watkins, M. W. (2017). The reliability of multidimensional neuropsychological measures: From alpha to omega. The Clinical Neuropsychologist, 31(6-7), 1113-1126. https://doi.org/10.1080/13854046.2017.1317364

Yoo, J. H. (2016). The effect of professional development on teacher efficacy and teachers' self-analysis of their efficacy change. Journal of Teacher Education for Sustainability, 18(1), 84-94. https://doi.org/10.1515/jtes-2016-0007  

Yusoff, M. S. B. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal, 11(2), 49-54. https://doi.org/10.21315/eimj2019.11.2.6

Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A.-R. (2015). Design and implementation content validity study: development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165-178. https://doi.org/10.15171/jcs.2015.017

...