Development and Validation of an Instrument to Measure a Performance of Vocational High School
Some evaluation has been carried out in Vocational High Schools (VHSs), but most of it focuses on the documents or passive data rather than the proces.
- Pub. date: July 15, 2020
- Pages: 955-966
- 708 Downloads
- 1249 Views
- 10 Citations
Some evaluation has been carried out in Vocational High Schools (VHSs), but most of it focuses on the documents or passive data rather than the processes happening in VHSs. Thus, this research focuses on the evaluation of VHS performances where the process is initiated with identifying the constructs and developing the instruments of performance evaluation for VHSs with Technology and Engineering expertise programs. Based on the problems found in the field, before conducting the evaluation, the researcher needs to, at first, develop the instrument of evaluation through three stages of development. The first stage is analyzing the concepts related to the evaluation by examining the factors affecting VHS performances. In the second stage, instrument development and instrument analysis (content validation) are conducted with the help of experts. The third stage is performance evaluation in VHSs located in Yogyakarta. The evaluation employs a set of instruments developed by the researchers. This research has produced a set of instruments for performance evaluation, which can be used extensively in VHSs. Based on the evaluation, it is found that the aspects of general management and academic management of the VHSs being studied are considered “Good”.
Keywords: Evaluation, school performance, vocational high school.
References
Aiken, L. R. (1980). Content validity and reliability of single items or questionnaires. Educational and Psychological Measurement, 40(4), 955-959. https://doi.org/10.1177/001316448004000419
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement 45(1), 131-142. https://doi.org/10.1177/0013164485451012
Akareem, H. S., & Hossain, S. S. (2016). Determinants of education quality: what makes students’ perception different? Open Review of Educational Research, 3(1), 52-67.
Al-Ali, S. (2016). A model for enhancing the quality of vocational education graduates the college of technological studies, Kuwait, as a case study. Researchers World, 7(2), 96-101. https://doi.org/10.18843/rwjasc/v7i2/10
Beilmann, M., & Espenberg, K. (2016). The reasons for the interruption of vocational training in Estonian vocational schools. Journal of Vocational Education & Training, 68(1), 87-101.
Billett, S. (2011). Vocational education: Purposes, traditions and prospects. Springer Science+Business Media B.V.
Cervai, S., Cian, L., Berlanga, A., Borelli, M., & Kekale, T. (2013). Assessing the quality of the learning outcome in vocational education: The Expero model. Journal of Workplace Learning, 25(3), 198-210.
Chouinard, J. A., & Cousins, J. B. (2015). The journey from rhetoric to reality: Participatory evaluation in a development context. Educational Assessment, Evaluation and Accountability, 27(1), 5-39. https://doi.org/10.1007/s11092-013-9184-8
Coates, H. (2009). Building quality foundations: indicators and instruments to measure the quality of vocational education and training. Journal of Vocational Education and Training, 61(4), 517–534. https://doi.org/10.1080/ 13636820903326532
DeNisi, A., & Smith, C. E. (2014). Performance appraisal, performance management, and firm-level performance: a review, a proposed model, and new directions for future research. The Academy of Management Annals, 8(1), 127-179. https://doi.org/10.5465/19416520.2014.873178
Fallon, L. M., Collier-Meek, M. A., Maggin, D. M., Sanetti, L. M., & Johnson, A. H. (2015). Is performance feedback for educators an evidence-based practice? A systematic review and evaluation based on single-case research. Exceptional Children, 81(2), 227-246.
Fleming, J., & Kleinhenz, E. (2007). Towards a moving school: Developing a professional learning and performance culture. Australian Council for Educational Research Ltd.
Gable, R. K. & Wolf, M. B. (1993). Instrument development in the affective domain : measuring attitudes and values in corporate and school settings. Springer Science+Business Media.
Jaedun, A. (2010). Model asesmen kinerja sekolah berbasis peserta didik [Student-based school performance assessment model]. Journal of Research and Education Evaluation/ Jurnal penelitian dan evaluasi pendidikan, 14(1), 100-122. https://doi.org/10.21831/pep.v14i1.1978
Jelantik, A., Dantes, N., & Suarni, N. K. (2014). Studi evaluatif tentang kinerja sekolah pada sekolah Smk rekayasa Denpasar [Evaluative studies on school performance at rekayasa Denpasar vocational high school]. Journal of Indonesian Education Administration/ Jurnal Administrasi Pendidikan Indonesia, 5(1), 41-50. https://doi.org /10.23887/japi.v5i1.1405
Lillis, K., & Hogan, D. (1983). Dilemmas of diversification: problems associated with vocational education in developing countries. Comparative Education, 19(1), 89-107. https://doi.org/10.1080/0305006830190108
Madani, R. (2019). Analysis of educational quality, a goal of education for all policy. Higher Education Studies, 9(1), 100-109. https://doi.org/10.5539/hes.v9n1p100.
Mardapi, D. (2017, February 14). The role of evaluation in improving the quality of vocational education [Paper Presentation]. The University Senate's Open Session for Retiring Professor, Yogyakarta State University, Yogyakarta, Indonesia.
Ministry of Education and Culture. (2016). Revitalisasi pendidikan vokasi kementerian pendidikan dan kebudayaan. [Revitalization of vocational education ministry of education and culture]. Directorate of Vocational High School Development, Ministry of Education and Culture.
Mo, Y. (1992). The maintenance of academic standards at Tuen Mun Technical Institute, Hong Kong. The Vocational Aspect of Education, 44(3), 259-281. https://doi.org/10.1080/10408347308003971
Moodie, G. (2002). Identifying vocational education and training. Journal of Vocational Education and Training, 54(2), 249-266. https://doi.org/10.1080/13636820200200197
Panina, T. S., Kostyuk, N. V., Pakhomova, E. A., & Dochkin, S. A. (2019). Innovation potential of vocational education and training institutions as a basis for high quality professional training. Contemporary Dilemmas: Education, Politics and Values/ Dilemas Contemporaneos: Educacion, Politica y Valore, 6 (Special), 1-29.
Purkey, S. C., & Smith, M. S. (1983). Effective schools: A review. The Elementary School Journal, 83(4), 427-452. https://doi.org/10.1086/461325
Ramadhan, S., Mardapi, D., Prasetyo, Z. K., & Utomo, H. B. (2019). The development of an instrument to measure the higher order thinking skill in Physics. European Journal of Educational Research, 8(3), 743-751. https://doi.org/10. 12973/eu-jer.8.3.743
Ramadhan, S., Nasran, S. A., Utomo, H. B., Musyadad, F., & Ishak, S. (2019). The implementation of generalisability theory on physics teachers’ competency assessment instruments development. International Journal of Scientific & Technology Research, 8(7), 333-337.
Ramadhan, S., Sumiharsono, R., Mardapi, D., & Prasetyo, Z. K. (2020). The Quality of Test Instruments Constructed by Teachers in Bima Regency, Indonesia: Document Analysis. International Journal of Instruction, 13(2), 507-518 . https://doi.org/10.29333/IJI.2020.13235a.
Retnawati, H., Hadi, S., Nugraha, A. C., Sulistyaningsih, E., Djidu, H., Apino, E., Iryanti, H.D., Arlinwibowo, J. (2017). Implementing the computer-based national examination in indonesian schools: the challenges and strategies. Problems of Education in the 21st Century, 75(6) 612-633.
Rojewski, J. W. (2009). A conceptual framework for technical and vocational education and training. In R. Maclean, D. Wilson, & C. Chinien (Eds.),. International Handbook of Education for the Changing World of Work: Bridging Academic and Vocational Learning (p. 19-36). UNESCO-UNEVOC (Springer Science+Business Media B.V).
Rossi, P. H., Lipsey, M. W., & Henry, G. T. (2018). Evaluation: A systematic approach. Sage publications
Saunders, R. (2012). Assessment of professional development for teachers in the vocational education and training sector: An examination of the concerns based adoption model. Australian Journal of Education, 56(2), 182-204.
Sirajudeen, M., & Sulaiman, M. (2020). A study on evaluation of school management and job satisfaction of the faculty members. Our Heritage, 68(1), 3797-3803.
State Secretary of the Republic of Indonesia (2016a, August 29). Undang-undang Republik Indonesia nomor 20 tahun 2003 tentang sistem pendidikan nasional [Act of the Republic of Indonesia, number 20, year 2003 on national education system]. Kementerian Pendidikan dan Kebudayaan [Ministry of Education and Culture]. http://luk.staff.ugm.ac.id/atur/UU20-2003Sisdiknas.pdf
State Secretary of the Republic of Indonesia. (2016b). Presidential instruction number 9 of 2016: Concerning revitalization of vocational high schools in the context of improving the quality and competitiveness of human resources of Indonesia. Kementerian Pendidikan dan Kebudayaan [Ministry of Education and Culture]. http://kemdikbud.go.id/main/files/download/e451d9ec3a04121
Suryavanshi, A. G. (2012). Innovative education: A student approach. African Journal of Business Management, 6(44), 10847-10857.
Triyono, M. B., & Moses, K. M. (2019). Technical and vocational education and training and training in Indonesia. In Bai, Bin, & Paryono (Eds.), Vocational Education and Training in ASEAN Member States (pp. 45-79). Springer.
van den Akker, J., Gravemeijer, K., McKenney, S., & Nieveen, N. (2006). Educational Design Research. Routledge, Taylor and Francis Ltd.
Wikipedia (2016, September 7). Vocational education. https://en.wikipedia.org/wiki/Vocational_education
Yusmina, E., & Murniati, A. R. (2014). Implementasi manajemen mutu terpadu dalam peningkatan kinerja sekolah pada SMK Negeri 1 Banda Aceh [Implementation of integrated quality management in school performance improvement at SMK Negeri 1 Banda Aceh]. Journal of Educational Administration: Unsyiah Postgraduate Program/ Jurnal Administrasi Pendidikan: Program Pascasarjana Unsyiah, 2(2), 168-178.