Validating Student’s Green Character Instrument Using Factor and Rasch Model
Akhmad Sukri , Muhammad Arief Rizka , Elly Purwanti , Siti Ramdiah , Marheny Lukitasari
Many researchers have separately developed instruments to measure environmental characteristics such as attitudes, values, and knowledge. However, the.
- Pub. date: April 15, 2022
- Pages: 859-872
- 628 Downloads
- 980 Views
- 2 Citations
Many researchers have separately developed instruments to measure environmental characteristics such as attitudes, values, and knowledge. However, there is no instrument used to measure all these aspects in one comprehensive instrument. This study is meant to develop and validate a green character instrument which reveals student behavior and awareness of the environment. The instrument consists of 40 statement items consisting of 5 aspects, namely private pro-environmental behavior, public pro-environmental behavior, environmental knowledge, environmental values, and environmental attitudes. It was implemented on 1,398 students from 15 universities in Indonesia. The instrument content validation was analyzed by three experts using content validity index (CVI). The construct validity was analyzed using exploratory factor analysis, confirmatory factor analysis, and RASCH analysis. The content validity results obtained CVI scores ranging between 0.8 and 0.9 with a good category, while item reliability was in a fairly good category with a high level of separation index. Construct validation resulted in 34 items (4 items were eliminated after Exploratory and Confirmatory Factor Analysis, and 2 items were eliminated after RASCH analysis) spread over five constructs, namely environmental behavior, environmental knowledge, environmental values, environmental attitudes, and environmental habits. The resulting instrument has a good level of item difficulty, with a well understood response set which can be understood easily by respondents, and without bias. Therefore, it can be used to measure the students’ green character on both male and female.
Keywords: Green character, instrument, factor and Rasch Analysis.
References
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066
Arent, E., Sumarmi, S., Utomo, D. H., & Ruja, I. (2020). Improving students’ environmental care character through positive character camp (pcc) program. Journal for the Education of Gifted Young Scientists, 8(4), 1329–1343. https://doi.org/10.17478/jegys.771681
Asrial, A., Syahrial, S., Maison, M., Kurniawan, D. A., & Putri, E. (2021). Fostering students’ environmental care characters through local wisdom-based teaching materials. Jurnal Pendidikan Indonesia, 10(1), 152–162. https://doi.org/10.23887/jpi-undiksha.v10i1.27744
Bond, T. G., & Fox, C. M. (2007). Applying the rasch model: Fundamental measurement in the human sciences: Second edition. Routledge Taylor & Francis Group. https://doi.org/10.4324/9781410614575
Chan, L. L., & Idris, N. (2017). Validity and reliability of the instrument using exploratory factor analysis and Cronbach’s alpha. International Journal of Academic Research in Business and Social Sciences, 7(10), 400–410. https://doi.org/https://doi.org/10.6007/ijarbss/v7-i10/3387
Chankrajang, T., & Muttarak, R. (2017). Green returns to education: Does schooling contribute to pro-environmental behaviours? Evidence from Thailand. Ecological Economics, 131, 434–448. https://doi.org/10.1016/j.ecolecon.2016.09.015
Chwialkowska, A., Bhatti, W. A., & Glowik, M. (2020). The influence of cultural values on pro-environmental behavior. Journal of Cleaner Production, 268, 122305. https://doi.org/10.1016/j.jclepro.2020.122305
Çokluk, Ö., & Koçak, D. (2016). Using Horn’s parallel analysis method in exploratory factor analysis for determining the number of factors. Educational Sciences: Theory & Practice/ Kuram ve Uygulamada Egitim Bilimleri, 16(2), 537–551. https://doi.org/10.12738/estp.2016.2.0328
Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research and Evaluation, 10(7), 1–9. https://doi.org/10.7275/jyj1-4868
Devon, H. A., Block, M. E., Moyle-Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., Savoy, S. M., & Kostas-Polston, E. (2007). A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship, 39(2), 155–164. https://doi.org/10.1111/j.1547-5069.2007.00161.x
Dunlap, R. E., Van Liere, K. D., Mertig, A. G., & Jones, R. E. (2000). Measuring endorsement of the new ecological paradigm: A revised NEP scale. Journal of Social Issues, 56(3), 425–442. https://doi.org/10.1111/0022-4537.00176
El Faisal, E., Chotimah, U., & Sulkipani. (2018). Building students’ environmental caring character through social science education. In Proceedings of 3rd Sriwijaya University Learning and Education International Conference 3rd-SULE-IC (pp. 194–198). Sriwijaya University. https://bit.ly/3IN5mIV
Endo, T., Yamamoto, A., & Watanabe, T. (2016). Bias factor method using random sampling technique. Journal of Nuclear Science and Technology, 53(10), 1494–1501. https://doi.org/10.1080/00223131.2015.1126541
Field, A. P. (2000). Discovering statistics using SPSS for Windows: Advanced techniques for the beginner. Sage publications.
Frasz, G. (2016). Environmental character: environmental feelings, sentiments and virtues. Ethics in Progress, 7(1), 32–43. https://doi.org/10.14746/eip.2016.1.3
Fu, L., Zhang, Y., Xiong, X., & Bai, Y. (2018). Pro-environmental awareness and behaviors on campus: Evidence from Tianjin, China. Eurasia Journal of Mathematics, Science and Technology Education, 14(1), 427–445. https://doi.org/10.12973/ejmste/77953
Goldberg, L. R., & Velicer, W. F. (2006). Principles of exploratory factor analysis. In S. Starck (Ed.), Differentiating normal and abnormal personality (2nd ed., pp. 209–237). Springer.
Hagell, P., & Westergren, A. (2016). Sample size and statistical conclusions from tests of fit to the rasch model according to the rasch unidimensional measurement model (rumm) program in health outcome measurement. Journal of Applied Measurement, 17(4), 416–431. https://pubmed.ncbi.nlm.nih.gov/28009589/
Hair, J., Black, W., Babin, B., & Anderson, R. (2010). Multivariate data analysis: A global perspective (7th ed.). Pearson.
He, L., & Filimonau, V. (2020). The effect of national culture on pro-environmental behavioural intentions of tourists in the UK and China. Tourism Management Perspectives, 35, 1–16. https://doi.org/10.1016/j.tmp.2020.100716
Hidayat, R., Syed Zamri, S. N. A., & Zulnaidi, H. (2018). Exploratory and confirmatory factor analysis of achievement goals for indonesian students in mathematics education programmes. Eurasia Journal of Mathematics, Science and Technology Education, 14(12), 1–12. https://doi.org/10.29333/ejmste/99173
Iseppi, L., Rizzo, M., Gori, E., Nassivera, F., Bassi, I., & Scuderi, A. (2021). Rasch model for assessing propensity to entomophagy. Sustainability, 13(8), 1–21. https://doi.org/10.3390/su13084346
Ismail, N. E., Jimam, N. S., Dapar, M. L. P., & Ahmad, S. (2020). Validation and reliability of healthcare workers’ knowledge, attitude, and practice instrument for uncomplicated malaria by rasch measurement model. Frontiers in Pharmacology, 10(1521), 1–8. https://doi.org/10.3389/fphar.2019.01521
Kassim, S., Hasan, H., Mohd Ismon, A., & Muhammad Asri, F. (2013). Parameter estimation in factor analysis: Maximum likelihood versus principal component. AIP Conference Proceedings, 1522 (1), 1293–1299. https://doi.org/10.1063/1.4801279
Kim, S., & Kyllonen, P. C. (2006). RASCH rating scale modeling of data from the standardized letter of recommendation. ETS Research Report Series, 2006(2), 1–22. https://doi.org/10.1002/j.2333-8504.2006.tb02038.x
Larsen, R., & Warne, R. T. (2010). Estimating confidence intervals for eigenvalues in exploratory factor analysis. Behavior Research Methods, 42(3), 871–876. https://doi.org/10.3758/BRM.42.3.871
Linacre, J. M. (2018). A User’s Guide to WINSTEPS MINISTEP. Winsteps. https://www.winsteps.com/a/Winsteps-Manual.pdf
Maisardi, M. (2017). Development learning device model of environmental education in the character of environmental care at senior high school in Solok Selatan regency. Sumatra Journal of Disaster, Geography and Geography Education, 1(2), 269–279. https://doi.org/10.24036/sjdgge.v1i2.52
Masturoh, & Ridlo, S. (2020). Character building of environmental care on students in Sekolah Indonesia Kota Kinabalu (SIKK) Malaysia. Journal of Biology Education, 9(2), 193–201. https://bit.ly/3tYyhW8
Matore, M. E. E. M., Khairani, A. Z., & Adnan, R. (2019). Exploratory factor analysis (EFA) for adversity quotient (AQ) instrument among youth. Journal of Critical Reviews, 6(6), 234-242
Muharlisiani, L. T., Soesatyo, Y., Karwanto, Khamidi, A., Noerhartati, E., Karjati, P. D., Dewira, R. F., & Setyowati, S. (2019). Environmental care imaging: Basic school students through character education by information communication technology (ICT) based learning. International Journal of Innovation, Creativity and Change, 9(11), 128–136. https://tinyurl.com/6xn84prd
Nye, C. D., & Drasgow, F. (2011). Assessing goodness of fit: Simple rules of thumb simply do not work. Organizational Research Methods, 14(3). https://doi.org/10.1177/1094428110368562
Osborne, J. W. (2015). What is rotating in exploratory factor analysis? Practical Assessment, Research and Evaluation, 20(2). https://doi.org/10.7275/hb2g-m060
Palupi, T., & Sawitri, D. R. (2018). The importance of pro-environmental behavior in adolescent. E3S Web of Conferences, 31, 2–5. https://doi.org/10.1051/e3sconf/20183109031
Pane, M. M., & Patriana, R. (2016). The significance of environmental contents in character education for quality of life. Procedia - Social and Behavioral Sciences, 222, 244–252. https://doi.org/10.1016/j.sbspro.2016.05.153
Pett, M., Lackey, N., & Sullivan, J. (2011). Making Sense of Factor Analysis. SAGE Publications, Inc. https://doi.org/10.4135/9781412984898
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing and Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
Pradhan, R. K. (2009). Character, personality and professionalism. Social Science International, 25(2), 3–23. https://tinyurl.com/5n7y9n8r
Prasetyo, K., Masrukan, M., & Sunawan, S. (2019). The development of mathematical literation instruments based on class IV geometry material conservation. Journal of Research and Educational Research Evaluation, 8(1), 1–13. https://bit.ly/3H47lrP
Prudon, P. (2014). Confirmatory factor analysis: a brief introduction and critique. Qualtrics, P.
Rahman, N., Purwoko, A. A., Muntari, & Haifaturrahmah. (2020). Development of subjects specific pedagogy to build environmental awareness character on students in mining areas. IOP Conference Series: Earth and Environmental Science, 413(1), 1–7. https://doi.org/10.1088/1755-1315/413/1/012033
Rahmawati, L. E., Niasih, A., Kusmanto, H., & Prayitno, H. J. (2020). Environmental awareness content for character education in grade 10 in Indonesian language student textbooks. International Journal of Innovation, Creativity and Change, 11(4), 161–174. https://tinyurl.com/2eepuw25
Raymond, C. M., Fazey, I., Reed, M. S., Stringer, L. C., Robinson, G. M., & Evely, A. C. (2010). Integrating local and scientific knowledge for environmental management. Journal of Environmental Management, 91(8), 1766–1777. https://doi.org/10.1016/j.jenvman.2010.03.023
Ryan, K. (2013). The failure of modern character education. Revista Espanola de Pedagogia, 71(254), 141–146. https://www.jstor.org/stable/23766855
Saefi, M., Fauzi, A., Kristiana, E., Adi, W. C., Muchson, M., Setiawan, M. E., Islami, N. N., Fitria Ningrum, D. E. A., Ikhsan, M. A., & Ramadhani, M. (2020). Validating of knowledge, attitudes, and practices questionnaire for prevention of covid-19 infections among undergraduate students: a rasch and factor analysis. Eurasia Journal of Mathematics, Science and Technology Education, 16(12), 1–14. https://doi.org/10.29333/ejmste/9352
Sanjaya, R. (2021). Headmaster’s strategy in developing environmental care character at SMA Negeri 9 Rejang Lebong. International Journal of Education Research and Development, 1(1), 16–30. https://doi.org/10.52760/ijerd.v1i1.5
Sari, N. H. P., Susilowati, S. M. E., & Rudyatmi, E. (2021). The environmental caring character through biology learning in senior and junior high school. Journal of Biology Education, 10(1), 1–8. https://bit.ly/3IElVXj
Scoulas, J. M., Aksu Dunya, B., & De Groote, S. L. (2021). Validating students’ library experience survey using rasch model. Library and Information Science Research, 43(1), 1–12. https://doi.org/10.1016/j.lisr.2021.101071
Stern, P. C. (2000). Toward a coherent theory of environmentally significant behavior. Journal of Social Issues, 56(3), 407–424. https://doi.org/10.1016/j.tra.2018.10.042
Sukri, A., Efendi, I., Hastuti, R., Ramdani, A., & Lukitasari, M. (2020a). The effect of coral reef comic media implementation on students’ environmental care attitude in Indonesia. Journal of Physics: Conference Series, 1464(1), 1–7. https://doi.org/10.1088/1742-6596/1464/1/012028
Sukri, A., Rizka, M. A., Sakti, H. G., Harisanti, B. M., & Muti’Ah, A. (2020b). The effect of local primacy-based comic media on students’ conservation attitudes. Journal of Physics: Conference Series, 1521(4), 1–5. https://doi.org/10.1088/1742-6596/1521/4/042004
Sukri, A., Rizka, M. A., Sakti, H. G., Maududy, K. U., & Hadiprayitno, G. (2018). Designing an integrated curriculum based on local primacy and social reconstruction perspectives of West Nusa Tenggara, Indonesia. Jurnal Pendidikan IPA Indonesia, 7(4), 467–475. https://doi.org/10.15294/jpii.v7i4.15272
Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan RASCH pada assessment pendidikan [Application of RASCH modeling in educational assessment]. Trim komunikata.
Sun, J. (2005). Assessing goodness of fit in confirmatory factor analysis. Measurement and Evaluation in Counseling and Development, 37(4), 240–256. https://doi.org/10.1080/07481756.2005.11909764
Susongko, P. (2016). Validation of science achievement test with the Rasch model. Jurnal Pendidikan IPA Indonesia, 5(2), 268–277. https://bit.ly/3nZ9vBk
Tabachnick, B. G., & Fidell, L. S. (2014). Principal Components and Factor Analysis - General Purpose and Description. In Using Multivariate Statistics (pp. 659–675). Allyn & Bacon.
Thompson, S. C. G., & Barton, M. A. (1994). Ecocentric and anthropocentric attitudes toward the environment. Journal of Environmental Psychology, 14(2), 149–157. https://doi.org/10.1017/CBO9780511845260.004
Tomé-Fernández, M., Fernández-Leyva, C., & Olmedo-Moreno, E. M. (2020). Exploratory and confirmatory factor analysis of the social skills scale for young immigrants. Sustainability (Switzerland), 12(17), 1–20. https://doi.org/10.3390/SU12176897
Trumpower, D. L., Sharara, H., & Goldsmith, T. E. (2010). Specificity of structural assessment of knowledge. Journal of Technology, Learning, and Assessment, 8(5), 1–32. https://tinyurl.com/yc5yukd3
UI Hadia, N., Abdullah, N., & Sentosa, I. (2016). An easy approach to exploratory factor analysis: marketing perspective. Journal of Educational and Social Research, 6(1), 215–223. https://doi.org/10.5901/jesr.2016.v6n1p215
Williams, B., Onsman, A., & Brown, T. (2010). Exploratory factor analysis: A five-step guide for novices. Journal of Emergency Primary Health Care, 8(3), 1–13. https://doi.org/10.33151/ajp.8.3.93
Yaghmaei, F. (2003). Content validity and its estimation. Journal of Medical Education, 3(1), 25–27. https://brief.land/jme/articles/105015.html
Yong, A. G., & Pearce, S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79–94. https://doi.org/https://doi.org/10.20982/tqmp.09.2.p079
Yu, T., & Richardson, J. C. (2015). An exploratory factor analysis and reliability analysis of the student online learning readiness (SOLR) instrument. Online Learning Journal, 19(5), 120–141. https://doi.org/10.24059/olj.v19i5.593
Yunesa, V. (2019). Students environmental care character building at islamic junior high school Diniyyah Al-azhar Muara Bungo. International Journal of Educational Dynamics, 1(1), 278–285. https://doi.org/10.24036/ijeds.v1i1.61