Measuring Self-Regulated Learning in the STEM Framework: A Confirmatory Factor Analysis
Within the context of Self-Regulated Learning (SRL), a process of directing oneself to facilitate individual learning more effectively, the SRL instru.
- Pub. date: October 15, 2021
- Pages: 2067-2077
- 778 Downloads
- 1303 Views
- 3 Citations
Within the context of Self-Regulated Learning (SRL), a process of directing oneself to facilitate individual learning more effectively, the SRL instrument development is deemed necessary to measure students’ self-reliance in learning mathematics in the science, technology, engineering, and mathematics (STEM) framework. The research aims to develop and test the validity and reliability of an SRL instrument, namely a 14-item SRL questionnaire accommodating four aspects, namely planning, self-monitoring, self-controlling, and evaluation. The study involved 420 junior high school students in East Java, Central Java, and Yogyakarta Special Region. The results show that the questionnaire was developed as planned and that planning, monitoring, controlling, and evaluating aspects can reflect the SRL variable in a valid, reliable, and significant way supported by each aspect's behavior indicator. The SRL variable theoretical model corresponds (good fit) with the empirical data, and all of the items are likely valid and reliable to assess student's mathematics SRL in the STEM framework. The SRL questionnaire was also found suitable for use by teachers to measure junior high school students’ self-reliance in SRL.
Keywords: Confirmatory factor analysis, reliability, self-regulated learning, STEM, validity.
References
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131-142. https://doi.org/10.1177/0013164485451012
Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Prentice Hall.
Banks, F., & Barlex, D. (2014). Teaching STEM in the secondary school: Helping teachers meet the challenge. Routledge. https://doi.org/10.4324/9780203809921
Boekaerts, M. (2016). Engagement as an inherent aspect of the learning process. Learning and Instruction, 43, 76–83. https://doi.org/10.1016/j.learninstruc.2016.02.001
Boekaerts, M., & Corno, L. (2005). Self-regulation in the classroom: A perspective on assessment and intervention. Applied Psychology: An International Review, 54(2), 199–231. https://doi.org/10.1111/j.1464-0597.2005.00205.x
Boekaerts, M., & Rozendaal, J. S. (2007). New insights into the self-regulation of writing skills in secondary vocational education. Journal of Psychology, 215(3), 164–173. https://doi.org/10.1027/0044-3409.215.3.164
Butler, D. L. (2002). Individualizing instruction in self-regulated learning. Theory Into Practice, 41(2), 81–92. https://doi.org/10.1207/s15430421tip4102_4
Chakrabartty, S. N. (2013). Best split-half and maximum reliability. IOSR Journal of Research & Method in Education, 3(1), 1–8. https://doi.org/10.9790/7388-0310108
Cleary, T. J., & Zimmerman, B. J. (2004). Self-regulation empowerment program: A school-based program to enhance self-regulated and self-motivated cycles of student learning. Psychology in the Schools, 41(5). 537-550. https://doi.org/10.1002/pits.10177
Dewanti, S. S., Hadi, S., Nu'man, M., & Ibrahim. (2021). The application of item response theory in analysis of characteristics of mathematical literacy test items. Elementary Education Online, 20(1), 1226–1237. https://doi.org/10.17051/ilkonline.2021.01.119
Efklides, A. (2011). Interactions of metacognition with motivation and effect in self-regulated learning: The MASRL model. Educational Psychologist, 46(1), 6–25. https://doi.org/10.1080/00461520.2011.538645
English, M. C., & Kitsantas, A. (2013). Supporting student self-regulated learning in problem- and project-based learning. Interdisciplinary Journal of Problem-Based Learning, 7(2), 128–150. https://doi.org/10.7771/1541-5015.1339
Ertmer, P. A., & Newby, T. J. (1996). The expert learner: Strategic, self-regulated, and reflective. Instructional Science, 24(1), 1–24. https://doi.org/10.1007/BF00156001
Felder, R. M., & Brent, R. (2016). Teaching and learning STEM: A practical guide. Jossey-Bass.
Fontana, R. P., Milligan, C., Littlejohn, A., & Margaryan, A. (2015). Measuring self-regulated learning in the workplace. International Journal of Training and Development, 19(1), 32–52. https://doi.org/10.1111/ijtd.12046
Hadwin, A. F., Järvelä, S., & Miller, M. (2011). Self-regulated, co-regulated, and socially shared regulation of learning. In B. J. Zimmerman & D. H. Schunk (Eds.), Handbook of self-regulation of learning and performance (pp. 65–84). Routledge.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis (7th ed.). Pearson Education Limited.
Kesuma, A. T., Harun, Zamroni, Putranta, H., & Kistoro, C. H. A. (2020). Evaluation of the self-regulated learning model in high schools : A systematic literature review. Universal Journal of Educational Research, 8(10), 4792–4806. https://doi.org/10.13189/ujer.2020.081051
Lawanto, O., & Johnson, S. D. (2012). Metacognition in an engineering design project. The International Journal of Engineering Education, 28(1), 92–102.
Li, S., Du, H., Xing, W., Zheng, J., Chen, G., & Xie, C. (2020). Examining temporal dynamics of self-regulated learning behaviors in STEM learning: A network approach. Computers & Education, 158, 1–14. https://doi.org/10.1016/j.compedu.2020.103987
Mardapi, D. (2017). Pengukuran, penilaian, dan evaluasi pendidikan [Measurement, assessment, and evaluation of education]. Parama Publishing.
Morris, B. J., Owens, W., Ellenbogen, K., Erduran, S., & Dunlosky, J. (2019). Measuring informal STEM learning supports across contexts and time. International Journal of STEM Education, 6(40), 1–12. https://doi.org/doi.org/10.1186/s40594-019-0195-y
Otaya, L. G., Kartowagiran, B., & Retnawati, H. (2018). Construct validity pedagogy competency instrument of teaching and learning practice program (TLPP) students: Unidimensional confirmatory factor analysis. International Journal of Advanced and Applied Sciences, 5(8), 24–33. https://doi.org/10.21833/ijaas.2018.08.004
Panadero, E. (2017). A review of self-regulated learning: Six models and four directions for research. Frontiers in Psychology, 8 (4), 1–28. https://doi.org/10.3389/fpsyg.2017.00422
Pintrich, P. R. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review, 16(4), 385–407. https://doi.org/10.1007/s10648-004-0006-x
Pintrich, P. R., Smith, D. A. F., Garcia, T., & Mckeachie, W. J. (1993). Reliability and predictive validity of the motivated strategies for learning questionnaire (MSLQ). Educational and Psychological Measurement, 53(3), 801–813. https://doi.org/10.1177/0013164493053003024
Retnawati, H. (2016a). Analisis kuantitatif instrumen penelitian [Quantitative analysis of research instruments]. Parama Publishing.
Retnawati, H. (2016b). Proving content validity of self-regulated learning scale (The comparison of Aiken index and expanded Gregory index). Research and Evaluation in Education, 2(2), 155–164. https://doi.org/10.21831/reid.v2i2.11029
Richey, R. C. (2005). Validating instruction design and development models. In J. M. Spector & D. A. Wiley (Eds.), Innovations in instructional technology: Essays in honor of M. David Merrill (pp. 171–185). Lawrence Erlbaum Associates.
Schermelleh-engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23–74.
Schunk, D. H. (1989). Social cognitive theory and self-regulated learning. In B. J. Zimmerman & D. H. Schunk (Eds.), Self-regulated learning and academic achievement: Theory, research, and practice (pp. 83–110). Springer. https://doi.org/10.1007/978-1-4612-3618-4_4
Schunk, D. H. (2005). Self-regulated learning: The educational legacy of Paul R. Pintrich. Educational Psychologist, 40(2), 85–94. https://doi.org/10.1207/s15326985ep4002_3
Schunk, D. H. (2012). Learning theories an educational perspective. Pearson.
Schunk, D. H., & Zimmerman, B. J. (2007). Influencing children's self-efficacy and self-regulation of reading and writing through modeling. Reading and Writing Quarterly, 23(1), 7–25. https://doi.org/10.1080/10573560600837578
Sharma, S. (1996). Applied multivariate techniques. John Wiley & Sons Inc.
Stehle, S. M., & Peters-burton, E. E. (2019). Developing student 21 st Century skills in selected exemplary inclusive STEM high schools. International Journal of STEM Education, 6, 1–15. https://doi.org/10.1186/s40594-019-0192-1
Sungur, S., & Tekkaya, C. (2006). Effects of problem-based learning and traditional instruction on self-regulated learning. Journal of Educational Research, 99(5), 307–320. https://doi.org/10.3200/JOER.99.5.307-320
Tentama, F., & Subardjo. (2018). Pengujian validitas dan reliabilitas konstruk pada organizational citizenship behavior [Testing of construct validity and reliability on organizational citizenship behavior]. Humanitas, 15(1), 62. https://doi.org/10.26555/humanitas.v15i1.5282
Widowati, E., Istiono, W., & Husodo, A. H. (2021). The development of disaster preparedness and safety school model: A confirmatory factor analysis. International Journal of Disaster Risk Reduction, 53, 1-14. https://doi.org/10.1016/j.ijdrr.2020.102004
Wijayanto, S. H. (2008). Structural equation modeling dengan LISREL 8.80: Konsep dan tutorial [Structural equation modeling with LISREL 8.80: Concepts and tutorials]. Graha Ilmu.
Winne, P. H., & Hadwin, A. F. (2008). The weave of motivation and self-regulated learning. In D. H. Schunk & B. J. Zimmerman (Eds.), Motivation and self-regulated learning: Theory, research, and applications (pp. 297–314)). Lawrence Erlbaum Associates Publishers.
Zheng, J., Xing, W., Zhu, G., Chen, G., Zhao, H., & Xie, C. (2020). Profiling self-regulation behaviors in STEM learning of engineering design. Computers and Education, 143, 1–13. https://doi.org/10.1016/j.compedu.2019.103669
Zimmerman, B. J. (1989a). A social cognitive view of self-regulated academic learning. Journal of Educational Psychology, 81(3), 329–339. https://doi.org/10.1037/0022-0663.81.3.329
Zimmerman, B. J. (1989b). Models of self-regulated learning and academic achievement. In B. J. Zimmerman & D. H. Schunk (Eds.), Self-regulated learning and academic achievement: Theory, research, and practice (pp. 1–25). Springer. https://doi.org/10.1007/978-1-4612-3618-4_1
Zimmerman, B. J. (1990). Goal setting and self-efficacy during self-regulated learning. Educational Psychologist, 25(1), 3–17. https://doi.org/10.1207/s15326985ep2501_2
Zimmerman, B. J. (2000). Attaining self-regulation A social cognitive perspective. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation: Theory, research, and applications (pp. 13–39). Academic Press.
Zimmerman, B. J. (2006). Development and adaptation of expertise: The role of self-regulatory processes and beliefs. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 705–722). Cambridge University Press. https://doi.org/10.1017/CBO9780511816796.039
Zimmerman, B. J., & Martinez-Pons, M. (1988). Construct validation of a strategy model of student self-regulated learning. Journal of Educational Psychology, 80(3), 284–290. https://doi.org/10.1037/0022-0663.80.3.284
Zumbrunn, S., Tadlock, J., & Roberts, W. D. (2011). Encourage self-regulated learning in the classroom: A literature review. Metropolitan Educational Research Consortium (MERC) Publications.