An Integrated Framework of Online Learning Effectiveness in Institutions of Higher Learning
Nor Liza Abdullah , Mohamad Rohieszan Ramdan , Nor Syamaliah Ngah , Khoo Yin Yin , Suzyanty Mohd Shokory , Dayang Rafidah Syariff M. Fuad , Azita Yonus
In the early stages of adopting online learning, both learners and teachers displayed resistance, but the COVID-19 pandemic has forced a widespread sh.
- Pub. date: July 15, 2024
- Online Pub. date: April 26, 2024
- Pages: 1321-1333
- 243 Downloads
- 693 Views
- 0 Citations
In the early stages of adopting online learning, both learners and teachers displayed resistance, but the COVID-19 pandemic has forced a widespread shift to digital learning. To facilitate this transition, there is a growing focus on highlighting the effectiveness of online learning, which directly impacts learning outcomes. This study investigates online learning effectiveness through an integrated framework that considers online assessment practices and online course design as independent variables, with online learning support as a moderating variable. Understanding the effectiveness of online learning is crucial as hybrid learning becomes the "new norm" in education, combining online and offline methods for teaching the digital generation. Using a quantitative research design involving 232 students at Universiti Kebangsaan Malaysia, the study found that online assessment practices and course design significantly influence students perceived learning outcomes in an online learning environment. Additionally, online learning support positively moderates this relationship. These findings offer a comprehensive perspective on how online assessment practices, course design, and support systems contribute to the quality of higher education in Malaysia amidst evolving educational practices.
online assessment practices online course design online learning support perceived online learning
Keywords: Online assessment practices, online course design, online learning support, perceived online learning.
References
Abd Aziz, N. A., Ramdan, M. R., Nik Hussin, N. S., Abdul Aziz, Z., Osman, J., & Hasbollah, H. R. (2021). The determinants of global expansion: A study on food and beverage franchisors in Malaysia. Sustainability, 13(18), Article 10328. http://doi.org/10.3390/su131810328
Abduh, M. Y. M. (2021). Full-time online assessment during COVID-19 lockdown: EFL teachers’ perceptions. Asian EFL Journal, 28(11), 26-46. https://bit.ly/49RHP6p
Adam, S., Fuzi, N. M., Ramdan, M. R., Isa, R. M., Ismail, A. F. M. F., Hashim, M. Y., Ong, S. Y. Y., & Ramlee, S. I. F. (2022). Entrepreneurial orientation and organizational performance of online business in Malaysia: The mediating role of the knowledge management process. Sustainability, 14(9), Article 5081. https://doi.org/10.3390/su14095081
Akimov, A., & Malin, M. (2020). When old becomes new: a case study of oral examination as an online assessment tool. Assessment and Evaluation in Higher Education, 45(8), 1205-1221. https://doi.org/gpxhsd
Alavi, M., Marakas, G. M., & Yoo, Y. (2002). A comparative study of distributed learning environments on learning outcomes. Information Systems Research, 13(4), 404-415. https://doi.org/10.1287/isre.13.4.404.72
Ali, L., & Al Dmour, N. A. H. H. (2021). The shift to online assessment due to COVID-19: An empirical study of university students, behaviour and performance, in the region of UAE. International Journal of Information and Education Technology, 11(5), 220-228. https://doi.org/10.18178/ijiet.2021.11.5.1515
Al Mamun, M. A., Lawrie, G., & Wright, T. (2020). Instructional design of scaffolded online learning modules for self-directed and inquiry-based learning environments. Computers and Education, 144, Article 103695. https://doi.org/10.1016/j.compedu.2019.103695
Baldwin, S. J. (2019). Assimilation in online course design. American Journal of Distance Education, 33(3), 195-211. https://doi.org/10.1080/08923647.2019.1610304
Bates, T. (2018). The 2017 national survey of online learning in Canadian post-secondary education: methodology and results. International Journal of Educational Technology in Higher Education, 15, Article 29. https://doi.org/10.1186/s41239-018-0112-3
Benson, A. D. (2003). Dimensions of quality in online degree programs. The American Journal of Distance Education, 17(3), 145-159. https://doi.org/10.1207/S15389286AJDE1703_2
Carr‐Chellman, A., & Duchastel, P. (2000). The ideal online course. British Journal of Educational Technology, 31(3), 229-241. https://doi.org/10.1111/1467-8535.00154
Carvalho, P. F., McLaughlin, E. A., & Koedinger, K. R. (2022). Varied practice testing is associated with better learning outcomes in self-regulated online learning. Journal of Educational Psychology, 114(8), 1723-1742. https://doi.org/10.1037/edu0000754
Chee, M., Davidian, Z., & Weaver, K. D. (2022). More to do than can ever be done: Reconciling library online learning objects with WCAG 2.1 standards for accessibility. Journal of Web Librarianship, 16(2), 87-119. https://doi.org/10.1080/19322909.2022.2062521
Chung, E., Subramaniam, G., & Christ Dass, L. (2020). Online learning readiness among university students in Malaysia amidst Covid-19. Asian Journal of University Education, 16(2), 45-58. https://doi.org/10.24191/ajue.v16i2.10294
Clark, R. C., & Mayer, R. E. (2008). Learning by viewing versus learning by doing: Evidence‐based guidelines for principled learning environments. Performance Improvement, 47(9), 5-13. https://doi.org/10.1002/pfi.20028
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Routledge. https://doi.org/10.4324/9780203771587
Cook, D. A., & Steinert, Y. (2013). Online learning for faculty development: a review of the literature. Medical Teacher, 35(11), 930-937. https://doi.org/10.3109/0142159X.2013.827328
Council of Adult and Experiential Learning. (2000). Serving adult learners in higher education: Principles of effectiveness (Executive Summary). CiteSeerX. http://surl.li/sxucu
Eom, S. B., Wen, H. J., & Ashill, N. (2016). The determinants of students’ perceived learning outcomes and satisfaction in university online education: An empirical investigation. Decision Sciences Journal of Innovative Education, 4(2), 215-235. https://doi.org/10.1111/j.1540-4609.2006.00114.x.
Ferrer, J., Ringer, A., Saville, K., Parris, M. A., & Kashi, K. (2022). Students’ motivation and engagement in higher education: The importance of attitude to online learning. Higher Education, 83, 317-338. https://doi.org/10.1007/s10734-020-00657-5
Fredericksen, E., Picket, A., Pelz, W., Swan, K., & Shea, P. (2000). Student satisfaction and perceived learning with on-line courses: principles and examples from the SUNY learning network. On-line education: Learning effectiveness and faculty satisfaction, 4(2), 7-41. https://doi.org/10.24059/olj.v4i2.1899
Gaytan, J., & McEwen, B. C. (2007). Effective online instructional and assessment strategies. The American Journal of Distance Education, 21(3), 117-132. https://doi.org/10.1080/08923640701341653
Gillis, A., & Krull, L. M. (2020). COVID-19 Remote learning transition in Spring 2020: Class structures, student perceptions, and inequality in college courses. Teaching Sociology, 48(4), 283-299. https://doi.org/10.1177/0092055X20954263
Grishchenko, N. (2020). The gap not only closes: Resistance and reverse shifts in the digital divide in Russia. Telecommunications Policy, 44(8), Article 102004. https://doi.org/10.1016/j.telpol.2020.102004
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis: A global perspective (7th ed.). Pearson Education Inc.
Hayes, A. F. (2018). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach (2th ed.). The Guilford Press.
Hew, K. F. (2016). Promoting engagement in online courses: What strategies can we learn from three highly rated MOOCS. British Journal of Educational Technology, 47(2), 320-341. https://doi.org/10.1111/bjet.12235
Huisman, B., Admiraal, W., Pilli, O., van de Ven, M., & Saab, N. (2018). Peer assessment in MOOCs: The relationship between peer reviewers’ ability and authors’ essay performance. British Journal of Educational Technology, 49(1), 101-110. https://doi.org/10.1111/bjet.12520
Jaggars, S. S., & Xu, D. (2016). How do online course design features influence student performance? Computers and Education, 95, 270-284. https://doi.org/10.1016/j.compedu.2016.01.014
Jones, B. D. (2010). An examination of motivation model components in face-to-face and online instruction. Electronic Journal of Research in Educational Psychology, 8(22), 915-944. https://doi.org/10.25115/ejrep.v8i22.1455
Joshi, A., Virk, A., Saiyad, S., Mahajan, R., & Singh, T. (2020). Online assessment: Concept and applications. Journal of Research in Medical Education and Ethics, 10(2), 49-59. https://doi.org/10.5958/2231-6728.2020.00015.3
Khairil, L. F., & Mokshein, S. E. (2018). 21st century assessment: online assessment. International Journal of Academic Research in Business and Social Sciences, 8(1), 649-662. https://doi.org/10.6007/IJARBSS/v8-i1/3838
Khan, S., & Khan, R. A. (2019). Online assessments: Exploring perspectives of university students. Education and Information Technologies, 24, 661–677 https://doi.org/10.1007/s10639-018-9797-0
Kirshner, D., & Whitson, J. A. (1997). Situated cognition: Social, semiotic and psychological perspectives. Lawrence Erlbaum Associates Inc.
Kurucay, M., & Inan, F. A. (2017). Examining the effects of learner-learner interactions on satisfaction and learning in an online undergraduate course. Computers and Education, 115, 20-37. https://doi.org/10.1016/j.compedu.2017.06.010
Lee, S. J., Srinivasan, S., Trail, T., Lewis, D., & Lopez, S. (2011). Examining the relationship among student perception of support, course satisfaction, and learning outcomes in online learning, The Internet and Higher Education, 14(3), 158-163. https://doi.org/10.1016/j.iheduc.2011.04.001
Li, Q., Li, Z., & Han, J. (2021). A hybrid learning pedagogy for surmounting the challenges of the COVID-19 pandemic in the performing arts education. Education and Information Technologies, 26, 7635-7655. https://doi.org/10.1007/s10639-021-10612-1
Liang, X., & Creasy, K. (2004). Classroom assessment in web-based instructional environment: Instructors’ experience. Practical Assessment, Research, and Evaluation, 9(1), Article 7. https://doi.org/10.7275/84mr-wp41
Marshall, M. (2003). Approaches of outstanding teachers. The teachers.net Gazette. https://www.teachers.net/gazette/APR03/marshall.html
Mayer, R. E. (2020). Multimedia learning. Cambridge University Press.
Meccawy, Z., Meccawy, M., & Alsobhi, A. (2021). Assessment in ‘survival mode’: student and faculty perceptions of online assessment practices in HE during Covid-19 pandemic. International Journal for Educational Integrity, 17, Article 16. https://doi.org/10.1007/s40979-021-00083-9
Moore, J. L., Dickson-Deane, C., & Galyen, K. (2011). e-Learning, online learning, and distance learning environments: Are they the same? The Internet and Higher Education, 14(2), 129-135. https://doi.org/10.1016/j.iheduc.2010.10.001
Muhtadi, A., Wahyuningsih, D., & Sidabutar, M. (2021). The effectiveness of online learning model implementation. In Proceedings of the 2nd International on Meaningful Education (2nd ICMEd) (pp. 505-520). KnE Publishing. https://doi.org/10.18502/kss.v6i2.10012
Nguyen, T. (2015). The effectiveness of online learning: Beyond no significant difference and future horizons. MERLOT Journal of Online Learning and Teaching, 11(2), 309-319. https://jolt.merlot.org/Vol11no2/Nguyen_0615.pdf
Nielsen, I., Newman, A., Smyth, R., Hirst, G., & Heilemann, B. (2017). The influence of instructor support, family support and psychological capital on the well-being of postgraduate students: a moderated mediation model. Studies in Higher Education, 42(11), 2099-2115. https://doi.org/10.1080/03075079.2015.1135116
Olapiriyakul, K., & Scher, J. M. (2006). A guide to establishing hybrid learning courses: Employing information technology to create a new learning experience, and a case study. The Internet and Higher Education, 9(4), 287-301. https://doi.org/10.1016/j.iheduc.2006.08.001
Paechter, M., Maier, B., & Macher, D. (2010). Students’ expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction. Computer and Education, 54(1), 222-229. https://doi.org/10.1016/j.compedu.2009.08.005
Podsakoff, P. M., MacKenzie, S. B., Lee, J. -Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879-903. https://doi.org/10.1037/0021-9010.88.5.879
Prescott, J., Rathbone, A. L., & Brown, G. (2020). Online peer to peer support: Qualitative analysis of UK and US open mental health Facebook groups. Digital Health, 6, 1-17. https://doi.org/10.1177/2055207620979209
Ramdan, M. R., Abd Aziz, N. A., Abdullah, N. L., Samsudin, N., Singh, G. S. V., Zakaria, T., Fuzi, N. M., & Ong, S. Y. Y. (2022). SMEs performance in Malaysia: The role of contextual ambidexterity in innovation culture and performance. Sustainability, 14(3), Article 1679. https://doi.org/10.3390/su14031679
Ramdan, M. R., Abdullah, N. L., Isa, R. M., & Hanafiah, M. H. (2020). Meneroka faktor-faktor yang mempengaruhi penggunaan platform digital oleh perusahaan mikro dan kecil [Exploring factors influencing the use of digital platform by micro and small enterprises]. Jurnal Pengurusan, 59, 37-51. https://rb.gy/prjx1z
Ramdan, M. R., Abdullah, N. L., Isa, R. M., & Hanafiah, M. H. (2021). Organizational ambidexterity within supply chain management: A scoping review. LogForum, 17(4), 531-546. https://www.logforum.net/pdf/17_4_6_21.pdf
Razak, A. A., Ramdan, M. R., Mahjom, N., Zabit, M. N. M., Muhammad, F., Hussin, M. Y. M., & Abdullah, N. L. (2022). Improving critical thinking skills in teaching through problem-based learning for students: A scoping review. International Journal of Learning, Teaching and Educational Research, 21(2), 342-362. http://doi.org/10.26803/ijlter.21.2.19
Rockinson-Szapkiw, A., Wendt, J., Whighting, M., & Nisbet, D. (2016). The predictive relationship among the community of inquiry framework, perceived learning and online, and graduate students’ course grades in online synchronous and asynchronous courses. International Review of Research in Open and Distributed Learning, 17(3), 18-35. https://doi.org/10.19173/irrodl.v17i3.2203
Rodchua, S., Yaiadom-boakye, G., & Woolsey, R. (2011). Student verification system for online assessments: Bolstering quality and integrity of distance learning. Journal of Industrial Technology, 27(3), 1-8. https://bit.ly/4b4BA02
Rotar, O. (2022). Online student support: A framework for embedding support interventions into the online learning cycle. Research and Practice in Technology Enhanced Learning, 17, Article 2. https://doi.org/10.1186/s41039-021-00178-4
Rovai, A. P. (2002). Sense of community, perceived cognitive learning, and persistence in asynchronous learning networks. The Internet and Higher Education, 5(4), 319-332. https://doi.org/10.1016/S1096-7516(02)00130-6
Samsudin, N., Ramdan, M. R., Abd Razak, A. Z. A., Mohamad, N., Yaakub, K. B., Abd Aziz, N. A., & Hanafiah, M. H. (2022). Related factors in undergraduate students' motivation towards social entrepreneurship in Malaysia. European Journal of Educational Research, 11(3), 1657-1668. http://doi.org/10.12973/eu-jer.11.3.1657
Sarason, I. G., Sarason, B. R., & Pierce, G. R. (1994). Social support: Global and relationship-based levels of analysis. Journal of Social and Personal Relationships, 11(2), 295-312. https://doi.org/10.1177/0265407594112008
Şenel, S., & Şenel, H. C. (2021). Remote assessment in higher education during COVID-19 pandemic. International Journal of Assessment Tools in Education, 8(2), 181-199. https://doi.org/10.21449/ijate.820140
Shao, M., Hong, J.-C., & Zhao, L. (2022). Impact of the self-directed learning approach and attitude on online learning ineffectiveness: The mediating roles of internet cognitive fatigue and flow state. Frontiers in Public Health, 10, Article 927454. https://doi.org/10.3389/fpubh.2022.927454
Shraim, K. (2019). Online examination practices in higher education institutions: Learners’ Perspectives. Turkish Online Journal of Distance Education, 20(4), 185-196. https://doi.org/10.17718/tojde.640588
Sim, G., Holifield, P., & Brown, M. (2004). Implementation of computer assisted assessment: Lessons from the literature. Research in Learning Technology, 12(3), 215-229. https://doi.org/10.1080/0968776042000259546
Spivey, M. F., & McMillan, J. J. (2014). Classroom versus online assessment. Journal of Education for Business, 89(8), 450-456. https://doi.org/10.1080/08832323.2014.937676
Steen, H. L. (2008). Effective eLearning design. MERLOT Journal of Online Learning and Teaching, 4(4), 526-532. https://jolt.merlot.org/vol4no4/steen_1208.pdf
Torris, C., Meyer, M. E., Sandbekken, I. H., Halvorsrud, H., & Molin, M. (2022). Nursing students’ perceived learning outcomes, motivation to learn and grade achieved in a digital blended learning course: A Norwegian cross-sectional study. Education Sciences, 12(7), Article 467. https://doi.org/10.3390/educsci12070467
Tsang, J. T. Y., So, M. K. P., Chong, A. C. Y., Lam, B. S. Y., & Chu, A. M. Y. (2021). Higher education during the pandemic: The predictive factors of learning effectiveness in COVID-19 online learning. Education Sciences, 11(8), Article 446. https://doi.org/10.3390/educsci11080446
Tseng, K.-H., Chang, C.-C., Lou, S.-J., & Chen, W.-P. (2013). Attitudes towards science, technology, engineering and mathematics (STEM) in a project-based learning (PjBL) environment. International Journal of Technology and Design Education, 23, 87-102. https://doi.org/10.1007/s10798-011-9160-x
Twigg, C. A. (2003). New models for online learning. Educause Review, 38, 28-38. https://www.thencat.com/Articles/erm0352.pdf
Vygotsky, L. S. (1978). Mind in society: Development of higher psychological processes (M. Cole, V. Jolm-Steiner, S. Scribner, & E. Souberman, Eds.). Harvard University Press. https://doi.org/10.2307/j.ctvjf9vz4
Walker, S. (1984). Learning theory and behaviour modification. Routledge. https://doi.org/10.4324/9781315206622
Wei, X., Saab, N., & Admiraal, W. (2023). Do learners share the same perceived learning outcomes in MOOCs? Identifying the role of motivation, perceived learning support, learning engagement, and self-regulated learning strategies. The Internet and Higher Education, 56, Article 100880. https://doi.org/10.1016/j.iheduc.2022.100880
Whitelock, D., & Watt, S. (2008). Reframing e-assessment: Adopting new media and adapting old frameworks. Learning, Media and Technology, 33(3), 151-154. https://doi.org/10.1080/17439880802447391
Wibowo, F. E., & Novitasari, U. (2021). An analysis of online assessment in teaching English. Professional Journal of English Education, 4(3), 521-529. https://doi.org/10.22460/project.v4i3.p521-529
Yahaya, R., Ramdan, M. R., Ahmad, N. L., Ismail, R., Khalid, K., Jusoh, M. A., & Isa, R. M. (2022). Educators’ motivation and intention within the UTAUT model to adopt the flipped classroom: A scoping review. International Journal of Learning, Teaching and Educational Research, 21(2), 285-302. http://doi.org/10.26803/ijlter.21.2.16
Yunusa, A. A., & Umar, I. N. (2021). A scoping review of critical predictive factors (CPFs) of satisfaction and perceived learning outcomes in E-learning environments. Education and Information Technologies, 26, 1223-1270. https://doi.org/10.1007/s10639-020-10286-1
Zheng, M., Bender, D., & Lyon, C. (2021). Online learning during COVID-19 produced equivalent or better student course performance as compared with pre-pandemic: empirical evidence from a school-wide comparative study. BMC Medical Education, 21, Article 495. https://doi.org/10.1186/s12909-021-02909-z