logo logo European Journal of Educational Research

EU-JER is is a, peer reviewed, online academic research journal.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

Eurasian Society of Educational Research
Eurasian Society of Educational Research
Christiaan Huygensstraat 44, Zipcode:7533XB, Enschede, THE NETHERLANDS
Eurasian Society of Educational Research
Headquarters
Christiaan Huygensstraat 44, Zipcode:7533XB, Enschede, THE NETHERLANDS
Research Article

An Integrated Framework of Online Learning Effectiveness in Institutions of Higher Learning

Nor Liza Abdullah , Mohamad Rohieszan Ramdan , Nor Syamaliah Ngah , Khoo Yin Yin , Suzyanty Mohd Shokory , Dayang Rafidah Syariff M. Fuad , Azita Yonus

In the early stages of adopting online learning, both learners and teachers displayed resistance, but the COVID-19 pandemic has forced a widespread sh.

I

In the early stages of adopting online learning, both learners and teachers displayed resistance, but the COVID-19 pandemic has forced a widespread shift to digital learning. To facilitate this transition, there is a growing focus on highlighting the effectiveness of online learning, which directly impacts learning outcomes. This study investigates online learning effectiveness through an integrated framework that considers online assessment practices and online course design as independent variables, with online learning support as a moderating variable. Understanding the effectiveness of online learning is crucial as hybrid learning becomes the "new norm" in education, combining online and offline methods for teaching the digital generation. Using a quantitative research design involving 232 students at Universiti Kebangsaan Malaysia, the study found that online assessment practices and course design significantly influence students perceived learning outcomes in an online learning environment. Additionally, online learning support positively moderates this relationship. These findings offer a comprehensive perspective on how online assessment practices, course design, and support systems contribute to the quality of higher education in Malaysia amidst evolving educational practices.

 

Keywords: Online assessment practices, online course design, online learning support, perceived online learning.

cloud_download PDF
Cite
Article Metrics
Views
243
Download
693
Citations
Crossref
0

Scopus
0

References

Abd Aziz, N. A., Ramdan, M. R., Nik Hussin, N. S., Abdul Aziz, Z., Osman, J., & Hasbollah, H. R. (2021). The determinants of global expansion: A study on food and beverage franchisors in Malaysia. Sustainability, 13(18), Article 10328. http://doi.org/10.3390/su131810328

Abduh, M. Y. M. (2021). Full-time online assessment during COVID-19 lockdown: EFL teachers’ perceptions. Asian EFL Journal, 28(11), 26-46. https://bit.ly/49RHP6p

Adam, S., Fuzi, N. M., Ramdan, M. R., Isa, R. M., Ismail, A. F. M. F., Hashim, M. Y., Ong, S. Y. Y., & Ramlee, S. I. F. (2022). Entrepreneurial orientation and organizational performance of online business in Malaysia: The mediating role of the knowledge management process. Sustainability, 14(9), Article 5081. https://doi.org/10.3390/su14095081

Akimov, A., & Malin, M. (2020). When old becomes new: a case study of oral examination as an online assessment tool. Assessment and Evaluation in Higher Education, 45(8), 1205-1221. https://doi.org/gpxhsd   

Alavi, M., Marakas, G. M., & Yoo, Y. (2002). A comparative study of distributed learning environments on learning outcomes. Information Systems Research, 13(4), 404-415. https://doi.org/10.1287/isre.13.4.404.72

Ali, L., & Al Dmour, N. A. H. H. (2021). The shift to online assessment due to COVID-19: An empirical study of university students, behaviour and performance, in the region of UAE. International Journal of Information and Education Technology, 11(5), 220-228. https://doi.org/10.18178/ijiet.2021.11.5.1515

Al Mamun, M. A., Lawrie, G., & Wright, T. (2020). Instructional design of scaffolded online learning modules for self-directed and inquiry-based learning environments. Computers and Education, 144, Article 103695. https://doi.org/10.1016/j.compedu.2019.103695

Baldwin, S. J. (2019). Assimilation in online course design. American Journal of Distance Education, 33(3), 195-211. https://doi.org/10.1080/08923647.2019.1610304

Bates, T. (2018). The 2017 national survey of online learning in Canadian post-secondary education: methodology and results. International Journal of Educational Technology in Higher Education, 15, Article 29. https://doi.org/10.1186/s41239-018-0112-3

Benson, A. D. (2003). Dimensions of quality in online degree programs. The American Journal of Distance Education, 17(3), 145-159. https://doi.org/10.1207/S15389286AJDE1703_2

CarrChellman, A., & Duchastel, P. (2000). The ideal online course. British Journal of Educational Technology, 31(3), 229-241. https://doi.org/10.1111/1467-8535.00154

Carvalho, P. F., McLaughlin, E. A., & Koedinger, K. R. (2022). Varied practice testing is associated with better learning outcomes in self-regulated online learning. Journal of Educational Psychology, 114(8), 1723-1742. https://doi.org/10.1037/edu0000754

Chee, M., Davidian, Z., & Weaver, K. D. (2022). More to do than can ever be done: Reconciling library online learning objects with WCAG 2.1 standards for accessibility. Journal of Web Librarianship16(2), 87-119. https://doi.org/10.1080/19322909.2022.2062521

Chung, E., Subramaniam, G., & Christ Dass, L. (2020). Online learning readiness among university students in Malaysia amidst Covid-19. Asian Journal of University Education, 16(2), 45-58. https://doi.org/10.24191/ajue.v16i2.10294  

Clark, R. C., & Mayer, R. E. (2008). Learning by viewing versus learning by doing: Evidencebased guidelines for principled learning environments. Performance Improvement, 47(9), 5-13. https://doi.org/10.1002/pfi.20028

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Routledge. https://doi.org/10.4324/9780203771587

Cook, D. A., & Steinert, Y. (2013). Online learning for faculty development: a review of the literature. Medical Teacher35(11), 930-937. https://doi.org/10.3109/0142159X.2013.827328

Council of Adult and Experiential Learning. (2000). Serving adult learners in higher education: Principles of effectiveness (Executive Summary). CiteSeerX. http://surl.li/sxucu

Eom, S. B., Wen, H. J., & Ashill, N. (2016). The determinants of students’ perceived learning outcomes and satisfaction in university online education: An empirical investigation. Decision Sciences Journal of Innovative Education, 4(2), 215-235. https://doi.org/10.1111/j.1540-4609.2006.00114.x.

Ferrer, J., Ringer, A., Saville, K., Parris, M. A., & Kashi, K. (2022). Students’ motivation and engagement in higher education: The importance of attitude to online learning. Higher Education, 83, 317-338. https://doi.org/10.1007/s10734-020-00657-5

Fredericksen, E., Picket, A., Pelz, W., Swan, K., & Shea, P. (2000). Student satisfaction and perceived learning with on-line courses: principles and examples from the SUNY learning network. On-line education: Learning effectiveness and faculty satisfaction, 4(2), 7-41. https://doi.org/10.24059/olj.v4i2.1899

Gaytan, J., & McEwen, B. C. (2007). Effective online instructional and assessment strategies. The American Journal of Distance Education, 21(3), 117-132. https://doi.org/10.1080/08923640701341653

Gillis, A., & Krull, L. M. (2020). COVID-19 Remote learning transition in Spring 2020: Class structures, student perceptions, and inequality in college courses. Teaching Sociology, 48(4), 283-299. https://doi.org/10.1177/0092055X20954263

Grishchenko, N. (2020). The gap not only closes: Resistance and reverse shifts in the digital divide in Russia. Telecommunications Policy, 44(8), Article 102004. https://doi.org/10.1016/j.telpol.2020.102004  

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis: A global perspective (7th ed.). Pearson Education Inc.

Hayes, A. F. (2018). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach (2th ed.). The Guilford Press.

Hew, K. F. (2016). Promoting engagement in online courses: What strategies can we learn from three highly rated MOOCS. British Journal of Educational Technology, 47(2), 320-341. https://doi.org/10.1111/bjet.12235

Huisman, B., Admiraal, W., Pilli, O., van de Ven, M., & Saab, N. (2018). Peer assessment in MOOCs: The relationship between peer reviewers’ ability and authors’ essay performance. British Journal of Educational Technology, 49(1), 101-110. https://doi.org/10.1111/bjet.12520

Jaggars, S. S., & Xu, D. (2016). How do online course design features influence student performance? Computers and Education, 95, 270-284. https://doi.org/10.1016/j.compedu.2016.01.014

Jones, B. D. (2010). An examination of motivation model components in face-to-face and online instruction. Electronic Journal of Research in Educational Psychology, 8(22), 915-944. https://doi.org/10.25115/ejrep.v8i22.1455

Joshi, A., Virk, A., Saiyad, S., Mahajan, R., & Singh, T. (2020). Online assessment: Concept and applications. Journal of Research in Medical Education and Ethics, 10(2), 49-59.  https://doi.org/10.5958/2231-6728.2020.00015.3

Khairil, L. F., & Mokshein, S. E. (2018). 21st century assessment: online assessment. International Journal of Academic Research in Business and Social Sciences, 8(1), 649-662. https://doi.org/10.6007/IJARBSS/v8-i1/3838

Khan, S.,  & Khan, R. A. (2019). Online assessments: Exploring perspectives of university students. Education and Information Technologies, 24, 661–677 https://doi.org/10.1007/s10639-018-9797-0  

Kirshner, D., & Whitson, J. A. (1997). Situated cognition: Social, semiotic and psychological perspectives. Lawrence Erlbaum Associates Inc.

Kurucay, M., & Inan, F. A. (2017). Examining the effects of learner-learner interactions on satisfaction and learning in an online undergraduate course. Computers and Education, 115, 20-37. https://doi.org/10.1016/j.compedu.2017.06.010

Lee, S. J., Srinivasan, S., Trail, T., Lewis, D., & Lopez, S. (2011). Examining the relationship among student perception of support, course satisfaction, and learning outcomes in online learning, The Internet and Higher Education, 14(3), 158-163. https://doi.org/10.1016/j.iheduc.2011.04.001 

Li, Q., Li, Z., & Han, J. (2021). A hybrid learning pedagogy for surmounting the challenges of the COVID-19 pandemic in the performing arts education. Education and Information Technologies, 26, 7635-7655. https://doi.org/10.1007/s10639-021-10612-1

Liang, X., & Creasy, K. (2004). Classroom assessment in web-based instructional environment: Instructors’ experience. Practical Assessment, Research, and Evaluation, 9(1), Article 7. https://doi.org/10.7275/84mr-wp41

Marshall, M. (2003). Approaches of outstanding teachers. The teachers.net Gazette. https://www.teachers.net/gazette/APR03/marshall.html

Mayer, R. E. (2020). Multimedia learning. Cambridge University Press.

Meccawy, Z., Meccawy, M., & Alsobhi, A. (2021). Assessment in ‘survival mode’: student and faculty perceptions of online assessment practices in HE during Covid-19 pandemic. International Journal for Educational Integrity, 17, Article 16. https://doi.org/10.1007/s40979-021-00083-9

Moore, J. L., Dickson-Deane, C., & Galyen, K. (2011). e-Learning, online learning, and distance learning environments: Are they the same? The Internet and Higher Education, 14(2), 129-135. https://doi.org/10.1016/j.iheduc.2010.10.001

Muhtadi, A., Wahyuningsih, D., & Sidabutar, M. (2021). The effectiveness of online learning model implementation. In Proceedings of the 2nd International on Meaningful Education (2nd ICMEd) (pp. 505-520). KnE Publishing. https://doi.org/10.18502/kss.v6i2.10012

Nguyen, T. (2015). The effectiveness of online learning: Beyond no significant difference and future horizons. MERLOT Journal of Online Learning and Teaching, 11(2), 309-319. https://jolt.merlot.org/Vol11no2/Nguyen_0615.pdf

Nielsen, I., Newman, A., Smyth, R., Hirst, G., & Heilemann, B. (2017). The influence of instructor support, family support and psychological capital on the well-being of postgraduate students: a moderated mediation model. Studies in Higher Education, 42(11), 2099-2115. https://doi.org/10.1080/03075079.2015.1135116

Olapiriyakul, K., & Scher, J. M. (2006). A guide to establishing hybrid learning courses: Employing information technology to create a new learning experience, and a case study. The Internet and Higher Education, 9(4), 287-301. https://doi.org/10.1016/j.iheduc.2006.08.001

Paechter, M., Maier, B., & Macher, D. (2010). Students’ expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction. Computer and Education, 54(1), 222-229. https://doi.org/10.1016/j.compedu.2009.08.005

Podsakoff, P. M., MacKenzie, S. B., Lee, J. -Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879-903. https://doi.org/10.1037/0021-9010.88.5.879

Prescott, J., Rathbone, A. L., & Brown, G. (2020). Online peer to peer support: Qualitative analysis of UK and US open mental health Facebook groups. Digital Health, 6, 1-17. https://doi.org/10.1177/2055207620979209

Ramdan, M. R., Abd Aziz, N. A., Abdullah, N. L., Samsudin, N., Singh, G. S. V., Zakaria, T., Fuzi, N. M., & Ong, S. Y. Y. (2022). SMEs performance in Malaysia: The role of contextual ambidexterity in innovation culture and performance. Sustainability, 14(3), Article 1679. https://doi.org/10.3390/su14031679

Ramdan, M. R., Abdullah, N. L., Isa, R. M., & Hanafiah, M. H. (2020). Meneroka faktor-faktor yang mempengaruhi penggunaan platform digital oleh perusahaan mikro dan kecil [Exploring factors influencing the use of digital platform by micro and small enterprises]. Jurnal Pengurusan, 59, 37-51. https://rb.gy/prjx1z

Ramdan, M. R., Abdullah, N. L., Isa, R. M., & Hanafiah, M. H. (2021). Organizational ambidexterity within supply chain management: A scoping review. LogForum, 17(4), 531-546. https://www.logforum.net/pdf/17_4_6_21.pdf  

Razak, A. A., Ramdan, M. R., Mahjom, N., Zabit, M. N. M., Muhammad, F., Hussin, M. Y. M., & Abdullah, N. L. (2022). Improving critical thinking skills in teaching through problem-based learning for students: A scoping review. International Journal of Learning, Teaching and Educational Research, 21(2), 342-362. http://doi.org/10.26803/ijlter.21.2.19

Rockinson-Szapkiw, A., Wendt, J., Whighting, M., & Nisbet, D. (2016). The predictive relationship among the community of inquiry framework, perceived learning and online, and graduate students’ course grades in online synchronous and asynchronous courses. International Review of Research in Open and Distributed Learning, 17(3), 18-35. https://doi.org/10.19173/irrodl.v17i3.2203

Rodchua, S., Yaiadom-boakye, G., & Woolsey, R. (2011). Student verification system for online assessments: Bolstering quality and integrity of distance learning. Journal of Industrial Technology27(3), 1-8. https://bit.ly/4b4BA02

Rotar, O. (2022). Online student support: A framework for embedding support interventions into the online learning cycle. Research and Practice in Technology Enhanced Learning, 17, Article 2. https://doi.org/10.1186/s41039-021-00178-4

Rovai, A. P. (2002). Sense of community, perceived cognitive learning, and persistence in asynchronous learning networks. The Internet and Higher Education, 5(4), 319-332. https://doi.org/10.1016/S1096-7516(02)00130-6

Samsudin, N., Ramdan, M. R., Abd Razak, A. Z. A., Mohamad, N., Yaakub, K. B., Abd Aziz, N. A., & Hanafiah, M. H. (2022). Related factors in undergraduate students' motivation towards social entrepreneurship in Malaysia. European Journal of Educational Research, 11(3), 1657-1668. http://doi.org/10.12973/eu-jer.11.3.1657

Sarason, I. G., Sarason, B. R., & Pierce, G. R. (1994). Social support: Global and relationship-based levels of analysis. Journal of Social and Personal Relationships, 11(2), 295-312. https://doi.org/10.1177/0265407594112008

Şenel, S., & Şenel, H. C. (2021). Remote assessment in higher education during COVID-19 pandemic. International Journal of Assessment Tools in Education, 8(2), 181-199. https://doi.org/10.21449/ijate.820140

Shao, M., Hong, J.-C., & Zhao, L. (2022). Impact of the self-directed learning approach and attitude on online learning ineffectiveness: The mediating roles of internet cognitive fatigue and flow state. Frontiers in Public Health, 10, Article 927454. https://doi.org/10.3389/fpubh.2022.927454

Shraim, K. (2019). Online examination practices in higher education institutions: Learners’ Perspectives. Turkish Online Journal of Distance Education, 20(4), 185-196. https://doi.org/10.17718/tojde.640588

Sim, G., Holifield, P., & Brown, M. (2004). Implementation of computer assisted assessment: Lessons from the literature. Research in Learning Technology, 12(3), 215-229. https://doi.org/10.1080/0968776042000259546

Spivey, M. F., & McMillan, J. J. (2014). Classroom versus online assessment. Journal of Education for Business, 89(8), 450-456. https://doi.org/10.1080/08832323.2014.937676

Steen, H. L. (2008). Effective eLearning design. MERLOT Journal of Online Learning and Teaching, 4(4), 526-532. https://jolt.merlot.org/vol4no4/steen_1208.pdf

Torris, C., Meyer, M. E., Sandbekken, I. H., Halvorsrud, H., & Molin, M. (2022). Nursing students’ perceived learning outcomes, motivation to learn and grade achieved in a digital blended learning course: A Norwegian cross-sectional study. Education Sciences, 12(7), Article 467. https://doi.org/10.3390/educsci12070467

Tsang, J. T. Y., So, M. K. P., Chong, A. C. Y., Lam, B. S. Y., & Chu, A. M. Y. (2021). Higher education during the pandemic: The predictive factors of learning effectiveness in COVID-19 online learning. Education Sciences, 11(8), Article 446. https://doi.org/10.3390/educsci11080446

Tseng, K.-H., Chang, C.-C., Lou, S.-J., & Chen, W.-P. (2013). Attitudes towards science, technology, engineering and mathematics (STEM) in a project-based learning (PjBL) environment. International Journal of Technology and Design Education, 23, 87-102. https://doi.org/10.1007/s10798-011-9160-x

Twigg, C. A. (2003). New models for online learning. Educause Review, 38, 28-38. https://www.thencat.com/Articles/erm0352.pdf

 Vygotsky, L. S. (1978). Mind in society: Development of higher psychological processes (M. Cole, V. Jolm-Steiner, S. Scribner, & E. Souberman, Eds.). Harvard University Press. https://doi.org/10.2307/j.ctvjf9vz4

Walker, S. (1984). Learning theory and behaviour modification. Routledge. https://doi.org/10.4324/9781315206622

Wei, X., Saab, N., & Admiraal, W. (2023). Do learners share the same perceived learning outcomes in MOOCs? Identifying the role of motivation, perceived learning support, learning engagement, and self-regulated learning strategies. The Internet and Higher Education, 56, Article 100880. https://doi.org/10.1016/j.iheduc.2022.100880

Whitelock, D., & Watt, S. (2008). Reframing e-assessment: Adopting new media and adapting old frameworks. Learning, Media and Technology, 33(3), 151-154. https://doi.org/10.1080/17439880802447391

Wibowo, F. E., & Novitasari, U. (2021). An analysis of online assessment in teaching English. Professional Journal of English Education, 4(3), 521-529. https://doi.org/10.22460/project.v4i3.p521-529

Yahaya, R., Ramdan, M. R., Ahmad, N. L., Ismail, R., Khalid, K., Jusoh, M. A., & Isa, R. M. (2022). Educators’ motivation and intention within the UTAUT model to adopt the flipped classroom: A scoping review. International Journal of Learning, Teaching and Educational Research, 21(2), 285-302. http://doi.org/10.26803/ijlter.21.2.16

Yunusa, A. A., & Umar, I. N. (2021). A scoping review of critical predictive factors (CPFs) of satisfaction and perceived learning outcomes in E-learning environments. Education and Information Technologies, 26, 1223-1270. https://doi.org/10.1007/s10639-020-10286-1

Zheng, M., Bender, D., & Lyon, C. (2021). Online learning during COVID-19 produced equivalent or better student course performance as compared with pre-pandemic: empirical evidence from a school-wide comparative study. BMC Medical Education, 21, Article 495. https://doi.org/10.1186/s12909-021-02909-z

...