'assessment model' Search Results
Construct Exploration of Teacher Readiness as an Assessor of Vocational High School Competency Test
competency test construct exploration readiness instruments vocational high school...
Teachers who can adapt and be ready for all changes will also be able to provide a balance to increase the competence of vocational high school students. This is also not denied when teachers become assessors in student competency tests. The objectives of this study were to produce an instrument for the readiness of teachers as assessors; to knowing good grain reliability; to know the characteristics of the instrument; and to know the difficulty level of the item. The method used in this research is instrument development. Respondents were vocational school teachers who were candidates for competency test assessors. Data collection techniques using a questionnaire. Analysis of construct validity using Confirmatory Factor Analysis. Reliability using Cronbach’s alpha. Test the instrument items using the Rasch model. The results are the readiness instruments of the vocational teacher as an assessor has 19 indicators that have been grouped into 5 factors with consistency values being in the same construct (proven construct validity). The result of the calculation of the reliability of this instrument is 0.852, which means that the reliability coefficient is high; There are two items, namely numbers 24 and 18 which indicate the absence of a fit item in the overall item fit criteria; At the item difficulty level, items 8 and 6 have a difficulty score of more than 2, while this indicates that items 8 and 6 have a high difficulty level.
Assessments on Vocational Knowledge and Skills: A Content Validity Analysis
assessments content validity analysis i-cvi modified kappa vocational knowledge...
While previous studies on assessments focused on measurement of principles and constructs, existing attention is given to content validation involving vocational education and skills. The emphasis on content validation has prompted a holistic perspective of teaching and learning to demand alternative research approaches. Using evidence of content validity based on expert judgment and assessment items, this paper argues that vocational knowledge and skills could be determined via constructs and construct functions. Content validity analysis was studied in two major phases, namely, through an assessment of an electrical technology course at a Malaysian higher education institution and expert panels’ examination of items. It was found that to increase confidence in providing reliable instruments for future empirical studies, a careful process in item development and content validity analysis was considered important. Therefore, applying these findings on item analysis and expert panels to reflect content validity can enhance the validity of assessment items.
Mathematics Teachers’ Practices of STEM Education: A Systematic Literature Review
instructional approaches mathematics stem education...
Science, technology, engineering and mathematics (STEM) education is regarded as one of the formulas to embracing many of our imminent challenges. STEM education benefits the learners by encouraging interest in STEM disciplines. This daunting task needs everyone’s concerted efforts in creating and innovating mathematics teachers’ classroom practices Therefore, a systematic review was conducted to identify best practices for STEM education following the guidelines of the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) by Moher et al. (2015). The reviewed articles were published from 2016 to 2020 and accessed using the Scopus and Web of Science (WoS) databases. Three themes for best practices were identified namely (a) core competencies encompassing 21st-century teaching skills; (b) instructional designs; and (c) requisite STEM execution. Results of PRISMA determined the dominant STEM practices were critical thinking, communication, collaboration, problem-solving, research-based pedagogy, problem-based learning and project-based learning, technological integration, accessibility, professional development and learning support, evidence of effectiveness, access to materials and practitioner support, and scalability. Mathematics teachers should determine the best STEM practices to employ even though there is a lack of studies on integrated STEM domains. When more students are interested in venturing and exploring into the field of STEM, the high demand for STEM related careers could be met by the younger generation.
Exploring Factors Predicting Undergraduate Healthcare Students’ Use of Learning Strategies
implicit theories learning strategies academic motivation self-determination theory undergraduate students...
The present study aimed to investigate the relationship between students’ academic motivation, implicit beliefs about intelligence and learning strategies among undergraduate healthcare students. First-year students of healthcare degree courses from a university in Southern Italy were surveyed. The study measured psychological constructs by means of Academic Motivation Scale, Motivated Strategies for Learning Questionnaire, and Dweck’s implicit questions about beliefs of intelligence. Two regression models were computed to assess the association between students’ beliefs about intelligence, motivations for studying, and learning strategies. In the first regression model, predicting students’ use of cognitive strategies from implicit intelligence beliefs and motivations for studying, stronger autonomous motivations were significant predictors of cognitive strategies. The second regression model, predicting students’ use of metacognitive strategies from implicit intelligence beliefs and motivations for studying, was not significant. These findings can be useful to plan tailored educational interventions to promote students’ motivation, incremental beliefs about intelligence and their use of learning strategies positively related with academic performance.
Technology Anxiety and its Impact on E-Learning System Actual Use in Jordan Public Universities during the Coronavirus Disease Pandemic
anxiety covid-19 e-learning self-efficacy...
During the Coronavirus disease (COVID-19) pandemic, universities were obligated to transform from traditional classroom teaching environments to virtual ones. This sudden transformation highlighted the issue of low e-learning system usage amongst instructors of humanity faculties in Jordan's public universities. This study empirically investigated the moderating impact of technology anxiety on the relationship between the instructor's self-efficacy and the e-learning system's actual use to contribute to solving the problem. A survey was distributed to 468 instructors to test the theoretical framework, which yielded 285 valid and complete instruments analyzed using Structural Equation Modeling (SEM). Results showed the positive direct effect of self-efficacy on actual use. Furthermore, the level of technology anxiety moderated the relationship. Instructors with low technology anxiety showed a higher level of e-learning system actual usage than those with a high anxiety level. To improve the use of e-learning systems, top management must understand the fundamental role of compulsory training as the Covid-19 pandemic, and the instructor's confidence must be increased by providing training and support.
The Users’ Experiences in Processing Visual Media for Creative and Online Learning Using Instagram
creative learning creating instagram online learning user experience...
The aims of the recent study were; analyzing the effect of creative and online learning using Instagram on the ability to create new products in the technology and learning media course, and determining the level of users’ experience in processing visual media through the Canva application on android. Quantitative approach with this research was carried out through a quasi-experimental research model because it measured the post-test was applied to 58 students as the respondents in two experimental and control classes. This study used two instruments; the cognitive learning outcome questionnaire according to the subject to get the students’ ability to create new products, and the second instrument was taken from ueq-online.org in the Indonesian version to know the users' experience in processing visual media. The data were analyzed using one-way ANOVA, mean and standard deviation assisted by IBM SPSS Statistics 24.0. The results demonstrated that the effect of creative and online learning using Instagram on the ability to create new products in The Technology and Learning Media course was found significant at 0.028 <0.05 which meant it could be applied well. Meanwhile, the level of users' experience in processing the visual media application Canva on Android had the highest score on the Stimulation scale at 1.59, categorized "Very Good" and the lowest score was on the Novelty scale at 0.93, categorized "Above Average". With the strong creative encouragement to create new products, the students were able to process their own visual media which were tailored to the agreed digital visual designs and were published on Instagram.
Development of Academic Optimism Model in Learning for Junior High School Students
academic optimism democratic parenting school climate internal locus of control self-concept...
Academic optimism has an essential role in the adjustment of students in school. This study aimed to examine a model of academic optimism formed from democratic parenting, school climate, internal locus of control, and students’ self-concept. This a cross-sectional non-experimental design research design involved 335 Junior High School students in Kediri. The data collection tool was a scale while the data analysis technique was Structural Equation Modeling (SEM) analysis. The results showed that the theoretical model for developing academic optimism in Junior High School students was in line with the research data and obtained empirical support (X2 = 246.056 < 255.6018; p = 0.110 > 0.05), so this model is feasible and can be used in samples that have been studied. In general, this study adds knowledge about positive psychology studies and supports democratic parenting, school climate, self-concept, and internal locus of control as ultimate factors for creating students’ academic optimism.
A Rasch Analysis of Item Quality of the Chemical Literacy Assessment for Investigating Student’s Chemical Literacy on Chemical Rate Concepts
assessment chemical rate rasch analysis students’ chemical literacy...
Assessment is a topic that continues to be developed in science education research. Assessment evaluates not only students' cognitive abilities but also their thinking skills. Therefore, in this study, an assessment that could measure students' chemical literacy was developed. Chemical literacy is a thinking skill that students must develop as part of their chemistry learning. The goal of this study was to assess item' quality, as well as student’ chemical literacy on the concept of chemical rate. The Rasch model was employed to analyze the data in this study. The results of this study depict that the developed assessment had sufficient reliability and validity to be used to assess students' chemical literacy. Furthermore, the analysis of the students’ responses to the items revealed that many students did not understand or were unaware of the context presented. These findings suggest that students' chemical literacy in the material for the reaction rate is still lacking and needs to be improved. As a result, the teacher's role in assisting students in improving their chemical literacy through chemistry learning is critical.
Combination of Discovery Learning and Metacognitive Knowledge Strategy to Enhance Students’ Critical Thinking Skills
discovery learning metacognitive knowledge strategy learning strategy combination critical thinking skills science education...
The research aims to develop an instructional tool based on Discovery Learning (DL) combined with a Metacognitive Knowledge Strategy (MKS) to enhance students’ Critical Thinking Skills (CTSs). In doing so, the study employed a Research and Development (R&D) method to develop such a tool. The developed instructional tool was tested for its validity by experts and practitioners’ evaluation. Further, the empirical data were collected from the results of implementation in learning and the student's responses, while the data of tools effectiveness were acquired from the critical thinking tests given to students (analyzed by related t-test). The developed instructional tools were implemented in a limited-scale trial of 32 students and a large-scale trial of 59 students. The results show that: firstly, the DL and MKS-integrated instructional tools are stated as valid in terms of the lesson plan, student worksheet, and critical thinking test. Secondly, the practicality criteria have been successfully met; the learning implementation, students’ activity, and students' responses were regarded as in accordance with the feasibility standard. Thirdly, the instructional tool was deemed effective in enhancing students’ CTSs (p = 0.05).
Pedagogical Concept of Self-reflection of Students of Social Education: Qualitative Study of Self-reflection Determinants
qualitative research self-reflection social education students of social education university education...
The main topic of the presented article is the pedagogical concept of self-reflection of students of Social Education. The authors understand the pedagogical concept as primarily educational determinants that influence and shape students’ self-reflection. To identify this aim, the authors formulate the main research question: How do social education students reflect on themselves as students, and what are the determinants of study self-reflection for social pedagogy students? The authors used the qualitative research strategy, specifically The Grounded Theory, through which sixty self-reflecting essays were analysed. These written self-reflections were further complemented with six in-depth interviews in which we acquired clarifying information on self-reflection and self-assessment of social education students. It was ascertained that students’ self-reflection is shaped through an awareness of internal and external study factors, which subsequently influence the overall concept of their study, motivation to perform, study style, and self-assessment.
The Interrelationships between Metacognition and Modeling Competency: The Moderating Role of the Academic Year
academic year levels confirmatory factor analysis mathematical modeling metacognition structural equation modelling...
Several concerted movements toward mathematical modeling have been seen in the last decade, reflecting the growing global relationship between the role of mathematics in the context of modern science, technology and real life. The literature has mainly covered the theoretical basis of research questions in mathematical modeling and the use of effective research methods in the studies. Driven by the Realistic Mathematics Education (RME) theory and empirical evidence on metacognition and modeling competency, this research aimed at exploring the interrelationships between metacognition and mathematical modeling and academic year level as a moderator via the SEM approach. This study involved 538 students as participants. From this sample, 133 students (24.7%) were from the first academic year, 223 (41.4%) were from the second and 182 (33.8%) were from the third. A correlational research design was employed to answer the research question. Cluster random sampling was used to gather the sample. We employed structural equation modeling (SEM) to test the hypothesized moderation employing IBM SPSS Amos version 18. Our findings confirmed the direct correlation between metacognition and mathematical modeling was statistically significant. Academic year level as a partial moderator significantly moderates the interrelationships between the metacognitive strategies and mathematical modeling competency. The effect of metacognition on mathematical modeling competency was more pronounced in the year two group compared to the year one and three groups.
The Effects of Online Learning on EFL Students’ Academic Achievement during Coronavirus Disease Pandemic
online learning pedagogical practices assessment learning outcomes affective factors academic achievement...
Coronavirus disease (COVID-19) Pandemic changed education conditions worldwide forcing all the parties involved to adapt to a new system. This study aimed to collect information related to the effects of teaching English online on English as a Foreign Language (EFL) students’ achievement. Data were collected from EFL teachers and students enrolled in three different Ecuadorian Universities (Technical University of Ambato, Higher Polytechnic School of Chimborazo, and University of Cuenca) from five different levels: A1, A2, B1, B1+, and B2. This preliminary paper reports the results of 480 students regarding four major sections: pedagogical practice and assessment, learning outcomes, affective factors and perceptions of students about the advantages and disadvantages of online learning during the pandemic COVID-19; considering the Hierarchy of online learning needs of Justin Shewell. An online survey questionnaire with 17 questions and a 5-point Likert scale was applied. The Cronbach's Alpha test presented 0.84 and 0.73 level of reliability. The Kolmogorov Smirnov’s statistic and, the Kendall's Tau_b tests, and the Levene's test for homogeneity of variances were performed with the SPSS statistical program. The results made evident that online learning affects academic achievement in EFL students during the COVID-19 pandemic, which was confirmed after analyzing four main areas: pedagogical practices and assessment, learning outcomes, affective factors and students’ perceptions about the advantages and disadvantages of online learning. The importance of online learning was highlighted since it has been understood as a tool to face the emergency produced by the COVID-19 pandemic.
Integration of Learning Management System as an Aid in Teaching: An Assessment
educational technology higher education learning management system teacher education...
The research delved into the assessment of integrating Learning Management System as an aid in teaching. Data were collected from 26 students at Rizal Technological University-College of Education, Philippines, through pretest-posttest quasi-experimental and normative survey design of research. Data were statistically tested using the frequency, percentage, mean, standard deviation, t-test for dependent and independent samples, and paired t-test. Results of the research indicate that the respondents have optimistic attitudes towards the integration of learning management system in teaching. The respondents performed poorly in the pretest examination but performed very satisfactorily in the posttest examination. Furthermore, the research found out that there is no significant difference between the performances of the experimental group and control group in pretest and posttest, moreover, there is a significant difference between the pretest and posttest scores of the experimental group and the pretest and posttest scores of the control group.
Fostering Tertiary Student Professional Mobility Skills via Convergence of the Professional Training and Foreign Language Learning
foreign language learning higher education professional mobility skills professional training tertiary students...
The purpose of the study was to identify how the instructional model that converges professional training and foreign language learning can influence the students’ professional mobility and students’ readiness to build their careers. The study used the methods of a quantitative kind for the evaluation study and descriptive research. The variables for the study were as follows: levels of student professional mobility skills proficiency that included students’ competence in their professional field, foreign language proficiency, students’ networking skills, personality qualities, and sampled students’ satisfaction with the reshaped course. The field phase of the study found that the Erasmus and Work-and-Travel programmes contributed to the former students’ adaptability and flexibility, the experience of work abroad, and practical specialism-related experience gained during study. The students developed their abilities to project a positive social image, ability to build and maintain relationships, foreign language proficiency, proficiency in presenting and negotiating, and theoretical knowledge. The English Language-delivered Professional Mobility course brought shifts in the levels of students’ professional mobility skills. The experimental group students reported that they improved their competence in their professional field, foreign language proficiency, networking skills, and personality qualities. The experimental group students’ judgements concerning the quality of the course were complimentary.
A Game-Based Learning Activity to Promote Conceptual Understanding of Chordates’ Phylogeny and Self-Efficacy to Learn Evolutionary Biology
chordates game-based learning level of use phylogeny self-efficacy...
Understanding phylogenetic trees representing evolutionary relationships of living organisms is essential in school biology. Traditional instructions based on lectures and textbooks with pictorial presentations have been proven ineffective to promote students’ understanding of the concept. This study, therefore, developed a game-based learning activity called the VERT card game to enhance students’ learning of the phylogenetic taxonomy of chordates. The VERT card game was designed to lay the foundation for different characteristics of chordate classes, as well as to allow students to construct and interpret their evolutionary relationships based on the phylogenetic tree. The effectiveness of the VERT card game was verified by a pre-test and post-test design with 109 middle school students in Thailand. The statistical result revealed that students’ mean scores increased significantly in the post-test, compared to the pre-test, indicating their improved understanding. In addition, after participating in the learning activity, the student participants were found to increase their self-efficacy to learn evolutionary biology statistically. Also, it showed positive views towards the usefulness of the developed card game as a large number of them expressed that they would like to use it for their lesson reviews and wished to have this form of learning activity in other topics in biology.
Development of Gazi Functional Vision Assessment Instrument
distance vision functional vision assessment low vision near vision visual field...
This study aimed to develop a valid and reliable instrument that measures the functional vision of students with low vision. Thus, an assessment tool and performance activities were developed for three vision skill groups (near vision skills, distance vision skills, and visual field) that include functional vision skills. The universe was 1485 students studying in various primary and middle schools (from 2nd to 7th grades) affiliated to the Ministry of National Education, and simple random sampling was used to select 310 students. The data were collected using the Gazi Functional Vision Assessment Instrument developed by the researchers. Many-facet Rasch model and generalizability theory were used for the rater reliability of the measurements obtained from the instrument, while discriminant analysis was used for the validity of the measurements. The analysis showed that the measurements were reliable, and the inferences based on these measurements were valid. Thus, this instrument can be used to identify and assess the functional vision status of students with low vision.
Virtual Classroom Critical Thinking as an Alternative Teaching Model to Improve Students' Critical Thinking Skills in Pandemic Coronavirus Disease Era
coronavirus disease critical thinking skills teaching model vc2t...
Critical thinking skills are one of the thinking skills needed to live in the 21st century and the era of the Industrial Revolution 4.0. This study aims to develop a Virtual Classroom Critical Thinking (VC2T) Model, which is valid, practical, and effective to improve students' critical thinking skills. VC2T model has six steps: problem orientation, formulation, group discussion, analysis, result discussion, and reflection. This study is a Research & Development (R & D) involving 33 high school students in Surabaya, Indonesia. Before being tested, the VC2T Model was designed based on the theory of Plomp and Nieveen and then validated by 3 (three) experts in physics education. Data were analyzed using validity by experts, implementation of teaching with the VC2T Model, paired t-test, calculation of n-gain, effect size and percentage of student responses. The results showed that the VC2T Model is: (1) valid with an average validity score of 4.14 in the high validity category; (2) practical with an average score of implementations teaching of VC2T Model 4.26 in the outstanding category; and (3) effective as indicated by increasing of students' critical thinking skills scores which are statistically significant at alpha .05, the average n-gain is .38 in the medium category, the effect size of 6.93 is in a strong category and the average students' response is 87.59 % with outstanding category.
Measuring Self-Regulated Learning in the STEM Framework: A Confirmatory Factor Analysis
confirmatory factor analysis reliability self-regulated learning stem validity...
Within the context of Self-Regulated Learning (SRL), a process of directing oneself to facilitate individual learning more effectively, the SRL instrument development is deemed necessary to measure students’ self-reliance in learning mathematics in the science, technology, engineering, and mathematics (STEM) framework. The research aims to develop and test the validity and reliability of an SRL instrument, namely a 14-item SRL questionnaire accommodating four aspects, namely planning, self-monitoring, self-controlling, and evaluation. The study involved 420 junior high school students in East Java, Central Java, and Yogyakarta Special Region. The results show that the questionnaire was developed as planned and that planning, monitoring, controlling, and evaluating aspects can reflect the SRL variable in a valid, reliable, and significant way supported by each aspect's behavior indicator. The SRL variable theoretical model corresponds (good fit) with the empirical data, and all of the items are likely valid and reliable to assess student's mathematics SRL in the STEM framework. The SRL questionnaire was also found suitable for use by teachers to measure junior high school students’ self-reliance in SRL.
Effect of Cooperative Learning on Chemistry Students’ Achievement in Rwandan Day-upper Secondary Schools
academic achievement basic education chemistry education cooperative learning secondary schools in rwanda...
The cooperative learning (CL) is an advanced instructional approach that uses different motivational procedures to make instruction significant and learners more responsible. This study aimed to investigate the effects of cooperative learning on students' achievement in chemistry among the advanced level in 12-year basic education schools; it engaged a quasi-experimental design with one treatment group and a comparison group (control); the first applied cooperative learning in teaching organic chemistry while in the control group, organic chemistry was taught by the conventional teaching methods (CTM). A sample of 257 students participated in the study. The data collected used an organic Chemistry Achievement Test, and its data were analyzed using SPSS version 23.0 and MS Excel 2016. The ANCOVA results showed that learners taught using cooperative learning achieved better than their counterparts in the control group (F=78.07, df=1, 256, p<.001) with the learning gains of 16.0% in traditional methods and 53.6% of cooperative learning approach, respectively. However, there was no statistically significant difference in gender of students. It is recommended that chemistry teachers be trained on cooperative learning and encouraged to apply it in their teaching methods to enhance students' academic achievement.
The Academic Buoyancy Scale: Measurement Invariance across Culture and Gender in Egyptian and Omani Undergraduates
academic buoyancy congeneric reliability measurement invariance...
The academic buoyancy scale (ABS) is one of the most widely used instruments for measuring academic buoyancy. To obtain meaningful and valid comparisons across groups using ABS, however, measurement invariance should be ascertained a priori. To that end, we examined its measurement invariance, validity evidence based on relations to other variables, and score reliability using categorical omega across culture and gender among Egyptian and Omani undergraduates. Participants were 345 college students: Egyptian sample (N=191) and Omani sample (N=154). To assess measurement invariance across culture and gender, multiple–group confirmatory factor analysis was performed with four successive invariance models: (a) configural, (b) metric, (c) scalar, and (d) residual. Results revealed that the unidimensional baseline model had adequate fit to the data in the full sample. Moreover, measurement invariance was found to hold across culture but not across gender and consequently the ABS could be used to yield valid cross-cultural comparisons between the Egyptian and Omani students. Conversely, it cannot be used to yield valid inferences related to comparing gender groups within each culture. Validity evidence based on relations to other variables was supported by the significantly moderate correlation between ABS and academic achievement (GPA; r =.435 and r = .457, P < .01) for the Egyptian and Omani samples, respectively. With regard to score reliability, categorical omega coefficients were moderate across both samples. Educational and psychological implications, limitations and suggestions for improving the scale are discussed.