' Rasch model' Search Results
The Pattern of Hybrid Learning to Maintain Learning Effectiveness at the Higher Education Level Post-COVID-19 Pandemic
covid-19 higher education hybrid learning learning effectiveness...
Online learning during the Coronavirus disease (COVID-19) pandemic has awakened and affirmed the necessity of learning based on digital technology. The article was aimed to analyze the effectiveness of online learning at bachelor’s, master’s, and doctoral degrees of Islamic Religious Education as a reference to develop a learning pattern post-COVID-19 pandemic. The research employed a mixed-method design with a concurrent triangulation model. The samples were taken using stratified random and purposive sampling. Meanwhile, the data were collected through questionnaires, in-depth interviews, and forum group discussion. A descriptive analysis and one-way analysis of variance were used to analyze the quantitative data, while interpretative descriptive for the qualitative data. The research showed that online learning during the COVID-19 pandemic at the bachelor’s, master’s, and doctoral degrees of Islamic Religious Education have been effective. In detail, online learning at the doctoral degree was the most effective among all. On the other hand, face-to-face learning is still necessary. Therefore, the learning pattern developed post-COVID-19 pandemic combines face-to-face and online learning (hybrid learning). The formulation is adjusted to the characteristics, educational purpose and orientation, level of ability, readiness, and learning autonomy of the students at each educational level.
The Development of Historical Thinking Assessment to Examine Students’ Skills in Analyzing the Causality of Historical Events
causality historical events historical thinking skills...
This research aimed to develop a historical thinking assessment for students' skills in analyzing the causality of historical events. The development process of Gall and colleagues and Rasch analysis models were used to develop an assessment instrument consisting of two processes, including the analysis of the framework of cause and consequence, the validity, reliability, and difficultness test. This research involved 150 senior high school students, with data collected using the validation sheet, tests, and scoring rubric. The results were in the form of an essay test consisting of six indicators of analyzing cause and consequence. The instruments were valid, reliable, and suitable for assessing students’ skills in analyzing the causality of historical events. The developed instruments were paired with a historical thinking skills assessment to improve the accuracy of the information about students' level of historical thinking skills in the learning history.
Exploratory and Confirmatory Factor Analysis for Disposition Levels of Computational Thinking Instrument Among Secondary School Students
attitudes computational thinking disposition factor analysis...
Computational thinking (CT) is a method for solving complex problems, but also gives people an inventive inspiration to adapt to our smart and changing society. Globally it has been considered as vital abilities for solving genuine issues successfully and efficiently in the 21st century. Recent studies have revealed that the nurture of CT mainly centered on measuring the technical skill. There is a lack of conceptualization and instruments that cogitate on CT disposition and attitudes. This study attends to these limitations by developing an instrument to measure CT concerning dispositions and attitudes. The instruments' validity and reliability testing were performed with the participation from secondary school students in Malaysia. The internal consistency reliability, standardized residual variance, construct validity and composite reliability were examined. The result revealed that the instrument validity was confirmed after removing items. The reliability and validity of the instrument have been verified. The findings established that all constructs are useful for assessing the disposition of computer science students. The implications for psychometric assessment were evident in terms of giving empirical evidence to corroborate theory-based constructs and also validating items' quality to appropriately represent the measurement.
The COVID-19 Pandemic’s Impact on 9th Grade Students’ Mathematics Achievement
covid-19 high-school mathematics spain...
In this research, the influence of the Coronavirus disease (COVID-19) pandemic on 9th grade students’ mathematics achievement is analyzed through quantitative and qualitative methods. A posttest only with control group design was used to compare the mathematics marks of 9th grade students from the previous school year (before the pandemic, control group) and the current school year (during the pandemic, experimental group). Seventy-three students from a public high school in Spain attending class on alternate days participated in the study. Three focus group sessions were held with students, and five semi-structured interviews were conducted—two with teachers and three with students’ families. Results show statistically significant differences in students’ mathematics achievement, with students enrolled in 9th grade the previous (pre-pandemic) year outscoring their peers currently enrolled in 9th grade (during the pandemic) by 22.17%. An overall negative effect size of Hedge’s g = -1.11 was reported. Although significant statistical differences between groups were reported for both male and female students, the effect was 42.31% larger for male students (Hedge’s g = -1.11) than for females (Hedge’s g = -0.78). The qualitative information supported the quantitative results. Changes in educational settings, students’ lack of motivation, monotony, and students’ level of responsibility were qualitatively reported as factors that may explain this phenomenon. The main conclusion of this study is that the COVID-19 pandemic may be significantly and negatively affecting 9th grade students’ mathematics achievement.
Validating Student’s Green Character Instrument Using Factor and Rasch Model
green character instrument factor and rasch analysis...
Many researchers have separately developed instruments to measure environmental characteristics such as attitudes, values, and knowledge. However, there is no instrument used to measure all these aspects in one comprehensive instrument. This study is meant to develop and validate a green character instrument which reveals student behavior and awareness of the environment. The instrument consists of 40 statement items consisting of 5 aspects, namely private pro-environmental behavior, public pro-environmental behavior, environmental knowledge, environmental values, and environmental attitudes. It was implemented on 1,398 students from 15 universities in Indonesia. The instrument content validation was analyzed by three experts using content validity index (CVI). The construct validity was analyzed using exploratory factor analysis, confirmatory factor analysis, and RASCH analysis. The content validity results obtained CVI scores ranging between 0.8 and 0.9 with a good category, while item reliability was in a fairly good category with a high level of separation index. Construct validation resulted in 34 items (4 items were eliminated after Exploratory and Confirmatory Factor Analysis, and 2 items were eliminated after RASCH analysis) spread over five constructs, namely environmental behavior, environmental knowledge, environmental values, environmental attitudes, and environmental habits. The resulting instrument has a good level of item difficulty, with a well understood response set which can be understood easily by respondents, and without bias. Therefore, it can be used to measure the students’ green character on both male and female.
Developing Assessment Instrument Using Polytomous Response in Mathematics
assessment instrument classical and modern theory vocational school polytomous responses...
This research is a developmental research aiming at developing a good mathematical test instrument using polytomous responses based on classical and modern theories. This research design uses the Plomp model, which consists of five stages, (1) preliminary investigation, (2) design, (3) realization/construction, (4) revision, and (5) implementation (testing). The study was conducted in three vocational schools in Lampung Province, Indonesia. The study involved 413 students, consisting of 191 male and 222 female students. The data were collected through questionnaire and test. The questionnaire was used to identify the assessment instruments currently employed by teachers and to be validated by the experts of mathematics and educational evaluation. The test used an open polytomous response test numbering of 40 items. The data were analyzed using both classical and modern theories. The results show that (1) the open polytomous response test has a good category according to classical and modern theory. However, the discrimination power of test items in classical theory needs several revisions, (2) the assessment instrument using the polytomous response of open multiple choice can guarantee information on the actual competence of students. This is proven by the fact that there is a harmony between the analysis result obtained from classical and modern theory from the students' arguments when giving reasons for their choices. Therefore, the open polytomous response test can be used as an alternative to learning assessment.
Competency Framework of Agriculture Educators Vocational College: Measurement Model Using Partial Least Square-Structural Equation Modeling
agriculture educators competency framework pls-sem vocational college...
Competent instructors need to have the skills, abilities, and competencies to perform tasks effectively, which will affect student learning achievement. This study is guided by the theory of Boyatzis developed by Spencer and Spencer. The Iceberg Competency Model was used as a guideline to identify the competency elements of educators from the agricultural stream in vocational colleges (KV). This research study aims to explore and identify the existing competency elements of agricultural educators in KV. This study used a study population comprising 243 respondents of agricultural educators in KV. To answer the research question, the data analysis was done by Partial Least Squares - Structural Equation Modeling (PLS-SEM). This study is a study built to observe the relationship between the latent constructs studied. These constructs consisted of exogenous and endogenous constructs. In this study, exogenous constructs comprised value constructs, social roles, self-image, motives, traits and constraints. At the same time, endogenous constructs involved constructs of skills and knowledge. To ensure that the construct of this study gives meaning to the reflective measurement model, it was evaluated based on internal consistency reliability and validity. Regarding the framework, some indicators that did not qualify were dropped based on factor loading and average variance extracted (AVE). From the analysis conducted, 16 indicators were dropped since they did not meet PLS-SEM requirements. The total number of items retained was 71 indicators. At the final stage of this study, the evaluation model was implemented to form a framework involving the evaluation of the constructs linked to each other.
A Systematic Review on Geometric Thinking: A Review Research Between 2017-2021
geometric thinking pre-service teachers technology based-media...
Geometric thinking affects success in learning geometry. Geometry is studied from elementary school to university level. Therefore, in higher education and basic education, it is necessary to carry out a systematic review in order to obtain tips for improving geometric thinking skills. A systematic review of geometric thinking was done in this study. In this study from 2017 to 2021, geometric thinking was investigated in the form of a synthesis review of the effect size of the given treatment. This is a comprehensive discussion of theories, models, and frameworks on the topic of geometric thinking from 36 articles. The research findings revealed that the interventions used were predominantly effective, with effect sizes ranging from "small" to "very large," with the "very large" effect obtained in the intervention of van Hiele's learning phase and various technology-based-media and concrete manipulative media. The research trend was reflected through twelve clusters of interrelated keywords. The results of this literature review suggested that it is necessary to carry out a specific study on how to achieve the highest level of geometric thinking, a more detailed form of scaffolding, and concrete manipulative media and technology that can be explored for a certain level of the participants’ geometric thinking.
The Effectiveness of Multimedia Learning for Distance Education Toward Early Childhood Critical Thinking During the COVID-19 Pandemic
critical thinking distance education early childhood multimedia learning...
The government has imposed social restrictions during the COVID-19 pandemic, affecting the education sector, including the early childhood school. Distance education offers different methods from the conventional methods, as the students are expected to gain the same skills, including critical thinking skills. Therefore, teachers must provide distance learning innovations using relevant learning media, such as multimedia-based learning. This research aims to assess the efficacy of multimedia learning in early childhood distance learning. This research is a quantitative model with a quasi-experimental pretest and posttest design. The data collection technique utilized questionnaires given to 30 samples of early childhood children. The data were statistically analyzed using SPSS software. The results confirmed that multimedia-based learning for distance learning could develop critical thinking skills in early childhood children during the COVID-19 pandemic. The results of this study offer exploration of learning strategies to improve children’s critical thinking.
Teacher-Student Performance Criteria During Online Classes due to COVID-19: Self-Report by Postgraduate Students in Education
didactic pandemic performance school lockdown teaching...
During didactic interactions, teachers and students employ competencies and skills that correspond functionally to one another, and several models propose to typify didactic performances in higher education. For this study, we chose the didactic performance interbehavioral model as the substantive theory to identify six pairs of didactic performance criteria through self-evaluations from graduate students. These included: Competency exploration–precurrent learning behaviors, Criteria explicitness–Criteria identification, Illustration–Participation, Practice supervision–Relevant practice, Feedback–Improvement, and Evaluation–Application.309 Peruvian students from an in-person postgraduate course in Education Sciences filled out two scales (via Google Forms) to assess teacher-student performance criteria during online classes. Convergent and divergent validity were obtained separately for six teacher/student performance constructs through a confirmatory analysis using LISREL 8. Moreover, differences according to sex were only significant for the Illustration teacher criterion (favoring men) and the Application student criterion (favoring women). Students rated Explicitness of criteria and Illustration as the teacher performance criteria most frequently seen during online classes. On the other hand, Criteria identification ranked the highest in terms of the students’ performance criteria, followed by Feedback–Improvement. Another conclusion was that the didactic performance interbehavioral model could be empirically supported by the two self-assessment questionnaires, which yielded good convergent and divergent validity of constructs.
Optimizing Academic Achievement through Comprehensive Integration of Formative Assessment into Teaching
academic achievement formative assessment peer assessment self-assessment structured assignments...
Learning activities are conducted to help students achieve optimal academic achievement. This research aims to optimize student academic achievement through a learning process that integrates comprehensive formative assessments, including formative tests, self-assessment, peer assessment, and the initiator of creating summaries or concept maps that are given to students in a structured manner at the end of every lesson. The research method used was a quasi-experimental method with a 2x2 factorial design. Students enrolled in the biology education program of the basic physics course for the 1st semester of the 2019 academic year participated in this study. The participants were 66 undergraduate students divided into two classes. Thirty-four students in the experimental group were in class A, while 32 students in the control group were in class B. Data were collected using a learning outcome test instrument to measure academic achievement, which was tested at the end of the semester. Data were analyzed using a two-way ANOVA. This study concluded that a learning process that includes comprehensive formative assessment significantly affects students' academic achievement. These findings support the theory that formative assessment provides feedback, correction, and improvement in student learning.
Study Item Parameters of Classical and Modern Theory of Differential Aptitude Test: Is it Comparable?
classical test theory differential aptitude test item parameter modern test theory...
This study aimed to find the Classical Test Theory (CTT) and Modern Test Theory (MTT) item parameters of the Differential Aptitude Test (DAT) and examined their comparability of them. The item parameters being studied are difficulty level and discrimination index. 5.024 data of the result sub-test DAT were documented by the Department of Psychology and Guidance and Counselling bureau. The parameter of classical and modern test items was estimated and correlated by examining the comparability between parameters. The results show that there is a significant correlation between item parameter estimates. The Rasch and IRT 1-PL models have the highest correlation toward CTT regarding the item difficulty level. In contrast, model 2-PL has the highest correlation toward CTT in the item discrimination index. Overall, the study concluded that CTT and MTT were comparable in estimating item parameters of DAT and thus could be used independently or complementary in developing DAT.
Measurement of Students' Chemistry Practicum Skills Using Many Facets Rash Model
chemistry practicum mfrm performance assessment process assessment product assessment...
The accuracy of assessing the capabilities of the process and product in chemical practice activities requires appropriate measurement procedures to be followed. It is crucial to identify the components that can introduce bias while measuring student abilities during the measurement process. This study aims to identify the components or criteria used by teachers to assess student performance in practicum activities and analyze the quality of the rubrics developed. The study was conducted with the participation of three raters, 27 high school students, and nine assessment criteria. A quantitative descriptive approach was employed using the many-facet Rasch model (MFRM) analysis for measurement. The results of the MFRM analysis show no significant measurement bias, with data measurement facets fitting the MFRM model. The reliability of all the facets meets the criteria, and the scale predictor functions appropriately. While all students can easily pass four out of nine items, five items can only be partially passed by students. The assessment criteria that require special attention include communication skills, tools and assembly, interpretation, cleanliness, and accuracy when performing practicums. These criteria provide feedback for teachers and students to ensure successful practicum activities. The Discussion section of this study delves into the findings and their implications.
Teaching Practices to Support the Transition of Students With Intellectual Disabilities to Adulthood
adulthood intellectual disability teachers teaching practices transition services...
There is a great need to provide transition planning and enhance the success of individuals with intellectual disabilities in employment and independent living through appropriate practices. This study aims to explore the essential components of effective transition services that teachers should include in their instruction of students with intellectual disabilities. A descriptive quantitative research design was utilized, and data were collected through an online survey from 102 teachers of students with intellectual disabilities. The findings indicated that participants sometimes included most of the five essential components of effective transition service components in their teaching. No statistically significant differences were found in participants’ responses based on school type, years of teaching experience, or qualifications. However, statistically significant differences were found between male and female participants in responses to two of the main components, namely, student-focused planning and interagency collaboration, with male participants reporting higher mean scores than female participants. The study’s implications for practice and future research are also discussed.
Strengthening Pedagogical Content Knowledge in Designing Laboratory Activity Based on Small-Scale Chemistry Practicum Approach
laboratory activity pedagogical content knowledge small-scale chemistry...
The purpose of this research is to strengthen pedagogical content knowledge (PCK) in designing laboratory activities based on small-scale chemistry approaches. This research is action research involving 60 trainee teachers with stages that include (a) Reflect; (b) Plan; (c) Act; (d) Observe; (e) Reflect (2nd); (f) Plan (2nd). Qualitative data were collected through (a) Questionnaires reflecting on experiences in practicing chemistry learning and responses to the importance of learning, (b) a Portfolio of chemistry practicum design, (c) documentation of the process of carrying out design, implementation, and practicum evaluation activities, (d) field notes, (e) reflection sheet, and (f) Portfolio of follow-up plans. The data is displayed through the R computation system with data pre-processing stages in the teacher's reflection text which includes basic cleaning, case folding, normalization, stemming, and deleting meaningless words. Display data in the form of word clouds, frequency expression diagrams, and tabulations. Descriptive narratives are used to analyze the documentation obtained in the action process. The teacher group demonstrated performance in implementing small-scale practicum activities. Teachers are increasingly skilled in modifying conventional laboratory equipment, minimizing the amount of chemical use, minimizing waste disposal, and increasing efficiency in the duration of practicum implementation. The follow-up plan for this activity includes quality improvement in aspects of (a) skill in using laboratory equipment, (b) understanding of chemical concepts, (c) equipment availability, materials, and work procedures, and (d) implementation of chemistry practicum.
A Psychometric Validation of the Sociomathematical Norm Scale for Senior High School Students in Mathematics Learning
developments scale learning mathematics; psychometric validation rasch model sociomathematical norms...
Students in mathematics classes do not understand the importance of sociomathematical norms in learning mathematics. This causes sociomathematical norms not to be teachers' focus when learning mathematics. Besides, there is no standardized instrument for assessing this norm, so developing this instrument is necessary to measure socio-mathematical norms in learning mathematics. This study aims to create and verify the psychometric validity of the sociomathematical norm scale. This research used a survey method with 505 senior high school students from Jakarta and West Java as respondents. The results showed that 25 items had convergent validity, with a loading factor value of > 0.700, meaning they could be declared valid. Concurrent validity indicates that each sociomathematical norms indicator is valid as a whole. Discriminant validity shows that the average variance extracted value on the diagonal is higher than the other values, so each item is declared valid. It was concluded that each item of the sociomathematical norms instrument has accuracy in its measurement function. The reliability test shows that each sociomathematical norms item is declared reliable. The reliability value of the sociomathematical norm item is .99, and the person's reliability is .86. Thus, the instruments developed can measure sociomathematical norms in learning mathematics.
Classroom Climate and Student–Teacher Relationship: A Study Among Students and Teachers in Slovenia
classroom climate primary school students teachers...
The primary objective of this study was to determine how students and teachers in primary schools view the classroom climate and its dimensions: (a) peer relationships and (b) student-teacher relationships. Additionally, the study aimed to explore the role of students' age (11-12 years old - 7th grade students vs. 14-15 years old - 9th grade primary school students) and gender on their perceptions of the school climate. Classroom climate was measured with the "Classroom Climate Questionnaire", which was completed by a total of 1,531 students (792; 51.6% female) and 348 teachers (296; 84.6% female). The findings of the study indicated that both students and teachers generally perceived the classroom climate as being relatively neutral to positive. However, teachers tended to report more positive classroom relationships compared to students. Furthermore, the study found no significant gender-based differences in how students perceived the classroom climate, peer relationships, and student-teacher interactions. However, differences were identified based on the age or grade level of the students. The results were discussed in the context of the students’ psychological development characteristics and the aspects of socio-emotional learning within school environments, also considering educational policies for achieving greater school quality.
Towards Effective Integration: Modeling Strategies to Link Standardized Assessment Results with Educational Policies
student evaluation quality of education standardized tests system dynamics modelling...
Considering the importance of the results of national and international standardized tests, which are a benchmark for measuring educational quality, the objective of this research was to model strategies to improve the results of the evaluations, specifically the Saber 11 standardized tests. These tests are applied to students who finish their Vocational Education and Training (VET) in Bogotá, Colombia. To achieve this objective, we employed the Systems Dynamics methodology for a comprehensive analysis, which is a tool that allows for the analysis and projecting of the behavior of different systems, in which anticipation by means of modeling results over time is required. The modeling was conducted in two stages: First, a causal loop diagram and a stock-and-flow diagram that linked 45 variables were designed, showing the underlying physical structure of the system. Then, five groups of alternative simulations were conducted over a time frame of six years: Reference mode, student self-efficacy rate, management rate, teaching competencies rate, and educational policy. An increase in results was observed in each scenario. The combined activity of educational stakeholders is a notably effective strategy to achieve significant improvements. The data used for these simulations came from a six-year period of standardized test results in Bogotá. This period was selected to capture both recent trends and long-term outcomes, ensuring that the model reflects current educational conditions while allowing for meaningful trend analysis.
Validation of Students' Green Behavior Instrument Based on Local Potential Using Structural Equation Modeling With Smart Partial Least Squares
instrument validation green behavior local potential structural equation modeling smart partial least squares...
This study aims to develop and validate a green behavior instrument based on local potential using structural equation modeling (SEM) with smart partial least squares (SmartPLS). The instrument consists of 40 statements covering five main indicators: environmental maintenance, waste reduction, saving natural resources, sustainable mobility and consumption, and community education. This study addresses a gap in existing research by creating a context-specific tool for assessing green behavior, incorporating local cultural and ecological factors. While prior studies emphasize global sustainability principles, they often overlook the significance of local practices and values, which are essential for effective environmental education. By integrating local potential, this instrument bridges global sustainability goals with regional contexts, enabling meaningful and practical student engagement. The instrument was validated through content validity testing, exploratory and confirmatory factor analyses, and construct validity and reliability testing using SEM with SmartPLS. The results indicate strong content validity, with content validity index (CVI) values ranging from .80 to .90. After analysis, 34 valid items were retained from the initial 40. This study contributes to the literature by developing an instrument that aligns with global sustainability goals while integrating local cultural practices and ecological contexts. It offers insights into how local knowledge enhances sustainability education, providing a holistic framework for assessing green behavior across diverse regions.