' Rasch analysis' Search Results
Development of Gazi Functional Vision Assessment Instrument
distance vision functional vision assessment low vision near vision visual field...
This study aimed to develop a valid and reliable instrument that measures the functional vision of students with low vision. Thus, an assessment tool and performance activities were developed for three vision skill groups (near vision skills, distance vision skills, and visual field) that include functional vision skills. The universe was 1485 students studying in various primary and middle schools (from 2nd to 7th grades) affiliated to the Ministry of National Education, and simple random sampling was used to select 310 students. The data were collected using the Gazi Functional Vision Assessment Instrument developed by the researchers. Many-facet Rasch model and generalizability theory were used for the rater reliability of the measurements obtained from the instrument, while discriminant analysis was used for the validity of the measurements. The analysis showed that the measurements were reliable, and the inferences based on these measurements were valid. Thus, this instrument can be used to identify and assess the functional vision status of students with low vision.
The Indonesian Version of the Physics Metacognition Inventory: Confirmatory Factor Analysis and Rasch Model
confirmatory factor analysis physics metacognition inventory psychometric evaluation rasch model scale adaptation...
Metacognition inventory supports increased awareness and self-control to improve student’s academic success, including physics. However, there are limitations to revealing the Physics Metacognition Inventory (PMI), especially in Indonesia. This study aims to explore and evaluate the psychometric properties of PMI. This survey research has involved 479 students from three high schools in Indonesia. The psychometric properties of the I-PMI were evaluated using a Confirmatory Factor Analysis and Rasch Model approach. The results show that the Indonesian Physics Metacognition Inventory (I-PMI) is collected in 6 constructs from 26 items. The validity, reliability, and compatibility tests have also been analyzed with good results. The five rating scales used have adequate functionality. This research has also presented more comprehensive information about the Physics Metacognition Inventory in the context of Indonesian culture. This study has implications for using I-PMI to assess students’ metacognition at the high school level in Indonesia and recommendations for future research.
The Pattern of Hybrid Learning to Maintain Learning Effectiveness at the Higher Education Level Post-COVID-19 Pandemic
covid-19 higher education hybrid learning learning effectiveness...
Online learning during the Coronavirus disease (COVID-19) pandemic has awakened and affirmed the necessity of learning based on digital technology. The article was aimed to analyze the effectiveness of online learning at bachelor’s, master’s, and doctoral degrees of Islamic Religious Education as a reference to develop a learning pattern post-COVID-19 pandemic. The research employed a mixed-method design with a concurrent triangulation model. The samples were taken using stratified random and purposive sampling. Meanwhile, the data were collected through questionnaires, in-depth interviews, and forum group discussion. A descriptive analysis and one-way analysis of variance were used to analyze the quantitative data, while interpretative descriptive for the qualitative data. The research showed that online learning during the COVID-19 pandemic at the bachelor’s, master’s, and doctoral degrees of Islamic Religious Education have been effective. In detail, online learning at the doctoral degree was the most effective among all. On the other hand, face-to-face learning is still necessary. Therefore, the learning pattern developed post-COVID-19 pandemic combines face-to-face and online learning (hybrid learning). The formulation is adjusted to the characteristics, educational purpose and orientation, level of ability, readiness, and learning autonomy of the students at each educational level.
The Development of Historical Thinking Assessment to Examine Students’ Skills in Analyzing the Causality of Historical Events
causality historical events historical thinking skills...
This research aimed to develop a historical thinking assessment for students' skills in analyzing the causality of historical events. The development process of Gall and colleagues and Rasch analysis models were used to develop an assessment instrument consisting of two processes, including the analysis of the framework of cause and consequence, the validity, reliability, and difficultness test. This research involved 150 senior high school students, with data collected using the validation sheet, tests, and scoring rubric. The results were in the form of an essay test consisting of six indicators of analyzing cause and consequence. The instruments were valid, reliable, and suitable for assessing students’ skills in analyzing the causality of historical events. The developed instruments were paired with a historical thinking skills assessment to improve the accuracy of the information about students' level of historical thinking skills in the learning history.
Exploratory and Confirmatory Factor Analysis for Disposition Levels of Computational Thinking Instrument Among Secondary School Students
attitudes computational thinking disposition factor analysis...
Computational thinking (CT) is a method for solving complex problems, but also gives people an inventive inspiration to adapt to our smart and changing society. Globally it has been considered as vital abilities for solving genuine issues successfully and efficiently in the 21st century. Recent studies have revealed that the nurture of CT mainly centered on measuring the technical skill. There is a lack of conceptualization and instruments that cogitate on CT disposition and attitudes. This study attends to these limitations by developing an instrument to measure CT concerning dispositions and attitudes. The instruments' validity and reliability testing were performed with the participation from secondary school students in Malaysia. The internal consistency reliability, standardized residual variance, construct validity and composite reliability were examined. The result revealed that the instrument validity was confirmed after removing items. The reliability and validity of the instrument have been verified. The findings established that all constructs are useful for assessing the disposition of computer science students. The implications for psychometric assessment were evident in terms of giving empirical evidence to corroborate theory-based constructs and also validating items' quality to appropriately represent the measurement.
The COVID-19 Pandemic’s Impact on 9th Grade Students’ Mathematics Achievement
covid-19 high-school mathematics spain...
In this research, the influence of the Coronavirus disease (COVID-19) pandemic on 9th grade students’ mathematics achievement is analyzed through quantitative and qualitative methods. A posttest only with control group design was used to compare the mathematics marks of 9th grade students from the previous school year (before the pandemic, control group) and the current school year (during the pandemic, experimental group). Seventy-three students from a public high school in Spain attending class on alternate days participated in the study. Three focus group sessions were held with students, and five semi-structured interviews were conducted—two with teachers and three with students’ families. Results show statistically significant differences in students’ mathematics achievement, with students enrolled in 9th grade the previous (pre-pandemic) year outscoring their peers currently enrolled in 9th grade (during the pandemic) by 22.17%. An overall negative effect size of Hedge’s g = -1.11 was reported. Although significant statistical differences between groups were reported for both male and female students, the effect was 42.31% larger for male students (Hedge’s g = -1.11) than for females (Hedge’s g = -0.78). The qualitative information supported the quantitative results. Changes in educational settings, students’ lack of motivation, monotony, and students’ level of responsibility were qualitatively reported as factors that may explain this phenomenon. The main conclusion of this study is that the COVID-19 pandemic may be significantly and negatively affecting 9th grade students’ mathematics achievement.
Validating Student’s Green Character Instrument Using Factor and Rasch Model
green character instrument factor and rasch analysis...
Many researchers have separately developed instruments to measure environmental characteristics such as attitudes, values, and knowledge. However, there is no instrument used to measure all these aspects in one comprehensive instrument. This study is meant to develop and validate a green character instrument which reveals student behavior and awareness of the environment. The instrument consists of 40 statement items consisting of 5 aspects, namely private pro-environmental behavior, public pro-environmental behavior, environmental knowledge, environmental values, and environmental attitudes. It was implemented on 1,398 students from 15 universities in Indonesia. The instrument content validation was analyzed by three experts using content validity index (CVI). The construct validity was analyzed using exploratory factor analysis, confirmatory factor analysis, and RASCH analysis. The content validity results obtained CVI scores ranging between 0.8 and 0.9 with a good category, while item reliability was in a fairly good category with a high level of separation index. Construct validation resulted in 34 items (4 items were eliminated after Exploratory and Confirmatory Factor Analysis, and 2 items were eliminated after RASCH analysis) spread over five constructs, namely environmental behavior, environmental knowledge, environmental values, environmental attitudes, and environmental habits. The resulting instrument has a good level of item difficulty, with a well understood response set which can be understood easily by respondents, and without bias. Therefore, it can be used to measure the students’ green character on both male and female.
Developing Assessment Instrument Using Polytomous Response in Mathematics
assessment instrument classical and modern theory vocational school polytomous responses...
This research is a developmental research aiming at developing a good mathematical test instrument using polytomous responses based on classical and modern theories. This research design uses the Plomp model, which consists of five stages, (1) preliminary investigation, (2) design, (3) realization/construction, (4) revision, and (5) implementation (testing). The study was conducted in three vocational schools in Lampung Province, Indonesia. The study involved 413 students, consisting of 191 male and 222 female students. The data were collected through questionnaire and test. The questionnaire was used to identify the assessment instruments currently employed by teachers and to be validated by the experts of mathematics and educational evaluation. The test used an open polytomous response test numbering of 40 items. The data were analyzed using both classical and modern theories. The results show that (1) the open polytomous response test has a good category according to classical and modern theory. However, the discrimination power of test items in classical theory needs several revisions, (2) the assessment instrument using the polytomous response of open multiple choice can guarantee information on the actual competence of students. This is proven by the fact that there is a harmony between the analysis result obtained from classical and modern theory from the students' arguments when giving reasons for their choices. Therefore, the open polytomous response test can be used as an alternative to learning assessment.
Competency Framework of Agriculture Educators Vocational College: Measurement Model Using Partial Least Square-Structural Equation Modeling
agriculture educators competency framework pls-sem vocational college...
Competent instructors need to have the skills, abilities, and competencies to perform tasks effectively, which will affect student learning achievement. This study is guided by the theory of Boyatzis developed by Spencer and Spencer. The Iceberg Competency Model was used as a guideline to identify the competency elements of educators from the agricultural stream in vocational colleges (KV). This research study aims to explore and identify the existing competency elements of agricultural educators in KV. This study used a study population comprising 243 respondents of agricultural educators in KV. To answer the research question, the data analysis was done by Partial Least Squares - Structural Equation Modeling (PLS-SEM). This study is a study built to observe the relationship between the latent constructs studied. These constructs consisted of exogenous and endogenous constructs. In this study, exogenous constructs comprised value constructs, social roles, self-image, motives, traits and constraints. At the same time, endogenous constructs involved constructs of skills and knowledge. To ensure that the construct of this study gives meaning to the reflective measurement model, it was evaluated based on internal consistency reliability and validity. Regarding the framework, some indicators that did not qualify were dropped based on factor loading and average variance extracted (AVE). From the analysis conducted, 16 indicators were dropped since they did not meet PLS-SEM requirements. The total number of items retained was 71 indicators. At the final stage of this study, the evaluation model was implemented to form a framework involving the evaluation of the constructs linked to each other.
The Effectiveness of Multimedia Learning for Distance Education Toward Early Childhood Critical Thinking During the COVID-19 Pandemic
critical thinking distance education early childhood multimedia learning...
The government has imposed social restrictions during the COVID-19 pandemic, affecting the education sector, including the early childhood school. Distance education offers different methods from the conventional methods, as the students are expected to gain the same skills, including critical thinking skills. Therefore, teachers must provide distance learning innovations using relevant learning media, such as multimedia-based learning. This research aims to assess the efficacy of multimedia learning in early childhood distance learning. This research is a quantitative model with a quasi-experimental pretest and posttest design. The data collection technique utilized questionnaires given to 30 samples of early childhood children. The data were statistically analyzed using SPSS software. The results confirmed that multimedia-based learning for distance learning could develop critical thinking skills in early childhood children during the COVID-19 pandemic. The results of this study offer exploration of learning strategies to improve children’s critical thinking.
Optimizing Academic Achievement through Comprehensive Integration of Formative Assessment into Teaching
academic achievement formative assessment peer assessment self-assessment structured assignments...
Learning activities are conducted to help students achieve optimal academic achievement. This research aims to optimize student academic achievement through a learning process that integrates comprehensive formative assessments, including formative tests, self-assessment, peer assessment, and the initiator of creating summaries or concept maps that are given to students in a structured manner at the end of every lesson. The research method used was a quasi-experimental method with a 2x2 factorial design. Students enrolled in the biology education program of the basic physics course for the 1st semester of the 2019 academic year participated in this study. The participants were 66 undergraduate students divided into two classes. Thirty-four students in the experimental group were in class A, while 32 students in the control group were in class B. Data were collected using a learning outcome test instrument to measure academic achievement, which was tested at the end of the semester. Data were analyzed using a two-way ANOVA. This study concluded that a learning process that includes comprehensive formative assessment significantly affects students' academic achievement. These findings support the theory that formative assessment provides feedback, correction, and improvement in student learning.
Effects of Project-Based Learning on Postgraduate Students' Research Proposal Writing Skills
academic achievement postgraduate students project-based learning research methodology research proposal writing skills...
Research is considered a vital component for propelling progress and development. This study aims to investigate the effects of problem-based learning (PBL) in the teaching of research methodology and statistics courses on improving research writing skills and enhancing course achievement. It also projects an action plan model for the effective implementation of PBL in the instructional aspect. The study utilised a positivist research paradigm based on action research design using the technique of content analysis. Employing a universal rubric, 45 proposals of graduate programme students enrolled in the College of Education at Minia University in North Upper Egypt were subjected to content analysis to rate students’ skills in writing research proposals before and after the delivery of the course. The students volunteered to participate in the study after they were given a synopsis of the aims and procedures. Students’ achievement was assessed through a test consisting of 90 items, developed primarily for this purpose at the end of the second semester in the academic year 2018–2019. The post-content analysis revealed a significant improvement in scientific research skills, with a considerable difference between the pre- and post-achievement scores. It is imperative to consider the feasibility of using the PBL approach in teaching research methodology and statistics courses for graduate students. The study recommended the adoption of PBL in undergraduate programmes as well as in high school education.
Study Item Parameters of Classical and Modern Theory of Differential Aptitude Test: Is it Comparable?
classical test theory differential aptitude test item parameter modern test theory...
This study aimed to find the Classical Test Theory (CTT) and Modern Test Theory (MTT) item parameters of the Differential Aptitude Test (DAT) and examined their comparability of them. The item parameters being studied are difficulty level and discrimination index. 5.024 data of the result sub-test DAT were documented by the Department of Psychology and Guidance and Counselling bureau. The parameter of classical and modern test items was estimated and correlated by examining the comparability between parameters. The results show that there is a significant correlation between item parameter estimates. The Rasch and IRT 1-PL models have the highest correlation toward CTT regarding the item difficulty level. In contrast, model 2-PL has the highest correlation toward CTT in the item discrimination index. Overall, the study concluded that CTT and MTT were comparable in estimating item parameters of DAT and thus could be used independently or complementary in developing DAT.
Measurement of Students' Chemistry Practicum Skills Using Many Facets Rash Model
chemistry practicum mfrm performance assessment process assessment product assessment...
The accuracy of assessing the capabilities of the process and product in chemical practice activities requires appropriate measurement procedures to be followed. It is crucial to identify the components that can introduce bias while measuring student abilities during the measurement process. This study aims to identify the components or criteria used by teachers to assess student performance in practicum activities and analyze the quality of the rubrics developed. The study was conducted with the participation of three raters, 27 high school students, and nine assessment criteria. A quantitative descriptive approach was employed using the many-facet Rasch model (MFRM) analysis for measurement. The results of the MFRM analysis show no significant measurement bias, with data measurement facets fitting the MFRM model. The reliability of all the facets meets the criteria, and the scale predictor functions appropriately. While all students can easily pass four out of nine items, five items can only be partially passed by students. The assessment criteria that require special attention include communication skills, tools and assembly, interpretation, cleanliness, and accuracy when performing practicums. These criteria provide feedback for teachers and students to ensure successful practicum activities. The Discussion section of this study delves into the findings and their implications.
Teaching Practices to Support the Transition of Students With Intellectual Disabilities to Adulthood
adulthood intellectual disability teachers teaching practices transition services...
There is a great need to provide transition planning and enhance the success of individuals with intellectual disabilities in employment and independent living through appropriate practices. This study aims to explore the essential components of effective transition services that teachers should include in their instruction of students with intellectual disabilities. A descriptive quantitative research design was utilized, and data were collected through an online survey from 102 teachers of students with intellectual disabilities. The findings indicated that participants sometimes included most of the five essential components of effective transition service components in their teaching. No statistically significant differences were found in participants’ responses based on school type, years of teaching experience, or qualifications. However, statistically significant differences were found between male and female participants in responses to two of the main components, namely, student-focused planning and interagency collaboration, with male participants reporting higher mean scores than female participants. The study’s implications for practice and future research are also discussed.
Strengthening Pedagogical Content Knowledge in Designing Laboratory Activity Based on Small-Scale Chemistry Practicum Approach
laboratory activity pedagogical content knowledge small-scale chemistry...
The purpose of this research is to strengthen pedagogical content knowledge (PCK) in designing laboratory activities based on small-scale chemistry approaches. This research is action research involving 60 trainee teachers with stages that include (a) Reflect; (b) Plan; (c) Act; (d) Observe; (e) Reflect (2nd); (f) Plan (2nd). Qualitative data were collected through (a) Questionnaires reflecting on experiences in practicing chemistry learning and responses to the importance of learning, (b) a Portfolio of chemistry practicum design, (c) documentation of the process of carrying out design, implementation, and practicum evaluation activities, (d) field notes, (e) reflection sheet, and (f) Portfolio of follow-up plans. The data is displayed through the R computation system with data pre-processing stages in the teacher's reflection text which includes basic cleaning, case folding, normalization, stemming, and deleting meaningless words. Display data in the form of word clouds, frequency expression diagrams, and tabulations. Descriptive narratives are used to analyze the documentation obtained in the action process. The teacher group demonstrated performance in implementing small-scale practicum activities. Teachers are increasingly skilled in modifying conventional laboratory equipment, minimizing the amount of chemical use, minimizing waste disposal, and increasing efficiency in the duration of practicum implementation. The follow-up plan for this activity includes quality improvement in aspects of (a) skill in using laboratory equipment, (b) understanding of chemical concepts, (c) equipment availability, materials, and work procedures, and (d) implementation of chemistry practicum.
A Psychometric Validation of the Sociomathematical Norm Scale for Senior High School Students in Mathematics Learning
developments scale learning mathematics; psychometric validation rasch model sociomathematical norms...
Students in mathematics classes do not understand the importance of sociomathematical norms in learning mathematics. This causes sociomathematical norms not to be teachers' focus when learning mathematics. Besides, there is no standardized instrument for assessing this norm, so developing this instrument is necessary to measure socio-mathematical norms in learning mathematics. This study aims to create and verify the psychometric validity of the sociomathematical norm scale. This research used a survey method with 505 senior high school students from Jakarta and West Java as respondents. The results showed that 25 items had convergent validity, with a loading factor value of > 0.700, meaning they could be declared valid. Concurrent validity indicates that each sociomathematical norms indicator is valid as a whole. Discriminant validity shows that the average variance extracted value on the diagonal is higher than the other values, so each item is declared valid. It was concluded that each item of the sociomathematical norms instrument has accuracy in its measurement function. The reliability test shows that each sociomathematical norms item is declared reliable. The reliability value of the sociomathematical norm item is .99, and the person's reliability is .86. Thus, the instruments developed can measure sociomathematical norms in learning mathematics.
Classroom Climate and Student–Teacher Relationship: A Study Among Students and Teachers in Slovenia
classroom climate primary school students teachers...
<p style="text-align:justify">The primary objective of this study was to determine how students and teachers in primary schools view the classroom climate and its dimensions: (a) peer relationships and (b) student-teacher relationships. Additionally, the study aimed to explore the role of students' age (11-12 years old - 7th grade students vs. 14-15 years old - 9th grade primary school students) and gender on their perceptions of the school climate. Classroom climate was measured with the "Classroom Climate Questionnaire", which was completed by a total of 1,531 students (792; 51.6% female) and 348 teachers (296; 84.6% female). The findings of the study indicated that both students and teachers generally perceived the classroom climate as being relatively neutral to positive. However, teachers tended to report more positive classroom relationships compared to students. Furthermore, the study found no significant gender-based differences in how students perceived the classroom climate, peer relationships, and student-teacher interactions. However, differences were identified based on the age or grade level of the students. The results were discussed in the context of the students’ psychological development characteristics and the aspects of socio-emotional learning within school environments, also considering educational policies for achieving greater school quality.</p>