'rasch analysis' Search Results
The Effect of Project Based Learning on the Statistical Literacy Levels of Student 8th Grade
statistical literacy project based learning statistics education middle school students rasch measurement...
This study examines the effect of project based learning on 8th grade students’ statistical literacy levels. A performance test was developed for this aim. Quasi-experimental research model was used in this article. In this context, the statistics were taught with traditional method in the control group and it was taught using project based learning in the intervention group. Statistics was given for four weeks according to pro ject based learning at intervention group. The performance test was applied to total 70 students as pre and post-test. Participants are from two different classes of a middle school in Trabzon. The data were analysed using Rasch measurement techniques. This measurement allowed both students’ performance and item difficulties to be measured using the same metric and placed on the same scale. All raw scores converted linear score in order to obtain equal interval scale. Acquired linear scores were compared. In the analysis of gained datum covariance analysis are used. According to gained results in pre-processing application there isn’t substantial difference between the achievements of intervention group and control group; but after processing between the achievements of intervention group and control group there is a substantial difference statistically in favor of intervention group. The results of the study revealed that the project based learning increased students’ statistical literacy levels in the intervention group.
10
The Effect on the 8th Grade Students’ Attitude towards Statistics of Project Based Learning
statistical literacy attitude project based learning statistics education...
This study investigates the effect of the project based learning approach on 8th students’ attitude towards statistics. With this aim, an attitude scale towards statistics was developed. Quasi experimental research model was used in this study. Following this model in the control group the traditional method was applied to teach statistics wheras in the intervention group project based learning approach was followed. The attitude scale towards statistics was applied as pre-test and post-tests to 70 students studying at two different 8th grade classes of a middle school in Trabzon during the 2011–2012 Academic Year. The results of the study revealed that the project based learning increased students’ attitude towards statistics in the intervention group. Therefore, the use of project based learning approach during statistics course in mathematics classes is recommended.
8
The Development of an Instrument to Measure the Higher Order Thinking Skill in Physics
higher order thinking skill physics instrument...
This study is conducted to develop the diagnostic test, which can be used to measure the higher-order thinking skill (HOTs) of students of first-grade senior high school in Bima district, West Nusa Tenggara. The step of developing instruments such as test which using modification model of Oreondo which include two activities such as test designing and test trials. The analysing technique of validity of content used Aiken formula, classical test theory used software Iteman 4.3, the model of Rasch used software Winstep and analysing reliability used software SPSS. The conclusion which can be taken are developing instrument has the characteristics as a useful instrument and fulfil requirement used to measure. This case proved from the data of analysis result which confirm that the instrument has been achieved the content of validity by expert judgment and obtained the empirical evidence, both as classical test theory or Rasch model.
Psychometric and Structural Evaluation of the Physics Metacognition Inventory Instrument
psychometric evaluation physics metacognition inventory problem solving...
The purpose of this study is to evaluate the psychometric and structural instruments of the Physics Metacognition Inventory (PMI) developed by Taasoobshirazi, Bailey, and Farley (2015). The PMI consists of 26 items in six factors. The English and Indonesian versions were tested on an English course (N = 37) in the Geophysics study program at Tadulako University. The trials were conducted separately within a two-week interval. The data collected from 364 students of the Physics Education Department, University of Tadulako were analyzed using the Exploratory Factor Analysis (EFA). Later, data were collected from 351 students of some Indonesian universities which have physics education study programs, and the data were analyzed using the Confirmatory Factor Analysis (CFA). The EFA result reveals six factors based on the rotation result with the maximum loading factor. The CFA result shows the RMSEA values of .018, 2 (284) = 316.32 (χ2 / df = 1,11), GFI = .93, CFI = .99, AGFI = .92 and NFI = .93 which meet the cut-off statistic value, and therefore, the model is considered fit, with the Construct Reliability Estimation (CR) of .93, Composite Reliability of = .95, and maximum reliability of Ω = .96. The results obtained reveal that the PMI scale has good, valid and reliable psychometric properties. Therefore, PMI can be used to measure the level of metacognition of students when solving physics problems. Future studies using PMI are also discussed.
Developing MeMoRI on Newton’s Laws: For Identifying Students’ Mental Models
memori-nl mental models instrument newton's laws students' mental models...
The identification of students’ mental models is crucial in understanding their knowledge of scientific concepts. This research aimed to develop a Mental Models Representation Instrument on Newton's Laws (MeMoRI-NL). The ADDIE (Analyzing, Designing, Developing, Implementing and Evaluating) model was used as a research method. The sample consisted of 30 students of 15-16 years-old at one of senior high school in Tatar Pasundan. The data was examined using Rasch analysis on validity, reliability, level of difficulty, and distributions of students’ mental models. Students’ mental models were classified as Scientific (SC), Synthetic (SY), Synthetic almost Misconception (SYM), and Initial (IN) model. Based on the evaluating stage, students’ mental models are mostly in the SYM and IN model. Consequently, it can be concluded that the Mental Models Representation Instrument on Newton's Laws (MeMoRI-NL) can be developed using the ADDIE model and most of the students' mental model has not been following scientific knowledge. Based on this research, teachers or educators should enhance students' mental models, especially for female students.
Construction of Students' Mathematical Knowledge in the Zone of Proximal Development and Zone of Potential Construction
construction of knowledge zone of proximal development zone of potential construction scaffolding...
This article highlights the main ideas that underlie the differences in potential pragmatic knowledge constructs students experience when solving problems, between the zone of proximal development (ZPD) and the zone of potential construction (ZPC). This qualitative research is based on a phenomenological approach to finding the meaning of things that are fundamental and essential from the ZPD and ZPC phenomena. Researchers observed mathematics learning by a teacher on 24 fourth-grade students who were divided into groups A (high IQ) and B (low IQ). Data collection through tests, observation, and interviews. While the validity of the data is done through triangulation of methods and triangulation of sources. The results showed that students of the Upper (A) group had high IQ but small ZPD and ZPC. In contrast, students in the Lower (B) group have low IQ but large ZPD and ZPC. This result means that intelligence (IQ) is measured not only logically-mathematically but also in the verbal-linguistic and spatial-visual fields. The conclusion is that there are differences in the construction of students' knowledge in the learning zone. This difference occurs because the knowledge constructs that the students have previously had an effect on the accommodation process of the schemes that students have built while in the proximal development zone (ZPD) where scaffolding works. Meanwhile, the potential construction zone (ZPC) is not sufficient to describe the real development of students. However, it only reflects what students have accomplished.
Teachers as Ethnographers: Narrative Study of Inquiry of Indonesian Teachers Assigned to Teach in Remote Areas
teacher ethnography narrative inquiry remote area...
The research explores the narrative inquiry of Indonesian teachers who are assigned to teach in remote areas. The research was conducted from 2019 until 2020. The teachers, in this case, are considered ethnographers because they try to recognize and enter remote island areas that have not been recognized. During this time, in the education context, narrative inquiry is more focused on teacher identity, teaching, curriculum, assessment, and counseling. In terms of narrative inquiry, the teacher as an ethnographer is very interesting to be studied, because it can provide ethnographic insight into the teacher’s perspective. The research used qualitative methods supported by ethnographic studies and involved 21 participants. Data analysis techniques used were the stages of identification, classification, reduction, and verification. The interview used was unstructured. The results show that the teacher as an ethnographer learned the local language in the early stage. The second stage is understanding the cultural situation of the local community. The third stage is the contribution of the teacher to the local community in the education context.
Implementation of Four-Tier Multiple-Choice Instruments Based on the Partial Credit Model in Evaluating Students’ Learning Progress
learning progress four-tier change of state of matter partial-credit model...
One of the issues that hinder the students’ learning progress is the inability to construct an epistemological explanation of a scientific phenomenon. Four-tier multiple-choice (hereinafter, 4TMC) instrument and Partial-Credit Model were employed to elaborate on the diagnosis process of the aforementioned problem. This study was to develop and implement the four-tier multiple-choice instrument with Partial-Credit Model to evaluate students’ learning progress in explaining the conceptual change of state of matter. This research applied a development research referring to the test development model by Wilson. The data were obtained through development and validation techniques on 20 4TMC items tested to 427 students. On each item, the study applied diagnostic-summative assessment and certainty response index. The students’ conceptual understanding level was categorized based on the combination of their answer choices; the measurement generated Partial-Credit Model for 1 parameter logistic (IPL) data. Analysis of differences was based on the student level class using Analysis of Variants (One-way ANOVA). This study resulted in 20 valid and reliable 4TMC instruments. The result revealed that the integration of 4TMC test and Partial-Credit Model was effective to be treated as the instrument to measure students’ learning progress. One-way ANOVA test indicated the differences among the students’ competence based on the academic level. On top of that, it was discovered that low-ability students showed slow progress due to the lack of knowledge as well as a misconception in explaining the Concept of Change of State of Matter. All in all, the research regarded that the diagnostic information was necessary for teachers in prospective development of learning strategies and evaluation of science learning.
A Rasch Model Analysis of the Psychometric Properties of the Student-Teacher Relationship Scale among Middle School Students
student-teacher relationship psychometric properties rasch analysis adolescents middle and high school...
The current study investigated Student-Teacher Relationship Measure (STRM) psychometric properties using Rasch analysis in a sample of middle school female students (N = 995). Rasch Principal Components Analysis revealed psychometric support of two subscales (i.e., Academic and Social Relations). Summary statistics showed good psychometric properties. The category structure and individual statistics (i.e., items and person infit and outfit) were not ideal. Category structure showed that the distances between adjacent thresholds were lower than optimal criteria. Even though findings indicated that items mean square statistics (MNSQ) were optimal, standardized fit statistics (i.e., ZSTD) reflected many misfit persons and items in each subscale. After eliminating the misfit persons and items, the two subscales met the Rasch optimal criteria. The updated short 22-item scale had good psychometric properties, high item and person separation, and good item and person reliability for the two subscales and can be used as a reliable and valid scale.
Influencing Variables and Implications in the Teacher-Student Relationships
learning motivation learning transfer perceived teacher innovation self-efficacy self-regulated learning...
The purpose of the study was to examine correlations between perceived teacher innovation (PTI) and self-regulated learning (SRL), where learning motivation, self-efficacy, and learning transfer help illustrate the interplay between and among influencing variables in the teacher-student relationship. This study gathered 213 valid questionnaires out of 355 participants in the Design Thinking for Data Scientists, which is one of the courses taught from a university in Taiwan. This study has analyzed the possible linkage in the Structural Equation Modeling (SEM) through the path coefficient. The ensuing data analysis study has shown that learning motivation, self-efficacy, and learning transfer not only served as the mediator effects in the PTI and SRL but also played small moderating effects. It appears that when learning motivation, self-efficacy, and learning transfer decrease, the interplay between PTI and SRL becomes stronger. It is necessary to increase the level of intrinsic motivation by the perception of greater innovation in teaching materials. By so doing, students would be more receptive and affective of course contents in the classroom and regulate themselves to achieve educational goals. The implications of teachers' perceptions of pedagogical innovation for learning motivation and learning experience are likewise discussed.
A Rasch Analysis of Item Quality of the Chemical Literacy Assessment for Investigating Student’s Chemical Literacy on Chemical Rate Concepts
assessment chemical rate rasch analysis students’ chemical literacy...
Assessment is a topic that continues to be developed in science education research. Assessment evaluates not only students' cognitive abilities but also their thinking skills. Therefore, in this study, an assessment that could measure students' chemical literacy was developed. Chemical literacy is a thinking skill that students must develop as part of their chemistry learning. The goal of this study was to assess item' quality, as well as student’ chemical literacy on the concept of chemical rate. The Rasch model was employed to analyze the data in this study. The results of this study depict that the developed assessment had sufficient reliability and validity to be used to assess students' chemical literacy. Furthermore, the analysis of the students’ responses to the items revealed that many students did not understand or were unaware of the context presented. These findings suggest that students' chemical literacy in the material for the reaction rate is still lacking and needs to be improved. As a result, the teacher's role in assisting students in improving their chemical literacy through chemistry learning is critical.
Development of Gazi Functional Vision Assessment Instrument
distance vision functional vision assessment low vision near vision visual field...
This study aimed to develop a valid and reliable instrument that measures the functional vision of students with low vision. Thus, an assessment tool and performance activities were developed for three vision skill groups (near vision skills, distance vision skills, and visual field) that include functional vision skills. The universe was 1485 students studying in various primary and middle schools (from 2nd to 7th grades) affiliated to the Ministry of National Education, and simple random sampling was used to select 310 students. The data were collected using the Gazi Functional Vision Assessment Instrument developed by the researchers. Many-facet Rasch model and generalizability theory were used for the rater reliability of the measurements obtained from the instrument, while discriminant analysis was used for the validity of the measurements. The analysis showed that the measurements were reliable, and the inferences based on these measurements were valid. Thus, this instrument can be used to identify and assess the functional vision status of students with low vision.
The Indonesian Version of the Physics Metacognition Inventory: Confirmatory Factor Analysis and Rasch Model
confirmatory factor analysis physics metacognition inventory psychometric evaluation rasch model scale adaptation...
Metacognition inventory supports increased awareness and self-control to improve student’s academic success, including physics. However, there are limitations to revealing the Physics Metacognition Inventory (PMI), especially in Indonesia. This study aims to explore and evaluate the psychometric properties of PMI. This survey research has involved 479 students from three high schools in Indonesia. The psychometric properties of the I-PMI were evaluated using a Confirmatory Factor Analysis and Rasch Model approach. The results show that the Indonesian Physics Metacognition Inventory (I-PMI) is collected in 6 constructs from 26 items. The validity, reliability, and compatibility tests have also been analyzed with good results. The five rating scales used have adequate functionality. This research has also presented more comprehensive information about the Physics Metacognition Inventory in the context of Indonesian culture. This study has implications for using I-PMI to assess students’ metacognition at the high school level in Indonesia and recommendations for future research.
The Pattern of Hybrid Learning to Maintain Learning Effectiveness at the Higher Education Level Post-COVID-19 Pandemic
covid-19 higher education hybrid learning learning effectiveness...
Online learning during the Coronavirus disease (COVID-19) pandemic has awakened and affirmed the necessity of learning based on digital technology. The article was aimed to analyze the effectiveness of online learning at bachelor’s, master’s, and doctoral degrees of Islamic Religious Education as a reference to develop a learning pattern post-COVID-19 pandemic. The research employed a mixed-method design with a concurrent triangulation model. The samples were taken using stratified random and purposive sampling. Meanwhile, the data were collected through questionnaires, in-depth interviews, and forum group discussion. A descriptive analysis and one-way analysis of variance were used to analyze the quantitative data, while interpretative descriptive for the qualitative data. The research showed that online learning during the COVID-19 pandemic at the bachelor’s, master’s, and doctoral degrees of Islamic Religious Education have been effective. In detail, online learning at the doctoral degree was the most effective among all. On the other hand, face-to-face learning is still necessary. Therefore, the learning pattern developed post-COVID-19 pandemic combines face-to-face and online learning (hybrid learning). The formulation is adjusted to the characteristics, educational purpose and orientation, level of ability, readiness, and learning autonomy of the students at each educational level.
The Development of Historical Thinking Assessment to Examine Students’ Skills in Analyzing the Causality of Historical Events
causality historical events historical thinking skills...
This research aimed to develop a historical thinking assessment for students' skills in analyzing the causality of historical events. The development process of Gall and colleagues and Rasch analysis models were used to develop an assessment instrument consisting of two processes, including the analysis of the framework of cause and consequence, the validity, reliability, and difficultness test. This research involved 150 senior high school students, with data collected using the validation sheet, tests, and scoring rubric. The results were in the form of an essay test consisting of six indicators of analyzing cause and consequence. The instruments were valid, reliable, and suitable for assessing students’ skills in analyzing the causality of historical events. The developed instruments were paired with a historical thinking skills assessment to improve the accuracy of the information about students' level of historical thinking skills in the learning history.
Validating Student’s Green Character Instrument Using Factor and Rasch Model
green character instrument factor and rasch analysis...
Many researchers have separately developed instruments to measure environmental characteristics such as attitudes, values, and knowledge. However, there is no instrument used to measure all these aspects in one comprehensive instrument. This study is meant to develop and validate a green character instrument which reveals student behavior and awareness of the environment. The instrument consists of 40 statement items consisting of 5 aspects, namely private pro-environmental behavior, public pro-environmental behavior, environmental knowledge, environmental values, and environmental attitudes. It was implemented on 1,398 students from 15 universities in Indonesia. The instrument content validation was analyzed by three experts using content validity index (CVI). The construct validity was analyzed using exploratory factor analysis, confirmatory factor analysis, and RASCH analysis. The content validity results obtained CVI scores ranging between 0.8 and 0.9 with a good category, while item reliability was in a fairly good category with a high level of separation index. Construct validation resulted in 34 items (4 items were eliminated after Exploratory and Confirmatory Factor Analysis, and 2 items were eliminated after RASCH analysis) spread over five constructs, namely environmental behavior, environmental knowledge, environmental values, environmental attitudes, and environmental habits. The resulting instrument has a good level of item difficulty, with a well understood response set which can be understood easily by respondents, and without bias. Therefore, it can be used to measure the students’ green character on both male and female.
Developing Assessment Instrument Using Polytomous Response in Mathematics
assessment instrument classical and modern theory vocational school polytomous responses...
This research is a developmental research aiming at developing a good mathematical test instrument using polytomous responses based on classical and modern theories. This research design uses the Plomp model, which consists of five stages, (1) preliminary investigation, (2) design, (3) realization/construction, (4) revision, and (5) implementation (testing). The study was conducted in three vocational schools in Lampung Province, Indonesia. The study involved 413 students, consisting of 191 male and 222 female students. The data were collected through questionnaire and test. The questionnaire was used to identify the assessment instruments currently employed by teachers and to be validated by the experts of mathematics and educational evaluation. The test used an open polytomous response test numbering of 40 items. The data were analyzed using both classical and modern theories. The results show that (1) the open polytomous response test has a good category according to classical and modern theory. However, the discrimination power of test items in classical theory needs several revisions, (2) the assessment instrument using the polytomous response of open multiple choice can guarantee information on the actual competence of students. This is proven by the fact that there is a harmony between the analysis result obtained from classical and modern theory from the students' arguments when giving reasons for their choices. Therefore, the open polytomous response test can be used as an alternative to learning assessment.
The Effectiveness of Multimedia Learning for Distance Education Toward Early Childhood Critical Thinking During the COVID-19 Pandemic
critical thinking distance education early childhood multimedia learning...
The government has imposed social restrictions during the COVID-19 pandemic, affecting the education sector, including the early childhood school. Distance education offers different methods from the conventional methods, as the students are expected to gain the same skills, including critical thinking skills. Therefore, teachers must provide distance learning innovations using relevant learning media, such as multimedia-based learning. This research aims to assess the efficacy of multimedia learning in early childhood distance learning. This research is a quantitative model with a quasi-experimental pretest and posttest design. The data collection technique utilized questionnaires given to 30 samples of early childhood children. The data were statistically analyzed using SPSS software. The results confirmed that multimedia-based learning for distance learning could develop critical thinking skills in early childhood children during the COVID-19 pandemic. The results of this study offer exploration of learning strategies to improve children’s critical thinking.
Measurement of Students' Chemistry Practicum Skills Using Many Facets Rash Model
chemistry practicum mfrm performance assessment process assessment product assessment...
The accuracy of assessing the capabilities of the process and product in chemical practice activities requires appropriate measurement procedures to be followed. It is crucial to identify the components that can introduce bias while measuring student abilities during the measurement process. This study aims to identify the components or criteria used by teachers to assess student performance in practicum activities and analyze the quality of the rubrics developed. The study was conducted with the participation of three raters, 27 high school students, and nine assessment criteria. A quantitative descriptive approach was employed using the many-facet Rasch model (MFRM) analysis for measurement. The results of the MFRM analysis show no significant measurement bias, with data measurement facets fitting the MFRM model. The reliability of all the facets meets the criteria, and the scale predictor functions appropriately. While all students can easily pass four out of nine items, five items can only be partially passed by students. The assessment criteria that require special attention include communication skills, tools and assembly, interpretation, cleanliness, and accuracy when performing practicums. These criteria provide feedback for teachers and students to ensure successful practicum activities. The Discussion section of this study delves into the findings and their implications.
Strengthening Pedagogical Content Knowledge in Designing Laboratory Activity Based on Small-Scale Chemistry Practicum Approach
laboratory activity pedagogical content knowledge small-scale chemistry...
The purpose of this research is to strengthen pedagogical content knowledge (PCK) in designing laboratory activities based on small-scale chemistry approaches. This research is action research involving 60 trainee teachers with stages that include (a) Reflect; (b) Plan; (c) Act; (d) Observe; (e) Reflect (2nd); (f) Plan (2nd). Qualitative data were collected through (a) Questionnaires reflecting on experiences in practicing chemistry learning and responses to the importance of learning, (b) a Portfolio of chemistry practicum design, (c) documentation of the process of carrying out design, implementation, and practicum evaluation activities, (d) field notes, (e) reflection sheet, and (f) Portfolio of follow-up plans. The data is displayed through the R computation system with data pre-processing stages in the teacher's reflection text which includes basic cleaning, case folding, normalization, stemming, and deleting meaningless words. Display data in the form of word clouds, frequency expression diagrams, and tabulations. Descriptive narratives are used to analyze the documentation obtained in the action process. The teacher group demonstrated performance in implementing small-scale practicum activities. Teachers are increasingly skilled in modifying conventional laboratory equipment, minimizing the amount of chemical use, minimizing waste disposal, and increasing efficiency in the duration of practicum implementation. The follow-up plan for this activity includes quality improvement in aspects of (a) skill in using laboratory equipment, (b) understanding of chemical concepts, (c) equipment availability, materials, and work procedures, and (d) implementation of chemistry practicum.