' partial-credit model.' Search Results
The Effect of Project Based Learning on the Statistical Literacy Levels of Student 8th Grade
statistical literacy project based learning statistics education middle school students rasch measurement...
This study examines the effect of project based learning on 8th grade students’ statistical literacy levels. A performance test was developed for this aim. Quasi-experimental research model was used in this article. In this context, the statistics were taught with traditional method in the control group and it was taught using project based learning in the intervention group. Statistics was given for four weeks according to pro ject based learning at intervention group. The performance test was applied to total 70 students as pre and post-test. Participants are from two different classes of a middle school in Trabzon. The data were analysed using Rasch measurement techniques. This measurement allowed both students’ performance and item difficulties to be measured using the same metric and placed on the same scale. All raw scores converted linear score in order to obtain equal interval scale. Acquired linear scores were compared. In the analysis of gained datum covariance analysis are used. According to gained results in pre-processing application there isn’t substantial difference between the achievements of intervention group and control group; but after processing between the achievements of intervention group and control group there is a substantial difference statistically in favor of intervention group. The results of the study revealed that the project based learning increased students’ statistical literacy levels in the intervention group.
10
Measuring Teaching Best Practice in the Induction Years: Development and Validation of an Item-Level Assessment
teacher induction development assessment rasch modeling teaching internship teacher attrition...
Schools and teacher induction programs around the world routinely assess teaching best practice to inform accreditation, tenure/promotion, and professional development decisions. Routine assessment is also necessary to ensure that teachers entering the profession get the assistance they need to develop and succeed. We introduce the Item-Level Assessment of Teaching practice (I-LAST) as a flexible framework-based approach for quantitative evaluation of teaching best practice in the induction stages. We based the I-LAST on a novel framework for teaching best practice, and used Fuller’s scale as a framework for understanding the potential of the I-LAST in providing longitudinal measures for growth. Using the context of a year-long teacher induction program in the Midwestern United States, we collected data through an online survey from 46 teaching supervisors who were asked to evaluate their interns. We used the Rasch partial credit model as a criterion for construct validity, and measured dimensionality and reliability from both Rasch and classical frameworks. The I-LAST was found to be a unidimensional, valid, and reliable measure for teaching best practice. It demonstrated the ability to provide reliable scores for specific sub-dimensions of best practice, including those which manifest at various stages along Fuller’s scale. Potential uses of the I-LAST to advance understanding of the role of teacher induction programs in fostering productive growth in new teachers is discussed.
5
Investigation of the 5th Grade Students’ Engagements in Mathematics Course towards Student Opinions
maths secondary school cognitive engagement social engagement emotional engagement...
The research was conducted to determine the opinions of students (10-11 years) on their engagement to mathematics course. These students are 5th grade students at a secondary school in Turkey. Qualitative research method was used in the research. At the study, designed as case study, a total of seven secondary school students were participated the research. The study group was constituted with “snowball sampling” technique of purposeful sampling methods. The data was collected by a semi-structured interview form. Sixteen-page interviews obtained from the interviews were transferred to the computer. Data analysis was performed in content analysis. Codes were listed as a result of analysis. Common themes were constituted from the codes. As a result of the research, three themes, (cognitive, social and emotional engagement) eleven sub-themes and eighty nine codes were determined. It was seen that the students’ most preferred superficial strategies in terms of cognitive engagement; negative opinions towards group work in terms of social engagement; value given to math course in terms of emotional engagement. Students preferred least getting support sub-theme in terms of cognitive engagement; competitive sub-theme in terms of social engagement; value to the mathematics teacher sub-theme in terms of emotional engagement.
Developing of Computerized Adaptive Testing to Measure Physics Higher Order Thinking Skills of Senior High School Students and its Feasibility of Use
computerized adaptive testing hots partial credit model item response theory...
The Computer has occupied a comprehensive coverage, especially in education scopes, including in learning-teaching processes, testing, and evaluating. This research aimed to develop computerized adaptive testing (CAT) to measure physics higher-order thinking skills (HOTS), namely PhysTHOTS-CAT. The Research Development used the 4-D developmental model carrying the four phases of define, design, development, and dissemination (4D) developed by Thiagarajan. This testing instrument can give the item test based on the student’s abilities. The research phases include (1) needs analysis and definition, (2) development design (3) development of CAT and assemble the test items into CAT, (4) validation by experts, and (5) feasibility try-out. The findings show that PhysTHOTS-CAT is valid to measure physics HOTS of the 10th-grade students of Senior High School according to 82.28% of teachers and students assessment on PhysTHOTS-CAT content and media. Therefore, it can conclude that PhysTHOTS-CAT can be used and feasible to measure physics HOTS of the 10th-grade students of the Senior High School.
Value Creation of Big Data Utilization: The Next Frontier for Productive Scholarship among Filipino Academics
research productivity big data rasch model productive scholarship academic productivity...
Research productivity plays an important role in the prestige and reputation among higher education institutions. However, the time spent to do research among Filipino academics is the most pressing issue since they can barely meet the requirement for research productivity. Further, the lack of time for data gathering aggravated the drawbacks for research productivity. Data gathering is at the core of almost all research activity, the absence of factual and reliable data will lead to an invalid and illogical inference. In research years, there has been a massive agglomeration of data in large volumes coming from diverse sources pertaining to almost all facets of human activity which is worthy of investigation- known today as Big Data. This research has two (2) main objectives; the first is to find out the underlying reasons why Filipino academics are not enthusiastic to do research. The second is to evaluate the value of big data utilization for research productivity based on the assessment of the faculty members. This research used the Rasch model to measure the responses of Filipino academics with regards to their reasons for not doing enough research work as well as on their assessment for value creation of big data utilization using a polytomous item response selection scale.
Implementation of Four-Tier Multiple-Choice Instruments Based on the Partial Credit Model in Evaluating Students’ Learning Progress
learning progress four-tier change of state of matter partial-credit model...
One of the issues that hinder the students’ learning progress is the inability to construct an epistemological explanation of a scientific phenomenon. Four-tier multiple-choice (hereinafter, 4TMC) instrument and Partial-Credit Model were employed to elaborate on the diagnosis process of the aforementioned problem. This study was to develop and implement the four-tier multiple-choice instrument with Partial-Credit Model to evaluate students’ learning progress in explaining the conceptual change of state of matter. This research applied a development research referring to the test development model by Wilson. The data were obtained through development and validation techniques on 20 4TMC items tested to 427 students. On each item, the study applied diagnostic-summative assessment and certainty response index. The students’ conceptual understanding level was categorized based on the combination of their answer choices; the measurement generated Partial-Credit Model for 1 parameter logistic (IPL) data. Analysis of differences was based on the student level class using Analysis of Variants (One-way ANOVA). This study resulted in 20 valid and reliable 4TMC instruments. The result revealed that the integration of 4TMC test and Partial-Credit Model was effective to be treated as the instrument to measure students’ learning progress. One-way ANOVA test indicated the differences among the students’ competence based on the academic level. On top of that, it was discovered that low-ability students showed slow progress due to the lack of knowledge as well as a misconception in explaining the Concept of Change of State of Matter. All in all, the research regarded that the diagnostic information was necessary for teachers in prospective development of learning strategies and evaluation of science learning.
Developing Assessment Instrument Using Polytomous Response in Mathematics
assessment instrument classical and modern theory vocational school polytomous responses...
This research is a developmental research aiming at developing a good mathematical test instrument using polytomous responses based on classical and modern theories. This research design uses the Plomp model, which consists of five stages, (1) preliminary investigation, (2) design, (3) realization/construction, (4) revision, and (5) implementation (testing). The study was conducted in three vocational schools in Lampung Province, Indonesia. The study involved 413 students, consisting of 191 male and 222 female students. The data were collected through questionnaire and test. The questionnaire was used to identify the assessment instruments currently employed by teachers and to be validated by the experts of mathematics and educational evaluation. The test used an open polytomous response test numbering of 40 items. The data were analyzed using both classical and modern theories. The results show that (1) the open polytomous response test has a good category according to classical and modern theory. However, the discrimination power of test items in classical theory needs several revisions, (2) the assessment instrument using the polytomous response of open multiple choice can guarantee information on the actual competence of students. This is proven by the fact that there is a harmony between the analysis result obtained from classical and modern theory from the students' arguments when giving reasons for their choices. Therefore, the open polytomous response test can be used as an alternative to learning assessment.
The Phenomenology of Indonesian Coastal Students: Are They Ready for Online Blended Learning?
pandemic indonesian coastal students online learning online blended learning phenomenology...
The pandemic case has shifted away from face-to-face teaching to online blended learning. This phenomenon certainly causes various problems in the world of education. The online blended learning is good when applied with good internet connections and complete facilities. However, it differs from Indonesian coastal students who do not have supporting facilities. Therefore, this research aims to analyze the experience and readiness of Indonesian coastal students. It determines the facilities of the process using qualitative research with a phenomenological approach. Purposive sampling was used to collect data from 25 students living in coastal areas in Aceh, Indonesia. Furthermore, in-depth interviews were used to obtain instruments and techniques for data collection, observations, field notes, and audio-visuals. Data analysis was carried out qualitatively by reducing, displaying, drawing conclusions, and verifying data. The data processing was conducted using NVivo 12 plus software. The kappa coefficient is used to check the accuracy of the data since there was no bias during coding. The analysis results show that Indonesian coastal students are not ready to conduct the online blended learning process. Furthermore, it is recommended that future research focus on coastal students’ development. A Hypothetical Learning Trajectory design should be created to assist in independent learning and lessen their readiness.
The Development of a Four-Tier Diagnostic Test Based on Modern Test Theory in Physics Education
developing test four-tiers diagnostic test modern test theory...
Diagnostic tests are generally two or three-tier and based on classical test theory. In this research, the Four-Tier Diagnostic Test (FTDT) was developed based on modern test theory to determine understanding of physics levels: scientific conception (SC), lack of knowledge (LK), misconception (MSC), false negatives (FN), and false positives (FP). The goals of the FTDT are to (a) find FTDT constructs, (b) test the quality of the FTDT, and (c) describe students' conceptual understanding of physics. The development process was conducted in the planning, testing, and measurement phases. The FTDT consists of four-layer multiple-choice with 100 items tested on 700 high school students in Yogyakarta. According to the partial credit models (PCM), the student's responses are in the form of eight categories of polytomous data. The results of the study show that (a) FTDT is built on the aspects of translation, interpretation, extrapolation, and explanation, with each aspect consisting of 25 items with five anchor items; (b) FTDT is valid with an Aiken's V value in the range of 0.85-0.94, and the items fit PCM with Infit Mean Square (INFIT MNSQ) of 0.77-1.30, item difficulty index of 0.12-0.38, and the reliability coefficient of Cronbach's alpha FTDT is 0.9; (c) the percentage of conceptual understanding of physics from large to small is LK type 2 (LK2), FP, LK type 1 (LK1), FN, LK type 3 (LK3), SC, LK type 4 (LK4), and MSC. The percentage sequence of MSC based on the successive material is momentum, Newton's law, particle dynamics, harmonic motion, work, and energy. In addition, failure to understand the concept sequentially is due to Newton's law, particle dynamics, work and energy, momentum, and harmonic motion.
Measurement of Students' Chemistry Practicum Skills Using Many Facets Rash Model
chemistry practicum mfrm performance assessment process assessment product assessment...
The accuracy of assessing the capabilities of the process and product in chemical practice activities requires appropriate measurement procedures to be followed. It is crucial to identify the components that can introduce bias while measuring student abilities during the measurement process. This study aims to identify the components or criteria used by teachers to assess student performance in practicum activities and analyze the quality of the rubrics developed. The study was conducted with the participation of three raters, 27 high school students, and nine assessment criteria. A quantitative descriptive approach was employed using the many-facet Rasch model (MFRM) analysis for measurement. The results of the MFRM analysis show no significant measurement bias, with data measurement facets fitting the MFRM model. The reliability of all the facets meets the criteria, and the scale predictor functions appropriately. While all students can easily pass four out of nine items, five items can only be partially passed by students. The assessment criteria that require special attention include communication skills, tools and assembly, interpretation, cleanliness, and accuracy when performing practicums. These criteria provide feedback for teachers and students to ensure successful practicum activities. The Discussion section of this study delves into the findings and their implications.