'item parameter' Search Results
A Comparison of Score Equating Conducted Using Haebara and Stocking Lord Method for Polytomous
equating polytomous graded data...
The purposes of this research are: 1) to compare two equalizing tests conducted with Hebara and Stocking Lord method; 2) to describe the characteristics of each equalizing test method using windows’ IRTEQ program. This research employs a participatory approach as the data are collected through questionnaires based on the National Examination Administration of 2018. The samples are classified into group A and group B respectively by 449 and 502 respondents. This paper discusses how to equalize shared items using the anchor method with a set of instruments in the forms of 35 questionnaire items and 6 shared items. In addition, the researcher also uses PARSCALE to estimate each respondent’s skills and each item’s characteristics. The shared items are eventually equalized using IRTEQ program. The results show that there is a significant difference between those conducted using Haebara method (0.592) which produces bigger mean-sigma value and Stocking & Lord (0.00213). Thus, the results show that the shared testing items may improve respondents’ discrimination and increase the difficulty level (parameter b). Due to the availability of shared items, it is good and appropriate to equalize two different tests on different theta skills.
Implementation of the Omega (ω) Index to Detect Large-Scale Systematic Cheating
answer-copying indices item response theory pirls cheating detection standardized testing test integrity...
Cheating detection is an important issue in standardized testing, especially in large-scale settings. Statistical approaches are often computationally intensive and require specialised software to conduct. We present a two-stage approach that quickly filters suspected groups using statistical testing on an IRT-based answer-copying index. We also present an approach to mitigate data contamination and improve the performance of the index. The computation of the index was implemented through a modified version of an open source R package, thus enabling wider access to the method. Using data from PIRLS 2011 (N=64,232) we conduct a simulation to demonstrate our approach. Type I error was well-controlled and no control group was falsely flagged for cheating, while 16 (combined n=12,569) of the 18 (combined n=14,149) simulated groups were detected. Implications for system-level cheating detection and further improvements of the approach were discussed.
The Development of Computerized Economics Item Banking for Classroom and School-Based Assessment
item banking cbt assessment economics...
The advancement of information and technology resulted in the change in conventional test methods. The weaknesses of the paper-based test can be minimized using the computer-based test (CBT). The development of a CBT desperately needs a computerized item bank. This study aimed to develop a computerized item bank for classroom and school-based assessments. A research and development method is used in this study, which consisted of four phases, i.e., planning, item development, system development, and field testing. Data is collected through documentation, expert judgment, and field testing. The data were analyzed using descriptive statistics and item response theory. The sample of this study was teachers and high school students in West Sumatera province selected using purposive random sampling techniques. The results of the study are as follows. 1) The computerized item bank has excellent quality based on expert validation. 2) There are 120 items inputted into the item bank system that has a moderate difficulty and good discriminant index based on item response theory. 3) The field testing indicated the computerized economics item banking has high effectiveness of usability, usefulness for the teachers, and feasible for classroom and school-based assessment.
Implementation of Four-Tier Multiple-Choice Instruments Based on the Partial Credit Model in Evaluating Students’ Learning Progress
learning progress four-tier change of state of matter partial-credit model...
One of the issues that hinder the students’ learning progress is the inability to construct an epistemological explanation of a scientific phenomenon. Four-tier multiple-choice (hereinafter, 4TMC) instrument and Partial-Credit Model were employed to elaborate on the diagnosis process of the aforementioned problem. This study was to develop and implement the four-tier multiple-choice instrument with Partial-Credit Model to evaluate students’ learning progress in explaining the conceptual change of state of matter. This research applied a development research referring to the test development model by Wilson. The data were obtained through development and validation techniques on 20 4TMC items tested to 427 students. On each item, the study applied diagnostic-summative assessment and certainty response index. The students’ conceptual understanding level was categorized based on the combination of their answer choices; the measurement generated Partial-Credit Model for 1 parameter logistic (IPL) data. Analysis of differences was based on the student level class using Analysis of Variants (One-way ANOVA). This study resulted in 20 valid and reliable 4TMC instruments. The result revealed that the integration of 4TMC test and Partial-Credit Model was effective to be treated as the instrument to measure students’ learning progress. One-way ANOVA test indicated the differences among the students’ competence based on the academic level. On top of that, it was discovered that low-ability students showed slow progress due to the lack of knowledge as well as a misconception in explaining the Concept of Change of State of Matter. All in all, the research regarded that the diagnostic information was necessary for teachers in prospective development of learning strategies and evaluation of science learning.
Psychological Well-Being of School Counsellors Model
self-compassion counseling self-efficacy emotional intelligence spiritual intelligence psychological well-being school counselors...
The school counselor’s role is increasingly challenging with various demands of students’ problems and the issue of Coronavirus disease (COVID-19) pandemic also affect students’ psychosocial and mental well-being. Therefore, school counselors need to equip themselves with high psychological well-being as a self-care factor to deal with burnout, instability, and work stress. This study aims to develop Psychological Well-Being Model among school counsellors. A total of 330 secondary school counsellors from four districts in Selangor were selected as the respondents using the group random sampling method. Data were collected through translated questionnaire instruments, namely Self Compassion Scale, Counselling Self Estimate Inventory, The Assessing Emotions Scale, Spiritual Involvement and Beliefs Scale Revised, and Psychological Well Being-Ryff. Confirmation Factor Analysis (CFA) and Structural Equation Modeling (SEM) show that there is a significant positive relationship between self-compassion, counselling self-efficacy, emotional intelligence, spiritual intelligence, and the school counsellor’s psychological well-being. The findings also showed that self-compassion, counselling self-efficacy, emotional and spiritual intelligence affected 76.5% (R2 = 0.765) of variance in psychological well-being. This study is one of the earliest in presenting the school counsellor’s psychological well-being model who can contribute to Malaysian education. The implications of this study suggest that the elements of self-compassion, counselling self-efficacy, emotional and spiritual intelligence, and psychological well-being should be applied in the curriculum at the counsellor training level in university so that counsellors have adequate preparation in providing effective services in schools. The Ministry of Education Malaysia, on the other hand, needs to cultivate psychological well-being interventions regularly so that counsellors can always manage various students’ issues in schools as well as maintaining psychological well-being in terms of personnel and professionals.
Study Item Parameters of Classical and Modern Theory of Differential Aptitude Test: Is it Comparable?
classical test theory differential aptitude test item parameter modern test theory...
This study aimed to find the Classical Test Theory (CTT) and Modern Test Theory (MTT) item parameters of the Differential Aptitude Test (DAT) and examined their comparability of them. The item parameters being studied are difficulty level and discrimination index. 5.024 data of the result sub-test DAT were documented by the Department of Psychology and Guidance and Counselling bureau. The parameter of classical and modern test items was estimated and correlated by examining the comparability between parameters. The results show that there is a significant correlation between item parameter estimates. The Rasch and IRT 1-PL models have the highest correlation toward CTT regarding the item difficulty level. In contrast, model 2-PL has the highest correlation toward CTT in the item discrimination index. Overall, the study concluded that CTT and MTT were comparable in estimating item parameters of DAT and thus could be used independently or complementary in developing DAT.
Course Dropout Intention Scale: Development and Validation of a New Brief Measure in Academic College Context
brief measure college student course dropout dropout intention dropout studies...
University students may encounter situations where they perform poorly in a course and contemplate dropping out. This intention to drop out of a course manifests not only in thoughts or ideas but also in a cognitive self-evaluation of their performance and skills, enabling them to reflect on the possibility of dropping out. In this sense, there is a shortage of instruments that evaluate the intention to drop out of a course, so the aim was to develop and validate the Course Dropout Intention Scale (CDIS). Data from two samples (N1 = 198; N2 = 675) were used; the first was for the EFA, and the second was for the CFA, GRM, and SEM. The one-factor model was derived from the EFA and confirmed in the second sample, exhibiting appropriate goodness-of-fit indices. Similarly, the GRM obtained adequate fit indices; all items discriminated adequately, and the difficulty parameter had a monotonic increase. The SEM model of the effect of satisfaction with studies on the CDIS showed a negative and statistically significant effect. Thus, it was demonstrated that the CDIS is a robust instrument in its psychometric properties and empirical evidence with other variables.