One of the issues that hinder the students’ learning progress is the inability to construct an epistemological explanation of a scientific phenomenon. Four-tier multiple-choice (hereinafter, 4TMC) instrument and Partial-Credit Model were employed to elaborate on the diagnosis process of the aforementioned problem. This study was to develop and implement the four-tier multiple-choice instrument with Partial-Credit Model to evaluate students’ learning progress in explaining the conceptual change of state of matter. This research applied a development research referring to the test development model by Wilson. The data were obtained through development and validation techniques on 20 4TMC items tested to 427 students. On each item, the study applied diagnostic-summative assessment and certainty response index. The students’ conceptual understanding level was categorized based on the combination of their answer choices; the measurement generated Partial-Credit Model for 1 parameter logistic (IPL) data. Analysis of differences was based on the student level class using Analysis of Variants (One-way ANOVA). This study resulted in 20 valid and reliable 4TMC instruments. The result revealed that the integration of 4TMC test and Partial-Credit Model was effective to be treated as the instrument to measure students’ learning progress. One-way ANOVA test indicated the differences among the students’ competence based on the academic level. On top of that, it was discovered that low-ability students showed slow progress due to the lack of knowledge as well as a misconception in explaining the Concept of Change of State of Matter. All in all, the research regarded that the diagnostic information was necessary for teachers in prospective development of learning strategies and evaluation of science learning.

The current study investigated Student-Teacher Relationship Measure (STRM) psychometric properties using Rasch analysis in a sample of middle school female students (N = 995). Rasch Principal Components Analysis revealed psychometric support of two subscales (i.e., Academic and Social Relations). Summary statistics showed good psychometric properties. The category structure and individual statistics (i.e., items and person infit and outfit) were not ideal. Category structure showed that the distances between adjacent thresholds were lower than optimal criteria. Even though findings indicated that items mean square statistics (MNSQ) were optimal, standardized fit statistics (i.e., ZSTD) reflected many misfit persons and items in each subscale. After eliminating the misfit persons and items, the two subscales met the Rasch optimal criteria. The updated short 22-item scale had good psychometric properties, high item and person separation, and good item and person reliability for the two subscales and can be used as a reliable and valid scale.

Student satisfaction with education service has been considered one of the most critical strategic factors to attract students of higher education institutions around the world. Various models of satisfaction with education service quality have been developed to motivate actions towards improving the education quality. This study aimed to confirm a Vietnamese theoretical five-dimension model of student satisfaction with higher education service and investigate the relationship between student satisfaction with education service quality and student satisfaction with educational outcomes in this model. A cross-sectional survey on 2933 students from four-member universities of Hue University in Central Vietnam was conducted. The research results showed that the model of student satisfaction with education service in Hue University was consistent with the proposed theoretical model, which comprises five dimensions including access to education service, facilities and teaching equipment, educational environment, educational activities, and educational outcomes. In addition, the satisfaction of all dimensions of education service quality from dimension 1 to 4 affects the satisfaction of educational outcomes, of which educational activities have the most significant impact. This research result can provide a number of implications and recommendations for Hue University to implement appropriate measures to improve student satisfaction with education services received, thereby enhancing educational outcomes, attracting and retaining students.

Teachers who can adapt and be ready for all changes will also be able to provide a balance to increase the competence of vocational high school students. This is also not denied when teachers become assessors in student competency tests. The objectives of this study were to produce an instrument for the readiness of teachers as assessors; to knowing good grain reliability; to know the characteristics of the instrument; and to know the difficulty level of the item. The method used in this research is instrument development. Respondents were vocational school teachers who were candidates for competency test assessors. Data collection techniques using a questionnaire. Analysis of construct validity using Confirmatory Factor Analysis. Reliability using Cronbach’s alpha. Test the instrument items using the Rasch model. The results are the readiness instruments of the vocational teacher as an assessor has 19 indicators that have been grouped into 5 factors with consistency values being in the same construct (proven construct validity). The result of the calculation of the reliability of this instrument is 0.852, which means that the reliability coefficient is high; There are two items, namely numbers 24 and 18 which indicate the absence of a fit item in the overall item fit criteria; At the item difficulty level, items 8 and 6 have a difficulty score of more than 2, while this indicates that items 8 and 6 have a high difficulty level.

This study explored the cognitive mechanism behind information integration in the test anxiety judgments in 140 engineering students. An experiment was designed to test four factors combined (test goal orientation, test cognitive functioning level, test difficulty and test mode). The experimental task required participants to read 36 scenarios, one at a time and then estimate how much test anxiety they would experience in the evaluation situation described in each scenario. The results indicate three response styles (low, moderate, and high-test anxiety) among the participants. The orientation and difficulty of each given exam scenario were the most critical factors dictating test anxiety judgments. Only the moderate test anxiety group considered the test mode to be a third relevant factor. The integration mechanism for Cluster 1 was multiplicative, while for Clusters 2 and 3, it was summative. Furthermore, these last two clusters differed in terms of the valuation of the factors. These results suggest that programs that help students to cope with test anxiety need to take into account the valuation and integration mechanism that students use to integrate different information in specific examination contexts, since the way students assess their internal and external circumstances can influence how they deal with evaluative situations.

Assessment is a topic that continues to be developed in science education research. Assessment evaluates not only students' cognitive abilities but also their thinking skills. Therefore, in this study, an assessment that could measure students' chemical literacy was developed. Chemical literacy is a thinking skill that students must develop as part of their chemistry learning. The goal of this study was to assess item' quality, as well as student’ chemical literacy on the concept of chemical rate. The Rasch model was employed to analyze the data in this study. The results of this study depict that the developed assessment had sufficient reliability and validity to be used to assess students' chemical literacy. Furthermore, the analysis of the students’ responses to the items revealed that many students did not understand or were unaware of the context presented. These findings suggest that students' chemical literacy in the material for the reaction rate is still lacking and needs to be improved. As a result, the teacher's role in assisting students in improving their chemical literacy through chemistry learning is critical.

This study was conducted to corroborate in understanding the teachers’ beliefs about assessment practices. The prior studies related to teachers’ assessment beliefs in mathematics have been done to assess teachers’ beliefs in the general context of mathematics teaching. This study developed an instrument to assess teachers’ assessment beliefs of mathematical thinking. The research aimed to develop and validate a scale of assessment beliefs of mathematical thinking by using the confirmatory factor analysis. The first draft of the scale contained 25 items. The sample of the study consisted of 537 mathematics teachers from public schools in Oman. The instrument was a questionnaire with a 5-point Likert scale. The scale was validated by asking a number of experts in mathematics educational measurement and evaluation. Exploratory and confirmatory factor analysis was applied to test the model of assessment beliefs of mathematical thinking scale using AMOS 25.0. All constructs had acceptable reliability. The model had a good model fit for the assessment beliefs of mathematical thinking scale which obtainable from the fit indices tests. The findings revealed that all fit criteria indices were realized. The results also showed acceptable validity and construct reliability for the scale.

This research aimed to develop a historical thinking assessment for students' skills in analyzing the causality of historical events. The development process of Gall and colleagues and Rasch analysis models were used to develop an assessment instrument consisting of two processes, including the analysis of the framework of cause and consequence, the validity, reliability, and difficultness test. This research involved 150 senior high school students, with data collected using the validation sheet, tests, and scoring rubric. The results were in the form of an essay test consisting of six indicators of analyzing cause and consequence. The instruments were valid, reliable, and suitable for assessing students’ skills in analyzing the causality of historical events. The developed instruments were paired with a historical thinking skills assessment to improve the accuracy of the information about students' level of historical thinking skills in the learning history.

The school counselor’s role is increasingly challenging with various demands of students’ problems and the issue of Coronavirus disease (COVID-19) pandemic also affect students’ psychosocial and mental well-being. Therefore, school counselors need to equip themselves with high psychological well-being as a self-care factor to deal with burnout, instability, and work stress. This study aims to develop Psychological Well-Being Model among school counsellors. A total of 330 secondary school counsellors from four districts in Selangor were selected as the respondents using the group random sampling method. Data were collected through translated questionnaire instruments, namely Self Compassion Scale, Counselling Self Estimate Inventory, The Assessing Emotions Scale, Spiritual Involvement and Beliefs Scale Revised, and Psychological Well Being-Ryff. Confirmation Factor Analysis (CFA) and Structural Equation Modeling (SEM) show that there is a significant positive relationship between self-compassion, counselling self-efficacy, emotional intelligence, spiritual intelligence, and the school counsellor’s psychological well-being. The findings also showed that self-compassion, counselling self-efficacy, emotional and spiritual intelligence affected 76.5% (R2 = 0.765) of variance in psychological well-being. This study is one of the earliest in presenting the school counsellor’s psychological well-being model who can contribute to Malaysian education. The implications of this study suggest that the elements of self-compassion, counselling self-efficacy, emotional and spiritual intelligence, and psychological well-being should be applied in the curriculum at the counsellor training level in university so that counsellors have adequate preparation in providing effective services in schools. The Ministry of Education Malaysia, on the other hand, needs to cultivate psychological well-being interventions regularly so that counsellors can always manage various students’ issues in schools as well as maintaining psychological well-being in terms of personnel and professionals.

Computational thinking (CT) is a method for solving complex problems, but also gives people an inventive inspiration to adapt to our smart and changing society. Globally it has been considered as vital abilities for solving genuine issues successfully and efficiently in the 21st century. Recent studies have revealed that the nurture of CT mainly centered on measuring the technical skill. There is a lack of conceptualization and instruments that cogitate on CT disposition and attitudes. This study attends to these limitations by developing an instrument to measure CT concerning dispositions and attitudes. The instruments' validity and reliability testing were performed with the participation from secondary school students in Malaysia. The internal consistency reliability, standardized residual variance, construct validity and composite reliability were examined. The result revealed that the instrument validity was confirmed after removing items. The reliability and validity of the instrument have been verified. The findings established that all constructs are useful for assessing the disposition of computer science students. The implications for psychometric assessment were evident in terms of giving empirical evidence to corroborate theory-based constructs and also validating items' quality to appropriately represent the measurement.

Research on instructional quality has been of great interest for several decades, leading to an immense and diverse body of literature. However, due to different definitions and operationalisations, the picture of what characteristics are important for instructional quality is not entirely clear. Therefore, in this paper, a scoping review was performed to provide an overview of existing evidence of both generic and subject-didactic characteristics with regard to student performance. More precisely, this paper aims to (a) identify both generic and subject-didactic characteristics affecting student performance in mathematics in secondary school, (b) cluster these characteristics into categories to show areas for quality teaching, and (c) analyse and assess the effects of these characteristics on student performance to rate the scientific evidence in the context of the articles considered. The results reveal that teaching characteristics, and not just the instruments for recording the quality of teaching as described in previous research, can be placed on a continuum ranging from generic to subject-didactic. Moreover, on account of the inconsistent definition of subject-didactic characteristics, the category of ‘subject-didactic specifics’ needs further development to establish it as a separate category in empirical research. Finally, this study represents a further step toward understanding the effects of teaching characteristics on student performance by providing an overview of teaching characteristics and their effects and evidence.

The present research aimed to test an Amharic version of the multi-dimensional Work Task Motivation Scale for Teachers (WTMST), which measures the five pillars of university instructors’ motivation toward teaching and student evaluation tasks based on self-determination theory (SDT). Therefore, the WTMST offers the first instrument to measure all five motivational elements, and today it is one of the most applicable instruments to assess teachers’ motivation. An Amharic version of the WTMST for teaching and student evaluation tasks was adopted and assessed in large-scale data (N=1,117). Our findings demonstrate excellent reliability and construct validity (convergent, discriminant, divergent and factorial). Besides, the results of the model comparisons provided that out of the four theoretically competing models (single-order factor, correlated factor, higher-order factor and bi-factor models), the bi-factor model was the most-fitted one used for measurement invariance across various groups. Results also suggest that the factor structure of the WTMST for both teaching and student evaluation tasks demonstrate consistency across gender (men, women), university types (research, applied, and general university), age and experience in teaching. Therefore, the WTMST for teaching and student evaluation tasks may be valid in Ethiopian higher education settings.

The longitudinal changes of the average grades in four study semesters before and during the COVID-19 pandemic and distance learning are presented in the current study. 11th grade students’ (n=586; age M=17.38, SD=0.53) average grades were assessed, as well as their verbal and non-verbal reasoning abilities, and self-evaluations of problem-solving and self-management skills. The main findings of the study are: 1) There is a general pattern for the grades to increase during the four semesters from the autumn 2019 to the spring 2021; 2) The general tendency of changes in the grades is similar to various students’ groups based on their level of skills; 3) Higher level of students’ skills and cognitive abilities determined that students’ grades were higher and were more likely to increase during the “second wave of the pandemic”, compared to the middle and low-level skill groups. Results of the current study show a tendency for the average grades to increase during the pandemic and distance learning, however, there are group differences in the findings, relating the grade level to the individual level of students’ skills and abilities.

The pandemic era has caused changes in the learning system. The situation demanded online learning and triggered students to have learning difficulties. The research aims to examine the impact of social media, social environment, and student learning potential on student learning difficulties. This study utilizes a quantitative approach. The respondents were university students experiencing online learning in West Java, Indonesia. A questionnaire validated by four experts was distributed to 539 of them. Accommodating structural equation modeling (SEM) by evaluating the measurement and structural models was used in data analysis. This study revealed that the instrument had good construct validity and reliability. A good instrument will produce a good measurement process so that the instrument can get the data needed. Hypothesis testing shows that high media activity can inhibit students from learning. However, social media activity directly influences learning difficulties. Meanwhile, the variables of learning potential and social environment positively influence student learning difficulties directly or indirectly. There are a few things to note on learning potential, social environment, and social media to delve into their influences on students' learning difficulties.

The skill to solve mathematical problems facilitates students to develop their basic skills to solve problems in daily life. This study analyzes students' problem-solving process with a reflective cognitive style in constructing probability problems using action, process, object, and schema theory (APOS). The explanatory method was used in this qualitative study. The participants were mathematics students at the Department of Mathematics, Universitas Negeri Semarang. The researchers collected the data with the cognitive style test using the Matching Familiar Figure Test (MFFT), used a valid problem-solving skill test, and the interview questions. The data analysis techniques used were processing and preparing the data for analysis, extensive reading of the data, coding all data, applying the coding process, describing the data, and interpreting the data. The results showed that (1) the problem-solving process of students with symbolic representation was characterized by the use of mathematical symbols to support the problem-solving process in the problem representation phase; (2) the problem-solving process of students with symbolic-visual representation was characterized by the use of symbols, notations, numbers, and visual representation in the form of diagrams in the problem representation phase.

Diagnostic tests are generally two or three-tier and based on classical test theory. In this research, the Four-Tier Diagnostic Test (FTDT) was developed based on modern test theory to determine understanding of physics levels: scientific conception (SC), lack of knowledge (LK), misconception (MSC), false negatives (FN), and false positives (FP). The goals of the FTDT are to (a) find FTDT constructs, (b) test the quality of the FTDT, and (c) describe students' conceptual understanding of physics. The development process was conducted in the planning, testing, and measurement phases. The FTDT consists of four-layer multiple-choice with 100 items tested on 700 high school students in Yogyakarta. According to the partial credit models (PCM), the student's responses are in the form of eight categories of polytomous data. The results of the study show that (a) FTDT is built on the aspects of translation, interpretation, extrapolation, and explanation, with each aspect consisting of 25 items with five anchor items; (b) FTDT is valid with an Aiken's V value in the range of 0.85-0.94, and the items fit PCM with Infit Mean Square (INFIT MNSQ) of 0.77-1.30, item difficulty index of 0.12-0.38, and the reliability coefficient of Cronbach's alpha FTDT is 0.9; (c) the percentage of conceptual understanding of physics from large to small is LK type 2 (LK2), FP, LK type 1 (LK1), FN, LK type 3 (LK3), SC, LK type 4 (LK4), and MSC. The percentage sequence of MSC based on the successive material is momentum, Newton's law, particle dynamics, harmonic motion, work, and energy. In addition, failure to understand the concept sequentially is due to Newton's law, particle dynamics, work and energy, momentum, and harmonic motion.

This paper discusses the development and validation of a concept inventory for interpreting kinematics graphs in the Tanzanian context. The study involved 61 participants comprising physics pre-service teachers, secondary school teachers, diploma college tutors, and a university lecturer from Tanzania. We developed 25 multiple-choice questions for interpreting kinematics graphs. The different steps in the development process used are selecting the topic, setting objectives, constructing questions, validating questions, and reliability testing. We carried out descriptive and inferential statistical analysis by using Statistical Package for Social Science (SPSS) version 22 followed by item analysis for pre-and post-piloting. Findings revealed normal distribution scores with a mean and standard deviation of 39.28±10.893 for pre-piloting and 40.16±8.08 for post-piloting. It also revealed no significant difference between pre-and post-piloting results with a p-value of 0.414.  In addition, correlation coefficients for test re-test reliability were .783 and .878 for single and average measures respectively. Moreover, item analysis in terms of difficulty index, discrimination index, and distractor efficiency agreed with the published standards. Based on these findings, the study recommends the use of developed and validated kinematics graphs concept inventory by physics educators in both research and classroom instructions in the Tanzanian context.

This study aimed to find the Classical Test Theory (CTT) and Modern Test Theory (MTT) item parameters of the Differential Aptitude Test (DAT) and examined their comparability of them. The item parameters being studied are difficulty level and discrimination index. 5.024 data of the result sub-test DAT were documented by the Department of Psychology and Guidance and Counselling bureau. The parameter of classical and modern test items was estimated and correlated by examining the comparability between parameters. The results show that there is a significant correlation between item parameter estimates. The Rasch and IRT 1-PL models have the highest correlation toward CTT regarding the item difficulty level. In contrast, model 2-PL has the highest correlation toward CTT in the item discrimination index. Overall, the study concluded that CTT and MTT were comparable in estimating item parameters of DAT and thus could be used independently or complementary in developing DAT.

This meta-analysis study investigates the effect of computer-based tests on motivation. The random effect model is the basis for calculating the summary effect, and it is found that the 30 articles obtained through the PRISMA method, which consist of four parts, namely identification, screening, eligibility, and included, can be generalized. Data analysis was performed using R studio and OpenMEE. Based on the research results, the p-value <.05 was obtained, so it was concluded that using a computer-based test significantly affected motivation. In the moderator analysis, it was found that computer-based tests were most effective for intrinsic motivation for the motivation variable, university students for the participants variable, and the country of Iran for the region variable. Evaluation of publication bias using the funnel plot and regression method shows no publication bias, proving that the 30 articles analyzed represent all existing studies on computer-based tests.

The objective of this study is to create a tool for evaluating teachers’ effectiveness in boarding schools. Planning and preparation stages, instrument testing, and measurements were used in this study to implement research on the creation of the Mardapi model instrument. In order to generate instrument items, the planning and preparation stage tasks included a literature assessment of teacher performance appraisal manuals. Data were gathered utilizing documentation approaches, and descriptive and qualitative analysis was performed. Six specialists validated the built instruments, which were subsequently put through limited testing at two boarding schools and extensive trials at nine boarding schools in Surakarta residency area. The Aiken formula was used to examine the expert’s evaluation data, and confirmatory factor analysis was used to analyze the test results. The results of this study indicate that the instrument for assessing teacher performance in boarding schools meets the validity criteria. This is indicated by the existence of loading factor values ranging from .51 to .72 (>.4) and t-sign values ranging from 4.75 to 9.25 (>1.96) and meeting the requirements of a fit model since Chi-square = 1307.95 < 2524 (2*df), p-value = .17956 (>.05), and RSMEA value = .014 (<.08). The instrument items are reliable assessment packages, and this is shown by the reliability value of omega .967 > .70. Because there is a guarantee of validity and reliability, the test can be used to further assess teacher performance in boarding schools.