Schools and teacher induction programs around the world routinely assess teaching best practice to inform accreditation, tenure/promotion, and professional development decisions. Routine assessment is also necessary to ensure that teachers entering the profession get the assistance they need to develop and succeed. We introduce the Item-Level Assessment of Teaching practice (I-LAST) as a flexible framework-based approach for quantitative evaluation of teaching best practice in the induction stages. We based the I-LAST on a novel framework for teaching best practice, and used Fuller’s scale as a framework for understanding the potential of the I-LAST in providing longitudinal measures for growth. Using the context of a year-long teacher induction program in the Midwestern United States, we collected data through an online survey from 46 teaching supervisors who were asked to evaluate their interns. We used the Rasch partial credit model as a criterion for construct validity, and measured dimensionality and reliability from both Rasch and classical frameworks. The I-LAST was found to be a unidimensional, valid, and reliable measure for teaching best practice. It demonstrated the ability to provide reliable scores for specific sub-dimensions of best practice, including those which manifest at various stages along Fuller’s scale. Potential uses of the I-LAST to advance understanding of the role of teacher induction programs in fostering productive growth in new teachers is discussed.

As we have seen from the current COVID-19 pandemic, misconceptions concerning viruses can lead to disease spread and panic. Therefore, it is imperative to determine misconceptions held concerning epidemics and pandemics. One virus that warrants study of misconceptions, albeit given limited attention in the West, is the Ebola virus. An assessment of college students’ knowledge and misconceptions about the Ebola virus was created and validated using data from 203 non-science majors at a Midwestern United States university. The data were analyzed using both classical and Rasch measurement methods to make a case for the validity of the assessment and to explore students’ misconceptions. The assessment was shown to be a valid and useful measure for students’ knowledge and misconceptions concerning Ebola. Integrating a confidence scale into students’ responses made the scale more reliable and assisted in identifying students’ tenacious misconceptions. Students displayed multiple misconceptions about viruses, including confusion between the characteristics of viruses and prokaryotes.  Students also displayed misconceptions about Ebola itself, including the overestimation of the number of Ebola strains and the number of patients who experience massive blood loss, misunderstandings about the incubation period, and overestimation of the mortality in comparison to other diseases like Influenza and Anthrax. This assessment can be used as a starting point in future studies to determine what misconceptions people have about Ebola and which types of educational and behavioral interventions need to be undertaken.

One of the issues that hinder the students’ learning progress is the inability to construct an epistemological explanation of a scientific phenomenon. Four-tier multiple-choice (hereinafter, 4TMC) instrument and Partial-Credit Model were employed to elaborate on the diagnosis process of the aforementioned problem. This study was to develop and implement the four-tier multiple-choice instrument with Partial-Credit Model to evaluate students’ learning progress in explaining the conceptual change of state of matter. This research applied a development research referring to the test development model by Wilson. The data were obtained through development and validation techniques on 20 4TMC items tested to 427 students. On each item, the study applied diagnostic-summative assessment and certainty response index. The students’ conceptual understanding level was categorized based on the combination of their answer choices; the measurement generated Partial-Credit Model for 1 parameter logistic (IPL) data. Analysis of differences was based on the student level class using Analysis of Variants (One-way ANOVA). This study resulted in 20 valid and reliable 4TMC instruments. The result revealed that the integration of 4TMC test and Partial-Credit Model was effective to be treated as the instrument to measure students’ learning progress. One-way ANOVA test indicated the differences among the students’ competence based on the academic level. On top of that, it was discovered that low-ability students showed slow progress due to the lack of knowledge as well as a misconception in explaining the Concept of Change of State of Matter. All in all, the research regarded that the diagnostic information was necessary for teachers in prospective development of learning strategies and evaluation of science learning.

The purpose of the study was to examine correlations between perceived teacher innovation (PTI) and self-regulated learning (SRL), where learning motivation, self-efficacy, and learning transfer help illustrate the interplay between and among influencing variables in the teacher-student relationship. This study gathered 213 valid questionnaires out of 355 participants in the Design Thinking for Data Scientists, which is one of the courses taught from a university in Taiwan. This study has analyzed the possible linkage in the Structural Equation Modeling (SEM) through the path coefficient. The ensuing data analysis study has shown that learning motivation, self-efficacy, and learning transfer not only served as the mediator effects in the PTI and SRL but also played small moderating effects. It appears that when learning motivation, self-efficacy, and learning transfer decrease, the interplay between PTI and SRL becomes stronger. It is necessary to increase the level of intrinsic motivation by the perception of greater innovation in teaching materials. By so doing, students would be more receptive and affective of course contents in the classroom and regulate themselves to achieve educational goals. The implications of teachers' perceptions of pedagogical innovation for learning motivation and learning experience are likewise discussed.

Learning in high schools has used a lot of smartphone assistance to make it easier for students to understand the material explained by the teacher. However, with the many uses of smartphones in learning, of course, it must provide positive benefits to the ability of students, especially the science literacy ability. In this study, the objectives to be achieved are to examine how much the smartphone's usability in physics learning, examine students' science literacy and examine the effect of the smartphone’s usability on students' science literacy in physics learning. The method used in this study is a quantitative method with a research design used is a one-shot case study. The data on smartphone usability is obtained using a questionnaire, and science literacy of students is obtained through on physics science literacy test. The results of this study indicate that the smartphones usability and students' science literacy in physics learning are respectively in the high and medium categories with a respective percentage of 57.20% and 36.36%. The students' science literacy is influenced by the smartphone's usability in physics learning by 34.30%. These results indicate that smartphone usability by most students is very high, but has not been able to contribute optimally to students' science literacy. Therefore, special treatment is needed in utilizing the use of smartphones in physics learning so that students' science literacy can be optimized.

Assessment is a topic that continues to be developed in science education research. Assessment evaluates not only students' cognitive abilities but also their thinking skills. Therefore, in this study, an assessment that could measure students' chemical literacy was developed. Chemical literacy is a thinking skill that students must develop as part of their chemistry learning. The goal of this study was to assess item' quality, as well as student’ chemical literacy on the concept of chemical rate. The Rasch model was employed to analyze the data in this study. The results of this study depict that the developed assessment had sufficient reliability and validity to be used to assess students' chemical literacy. Furthermore, the analysis of the students’ responses to the items revealed that many students did not understand or were unaware of the context presented. These findings suggest that students' chemical literacy in the material for the reaction rate is still lacking and needs to be improved. As a result, the teacher's role in assisting students in improving their chemical literacy through chemistry learning is critical.

This study aimed to develop a valid and reliable instrument that measures the functional vision of students with low vision. Thus, an assessment tool and performance activities were developed for three vision skill groups (near vision skills, distance vision skills, and visual field) that include functional vision skills. The universe was 1485 students studying in various primary and middle schools (from 2nd to 7th grades) affiliated to the Ministry of National Education, and simple random sampling was used to select 310 students. The data were collected using the Gazi Functional Vision Assessment Instrument developed by the researchers. Many-facet Rasch model and generalizability theory were used for the rater reliability of the measurements obtained from the instrument, while discriminant analysis was used for the validity of the measurements. The analysis showed that the measurements were reliable, and the inferences based on these measurements were valid. Thus, this instrument can be used to identify and assess the functional vision status of students with low vision.

Metacognition inventory supports increased awareness and self-control to improve student’s academic success, including physics. However, there are limitations to revealing the Physics Metacognition Inventory (PMI), especially in Indonesia. This study aims to explore and evaluate the psychometric properties of PMI. This survey research has involved 479 students from three high schools in Indonesia. The psychometric properties of the I-PMI were evaluated using a Confirmatory Factor Analysis and Rasch Model approach. The results show that the Indonesian Physics Metacognition Inventory (I-PMI) is collected in 6 constructs from 26 items. The validity, reliability, and compatibility tests have also been analyzed with good results. The five rating scales used have adequate functionality. This research has also presented more comprehensive information about the Physics Metacognition Inventory in the context of Indonesian culture. This study has implications for using I-PMI to assess students’ metacognition at the high school level in Indonesia and recommendations for future research.

Computational thinking (CT) is a method for solving complex problems, but also gives people an inventive inspiration to adapt to our smart and changing society. Globally it has been considered as vital abilities for solving genuine issues successfully and efficiently in the 21st century. Recent studies have revealed that the nurture of CT mainly centered on measuring the technical skill. There is a lack of conceptualization and instruments that cogitate on CT disposition and attitudes. This study attends to these limitations by developing an instrument to measure CT concerning dispositions and attitudes. The instruments' validity and reliability testing were performed with the participation from secondary school students in Malaysia. The internal consistency reliability, standardized residual variance, construct validity and composite reliability were examined. The result revealed that the instrument validity was confirmed after removing items. The reliability and validity of the instrument have been verified. The findings established that all constructs are useful for assessing the disposition of computer science students. The implications for psychometric assessment were evident in terms of giving empirical evidence to corroborate theory-based constructs and also validating items' quality to appropriately represent the measurement.

Many researchers have separately developed instruments to measure environmental characteristics such as attitudes, values, and knowledge. However, there is no instrument used to measure all these aspects in one comprehensive instrument. This study is meant to develop and validate a green character instrument which reveals student behavior and awareness of the environment. The instrument consists of 40 statement items consisting of 5 aspects, namely private pro-environmental behavior, public pro-environmental behavior, environmental knowledge, environmental values, and environmental attitudes. It was implemented on 1,398 students from 15 universities in Indonesia. The instrument content validation was analyzed by three experts using content validity index (CVI). The construct validity was analyzed using exploratory factor analysis, confirmatory factor analysis, and RASCH analysis. The content validity results obtained CVI scores ranging between 0.8 and 0.9 with a good category, while item reliability was in a fairly good category with a high level of separation index. Construct validation resulted in 34 items (4 items were eliminated after Exploratory and Confirmatory Factor Analysis, and 2 items were eliminated after RASCH analysis) spread over five constructs, namely environmental behavior, environmental knowledge, environmental values, environmental attitudes, and environmental habits. The resulting instrument has a good level of item difficulty, with a well understood response set which can be understood easily by respondents, and without bias. Therefore, it can be used to measure the students’ green character on both male and female.

This research is a developmental research aiming at developing a good mathematical test instrument using polytomous responses based on classical and modern theories. This research design uses the Plomp model, which consists of five stages, (1) preliminary investigation, (2) design, (3) realization/construction, (4) revision, and (5) implementation (testing). The study was conducted in three vocational schools in Lampung Province, Indonesia. The study involved 413 students, consisting of 191 male and 222 female students. The data were collected through questionnaire and test. The questionnaire was used to identify the assessment instruments currently employed by teachers and to be validated by the experts of mathematics and educational evaluation. The test used an open polytomous response test numbering of 40 items. The data were analyzed using both classical and modern theories. The results show that (1) the open polytomous response test has a good category according to classical and modern theory. However, the discrimination power of test items in classical theory needs several revisions, (2) the assessment instrument using the polytomous response of open multiple choice can guarantee information on the actual competence of students. This is proven by the fact that there is a harmony between the analysis result obtained from classical and modern theory from the students' arguments when giving reasons for their choices. Therefore, the open polytomous response test can be used as an alternative to learning assessment.

Competent instructors need to have the skills, abilities, and competencies to perform tasks effectively, which will affect student learning achievement. This study is guided by the theory of Boyatzis developed by Spencer and Spencer. The Iceberg Competency Model was used as a guideline to identify the competency elements of educators from the agricultural stream in vocational colleges (KV). This research study aims to explore and identify the existing competency elements of agricultural educators in KV. This study used a study population comprising 243 respondents of agricultural educators in KV. To answer the research question, the data analysis was done by Partial Least Squares - Structural Equation Modeling (PLS-SEM). This study is a study built to observe the relationship between the latent constructs studied. These constructs consisted of exogenous and endogenous constructs. In this study, exogenous constructs comprised value constructs, social roles, self-image, motives, traits and constraints. At the same time, endogenous constructs involved constructs of skills and knowledge. To ensure that the construct of this study gives meaning to the reflective measurement model, it was evaluated based on internal consistency reliability and validity. Regarding the framework, some indicators that did not qualify were dropped based on factor loading and average variance extracted (AVE). From the analysis conducted, 16 indicators were dropped since they did not meet PLS-SEM requirements. The total number of items retained was 71 indicators. At the final stage of this study, the evaluation model was implemented to form a framework involving the evaluation of the constructs linked to each other.

This study aimed to find the Classical Test Theory (CTT) and Modern Test Theory (MTT) item parameters of the Differential Aptitude Test (DAT) and examined their comparability of them. The item parameters being studied are difficulty level and discrimination index. 5.024 data of the result sub-test DAT were documented by the Department of Psychology and Guidance and Counselling bureau. The parameter of classical and modern test items was estimated and correlated by examining the comparability between parameters. The results show that there is a significant correlation between item parameter estimates. The Rasch and IRT 1-PL models have the highest correlation toward CTT regarding the item difficulty level. In contrast, model 2-PL has the highest correlation toward CTT in the item discrimination index. Overall, the study concluded that CTT and MTT were comparable in estimating item parameters of DAT and thus could be used independently or complementary in developing DAT.

The purpose of this research is to strengthen pedagogical content knowledge (PCK) in designing laboratory activities based on small-scale chemistry approaches. This research is action research involving 60 trainee teachers with stages that include (a) Reflect; (b) Plan; (c) Act; (d) Observe; (e) Reflect (2nd); (f) Plan (2nd). Qualitative data were collected through (a) Questionnaires reflecting on experiences in practicing chemistry learning and responses to the importance of learning, (b) a Portfolio of chemistry practicum design, (c) documentation of the process of carrying out design, implementation, and practicum evaluation activities, (d) field notes, (e) reflection sheet, and (f) Portfolio of follow-up plans. The data is displayed through the R computation system with data pre-processing stages in the teacher's reflection text which includes basic cleaning, case folding, normalization, stemming, and deleting meaningless words. Display data in the form of word clouds, frequency expression diagrams, and tabulations. Descriptive narratives are used to analyze the documentation obtained in the action process. The teacher group demonstrated performance in implementing small-scale practicum activities. Teachers are increasingly skilled in modifying conventional laboratory equipment, minimizing the amount of chemical use, minimizing waste disposal, and increasing efficiency in the duration of practicum implementation. The follow-up plan for this activity includes quality improvement in aspects of (a) skill in using laboratory equipment, (b) understanding of chemical concepts, (c) equipment availability, materials, and work procedures, and (d) implementation of chemistry practicum.

Students in mathematics classes do not understand the importance of sociomathematical norms in learning mathematics. This causes sociomathematical norms not to be teachers' focus when learning mathematics. Besides, there is no standardized instrument for assessing this norm, so developing this instrument is necessary to measure socio-mathematical norms in learning mathematics. This study aims to create and verify the psychometric validity of the sociomathematical norm scale. This research used a survey method with 505 senior high school students from Jakarta and West Java as respondents. The results showed that 25 items had convergent validity, with a loading factor value of > 0.700, meaning they could be declared valid. Concurrent validity indicates that each sociomathematical norms indicator is valid as a whole. Discriminant validity shows that the average variance extracted value on the diagonal is higher than the other values, so each item is declared valid. It was concluded that each item of the sociomathematical norms instrument has accuracy in its measurement function. The reliability test shows that each sociomathematical norms item is declared reliable. The reliability value of the sociomathematical norm item is .99, and the person's reliability is .86. Thus, the instruments developed can measure sociomathematical norms in learning mathematics.

Considering the importance of the results of national and international standardized tests, which are a benchmark for measuring educational quality, the objective of this research was to model strategies to improve the results of the evaluations, specifically the Saber 11 standardized tests. These tests are applied to students who finish their Vocational Education and Training (VET) in Bogotá, Colombia. To achieve this objective, we employed the Systems Dynamics methodology for a comprehensive analysis, which is a tool that allows for the analysis and projecting of the behavior of different systems, in which anticipation by means of modeling results over time is required. The modeling was conducted in two stages: First, a causal loop diagram and a stock-and-flow diagram that linked 45 variables were designed, showing the underlying physical structure of the system. Then, five groups of alternative simulations were conducted over a time frame of six years: Reference mode, student self-efficacy rate, management rate, teaching competencies rate, and educational policy. An increase in results was observed in each scenario. The combined activity of educational stakeholders is a notably effective strategy to achieve significant improvements. The data used for these simulations came from a six-year period of standardized test results in Bogotá. This period was selected to capture both recent trends and long-term outcomes, ensuring that the model reflects current educational conditions while allowing for meaningful trend analysis.