' assessment and evaluation' Search Results
The Relationship of Supporting Factors That Influence the Performance of Hindu Religious Teachers
hindu religious teacher hindu principal leadership school culture supervision of school superintendents teacher work motivation...
Several supporting factors are alleged to influence the performance of teachers. This study aimed to describe the relationship between each research variable and teachers’ performance, either directly or indirectly. This research was conducted through surveys and quantitative approaches that included correlational research types. The research subjects were Hindu religion teachers in 119 state junior high schools, consisting of 517 teachers. The sample of 256 people was determined using the Krejcie and Morgan formula and the Warwick and Lininger formula. The samples from each sub-population were determined with the proportional random sampling technique, and the personal sampling of sample members was determined with the use of lottery techniques. The data were collected using a five-point Likert scale model questionnaire with high validity and reliability. The data analysis technique used in this study was structural equation modelling. The conceptual model met the standards of comprehensive goodness-of-fit requirements. The results of the study show that the average levels of Hindu principals’ leadership, the emotional intelligence of teachers, supervision of school superintendents, school culture, teachers’ work motivation, and the performance of Hindu religion teachers are in the high category. In addition, the hypothesis testing results show there is a significant direct and indirect relationship between the variables in the state junior high school.
The Development of Teacher and Student’s Book Based on Realistic Mathematics Education in Statistics for A package Program
realistic mathematical education student books teacher's books validity...
Development research demands a improvement in the implementation of learning by developing products based on learning needs. The products of this development are teacher book and student book based on the realistic mathematic education (RME) approach for package A in statistics material. Validity testing in this study includes instrument validation, self-evaluation, expert validation, one-to-one evaluation. Aiken's V and Intraclass Correlation Coefficient (ICC) are used to determine the validity and reliability of the product. The result of research shows that the instruments and prototype are valid and feasible. Then, the ICC obtained moderate stability, it also categorize reliable. In terms of context and hypothetical learning trajectory (HLT) developed, the products should be revised to achieve meaningful learning.
The Effects of The Blended Project-Based Literacy that Integrates School Literacy Movement Strengthening Character Education Learning Model on Metacognitive Skills, Critical Thinking, and Opinion Expression
blended li-pro-gp learning model critical thinking metacognitive skills opinion expression...
Metacognitive, critical thinking and opinion expression are in high demand. This study aimed to investigate the effects of the blended project- based literacy that integrates school literacy movement strengthening character education (literasi berbasis proyek terintegrasi GLS dan PPK: Li-Pro-GP) learning model on students' metacognitive skills, critical thinking, and opinion expression. A post-test experimental design was used to answer the research question. The study was conducted from August to October 2021 at Government Junior High School 23 Malang. Seventh-grade students were selected as research participants. The participants included 30 students from class VII-2. The research instrument was five essay questions to measure critical thinking skills. Material and assessment experts validated the essay questions developed by the researcher. The items that were declared valid were tested for validity. The result showed five valid items with high reliability of .670. Metacognitive skills were measured using the Metacognition Awareness Instrument (MAI), which consists of 40 items. The questions declared valid were tested for validity with a very high reliability of .953 for 37 items, and only three items were invalid. The ability to express an opinion was measured with an observation questionnaire validated by experts with a valid instrument score. Data analysis was performed by path analysis using the SmartPLS software. The results showed that the Li-Pro-GP blended learning model significantly strengthened students' metacognitive skills, critical thinking, and opinion formation.
Bandura's Observational Learning Model and General Motoric Ability About Learning Outcomes in Athletic Skills
athletic skills learning outcomes general motoric ability learning model...
This study aims to analyze the impact of Bandura’s observational learning model based on performance assessment learning models and general motor skills on athletic skills learning outcomes. This study used an experimental design treatment by level 2x2. A simple random sampling technique was used with a total of 88 people. The data collection method used consisted of tests and documentation. A two-way analysis of variance was used to analyze the data. The results showed that the students’ athletic skills learning outcomes that followed the Bandura observational learning model based on performance assessment were higher than students’ conventional learning model. There was an interaction effect between the learning model and general motor skills on the student's athletic skills learning outcomes. The students’ athletic skills learning outcomes who follow the Bandura observational learning model based on performance assessment were higher than the conventional learning model. The students with low general motor skills and the students’ athletic skills learning outcomes that followed the Bandura observational learning model based on performance assessment were lower than the conventional learning model. Based on the research findings, it is recommended to improve the athletic skills learning outcomes with Bandura's observational learning model based on performance assessments appropriately and correctly.
The Use of Technology-Based Model of Critical Thinking Development to Reshape Students’ Self-Study Process
critical thinking higher education self-study student performance technologies...
The aim of this study was to investigate how the use of the technologized model of critical thinking development affected the self-study process of students of higher educational institutions (HEIs). The research methodology was based on a combination of qualitative and quantitative empirical methods, as well as a descriptive approach to data analysis. The study involved a quasi-experimental model supposed to influence the variables under study. The technology-based educational model of autonomous learning with a focus on the critical thinking development in students of HEIs consisted of the following processes, such as: communication, analysis, synthesis, problem-solving, evaluation, and reflection. The Watson Glaser Test was adapted to monitor the level of students’ critical thinking. The average score on the final control of students’ knowledge was used to monitor the experimental group students’ performance. By monitoring the development of students’ critical thinking and the dynamics of their performance in the course of training, where 90% of the time students studied independently, it was established that the use of a technological educational model had a positive effect on the critical thinking of students of HEIs, and as a result, the effectiveness of their self-study.
The Development of a Four-Tier Diagnostic Test Based on Modern Test Theory in Physics Education
developing test four-tiers diagnostic test modern test theory...
Diagnostic tests are generally two or three-tier and based on classical test theory. In this research, the Four-Tier Diagnostic Test (FTDT) was developed based on modern test theory to determine understanding of physics levels: scientific conception (SC), lack of knowledge (LK), misconception (MSC), false negatives (FN), and false positives (FP). The goals of the FTDT are to (a) find FTDT constructs, (b) test the quality of the FTDT, and (c) describe students' conceptual understanding of physics. The development process was conducted in the planning, testing, and measurement phases. The FTDT consists of four-layer multiple-choice with 100 items tested on 700 high school students in Yogyakarta. According to the partial credit models (PCM), the student's responses are in the form of eight categories of polytomous data. The results of the study show that (a) FTDT is built on the aspects of translation, interpretation, extrapolation, and explanation, with each aspect consisting of 25 items with five anchor items; (b) FTDT is valid with an Aiken's V value in the range of 0.85-0.94, and the items fit PCM with Infit Mean Square (INFIT MNSQ) of 0.77-1.30, item difficulty index of 0.12-0.38, and the reliability coefficient of Cronbach's alpha FTDT is 0.9; (c) the percentage of conceptual understanding of physics from large to small is LK type 2 (LK2), FP, LK type 1 (LK1), FN, LK type 3 (LK3), SC, LK type 4 (LK4), and MSC. The percentage sequence of MSC based on the successive material is momentum, Newton's law, particle dynamics, harmonic motion, work, and energy. In addition, failure to understand the concept sequentially is due to Newton's law, particle dynamics, work and energy, momentum, and harmonic motion.
Challenges in Managing Bilingual Schools: A Solution Through Higher Education for Prospective Leaders
bilingual education management education prospective leader...
This qualitative study is part of a feasibility study conducted by State University of Malang (SUM), Indonesia, to determine stakeholder needs for a study program specializing in managing bilingual education. The study participants included one SUM lecturer who held a managerial position in the division of SUM laboratory schools and twelve teachers/leaders of bilingual schools in some cities in East Java and South Sulawesi. Data were collected using an online questionnaire and in-depth interviews with two selected participants. The results indicate issues related to teachers' English competencies, materials development, and integrating an internationally-oriented curriculum into the national curriculum. Teachers' low English competencies prevented them from conducting teaching and learning bilingually and developing instructional materials in appropriate English. In addition, the combination of national and international curricula was identified as the biggest challenge for bilingual schools. The teachers/leaders were never trained to manage the bilingual program. They learned based on their experiences, and it took years to figure out how to manage bilingual programs successfully. Therefore, the establishment of a new program of study is needed.
An Examination of Science Achievement and School Compositional Effects in Ireland Using TIMSS Data
before children start school results are discussed with regard to educational policy and educational practice in ireland keywords: e...
Recent educational policy initiatives in Ireland have focused on improving outcomes in reading and mathematics among students, particularly those experiencing educational disadvantage. However, science achievement in Irish primary schools has received much less research attention, especially in the context of educational disadvantage. This article examines science achievement and its relationship to school compositional effects in primary schools at the national level, including school-average indicators of the school context, as well as examining factors associated with science achievement in three distinct categories of schools (those with high, moderate, or minor levels of educational disadvantage). The data are drawn from the Fourth grade Trends in International Mathematics and Science Study (TIMSS) 2015 database for Ireland. Multilevel analyses were implemented in a stepwise manner. Findings suggest the relevance of school contexts with regard to science achievement. Before including school-level contextual variables, students from ‘minor disadvantaged’ schools achieved significantly higher science scores than students from schools with ‘moderate’ or ‘high’ levels of disadvantaged. However, this difference disappears after controlling for predictors at the school level. The findings highlight the importance of the home environment, including early numeracy activities and skills before children start school. Results are discussed with regard to educational policy and educational practice in Ireland.
Learning Materials and Their Prototypes for Academic Writing Skills: The Needs of Indonesian Lecturers in the Post-COVID-19 Era
academic writing skills learning materials lecturers’ needs post-covid-19 prototype...
This study aims to investigate lecturers' needs for academic writing learning materials and determine their prototypes. This study is qualitative research in the form of an exploratory case study. The research instruments were semi-open-ended questionnaires and unstructured and open-ended interview guides. The data were analyzed using content analysis. The results show that the developed learning material for academic writing skills contains seven needs for lecturers in the Department of Indonesian Language and Literature. Four of them have not been found by previous researchers. The results from this study provide new knowledge and contribution to the literature about the need to prototype the learning materials. The lecturers or other researchers can use these seven needs in prototyping learning materials for academic writing skills, such as the needs of learning materials, their forms, presentation system, language use, evaluation form, main menu design, and the way of creating learning materials.
Development of a Self-Evaluation Instrument with Programmatic Assessment Components for Undergraduate Medical Students
instrument development medical education programmatic assessment...
This study aimed to develop and test a student self-assessment instrument based on the programmatic assessment (PA) components. We applied a series of psychometric research methods by (a) conducting a literature study to find PA constructs, (b) developing the students' self-questionnaires, (c) ensuring content validity, (d) testing face validity, and (e) conducting reliability tests that involve medical students, medical teachers, medical educationalist, and an international PA expert. Face validity (readability test) was conducted with 30 medical students from an Indonesian university who were in their last year of pre-clinical education and had average scores above or equal to their classmates. The confirmatory factor analysis (CFA) was used to report the instruments’ validity and reliability. The final instrument was tested on 121 medical students with excellent GPAs from another medical school with a middle-level accreditation. The PA consists of five components: ‘learning activities’, ‘assessment activities’, 'supporting activities’, 'intermediate evaluations’, and ‘final evaluations'. These components are conveyed through 41 relevant statements with a four-point Likert scale and three yes/no statements. According to the respondents, there was a lack of 'supporting activities' and 'intermediate evaluation' components in the PA in their universities. This study has developed and tested a five-component evaluation instrument based on medical students' perceptions regarding PA implementation.
Development and Validation of a Concept Inventory for Interpreting Kinematics Graphs in the Tanzanian Context
concept inventory kinematics graphs physics teachers tanzania context...
This paper discusses the development and validation of a concept inventory for interpreting kinematics graphs in the Tanzanian context. The study involved 61 participants comprising physics pre-service teachers, secondary school teachers, diploma college tutors, and a university lecturer from Tanzania. We developed 25 multiple-choice questions for interpreting kinematics graphs. The different steps in the development process used are selecting the topic, setting objectives, constructing questions, validating questions, and reliability testing. We carried out descriptive and inferential statistical analysis by using Statistical Package for Social Science (SPSS) version 22 followed by item analysis for pre-and post-piloting. Findings revealed normal distribution scores with a mean and standard deviation of 39.28±10.893 for pre-piloting and 40.16±8.08 for post-piloting. It also revealed no significant difference between pre-and post-piloting results with a p-value of 0.414. In addition, correlation coefficients for test re-test reliability were .783 and .878 for single and average measures respectively. Moreover, item analysis in terms of difficulty index, discrimination index, and distractor efficiency agreed with the published standards. Based on these findings, the study recommends the use of developed and validated kinematics graphs concept inventory by physics educators in both research and classroom instructions in the Tanzanian context.
Numerical Ratings and Content Labeling of Speeches in an Educational Public Speaking Program
evaluations public speaking rhetoric speeches...
Education in public speaking often relies largely on qualitative feedback. In this study, we explored how a numerical feedback form based on a validated scale could be used in an educational public speaking program. Data were collected at three clubs of Toastmasters International. Speech content was labeled to enable statistical analysis of correlations between speech content and audience ratings. 216 speeches by 59 speakers were evaluated by audience members, providing 1416 individual evaluations. All rating categories correlated strongly with each other. Speeches mentioning relationships, personal stories and positive emotions were rated more favorably. Speeches given in-person were rated more highly in several dimensions compared to speeches given through online video. There were some sex differences in choice of content and emotional expressiveness, but not in audience ratings of speech quality. Overall, the study found that the method was useful for both providing individual feedback and aggregated data for research purposes.
Constructive Cognitive Assessment of Learning in a Course on the Computational Cognition in Psychology Students
academic learning cognitive evaluation mental representation of knowledge natural semantic networks...
Learning evaluation is a complex task, and this study illustrates the Constructive Assessment of Learning as a complementary alternative to evaluate the computational cognition schema construction. The authors designed a mental representational task under the Chronometric Constructive Cognitive Learning Evaluation Model. Control and experimental groups performed a conceptual definition task based on the Natural Semantic Network technique (NSN). They defined ten target concepts related to computational cognition theory, using verbs, nouns, and adjectives as definers. Afterward, the participants rated the conceptual quality of each definer one by one, on a scale of one to ten; the higher the rating, the greater the quality of the definer to define the target concept. The results indicate that the NSN technique was sensitive to measuring and discriminating cognitive changes in knowledge structures produced by the specific learning of computational cognition theory. In contrast, the learning of broad psychology subjects produced general cognitive changes without organization related to the specific learning of the evaluated course. Data showed more sophisticated cognitive change patterns on the evaluated schema in the experimental group than in the control group. The findings of this study suggest that cognitive assessment techniques can be helpful in the formative assessment of learning and provide clear indicators of students' knowledge management skills.
Evaluation of Preservice Teachers’ Performance in School through Video Observations during the COVID-19 Pandemic
observation preservice teachers rubrics student evaluation teacher education...
Lesson study, observation and analysis are relevant to professional development and initial teacher education. As a strategy, it helps to bridge the gap between theory and practice. The health conditions brought on by the COVID-19 pandemic forced the restriction of the tutors’ direct observation of preservice teachers at school. This study analyses preservice teachers’ performance through video observations to evaluate their professional activity at school during the COVID-19 pandemic. The Fifteen Items Revised Tsang-Hester Observation Rubric (FIR-THOR) was administered to a sample of 166 preservice teachers in their internship schools and their video recordings each one of 45-minute teaching lessons were analysed. The results show that the FIR-THOR appears as a robust instrument, which allows us to conclude that the instrument works well in the three five-items dimensions that compose it - Instruction, Management, and Assessment - proving to be reliable for assessing teacher intervention in the classroom. Among the three dimensions, the preservice teachers’ performance stands out in the Management of the classroom, as well as in the classroom Instruction. This contribution is relevant considering the potential of lesson analysis in learning and professional development during initial teacher training.
How Students Generate Patterns in Learning Algebra? A Focus on Functional Thinking in Secondary School Students
functional relationships functional thinking generalization learning algebra...
This research aims to describe secondary school students' functional thinking in generating patterns in learning algebra, particularly in solving mathematical word problems. In addressing this aim, a phenomenological approach was conducted to investigate the meaning of functional relationships provided by students. The data were collected from 39 ninth graders (13-14 years old) through a written test about generating patterns in linear functions. The following steps were conducting interviews with ten representative students to get detailed information about their answers to the written test. All students' responses were then analyzed using the thematic analysis software ATLAS.ti. The findings illustrate that students employed two types of approaches in solving the problem: recursive patterns and correspondence. Students favored the recursive patterns approach in identifying the pattern. They provided arithmetic computation by counting term-to-term but could not represent generalities with algebraic symbols. Meanwhile, students evidenced for correspondence managed to observe the relation between two variables and create the symbolic representation to express the generality. The study concludes that these differences exist due to their focus on identifying patterns: the recursive pattern students tend to see the changes in one variable, whereas the correspondence ones relate to the corresponding pair of variables.
Sohanjana Antibullying Intervention: Culturally and Socially Targeted Intervention for Teachers in Pakistan to Take Actions Against Bullying
aggression prevention antibullying intervention pakistan’s educational institutions social and cultural adaptation teachers’ professional development...
Several studies have demonstrated that bullying and cyberbullying are prevalent in Pakistani educational institutions, negatively affecting students' physical and mental health. Literature has revealed that it has not always been successful to prevent bullying in Pakistani educational institutions by adapting or adopting antibullying interventions from other countries. Sohanjana Antibullying Intervention is the first contextualized antibullying intervention designed specifically for Pakistani teachers. Assisting teachers in identifying bullying and victimization issues prevalent in educational institutions, intervening quickly to assist pupils, and creating a conducive school environment are the main goals of this program. A description of the Sohanjana intervention program, its modules, and its design is presented in the current study. After a comprehensive literature review on bullying in Pakistan, and conducting a baseline survey for need assessment, the program’s content and activities have been developed. In this 32-hour professional development program, teachers are trained on eight different themes over the course of eight modules. In the present paper, the design, the theoretical background, details of the different modules and preliminary evaluation data of the Sohanjana intervention program are presented. A pilot study of the intervention so far has produced successful results and gathered positive feedback from participants. As a result of the feedback, several recommendations and suggestions are discussed in the study.
Effect of Computer Based Test on Motivation: A Meta-Analysis
computer-based test meta-analysis motivation r studio...
This meta-analysis study investigates the effect of computer-based tests on motivation. The random effect model is the basis for calculating the summary effect, and it is found that the 30 articles obtained through the PRISMA method, which consist of four parts, namely identification, screening, eligibility, and included, can be generalized. Data analysis was performed using R studio and OpenMEE. Based on the research results, the p-value <.05 was obtained, so it was concluded that using a computer-based test significantly affected motivation. In the moderator analysis, it was found that computer-based tests were most effective for intrinsic motivation for the motivation variable, university students for the participants variable, and the country of Iran for the region variable. Evaluation of publication bias using the funnel plot and regression method shows no publication bias, proving that the 30 articles analyzed represent all existing studies on computer-based tests.
The Implementation of Flipped Learning Model and STEM Approach in Elementary Education: A Systematic Literature Review
elementary education e-learning flipped learning stem technology...
This study aimed to explore the implementation and impact of the Flipped Learning Model (FLM) and STEM Approach in elementary education. The advancement of technology and the Covid-19 pandemic has increased the importance of e-learning, including in elementary schools. The literature review analyzed 193 academic works published in the past six years using NVivo, Mendeley, and VOSviewer software. The validity of the data was verified through the analysis of five online databases. The results showed that STEM research has been well-developed with innovative approaches that improve learning outcomes, while FLM research in elementary schools is limited. The study suggested that combining FLM with STEM Approach (FLM-SA) can optimize learning in the technological era. By integrating FLM-SA, students can engage in active learning experiences in class and acquire fundamental knowledge outside of class, offering a solution to e-learning challenges. The study emphasized the strong connection between FLM and STEM Approach and how they can support each other to enhance student learning.
The Development of Teacher Performance Assessment Instruments in Boarding School
assessment boarding school teacher’s performance...
The objective of this study is to create a tool for evaluating teachers’ effectiveness in boarding schools. Planning and preparation stages, instrument testing, and measurements were used in this study to implement research on the creation of the Mardapi model instrument. In order to generate instrument items, the planning and preparation stage tasks included a literature assessment of teacher performance appraisal manuals. Data were gathered utilizing documentation approaches, and descriptive and qualitative analysis was performed. Six specialists validated the built instruments, which were subsequently put through limited testing at two boarding schools and extensive trials at nine boarding schools in Surakarta residency area. The Aiken formula was used to examine the expert’s evaluation data, and confirmatory factor analysis was used to analyze the test results. The results of this study indicate that the instrument for assessing teacher performance in boarding schools meets the validity criteria. This is indicated by the existence of loading factor values ranging from .51 to .72 (>.4) and t-sign values ranging from 4.75 to 9.25 (>1.96) and meeting the requirements of a fit model since Chi-square = 1307.95 < 2524 (2*df), p-value = .17956 (>.05), and RSMEA value = .014 (<.08). The instrument items are reliable assessment packages, and this is shown by the reliability value of omega .967 > .70. Because there is a guarantee of validity and reliability, the test can be used to further assess teacher performance in boarding schools.
Semantic Correlation Model of Socio-Formative Data for Curricular Planning Evaluation
curriculum planning curricular evaluation natural language processingi semantic correlation socio-formative data...
The study presents a semantic correlation model (SCM) of socioformative data, which is designed to support the evaluation of curriculum planning (CPE) that is developed from indicators derived from curriculum components such as graduate profile, study plan, area plan and subject plan. The objective of the research was to design a semantic correlation model of socio-formative data to support the evaluation of curriculum planning in accordance with the objectives of sustainable development in education. The study is a quasi-experimental research based in a Likert questionnaire applied on a group of 10 students (16 and 18 years old) belonging to the eleventh grade of the urban official educational institutions of Marsella, in the department of Risaralda in Colombia. The results indicate that the model has an impact on the evaluation of curricular planning, concluding that the design and implementation of a semantic correlation model of sociodemographic data does have an impact on the evaluation of curricular planning of a classroom subject in an educational institution in Marsella.