'student evaluation' Search Results
The Development of a Four-Tier Diagnostic Test Based on Modern Test Theory in Physics Education
developing test four-tiers diagnostic test modern test theory...
Diagnostic tests are generally two or three-tier and based on classical test theory. In this research, the Four-Tier Diagnostic Test (FTDT) was developed based on modern test theory to determine understanding of physics levels: scientific conception (SC), lack of knowledge (LK), misconception (MSC), false negatives (FN), and false positives (FP). The goals of the FTDT are to (a) find FTDT constructs, (b) test the quality of the FTDT, and (c) describe students' conceptual understanding of physics. The development process was conducted in the planning, testing, and measurement phases. The FTDT consists of four-layer multiple-choice with 100 items tested on 700 high school students in Yogyakarta. According to the partial credit models (PCM), the student's responses are in the form of eight categories of polytomous data. The results of the study show that (a) FTDT is built on the aspects of translation, interpretation, extrapolation, and explanation, with each aspect consisting of 25 items with five anchor items; (b) FTDT is valid with an Aiken's V value in the range of 0.85-0.94, and the items fit PCM with Infit Mean Square (INFIT MNSQ) of 0.77-1.30, item difficulty index of 0.12-0.38, and the reliability coefficient of Cronbach's alpha FTDT is 0.9; (c) the percentage of conceptual understanding of physics from large to small is LK type 2 (LK2), FP, LK type 1 (LK1), FN, LK type 3 (LK3), SC, LK type 4 (LK4), and MSC. The percentage sequence of MSC based on the successive material is momentum, Newton's law, particle dynamics, harmonic motion, work, and energy. In addition, failure to understand the concept sequentially is due to Newton's law, particle dynamics, work and energy, momentum, and harmonic motion.
Challenges in Managing Bilingual Schools: A Solution Through Higher Education for Prospective Leaders
bilingual education management education prospective leader...
This qualitative study is part of a feasibility study conducted by State University of Malang (SUM), Indonesia, to determine stakeholder needs for a study program specializing in managing bilingual education. The study participants included one SUM lecturer who held a managerial position in the division of SUM laboratory schools and twelve teachers/leaders of bilingual schools in some cities in East Java and South Sulawesi. Data were collected using an online questionnaire and in-depth interviews with two selected participants. The results indicate issues related to teachers' English competencies, materials development, and integrating an internationally-oriented curriculum into the national curriculum. Teachers' low English competencies prevented them from conducting teaching and learning bilingually and developing instructional materials in appropriate English. In addition, the combination of national and international curricula was identified as the biggest challenge for bilingual schools. The teachers/leaders were never trained to manage the bilingual program. They learned based on their experiences, and it took years to figure out how to manage bilingual programs successfully. Therefore, the establishment of a new program of study is needed.
An Examination of Science Achievement and School Compositional Effects in Ireland Using TIMSS Data
before children start school results are discussed with regard to educational policy and educational practice in ireland keywords: e...
Recent educational policy initiatives in Ireland have focused on improving outcomes in reading and mathematics among students, particularly those experiencing educational disadvantage. However, science achievement in Irish primary schools has received much less research attention, especially in the context of educational disadvantage. This article examines science achievement and its relationship to school compositional effects in primary schools at the national level, including school-average indicators of the school context, as well as examining factors associated with science achievement in three distinct categories of schools (those with high, moderate, or minor levels of educational disadvantage). The data are drawn from the Fourth grade Trends in International Mathematics and Science Study (TIMSS) 2015 database for Ireland. Multilevel analyses were implemented in a stepwise manner. Findings suggest the relevance of school contexts with regard to science achievement. Before including school-level contextual variables, students from ‘minor disadvantaged’ schools achieved significantly higher science scores than students from schools with ‘moderate’ or ‘high’ levels of disadvantaged. However, this difference disappears after controlling for predictors at the school level. The findings highlight the importance of the home environment, including early numeracy activities and skills before children start school. Results are discussed with regard to educational policy and educational practice in Ireland.
Learning Materials and Their Prototypes for Academic Writing Skills: The Needs of Indonesian Lecturers in the Post-COVID-19 Era
academic writing skills learning materials lecturers’ needs post-covid-19 prototype...
This study aims to investigate lecturers' needs for academic writing learning materials and determine their prototypes. This study is qualitative research in the form of an exploratory case study. The research instruments were semi-open-ended questionnaires and unstructured and open-ended interview guides. The data were analyzed using content analysis. The results show that the developed learning material for academic writing skills contains seven needs for lecturers in the Department of Indonesian Language and Literature. Four of them have not been found by previous researchers. The results from this study provide new knowledge and contribution to the literature about the need to prototype the learning materials. The lecturers or other researchers can use these seven needs in prototyping learning materials for academic writing skills, such as the needs of learning materials, their forms, presentation system, language use, evaluation form, main menu design, and the way of creating learning materials.
Employing Fuzzy Delphi Techniques to Validate the Components and Contents of E-Learning Antecedents and Usage Behavior Towards E-Learning Performance
e-learning antecedents e-learning performance fuzzy delphi techniques usage behavior...
The primary objective of this study is to require the experts’ unanimous agreement on the e-learning antecedents and usage behavior towards e-learning performance. This study used the Fuzzy Delphi Method (FDM) to gather answers and feedback using a 7-point Likert scale. The survey (items) was reviewed and approved by eight panel members or experts. It was analyzed using Fuzzy Delphi Logic (FUDELO 1.0) software. The data were evaluated using triangular fuzzy numbering and the position (ranking) of each variable was established through defuzzification. The findings revealed that all of the items received high levels of expert agreement, significantly greater α-cut defuzzification values >.5, the overall value of the threshold (d) is less than .2 and had to comply with the overall percentage of percent consensus, which must be greater than 75%. All 45 recommended items were retained adequately and acceptable for a large-scale survey in this study. Finally, each item was prioritized (ranked) based on the defuzzification value, and then some additional items were added, as recommended by experts.
Research on Factors that Influence College Academic Performance: A Structural Equation Modelling Approach
academic performance emotion engagement self-control self-efficacy...
This study used the structural equation modeling (SEM) approach to test a model that hypothesized the influence of self-efficacy, self-control, emotion, and engagement on student academic performance. The structural equation modeling model was developed to link all the study variables with a literature review to describe the interrelationship. Data collected were from 413 college students in their second year. The results show that self-efficacy, self-control, emotion, and engagement predict student academic performance. And through emotion and student engagement, both self-efficacy and self-control predict student academic performance indirectly. Practically the measures used in this study give more information about the learning environment in higher education settings than those usually come from traditional practices faculty received in the classroom, such as student rating forms and feedback. The main findings of this study have some implications for higher education, theory development, measurement, and future research.
Professional Learning Communities in Vietnamese Primary Schools in the Educational Reform Context: Forms and Challenges
principal leadership professional learning community teacher learning vietnamese schools...
Professional learning communities (PLCs) are important for improving student achievement and school development. According to PLC research, teachers' knowledge and practice in teaching are significantly improved by various PLC forms and favorable working environments. This qualitative research was conducted to find out what forms of PLCs were popular and what challenges were facing three primary schools in a province in Vietnam. The study utilizes a multiple-site case study design relating to PLCs in those schools with the data from interviews with the principals, group leaders and teachers, observations of PLC activities and related policy documents. The two forms of PLCs were identified in this research, including professional groups and groups of core teachers. Besides, four challenges facing PLCS implementation in those schools included the old habit of professional learning in PLCs, structural conditions of schedules and facilities, economic conditions of teachers and motivation for reforms. The study provides recommendations based on the findings for PLC research and practice within and beyond the Vietnamese context.
Teachers’ Performance During the COVID-19 Pandemic in Indonesia: Causality and Comparison
competence moderated factor teacher performance...
The greatest impact of the COVID-19 pandemic on Indonesian education was the decline in teacher performance. In light of this information, this study analyzes the role of supervision, salary and benefits, school climate, training and development, and perceived organizational support in moderating the impact of competence on teacher performance during the COVID-19 pandemic. This study also compares the relationships between employed government and private teachers. Data were collected through questionnaires to teachers with a sample of 166 government teachers and 175 private teachers in primary and secondary schools through a Google form and analyzed using moderated Structural Equation Modeling-Partial Least Square (SEM-PLS), multigroup, and multilevel analysis. The results showed that salary and benefits, training, and development did not affect the performance of public school teachers. In contrast, only salary and benefits did not affect teacher performance for private teachers. Moreover, only supervision significantly moderated the effect of competence on the performance of public school teachers. However, supervision, salary, benefits, school climate, training and development, and perceived organizational support did not affect private teachers' performance. The Ministry of Education or the Foundation needs to review and improve the mechanisms of training and development, supervision, and school organizational climate to promote optimal teacher performance during the pandemic.
Typology of Epistemologies for Democratising Knowledge and Policy Benefits for All Mainstreamed by Doctoral-Study
education outcomes knowledge production peace prosperity sustainable development goals...
Ursula von der Leyen identifies diverse classrooms have different knowledges and ‘epistemologies’. A typology of epistemologies for democratising knowledge ‘A Blueprint for Character Development for Evolution’ (ABCDE) is offered to mainstream policy benefits for all by Higher Education as hubs i) credentialing educational leaders by doctoral-study and ii) propelling networks of Professional Educators and Administrators Committees for Empowerment (PEACE) across professions credentialed by Higher Education and chaired by educational leaders. PEACE builds robust evidence bases to inform redesigning curriculums and culturally responsive pedagogies as policy benefits that empower students to use ABCDE with Assessment for Personal and Social Learning (APSL) to problem solve across the quadruple-helix. Education Outcomes include students’ self-management of personal and social understanding and wellbeing for resilience within sustainable circular, entrepreneurial, green and digitised economies with products and means of production regulated by professions credentialed by Higher Education. Impacts include communities developing responsible historical social consciousness to reinvigorate democratic governance, accountability, transparency, effectiveness and trustworthiness of rule-of-law based institutions and policies to expand active and inclusive citizenship empowered by safeguarding human rights. Further research, building on the powerful European Commission funded platform ‘DocEnhance’ is recommended to inform effective and efficient investment into high quality education and training.
Development of a Self-Evaluation Instrument with Programmatic Assessment Components for Undergraduate Medical Students
instrument development medical education programmatic assessment...
This study aimed to develop and test a student self-assessment instrument based on the programmatic assessment (PA) components. We applied a series of psychometric research methods by (a) conducting a literature study to find PA constructs, (b) developing the students' self-questionnaires, (c) ensuring content validity, (d) testing face validity, and (e) conducting reliability tests that involve medical students, medical teachers, medical educationalist, and an international PA expert. Face validity (readability test) was conducted with 30 medical students from an Indonesian university who were in their last year of pre-clinical education and had average scores above or equal to their classmates. The confirmatory factor analysis (CFA) was used to report the instruments’ validity and reliability. The final instrument was tested on 121 medical students with excellent GPAs from another medical school with a middle-level accreditation. The PA consists of five components: ‘learning activities’, ‘assessment activities’, 'supporting activities’, 'intermediate evaluations’, and ‘final evaluations'. These components are conveyed through 41 relevant statements with a four-point Likert scale and three yes/no statements. According to the respondents, there was a lack of 'supporting activities' and 'intermediate evaluation' components in the PA in their universities. This study has developed and tested a five-component evaluation instrument based on medical students' perceptions regarding PA implementation.
Development and Validation of a Concept Inventory for Interpreting Kinematics Graphs in the Tanzanian Context
concept inventory kinematics graphs physics teachers tanzania context...
This paper discusses the development and validation of a concept inventory for interpreting kinematics graphs in the Tanzanian context. The study involved 61 participants comprising physics pre-service teachers, secondary school teachers, diploma college tutors, and a university lecturer from Tanzania. We developed 25 multiple-choice questions for interpreting kinematics graphs. The different steps in the development process used are selecting the topic, setting objectives, constructing questions, validating questions, and reliability testing. We carried out descriptive and inferential statistical analysis by using Statistical Package for Social Science (SPSS) version 22 followed by item analysis for pre-and post-piloting. Findings revealed normal distribution scores with a mean and standard deviation of 39.28±10.893 for pre-piloting and 40.16±8.08 for post-piloting. It also revealed no significant difference between pre-and post-piloting results with a p-value of 0.414. In addition, correlation coefficients for test re-test reliability were .783 and .878 for single and average measures respectively. Moreover, item analysis in terms of difficulty index, discrimination index, and distractor efficiency agreed with the published standards. Based on these findings, the study recommends the use of developed and validated kinematics graphs concept inventory by physics educators in both research and classroom instructions in the Tanzanian context.
Development of Online Local History Learning Media Based on Virtual Field Trips to Enhance the Use of Primary Source Evidence
history learning use primary source evidence skill virtual field trip...
It is important for students who learn history to have the skills to think, read and analyze historical sources because past events can only be reconstructed and understood from these numerous resources. Various media methods are needed to support the development of these skills, especially in online learning. Therefore, this research aims to create a virtual field trip (VFT) based history learning media to help students improve their thinking skills using primary source evidence. It was carried out by using the research and development (R&D) method consisting of four stages, namely analysis, designs, conducting trials, and testing media effectiveness. The sample subjects consisted of six teams as expert validators, seven history teachers, 70 and 280 Class X students who assessed the product's practicality and determined the developed media's effectiveness. Data were collected through expert validation, student and teacher response questionnaire sheets, as well as description exams. The level of validity and practicality of the medium were determined using descriptive analysis, while the N-Gain approach evaluated the media's effectiveness. The expert validation result is very good, with an average score of 3.77. The teacher and student response tests showed an average score of 4.67, indicating that the VFT medium is practical for learning history. The N-Gain value of 72% showed that the students' abilities to use primary source evidence are increasing. Therefore, using VFT based history classes to develop explanation skills using primary source evidence is feasible, practical, and useful.
Numerical Ratings and Content Labeling of Speeches in an Educational Public Speaking Program
evaluations public speaking rhetoric speeches...
Education in public speaking often relies largely on qualitative feedback. In this study, we explored how a numerical feedback form based on a validated scale could be used in an educational public speaking program. Data were collected at three clubs of Toastmasters International. Speech content was labeled to enable statistical analysis of correlations between speech content and audience ratings. 216 speeches by 59 speakers were evaluated by audience members, providing 1416 individual evaluations. All rating categories correlated strongly with each other. Speeches mentioning relationships, personal stories and positive emotions were rated more favorably. Speeches given in-person were rated more highly in several dimensions compared to speeches given through online video. There were some sex differences in choice of content and emotional expressiveness, but not in audience ratings of speech quality. Overall, the study found that the method was useful for both providing individual feedback and aggregated data for research purposes.
Constructive Cognitive Assessment of Learning in a Course on the Computational Cognition in Psychology Students
academic learning cognitive evaluation mental representation of knowledge natural semantic networks...
Learning evaluation is a complex task, and this study illustrates the Constructive Assessment of Learning as a complementary alternative to evaluate the computational cognition schema construction. The authors designed a mental representational task under the Chronometric Constructive Cognitive Learning Evaluation Model. Control and experimental groups performed a conceptual definition task based on the Natural Semantic Network technique (NSN). They defined ten target concepts related to computational cognition theory, using verbs, nouns, and adjectives as definers. Afterward, the participants rated the conceptual quality of each definer one by one, on a scale of one to ten; the higher the rating, the greater the quality of the definer to define the target concept. The results indicate that the NSN technique was sensitive to measuring and discriminating cognitive changes in knowledge structures produced by the specific learning of computational cognition theory. In contrast, the learning of broad psychology subjects produced general cognitive changes without organization related to the specific learning of the evaluated course. Data showed more sophisticated cognitive change patterns on the evaluated schema in the experimental group than in the control group. The findings of this study suggest that cognitive assessment techniques can be helpful in the formative assessment of learning and provide clear indicators of students' knowledge management skills.
Evaluation of Preservice Teachers’ Performance in School through Video Observations during the COVID-19 Pandemic
observation preservice teachers rubrics student evaluation teacher education...
Lesson study, observation and analysis are relevant to professional development and initial teacher education. As a strategy, it helps to bridge the gap between theory and practice. The health conditions brought on by the COVID-19 pandemic forced the restriction of the tutors’ direct observation of preservice teachers at school. This study analyses preservice teachers’ performance through video observations to evaluate their professional activity at school during the COVID-19 pandemic. The Fifteen Items Revised Tsang-Hester Observation Rubric (FIR-THOR) was administered to a sample of 166 preservice teachers in their internship schools and their video recordings each one of 45-minute teaching lessons were analysed. The results show that the FIR-THOR appears as a robust instrument, which allows us to conclude that the instrument works well in the three five-items dimensions that compose it - Instruction, Management, and Assessment - proving to be reliable for assessing teacher intervention in the classroom. Among the three dimensions, the preservice teachers’ performance stands out in the Management of the classroom, as well as in the classroom Instruction. This contribution is relevant considering the potential of lesson analysis in learning and professional development during initial teacher training.
How Students Generate Patterns in Learning Algebra? A Focus on Functional Thinking in Secondary School Students
functional relationships functional thinking generalization learning algebra...
This research aims to describe secondary school students' functional thinking in generating patterns in learning algebra, particularly in solving mathematical word problems. In addressing this aim, a phenomenological approach was conducted to investigate the meaning of functional relationships provided by students. The data were collected from 39 ninth graders (13-14 years old) through a written test about generating patterns in linear functions. The following steps were conducting interviews with ten representative students to get detailed information about their answers to the written test. All students' responses were then analyzed using the thematic analysis software ATLAS.ti. The findings illustrate that students employed two types of approaches in solving the problem: recursive patterns and correspondence. Students favored the recursive patterns approach in identifying the pattern. They provided arithmetic computation by counting term-to-term but could not represent generalities with algebraic symbols. Meanwhile, students evidenced for correspondence managed to observe the relation between two variables and create the symbolic representation to express the generality. The study concludes that these differences exist due to their focus on identifying patterns: the recursive pattern students tend to see the changes in one variable, whereas the correspondence ones relate to the corresponding pair of variables.
The Use of Mathematics Comics to Develop Logical-Mathematical Intelligence for Junior High School Students
logical-mathematical intelligence mathematics comics rural school students urban school students...
Logical-mathematical intelligence is highly needed to ease students’ understanding of mathematics concepts. Therefore, it is necessary to delivery an innovative teaching approach to enhance students’ logical-mathematical intelligence. This study aims to investigate the use of mathematics comics to increase the logical-mathematical intelligence of junior high school students in urban and rural schools. This study employed a quantitative approach with a pretest-posttest control group design. The population of this study were seventh-grade students from a junior high school in Banda Aceh (urban areas) and a junior high school in Aceh Besar (rural areas), Indonesia. The samples of this study were two classes (experimental and control) from each school which were selected randomly. To collect data, we used a logical-mathematical intelligence test and analyzed it by using t-test. This study shows that the use of mathematical comics in urban schools can improve mathematical logical intelligence. However, there was no improvement in students' mathematical logical intelligence in rural schools. Therefore, this study showed that using mathematics comics in different school conditions yield different results in logical-mathematical intelligence. The findings suggest that other learning innovations are required to improve students' logical-mathematical intelligence in rural areas.
Design Thinking as a Co-Creation Methodology in Higher Education. A Perspective on the Development of Teamwork and Skill Cultivation
co-creation design thinking methodology skills teamwork university students...
Graduates of higher education need, in addition to knowledge, skills such as cooperation, communication, and problem-solving to cope with their working life. Collaborative learning environments like co-creation, are gaining attention for their ability to cultivate these essential skills. This study aims to investigate the understanding and efficacy of co-creation from the perspective of 145 undergraduate students enrolled in a physics course, using a questionnaire. Design thinking, using the double-diamond model, is applied as the co-creation methodology. The study examines the effects of co-creation and design thinking on teamwork and the development of skills. The study also discusses the differences in co-creation, design thinking, teamwork, and skill development among various demographics, previous co-creation experiences, and teaching methods. The findings demonstrate that the majority of students understand the concepts of co-creation and design thinking, and that their co-creation teams functioned satisfactorily, leading to the development of necessary skills. However, increasing age seems to be an inhibiting factor. Finally, the study shows that students who prefer co-creation as a teaching method or have previous co-creation experiences are more receptive to this approach.
The Factors Influencing Digital Literacy Practice in Vocational Education: A Structural Equation Modeling Approach
digital literacy practice pls-sem teacher readiness vocational education...
In the future, vocational students will face all changes and developments in technology and information. In this context, students' digital literacy skills need to be trained to adapt to the demands of the world of work. This article aims to present the results of a study on factors that can improve the digital literacy practice for vocational students as a roadmap for digital learning in the current era. The sampling technique used purposive random sampling of 8 Vocational Schools in East Java Province, Indonesia. The number of respondents in this study amounted to 355 second-year students. The study has found that online learning, motivation, and technology introduction are influenced by students' digital literacy practices, while teacher readiness and infrastructure must be mediated by online learning. The findings in this study indicate that collaboration from various parties is needed from teachers, school administrators, and policymakers in planning learning that focuses on students' digital abilities.
The Effect of Character Teaching on College Student Social-Emotional Character Development: A Case in Indonesia
character teaching college student socioemotional development...
This study aimed to investigate the effect of character teaching on college student socioemotional character development. The study was conducted at IAIN Pontianak, Universitas Tanjungpura and Universitas Muhammadiyah Pontianak. The sample was 1284 students, 388 male and 896 female. Partial least square-structural equation modeling (PLS-SEM) data analysis using SmartPLS was used. The findings reveal that character teaching has a significant and positive effect on college student honesty, prosociality, respect at home, respect at school, self-control, and self-development. This study suggests that colleges/universities ensure that lecturers supervise student assignments, seriousness and discipline, check students’ attendance strictly, give course assessment samples, and grade their assignments on schedule. At the end of the conclusion, implications and suggestions are given.