' instrument development' Search Results
Critical Incidents: Exploring EFL Prospective Teachers’ Teaching Experiences
reflective practice critical incident teaching experience continuing professional development...
Investigating critical incidents is one way to assist prospective teachers in expressing any developmental stage when accomplishing the teaching practice program. It is a significant component of reflective teaching in an educational framework related to continuing professional development (CPD), particularly self-directed learning. This study aims at exploring EFL prospective teachers’ field experience in cultivating their teaching competence through a critical incident analysis. A qualitative approach was applied. Three participants with different levels of English proficiency took part in this study by sharing their experiences through participating in and answering an interview and an opinionnaire. To analyze the data from the instruments, this study used descriptive analysis and coding techniques respectively. Results indicate that both negative and positive critical incidents contribute to the participants’ teaching development. The incidents support the learning process towards becoming a teacher and assist shaping their awareness of teacher identity. Further, the result of this study reveals that English proficiency level seems to take part in the strategy used for identifying critical incidents. This study implies that critical incidents provide a chance for prospective teachers to be more reflective. Thus, teacher education program stakeholders need to support critical incident analysis by giving relevant assignments while they are doing teaching practice, which in turn builds professional development in the context of prospective teachers.
Development and Validation of an Instrument to Measure a Performance of Vocational High School
evaluation school performance vocational high school...
Some evaluation has been carried out in Vocational High Schools (VHSs), but most of it focuses on the documents or passive data rather than the processes happening in VHSs. Thus, this research focuses on the evaluation of VHS performances where the process is initiated with identifying the constructs and developing the instruments of performance evaluation for VHSs with Technology and Engineering expertise programs. Based on the problems found in the field, before conducting the evaluation, the researcher needs to, at first, develop the instrument of evaluation through three stages of development. The first stage is analyzing the concepts related to the evaluation by examining the factors affecting VHS performances. In the second stage, instrument development and instrument analysis (content validation) are conducted with the help of experts. The third stage is performance evaluation in VHSs located in Yogyakarta. The evaluation employs a set of instruments developed by the researchers. This research has produced a set of instruments for performance evaluation, which can be used extensively in VHSs. Based on the evaluation, it is found that the aspects of general management and academic management of the VHSs being studied are considered “Good”.
HOTSEP: Revised Anderson’s Taxonomy in Environmental Learning of COVID-19
covid-19 environmental learning hotsep...
Environmental learning in the 21st century requires a high level of thinking ability, especially to solve environmental problems when COVID-19 pandemic. This was to develop a new level of thinking, namely Higher Order Thinking Skills of Environmental Problem (HOTSEP) which is a revision of Anderson's Taxonomy. The purpose of this study was to measure students HOTSEP in the context of environmental problems related to COVID-19. The research method used in this research was descriptive. The sample used 277 university students from several cities in Indonesia. The instrument used HOTSEP which has 3 categories of thinking level start from develop innovation about environment (C6), solve environmental problem (C5), criticize environmental problem (C4). The results showed that students HOTSEP were still in the very low category (33.64). This study concludes that the HOTSEP of students was still low and needs to be improved to the understanding of COVID-19 concept in environmental learning. Suggestion for further research was HOTSEP need to implement in school or university for several environmental learning topics in many subjects/courses start from Natural Science, Social Science, Engineering, and others relevant subject. HOTSEP can be measured not only in school or university, HOTSEP can be implement in community and public.
Development of Interactive Multimedia Learning Courseware to Strengthen Students’ Character
interactive multimedia observational learning national historical event character...
The development of information technology rapidly has an impact on the changing paradigm of education. On the other hand, education holds an important responsibility to create students who have a good and strong character. This research aims to: 1) describe the concept and framework of interactive multimedia courseware; 2) test the feasibility of interactive multimedia courseware by experts and practitioners; 3) test student responses to the use of interactive multimedia courseware. This research and development involved experts, teachers, and students. The data were collected using expert validation sheets, teacher questionnaires, and student questionnaires. They were then analyzed using the descriptive statistics analysis based on mean and percentage. This research yielded interactive multimedia courseware called IMONEC (Interactive Multimedia courseware integrated with Bandura’s Observational learning model and National historical Event to strengthen students' Character) that integrates three important components: the principles of interactive multimedia learning; Bandura's observational learning model; and the noble values and messages of national historical events to strengthen students' characters. The framework of the interactive multimedia courseware consists of the title, user instruction, home, core competency and basic competency, concept map of material, learning material, and quizzes. The results of the expert validation, teacher questionnaire, and student questionnaire showed that the interactive multimedia courseware is feasible for use in learning and effective in strengthening students’ characters.
Research-Oriented Framework of Training Philology Students’ Research Skills Based on Corpus Analytical Software
higher education tertiary students majoring in philology research-oriented approach technologisation of the research-oriented approach text-analysis-purpose software...
The purpose of the study was to explore how technological advances incorporated into the Philology Studies curriculum could impact the students’ research skills and the quality of their research projects and what students’ and teachers’ impressions of the reshaped research component of the curriculum were. The study used qualitative and quantitative methods with the dominance of qualitative methods. It employed the baseline study, checklist to assess students’ research papers, assessment criteria, and the Triangular Assessment Method to assess the students’ papers. The consensus meeting was held to allow the experts to express their reasoning for the scores. The semi-structured interview was administered to the students’ and teachers’ to identify their impressions of the reshaped research component of the curriculum of philology. The technological advances incorporated into Philology Studies curriculum improve the students’ research skills and the quality of their research projects. Both students and teachers appreciated the reshaped research component of the curriculum. The analytical software can be successfully incorporated in the corpus analysis-purpose student research. The students found the intervention a challenging experience that ‘pumped up’ their intellectual, research, and technical skills. They reported improvement in interpreting corpus using correlations, frequencies, distributions, and collecting information using software to organise it in a professional way. The lecturers agreed that the technology-based instructional model incorporated into Philology Studies curriculum improved both students’ research skills and the quality of their research projects.
Arguments for Construct Validity of the Self-Efficacy Beliefs of Interdisciplinary Science Teaching (SElf-ST) Instrument
self-efficacy belief science education teacher education construct validity self-rated content knowledge...
Current research on self-efficacy beliefs of interdisciplinary science teaching indicates shortcomings in facing recent teaching challenges in secondary education and corresponding valid instruments. Thus, we designed the Self-Efficacy Beliefs of Interdisciplinary Science Teaching (SElf-ST) instrument based on a pedagogical content knowledge model for science teaching. We ensured the factorial validity of ten factors. To bring construct validity down to a round figure, we examined convergent and divergent validity in this paper. For answering the overall research question regarding arguments for the convergent and divergent validity of the interpretation of the SElf-ST instrument’s test values (and related hypotheses), we analyzed data of pre-service, trainee, and in-service biology, chemistry, and physics teachers (n = 590) in a cross-sectional study. While the strong latent correlations of the ten SElf-ST factors with self-efficacy beliefs of interdisciplinary science teaching in primary education (r = 0.40 – 0.63, p < 0.01) indicate convergent validity, the rather weak correlations with self-efficacy beliefs of general teaching (r = 0.17 – 0.54, p < 0.01), self-rated content knowledge in science (r = 0.13 – 0.40, p < 0.01), and perceived stress (r = -0.13 – -0.19, p < 0.01) support different divergent validity intensities. Thus, assumed relations within the nomological net surrounding the self-efficacy beliefs of interdisciplinary science teaching construct were confirmed for secondary education. In sum, we shed light on a rarely explored aspect of construct validity in science education research regarding self-efficacy beliefs. Doing so, we gained strong arguments that the SElf-ST instrument’s test values can serve as indicators of self-efficacy beliefs of interdisciplinary science teaching in secondary education.
Implementation of Authentic Assessment on Mathematics Teaching: Study on Junior High School Teachers
authentic assessment junior high school mathematics learning mathematics teachers...
This study aimed at analyzing the implementation of authentic assessments and constraints faced by junior high schools' teachers in mathematics teaching. A qualitative approach was applied in the study. The data on the implementation of authentic assessments and constraints were obtained from 50 mathematics teachers in several public junior high schools in Malang City, East Java Province-Indonesia, trained by the 2013 curriculum. Documentation, questionnaires, observations, and interviews were used to collect the data. The study results showed that most teachers implemented authentic assessments in mathematics teaching as designed in the learning plan. The obstacles faced by the teachers in the implementation of the authentic assessment included the time limit and accuracy. The efforts made by the teachers varied, but the teachers tried to administer the authentic assessment properly following the demands of the curriculum.
Students’ Perceptions of an Intervention Course Designed to Raise Science-Related Career Awareness
career-based teaching-learning module (c-tlm) learning environment attributes relevance science-related career awareness...
This longitudinal study focuses on evaluating grade 7-9 school students’ perceptions of intervention modules intended to be relevant, as well as promoting learning attributes to raise awareness of science-related careers. Students are taught through six purposely developed and designed career-related teaching–learning modules (C-TLMs). Each module is initiated by means of a career-related scenario, followed up by promoting conceptual science learning plus drawing attention to careers to which each module intends to relate. Student perceptions are obtained by means of a questionnaire after each module with respect to its relevance and also the mean by which the learning environment raise interest, enjoyment and motivation associated with career awareness. Outcomes show that, in general, students participating in this study agree that the developed C-TLMs are relevant and students value the learning experienced through the different module contexts. Nevertheless, student appreciation of the specific inclusion of career awareness components in the modules is mixed.
Effects of Democratic Parenting and Teaching Activities on High School Students’ Global Citizenship: A Multilevel Structural Equation Model with Student Factors as Mediators
global citizenship democratic parenting teaching activities political attitude determination...
The objectives of this research included to study the effects of democratic parenting and teaching activities on global citizenship according to logical reasoning in making decisions on political attitudes among 2,286 students from 80 classrooms. The research instruments included 1) a set of rating- scale questionnaires for students with 92 items, having the reliability as 0.968 and 2) a set of rating- scale questionnaires for teachers with 23 items, having the reliability as 0.893. The results of the multilevel structural equation model analysis revealed that the factor of political attitudes was the most important in describing each student's global citizenship with the explanation of the variance with democratic parenting and the analysis of applying the reasons in students’ decisions was as 68.50%. Teaching activities affected positively on global citizenship both directly and indirectly through statistically significant factors with and together explained the variance of the global citizenship of each student by 84.00%. These findings highlight the importance of developing and fostering political attitudes that affect students' global citizenship through parenting and teaching activities covering the development of relevant factors as discussed in the Discussion and Implementation Part.
The Effects of MANSA Historical Board Game toward the Students’ Creativity and Learning Outcomes on Historical Subjects
board game creativity history learning outcomes project-based learning...
The constraints of history learning in the Indonesia curriculum are the weekly time is only one hour of lessons and the material is quite dense, if delivered with an explanation and discussion the time is not enough. Therefore, it was sought how to get all material delivered and students not bored. Learning this model is done to condition students as a center of learning, increase creativity and learning outcomes, the project undertaken is called the MANSA Historical board game (MANSA is taken from the abbreviation of our school name). In this case, students are asked to create, design their own board game on a different topic for each group. This study aims to determine the differences in learning outcomes and creativity between the control class and the experimental class of students at senior high schools in Salatiga, Indonesia. The research model used is quasi-experimental. The respondents of the research were 35 students in the experimental class and 35 students in the control class, who had the same homogeneity in creativity and learning outcomes. The results showed that the MANSA Historical board game had a significant effect on creativity and student learning outcomes. It is proven that creativity and student-learning outcomes can be increased. As shown by the mean different test results, there was a difference in the creativity of 0.593 and a learning outcome of 4.224 between the control class and the experimental class before and after treatment. The results showed a difference in learning outcomes between the control class and the experimental class. The average learning outcomes of the experimental class are higher than the average learning outcomes of the control class, as well as student creativity.
Development of Web-based Application for Teacher Candidate Competence Instruments: Preparing Professional Teachers in the IR 4.0 Era
instrument application ir 40 pedagogy professional social personality...
This research aimed to develop a web-based application for teacher candidate competence instruments to prepare professional teachers in the Industrial Revolution 4.0 (IR 4.0) era. Teacher candidate competencies consist of pedagogical, professional, social, and personality competences. This is a research and development with 8 stages, involving the development of instrument grids/ construct, focus group discussions, instrument item development, instrument validation, manual instrument testing, application development, application assessment by experts, application trial, and final revision of the application. The initial focus group discussions involved 9 experts, while the instrument validation involved 35 experts consisting of 21 experts for pedagogical and professional competences, 7 experts for social competences, 7 experts for the personality competences, and 4 media experts. The trial involved a total of 107 Mathematics, Indonesian, and English student teacher candidates. Expert validation was analyzed using the Aiken formula; application effectiveness and readability were described based on expert judgment, and discrimination tests on the results of social and personality competence tests between the study programs used the Multivariate Analysis of Variants. The results showed that there were no differences in social and personality competences between Mathematics, Indonesian, and English prospective teachers. The developed instruments for pedagogical, professional, personality, and social competences were deemed valid. The application has met the readability aspect and is scored well by experts with an average assessment rating of .78. These results suggest that the application can be used by the government as a solution to assess teacher candidate competences in the IR 4.0 era.
Science KIT Teaching Aid for the Earthquake in Improving Students’ Collaboration Skills and Creative Thinking in Junior High School
science kit earthquake creative thinking collaboration skills teaching aid...
This study aims to determine the effectiveness of the IPA KIT teaching aids for earthquakes science KIT in improving students' collaboration skills and creative thinking. The design of this research is a quasi-experimental research with a stratified random sampling technique. This study involved two classes, namely the experimental class (n = 32) and the control class (n = 33) with a pretest-posttest control group design. This research was conducted at SMP Negeri 5 Depok. The statistical analysis used to test the research hypothesis based on the pretest and posttest scores is the normality test, linearity test, homogeneity test, correlation test, effect size, and MANOVA test. The results showed that the use of IPA KIT teaching aids for earthquakes was more effective in improving students' creative thinking skills and collaboration. Therefore, teachers are advised to use the earthquake science KIT teaching aids for earthquakes to improve the creative thinking skills and collaboration of junior high school students.
A Critical Thinking Assessment Model Integrated with Science Process Skills on Chemistry for Senior High School
assessment model critical thinking science process skills...
Every school should be able to equip students to have the ability to integrate the knowledge gained with real life in responding to global challenges. Assessment of learning outcomes in the form of cognitive and skill aspects must go hand in hand. This study aims to produce: (1) a critical thinking model integrated with the science process, (2) construct validity and reliability instruments that measure the integrated critical thinking skills of science process skills in high school chemistry learning. This assessment model uses the Design and Development approach which refers to the Ellis & Levy model, namely: (1) problem (2) goal setting, (3) model design and development, (4) model testing, (5) evaluation of the test result model, and (6) application model. The validity assessment consisted of 3 measurement and measurement experts, 2 chemistry education experts, and 2 treatments. The trial sample described 289 high school students in Sleman Regency. Proving the validity of the content using the Aiken formula gets a value of 0.923 in the good category. Internal instrument reliability is included in the reliable category with a value of 0.886 (> 0.7), while the Composite Reliability ranges from 0.88 to 0.90. Confirmatory factor analysis showed that the value of the Root Mean Square Error of Approximation (RMSEA) was 0.021 <0.08, the Chi-Square obtained from <2df testing was 38.29 <2 (34) and the Goodness of fit Index (GFI) was 0.97. > 0.90 or a model declared according to the data obtained in the field and can be used in extensive measurements.
Adaptation of the Epistemological Belief Scale to Kosovo
epistemological beliefs epistemological beliefs scale scale adaptation linguistic validity...
The investigation of epistemological beliefs has become important in both pre-service and in-service education of teachers. Different scales have been developed to determine teachers’ epistemological beliefs. The same scale yields different results in different cultures especially due to the cultural aspects of education. Therefore, testing the scales in different cultures contributes to their use. Within this framework, the scale developed by Schommer and adapted to Turkish culture by Deryakulu and Büyüköztürk was adapted to Kosovo culture. In the study, whether the Albanian, Bosnian and Turkish versions of the scale support the same factor structure was tested by employing the quantitative research method. First, the Epistemological Belief Scale was translated into Albanian and Bosnian and expert opinion was received. The scale was applied to 200 teachers who serve in schools where education languages are Albanian, Bosnian and Turkish. The scale comprised 35 items and 3 factors. Linguistic equivalence was prioritized, as the study was carried out in Kosovo. The Confirmatory Factor Analysis was employed to confirm the suitability of the three-factor structure of the scale. The analyses were carried out separately for each language and revealed acceptable fit indices. Reliability analysis produced satisfactory results.
Changes in Online Distance Learning Behaviour of University Students during the Coronavirus Disease 2019 Outbreak, and development of the Model of Forced Distance Online Learning Preferences
higher education online distance learning continuance preferences covid-19 outbreak...
Because of the Coronavirus Disease 2019 (COVID-19) outbreak, most universities were forced to choose Online Distance Learning (ODL). The study aimed to examine the response of university students to the new situation. A questionnaire was sent to the entire university student population. Based on responses from 606 students, it was revealed that use of all applications in ODL increased. However, only the use of MS Teams increased significantly, while the use of the other applications (email, Moodle, e-textbooks) increased in a range of low to medium in terms of effect sizes, and even nonsignificant for applications such as Padlet and Kahoot. Based on the replies of 414 respondents, a Model of Forced Distance Online Learning Preferences (MoFDOLP) based on Structural Equation Modeling was developed. With a chosen combination of predictors, we succeeded in predicting 95% of variance for Satisfaction, more than 50% for Continuance Preferences variance in MS Teams applications, and nearly 20% in the case of e-materials. Among hypothesized constructs, only Attitudes are a strong predictor of Satisfaction, while Organizational Support, Perceived Ease of Use and Learner Attitude toward Online Learning are not. Satisfaction is a good predictor of Continuance Preferences to use Information Technology after the lockdown ended.
Strategies for Parental Involvement during Emergency Remote Teaching Scale: Its Psychometric Properties
emergency remote teaching home and school collaboration parental involvement epstein's typology...
Recently, Emergency Remote Teaching (ERT) has caused a considerable interest in the school community due to the wide-scale lockdown brought about by the COVID-19 pandemic. The curriculum's alteration necessitated a call to explore mechanisms for effective remote instruction delivery—including parental involvement. This research determined the psychometric properties of the "Strategies for Parental Involvement during Emergency Remote Teaching - Scale (SPIERT-S). The tool assesses the strategies used by teachers to facilitate parental involvement during ERT. Through a thorough literature review, 22 items about home and school collaboration and ERT were initially developed. Evidence related to content validity was established through two-round expert consultation, while data related to construct validity were gathered through factor analyses. The content validity analysis resulted in the deletion of four (4) items; hence, 18 items were retained. A three-factor structure was yielded from Exploratory Factor Analysis (parents as facilitators of learning, parents as sources of information, and parents as collaborators), and a total of 15 items were retained. The confirmatory factor analysis indicated an acceptable level of the goodness-of-fit indices measured. The internal consistency of the factors and the whole scale showed excellent reliability. The results suggest that the SPIERT-S has good, valid, and reliable psychometric qualities and can be used to examine the strategies for parental involvement that teachers utilize during emergency remote teaching. Recommendations and limitations of the study are discussed.
Agreement Levels of Kindergarten Principals and Teachers to Determine Teaching Competencies and Performance
agreement level competence kindergarten teacher teaching performance...
This research aimed to analyze the levels of agreement between kindergarten teachers and principals in identifying the assessment of teachers’ teaching competencies and performance. The study was designed under a quantitative approach using a survey. It implemented a non-probability sampling technique with purposive sampling. The sample of the population comprised of 173 kindergarten teachers and 101 principals in Semarang District, Indonesia, or a total of 274 respondents. The data were collected through a questionnaire and analyzed using Cohen’s Kappa coefficient to measure the levels of agreement between raters and Pearson Chi-Square test was also utilized to determine the differences in perceptions among principals and teachers. The findings showed that the levels of agreement between raters were averagely in the no agreement category, implying the existence of differences in perceptions among teachers and principals. The involvement of a multi-rater strategy in such research is a rare effort, especially for the Early Childhood Education (ECE) level in Indonesia. Researches regarding teaching competencies and performance generally only involve single rater, either teachers or principals who judge themselves on their competencies and performance, thus the results tend to be subjective. In conclusion, the assessment of teaching competencies with the relation of cognitive abilities was conducted through a test that considered subjective questions and case analysis to evaluate the teachers’ skills based on their performance and self-description. Both personal and social assessments utilized self-assessment forms or autobiographies, which were completed with specific themes. Meanwhile, the performance assessment was observed with the assessment rubric and comparison with the learning process performed by an individual educator.
Fostering Artistic Reflection Skills in Student Pre-School Educators Seen as Artistic Competence Development
artistic reflection higher education student pre-school educators technology of artistic reflection and image creation...
The purpose of the study is to identify how the instructional model influences students’ reflective disposition and how the students perceived the intervention. The study addressed the research questions through the ‘Artistic Reflection Scale’ for student pre-school educators that consisted of four domains such as students’ observation skills, critical analysis skills, evaluation skills, and the occupation application of artistic reflection, and the course satisfaction questionnaire. The study found that the technology of artistic reflection and image creation was effective in fostering students’ artistic reflective thinking comprising observation skills, critical analysis, their art output evaluation skills with a focus on sharing their reflective experience with the preschoolers. The artistic reflection scale was proved to be a reliable instrument in measuring students’ reflective thinking skills. The study found a change in the artistic reflective skills of the experimental group students was substantially greater than in the students of the control group. After the intervention, there was a shift from the basic level of artistic reflection to the higher levels in the experimental group students, and the proportion of the students being at this stage reduced, while the other proportions increased.
Assessment of the Validity and Reliability of Mental Health Instruments of High School Student in Indonesia
validity reliability mental health item measurement adolescence indonesia...
This study aims to develop a standard instrument for measuring mental health among urban adolescents in Indonesia. The objective is to produce valid and reliable school adolescent mental health instruments to be used by agencies or schools to identify students' mental health. The survey was conducted in Jakarta and South Tangerang with a total of 1007 respondents divided into two experiments where the first trial was conducted on 597 students and the second trial was conducted on 410 students. Measurements were made using a Likert scale questionnaire. Instrument testing begins with a theoretical validity test by 4 experts and 20 panelists who test the instrument material in terms of construction, content and language. Experts analyze and correct the instrument qualitatively. The instrument was then reviewed and analyzed quantitatively by panelists using the Aiken index. At this stage, 44 items, 9 indicators and 3 variable dimensions were obtained. The next test is done by testing the validity empirically, by analyzing the measurement model using Confirmatory Factor Analysis (CFA) with the LISREL 8.80 Full Version program. By using the criteria for the SLF value ≥0.30 and t-value ≥1.96, and calculating the reliability with the construct reliability (CR) at the level> 0.70, the results of the second trial showed that 35 items were valid. The observations of the model fitness through Goodness-of-Fit test showed that there is a fitness between the theoretical model and the empirical model for the mental health instruments in this study.
When Prospective Biology Teachers Visualize their Beliefs about Teaching and Learning by Drawing it, is it more than a Reproduction of their Experienced School Lessons?
teacher beliefs constructivism teacher-centered science teacher education prospective biology teachers...
Professional teaching competence is significantly influenced by beliefs about teaching and learning. Prospective teachers start their teacher training with quite persistent beliefs about learning processes. These beliefs are mainly influenced by the way they experienced their own lessons as a student at school. Previous biology lessons at school might be linked to the imagined biology lessons of prospective teachers. We interpret these future lessons as a representation of their beliefs about teaching and learning. The present study investigated how prospective teachers remembered their previous biology lessons as well as how they imagine the lessons they will conduct in the future. The drawings of 181 prospective biology teachers in Germany (Mage = 22.1; SD = 3.6; 64.1 % female) were analyzed using the Draw-a-Science-Teacher-Test Checklist (DASTT-C). Results of the study indicate that the lessons they experienced were mainly teacher-centered, whereas the lessons they imagined were mainly student-centered. Results of a chi-square-test indicate that there is no connection between these two drawings of biology lessons. This suggests that experiences from one’s own schooling may have no connection with the way prospective teachers would like to teach in the future. The results of this study might be used as a basis for further studies examining the development of prospective biology teachers’ beliefs about teaching and learning.