'instruments' Search Results
Strategies for Parental Involvement during Emergency Remote Teaching Scale: Its Psychometric Properties
emergency remote teaching home and school collaboration parental involvement epstein's typology...
Recently, Emergency Remote Teaching (ERT) has caused a considerable interest in the school community due to the wide-scale lockdown brought about by the COVID-19 pandemic. The curriculum's alteration necessitated a call to explore mechanisms for effective remote instruction delivery—including parental involvement. This research determined the psychometric properties of the "Strategies for Parental Involvement during Emergency Remote Teaching - Scale (SPIERT-S). The tool assesses the strategies used by teachers to facilitate parental involvement during ERT. Through a thorough literature review, 22 items about home and school collaboration and ERT were initially developed. Evidence related to content validity was established through two-round expert consultation, while data related to construct validity were gathered through factor analyses. The content validity analysis resulted in the deletion of four (4) items; hence, 18 items were retained. A three-factor structure was yielded from Exploratory Factor Analysis (parents as facilitators of learning, parents as sources of information, and parents as collaborators), and a total of 15 items were retained. The confirmatory factor analysis indicated an acceptable level of the goodness-of-fit indices measured. The internal consistency of the factors and the whole scale showed excellent reliability. The results suggest that the SPIERT-S has good, valid, and reliable psychometric qualities and can be used to examine the strategies for parental involvement that teachers utilize during emergency remote teaching. Recommendations and limitations of the study are discussed.
Agreement Levels of Kindergarten Principals and Teachers to Determine Teaching Competencies and Performance
agreement level competence kindergarten teacher teaching performance...
This research aimed to analyze the levels of agreement between kindergarten teachers and principals in identifying the assessment of teachers’ teaching competencies and performance. The study was designed under a quantitative approach using a survey. It implemented a non-probability sampling technique with purposive sampling. The sample of the population comprised of 173 kindergarten teachers and 101 principals in Semarang District, Indonesia, or a total of 274 respondents. The data were collected through a questionnaire and analyzed using Cohen’s Kappa coefficient to measure the levels of agreement between raters and Pearson Chi-Square test was also utilized to determine the differences in perceptions among principals and teachers. The findings showed that the levels of agreement between raters were averagely in the no agreement category, implying the existence of differences in perceptions among teachers and principals. The involvement of a multi-rater strategy in such research is a rare effort, especially for the Early Childhood Education (ECE) level in Indonesia. Researches regarding teaching competencies and performance generally only involve single rater, either teachers or principals who judge themselves on their competencies and performance, thus the results tend to be subjective. In conclusion, the assessment of teaching competencies with the relation of cognitive abilities was conducted through a test that considered subjective questions and case analysis to evaluate the teachers’ skills based on their performance and self-description. Both personal and social assessments utilized self-assessment forms or autobiographies, which were completed with specific themes. Meanwhile, the performance assessment was observed with the assessment rubric and comparison with the learning process performed by an individual educator.
Assessment of the Validity and Reliability of Mental Health Instruments of High School Student in Indonesia
validity reliability mental health item measurement adolescence indonesia...
This study aims to develop a standard instrument for measuring mental health among urban adolescents in Indonesia. The objective is to produce valid and reliable school adolescent mental health instruments to be used by agencies or schools to identify students' mental health. The survey was conducted in Jakarta and South Tangerang with a total of 1007 respondents divided into two experiments where the first trial was conducted on 597 students and the second trial was conducted on 410 students. Measurements were made using a Likert scale questionnaire. Instrument testing begins with a theoretical validity test by 4 experts and 20 panelists who test the instrument material in terms of construction, content and language. Experts analyze and correct the instrument qualitatively. The instrument was then reviewed and analyzed quantitatively by panelists using the Aiken index. At this stage, 44 items, 9 indicators and 3 variable dimensions were obtained. The next test is done by testing the validity empirically, by analyzing the measurement model using Confirmatory Factor Analysis (CFA) with the LISREL 8.80 Full Version program. By using the criteria for the SLF value ≥0.30 and t-value ≥1.96, and calculating the reliability with the construct reliability (CR) at the level> 0.70, the results of the second trial showed that 35 items were valid. The observations of the model fitness through Goodness-of-Fit test showed that there is a fitness between the theoretical model and the empirical model for the mental health instruments in this study.
Exploring Students’ Learning Strategies and Self-Regulated Learning in Solving Mathematical Higher-Order Thinking Problems
learning strategies srl hots metacognitive question misconceptions...
Considering the low achievement of Indonesian students in international studies (PISA), which measures Higher-Order Thinking Skill (HOTS) in solving the problem, improving the quality of mathematics learning in Indonesia is very important. The purpose of this research was conducted to explore the variations in students’ learning strategies and students’ Self–Regulated Learning (SRL) in solving mathematical HOT problems. The study employed a mixed-method, namely quantitative and qualitative methods were applied through five tests and seven interviews for over eight weeks. Two types of instruments were employed in this study, and they include tests and interviews. At the initial stage, we randomly selected 30 students from all those in grade 10 (Senior High School ), after which 12 were chosen purposively after the pre-test for an interview, having satisfied all complete group, middle group, and lower group. All of them were treated using metacognitive questions. Data analysis techniques used were percentage, data reduction, presentation, and conclusion. The quantitative results showed the students could generally use orientation, organization, and elaboration learning strategies as observed with 68.3%, 60%, and 56.7% for complete, middle, and lower groups. Moreover, the students were also observed to have conducted three cognitive processes in selecting the rules for solving the mathematical HOT problem, namely using models and drawing, written texts, and combining both. Furthermore, their final solution failures were affected by their misconceptions and errors in creating the mathematical model. The interview results on designing the learning procedures, monitoring the progress, and evaluating the outcomes, show that the students’ SRL level is good for complete (89.3%), middle (75%), and lower groups (60.7%).
When Prospective Biology Teachers Visualize their Beliefs about Teaching and Learning by Drawing it, is it more than a Reproduction of their Experienced School Lessons?
teacher beliefs constructivism teacher-centered science teacher education prospective biology teachers...
Professional teaching competence is significantly influenced by beliefs about teaching and learning. Prospective teachers start their teacher training with quite persistent beliefs about learning processes. These beliefs are mainly influenced by the way they experienced their own lessons as a student at school. Previous biology lessons at school might be linked to the imagined biology lessons of prospective teachers. We interpret these future lessons as a representation of their beliefs about teaching and learning. The present study investigated how prospective teachers remembered their previous biology lessons as well as how they imagine the lessons they will conduct in the future. The drawings of 181 prospective biology teachers in Germany (Mage = 22.1; SD = 3.6; 64.1 % female) were analyzed using the Draw-a-Science-Teacher-Test Checklist (DASTT-C). Results of the study indicate that the lessons they experienced were mainly teacher-centered, whereas the lessons they imagined were mainly student-centered. Results of a chi-square-test indicate that there is no connection between these two drawings of biology lessons. This suggests that experiences from one’s own schooling may have no connection with the way prospective teachers would like to teach in the future. The results of this study might be used as a basis for further studies examining the development of prospective biology teachers’ beliefs about teaching and learning.
Implementation of Four-Tier Multiple-Choice Instruments Based on the Partial Credit Model in Evaluating Students’ Learning Progress
learning progress four-tier change of state of matter partial-credit model...
One of the issues that hinder the students’ learning progress is the inability to construct an epistemological explanation of a scientific phenomenon. Four-tier multiple-choice (hereinafter, 4TMC) instrument and Partial-Credit Model were employed to elaborate on the diagnosis process of the aforementioned problem. This study was to develop and implement the four-tier multiple-choice instrument with Partial-Credit Model to evaluate students’ learning progress in explaining the conceptual change of state of matter. This research applied a development research referring to the test development model by Wilson. The data were obtained through development and validation techniques on 20 4TMC items tested to 427 students. On each item, the study applied diagnostic-summative assessment and certainty response index. The students’ conceptual understanding level was categorized based on the combination of their answer choices; the measurement generated Partial-Credit Model for 1 parameter logistic (IPL) data. Analysis of differences was based on the student level class using Analysis of Variants (One-way ANOVA). This study resulted in 20 valid and reliable 4TMC instruments. The result revealed that the integration of 4TMC test and Partial-Credit Model was effective to be treated as the instrument to measure students’ learning progress. One-way ANOVA test indicated the differences among the students’ competence based on the academic level. On top of that, it was discovered that low-ability students showed slow progress due to the lack of knowledge as well as a misconception in explaining the Concept of Change of State of Matter. All in all, the research regarded that the diagnostic information was necessary for teachers in prospective development of learning strategies and evaluation of science learning.
Self-Regulation and its Relationship to Social Intelligence among College of Education Female Students at Prince Sattam University
self-regulation social intelligence female students college of education prince sattam university...
The current study aimed to identify the level of self-regulation and social intelligence among students of the College of Education at Prince Sattam University in Wadi Al-Dawasir, and to reveal the relationship between self-regulation and social intelligence, as well as the possibility of predicting social intelligence through self-regulation. A sample consisting of (204) female students at the College of Education, Prince Sattam bin Abdulaziz University in Wadi Ad-Dawasir participated in this study. The measurement instruments included two researcher-made scales of self-regulation and social intelligence, and the SPSS program was used for statistical treatments. Results revealed that female students of the College of Education in Wadi Ad-Dawasir, Prince Sattam University, have a high level of self-regulation as well as social intelligence, and that there is a statistically significant positive correlation between the scores of self-regulation and social intelligence among the study sample. In addition, it was found that social intelligence can be predicted through self-regulation. It is possible to benefit from the results of this study in directing university planning officials to the importance of transforming the self-regulation and social intelligence of students into a culture and systematic practice through courses, symposiums and workshops, or integrating them into academic courses.
Probabilistic Thinking Profile of Mathematics Teacher Candidates in Problem Solving based on Self-Regulated Learning
probabilistic thinking problem-solving self-regulated learning...
Many problems in real life are full of uncertainty. Probabilistic thinking is one way to solve this uncertainty problem. The personality abilities that are interesting to examine include how independent the students are in facing probabilistic solutions. For this reason, it is necessary to study the probabilistic thinking profile of prospective mathematics teachers in solving probabilistic problems in terms of learning the self-regulation. The research method used in this research is qualitative research. In this study, the researcher conducted an analysis of students' probabilistic thinking with the scope of the probability material related to the sample space, the probability of events, and the probability of the random variable space. The profile of the level of probabilistic thinking is influenced by cognitive factors in the form of probabilistic knowledge obtained by students and personality in the form of self-regulated learning. Student learning self-regulated influences the mental activity in decision making. By studying the profile of probabilistic thinking, students are better prepare to face uncertainty with various aspects that influence it.
Psychological Capital and Teacher Well-being: The Mediation Role of Coping with Stress
coping with stress mediation analysis psychological capital teacher well-being university teachers...
This study aimed to investigate the mediation role of coping with stress between psychological capital and teacher well-being based on positive psychology, conservation resource, and broaden-and-build theories. Participants in this study were 836 teachers from three clustered, ethnically diverse public universities. Our findings showed that, in line with previous studies, the psychological capital (PsyCap), coping with stress (CWS), and teacher well-being (TWB) dimensions showed the best fit in our data. PsyCap was related positively to TWB (total and dimensions), CWS, coping through withdrawal, and negative coping with acceptance and change. The indirect effect of PsyCap on TWB through coping with stress was fully mediated. PsyCap also positively and directly affected TWB and CWS. Coping through acceptance and change were fully mediated by PsyCap and TWB dimensions, while coping through withdrawal was not. PsyCap directly and positively affected coping with stress (acceptance and change) and negatively affected coping through withdrawal. Future theoretical and practical implications are discussed.
School Health as the Mediator Variable: Determinants of the Principal Instructional Leadership Behavior
instructional leadership school health organizational commitment teacher efficacy and teacher satisfaction...
The primary purpose of this research was to determine the effect of principal instructional leadership behavior on several determinants: organizational commitment, efficacy, and teacher satisfaction through school health. Five instruments that had been used are the principal instructional management rating scale (PIMRS); organizational health inventory for elementary schools (OHI-E); online course questionnaire (OCQ); teacher satisfaction scale (TSS); teacher efficacy scale (TES). All of these instruments had high validity and reliability; with Cronbach’s alpha values of each was PIMRS (.83), OHI-E (.81), OCQ (.80), TSS (.86), and TES (.79). A total of 350 public primary school teachers in Surakarta had been selected as respondents in this study with satisfied random sampling. AMOS software version 6.0 is used to analyze CFA and SEM. The results of SEM analysis to the structural model built by the researcher was good, with Probability = .001; RMSEA = .043; GFI = .941; AGFI = .907; CMIN/DF = 1.522), so the relationship between the variables in the constructs was interpreted; (1) The Principal instructional leadership behavior had a significant direct influence on the school health, (2) The school health parameter had a significant direct influence on organizational commitment, efficacy, and teacher satisfaction, (3) The principal instructional leadership behavior did not have a significant direct effect on organizational commitment, efficacy, and teacher satisfaction through the variables and school health.
Construct Exploration of Teacher Readiness as an Assessor of Vocational High School Competency Test
competency test construct exploration readiness instruments vocational high school...
Teachers who can adapt and be ready for all changes will also be able to provide a balance to increase the competence of vocational high school students. This is also not denied when teachers become assessors in student competency tests. The objectives of this study were to produce an instrument for the readiness of teachers as assessors; to knowing good grain reliability; to know the characteristics of the instrument; and to know the difficulty level of the item. The method used in this research is instrument development. Respondents were vocational school teachers who were candidates for competency test assessors. Data collection techniques using a questionnaire. Analysis of construct validity using Confirmatory Factor Analysis. Reliability using Cronbach’s alpha. Test the instrument items using the Rasch model. The results are the readiness instruments of the vocational teacher as an assessor has 19 indicators that have been grouped into 5 factors with consistency values being in the same construct (proven construct validity). The result of the calculation of the reliability of this instrument is 0.852, which means that the reliability coefficient is high; There are two items, namely numbers 24 and 18 which indicate the absence of a fit item in the overall item fit criteria; At the item difficulty level, items 8 and 6 have a difficulty score of more than 2, while this indicates that items 8 and 6 have a high difficulty level.
Assessments on Vocational Knowledge and Skills: A Content Validity Analysis
assessments content validity analysis i-cvi modified kappa vocational knowledge...
While previous studies on assessments focused on measurement of principles and constructs, existing attention is given to content validation involving vocational education and skills. The emphasis on content validation has prompted a holistic perspective of teaching and learning to demand alternative research approaches. Using evidence of content validity based on expert judgment and assessment items, this paper argues that vocational knowledge and skills could be determined via constructs and construct functions. Content validity analysis was studied in two major phases, namely, through an assessment of an electrical technology course at a Malaysian higher education institution and expert panels’ examination of items. It was found that to increase confidence in providing reliable instruments for future empirical studies, a careful process in item development and content validity analysis was considered important. Therefore, applying these findings on item analysis and expert panels to reflect content validity can enhance the validity of assessment items.
Reading Comprehension Skills: The Effect of Online Flipped Classroom Learning and Student Engagement During the COVID-19 Pandemic
reading comprehension online flipped classroom learning student engagement...
The Coronavirus disease (COVID-19) pandemic outbreak in the Indonesians nowadays, the public education department established the policy of the online education system to all education levels. Most educators employ an online flipped learning method to support the policy. Research aimed to measure the effect of online based-flipped classroom learning between using Microsoft Team and WhatsApp and student engagement on reading comprehension skills. The research approach was a quasi-experimental model with a 2 x 3 factorial pre-test-post-test non-equivalent control group design. The sample of this investigation was early period undergraduates of the management economics study program. Data analysis employed a two-way ANOVA test. The result confirmed that the online flipped learning scheme using Microsoft Team was better than WhatsApp in improving student engagement and reading comprehension skills. We advise English lecturers to apply better online media services, pay attention to the completeness of the learning features and train their competence in implementing distance learning to use compatible synchronous flipped classroom teaching based on internet technologies.
Technology Anxiety and its Impact on E-Learning System Actual Use in Jordan Public Universities during the Coronavirus Disease Pandemic
anxiety covid-19 e-learning self-efficacy...
During the Coronavirus disease (COVID-19) pandemic, universities were obligated to transform from traditional classroom teaching environments to virtual ones. This sudden transformation highlighted the issue of low e-learning system usage amongst instructors of humanity faculties in Jordan's public universities. This study empirically investigated the moderating impact of technology anxiety on the relationship between the instructor's self-efficacy and the e-learning system's actual use to contribute to solving the problem. A survey was distributed to 468 instructors to test the theoretical framework, which yielded 285 valid and complete instruments analyzed using Structural Equation Modeling (SEM). Results showed the positive direct effect of self-efficacy on actual use. Furthermore, the level of technology anxiety moderated the relationship. Instructors with low technology anxiety showed a higher level of e-learning system actual usage than those with a high anxiety level. To improve the use of e-learning systems, top management must understand the fundamental role of compulsory training as the Covid-19 pandemic, and the instructor's confidence must be increased by providing training and support.
The Users’ Experiences in Processing Visual Media for Creative and Online Learning Using Instagram
creative learning creating instagram online learning user experience...
The aims of the recent study were; analyzing the effect of creative and online learning using Instagram on the ability to create new products in the technology and learning media course, and determining the level of users’ experience in processing visual media through the Canva application on android. Quantitative approach with this research was carried out through a quasi-experimental research model because it measured the post-test was applied to 58 students as the respondents in two experimental and control classes. This study used two instruments; the cognitive learning outcome questionnaire according to the subject to get the students’ ability to create new products, and the second instrument was taken from ueq-online.org in the Indonesian version to know the users' experience in processing visual media. The data were analyzed using one-way ANOVA, mean and standard deviation assisted by IBM SPSS Statistics 24.0. The results demonstrated that the effect of creative and online learning using Instagram on the ability to create new products in The Technology and Learning Media course was found significant at 0.028 <0.05 which meant it could be applied well. Meanwhile, the level of users' experience in processing the visual media application Canva on Android had the highest score on the Stimulation scale at 1.59, categorized "Very Good" and the lowest score was on the Novelty scale at 0.93, categorized "Above Average". With the strong creative encouragement to create new products, the students were able to process their own visual media which were tailored to the agreed digital visual designs and were published on Instagram.
A Rasch Analysis of Item Quality of the Chemical Literacy Assessment for Investigating Student’s Chemical Literacy on Chemical Rate Concepts
assessment chemical rate rasch analysis students’ chemical literacy...
Assessment is a topic that continues to be developed in science education research. Assessment evaluates not only students' cognitive abilities but also their thinking skills. Therefore, in this study, an assessment that could measure students' chemical literacy was developed. Chemical literacy is a thinking skill that students must develop as part of their chemistry learning. The goal of this study was to assess item' quality, as well as student’ chemical literacy on the concept of chemical rate. The Rasch model was employed to analyze the data in this study. The results of this study depict that the developed assessment had sufficient reliability and validity to be used to assess students' chemical literacy. Furthermore, the analysis of the students’ responses to the items revealed that many students did not understand or were unaware of the context presented. These findings suggest that students' chemical literacy in the material for the reaction rate is still lacking and needs to be improved. As a result, the teacher's role in assisting students in improving their chemical literacy through chemistry learning is critical.
A Game-Based Learning Activity to Promote Conceptual Understanding of Chordates’ Phylogeny and Self-Efficacy to Learn Evolutionary Biology
chordates game-based learning level of use phylogeny self-efficacy...
Understanding phylogenetic trees representing evolutionary relationships of living organisms is essential in school biology. Traditional instructions based on lectures and textbooks with pictorial presentations have been proven ineffective to promote students’ understanding of the concept. This study, therefore, developed a game-based learning activity called the VERT card game to enhance students’ learning of the phylogenetic taxonomy of chordates. The VERT card game was designed to lay the foundation for different characteristics of chordate classes, as well as to allow students to construct and interpret their evolutionary relationships based on the phylogenetic tree. The effectiveness of the VERT card game was verified by a pre-test and post-test design with 109 middle school students in Thailand. The statistical result revealed that students’ mean scores increased significantly in the post-test, compared to the pre-test, indicating their improved understanding. In addition, after participating in the learning activity, the student participants were found to increase their self-efficacy to learn evolutionary biology statistically. Also, it showed positive views towards the usefulness of the developed card game as a large number of them expressed that they would like to use it for their lesson reviews and wished to have this form of learning activity in other topics in biology.
Exploring the Multicomponent Structure of Acceptance Attitudes in Portuguese Children Using the Modified Chedoke-McMaster Attitudes toward Children with Handicaps scale
children with disabilities attitudes catch confirmatory factor analysis measurement invariance...
Social participation represent one of the major outcomes of inclusive education. Students with additional support needs often encountered negative attitudes of social acceptance exhibited by their typically developing peers hindering their social participation in the educational context. This study explored the multicomponent structure of Portuguese children’s attitudes toward their peers with disabilities using a modified short form of the Chedoke-McMaster Attitudes toward Children with Handicaps scale (CATCH). In particular, this study aimed to (a) determine the factor structure of the CATCH and (b) evaluate the measurement invariance across age and gender. To identify the CATCH factor structure, exploratory and confirmatory factor analyses were conducted on data collected from 1,038 children aged 8–18 years. Analyses revealed that a modified short form of the CATCH consisting of a 20-item measure with a three-factor structure displayed acceptable fit and internal consistency indices. This model proved to be invariant across groups. The Portuguese-modified short form of the CATCH, in which cognitive, affective, and behavioral dimensions are represented, has acceptable psychometric properties and the potential to evaluate the effectiveness of educational programs designed to improve children’s attitudes.
Measuring Self-Regulated Learning in the STEM Framework: A Confirmatory Factor Analysis
confirmatory factor analysis reliability self-regulated learning stem validity...
Within the context of Self-Regulated Learning (SRL), a process of directing oneself to facilitate individual learning more effectively, the SRL instrument development is deemed necessary to measure students’ self-reliance in learning mathematics in the science, technology, engineering, and mathematics (STEM) framework. The research aims to develop and test the validity and reliability of an SRL instrument, namely a 14-item SRL questionnaire accommodating four aspects, namely planning, self-monitoring, self-controlling, and evaluation. The study involved 420 junior high school students in East Java, Central Java, and Yogyakarta Special Region. The results show that the questionnaire was developed as planned and that planning, monitoring, controlling, and evaluating aspects can reflect the SRL variable in a valid, reliable, and significant way supported by each aspect's behavior indicator. The SRL variable theoretical model corresponds (good fit) with the empirical data, and all of the items are likely valid and reliable to assess student's mathematics SRL in the STEM framework. The SRL questionnaire was also found suitable for use by teachers to measure junior high school students’ self-reliance in SRL.
The Academic Buoyancy Scale: Measurement Invariance across Culture and Gender in Egyptian and Omani Undergraduates
academic buoyancy congeneric reliability measurement invariance...
The academic buoyancy scale (ABS) is one of the most widely used instruments for measuring academic buoyancy. To obtain meaningful and valid comparisons across groups using ABS, however, measurement invariance should be ascertained a priori. To that end, we examined its measurement invariance, validity evidence based on relations to other variables, and score reliability using categorical omega across culture and gender among Egyptian and Omani undergraduates. Participants were 345 college students: Egyptian sample (N=191) and Omani sample (N=154). To assess measurement invariance across culture and gender, multiple–group confirmatory factor analysis was performed with four successive invariance models: (a) configural, (b) metric, (c) scalar, and (d) residual. Results revealed that the unidimensional baseline model had adequate fit to the data in the full sample. Moreover, measurement invariance was found to hold across culture but not across gender and consequently the ABS could be used to yield valid cross-cultural comparisons between the Egyptian and Omani students. Conversely, it cannot be used to yield valid inferences related to comparing gender groups within each culture. Validity evidence based on relations to other variables was supported by the significantly moderate correlation between ABS and academic achievement (GPA; r =.435 and r = .457, P < .01) for the Egyptian and Omani samples, respectively. With regard to score reliability, categorical omega coefficients were moderate across both samples. Educational and psychological implications, limitations and suggestions for improving the scale are discussed.