'assessment instrument' Search Results
Assessment of the Validity and Reliability of Mental Health Instruments of High School Student in Indonesia
validity reliability mental health item measurement adolescence indonesia...
This study aims to develop a standard instrument for measuring mental health among urban adolescents in Indonesia. The objective is to produce valid and reliable school adolescent mental health instruments to be used by agencies or schools to identify students' mental health. The survey was conducted in Jakarta and South Tangerang with a total of 1007 respondents divided into two experiments where the first trial was conducted on 597 students and the second trial was conducted on 410 students. Measurements were made using a Likert scale questionnaire. Instrument testing begins with a theoretical validity test by 4 experts and 20 panelists who test the instrument material in terms of construction, content and language. Experts analyze and correct the instrument qualitatively. The instrument was then reviewed and analyzed quantitatively by panelists using the Aiken index. At this stage, 44 items, 9 indicators and 3 variable dimensions were obtained. The next test is done by testing the validity empirically, by analyzing the measurement model using Confirmatory Factor Analysis (CFA) with the LISREL 8.80 Full Version program. By using the criteria for the SLF value ≥0.30 and t-value ≥1.96, and calculating the reliability with the construct reliability (CR) at the level> 0.70, the results of the second trial showed that 35 items were valid. The observations of the model fitness through Goodness-of-Fit test showed that there is a fitness between the theoretical model and the empirical model for the mental health instruments in this study.
Measuring Students' Curiosity Character Using Confirmatory Factor Analysis
students curiosity confirmatory factor analysis...
This study aims to test proving the scale of measuring the character of students' curiosity using confirmatory factor analysis. This study uses a quantitative approach. The sample used was 325 randomly selected participants. The variable examined in this study is the character of curiosity. The curiosity variable is focused on elementary school students. In this study, this variable was measured by four indicators and 16 measuring items. The four indicators include: paying attention, taking notes, asking questions, and comparing. Data collection was carried out by distributing curiosity questionnaires to participants. The data analysis technique used was confirmatory factor analysis. The reliability analysis used was the composite score reliability analysis. The results of the study concluded that the constituent indicators of the latent variables of students' curiosity show that all loading factor values have a significant effect on the latent variables in the first order confirmatory factor analysis (CFA). Meanwhile, in the second order CFA, the variable of curiosity, the biggest contribution was the indicators compare. This student curiosity assessment model has fulfilled the goodness of fit aspect of the model and has been reliable based on construct reliability. This study recommends a scale measuring elementary school students' curiosity.
Is Peer Instruction in Primary School Feasible? : The Case Study in Slovenia
misconceptions in physics and chemistry peer instruction approach primary education science and technology subject...
An evidence-based, interactive teaching method peer instruction (PI) is promoted to support effectiveness over more commonly used teaching methods. Usually it is proposed for the university and upper secondary school. The research reports on the implementation of the PI approach in teaching subject Science and Technology (S&T) in the 4th grade of primary school. The aim of this research was to verify the feasibility of this approach for much younger students in primary school by evaluating the students’ progress in the subject S&T, identifying the differences in individual progress in relation to students’ general learning success, and determining students’ opinions about the approach and where no desired progress has been made. In a selected Slovenian primary school, a classroom with 26 students (age 9 – 10) was included in the study and 5 different content areas (Earth’s motion, Matter, Magnetism, Forces and motion, and Electricity) were taught using this PI approach. Results show that students made progress in all content areas and no differences were identified in the progress of individual students in terms of general learning success. Students were satisfied with the approach, although more than half of them found the multiple-choice questions as too difficult. Although the PI approach is successful, teachers must be aware that some persistent and widespread misunderstandings may still remain and require additional intervention.
Implementation of Four-Tier Multiple-Choice Instruments Based on the Partial Credit Model in Evaluating Students’ Learning Progress
learning progress four-tier change of state of matter partial-credit model...
One of the issues that hinder the students’ learning progress is the inability to construct an epistemological explanation of a scientific phenomenon. Four-tier multiple-choice (hereinafter, 4TMC) instrument and Partial-Credit Model were employed to elaborate on the diagnosis process of the aforementioned problem. This study was to develop and implement the four-tier multiple-choice instrument with Partial-Credit Model to evaluate students’ learning progress in explaining the conceptual change of state of matter. This research applied a development research referring to the test development model by Wilson. The data were obtained through development and validation techniques on 20 4TMC items tested to 427 students. On each item, the study applied diagnostic-summative assessment and certainty response index. The students’ conceptual understanding level was categorized based on the combination of their answer choices; the measurement generated Partial-Credit Model for 1 parameter logistic (IPL) data. Analysis of differences was based on the student level class using Analysis of Variants (One-way ANOVA). This study resulted in 20 valid and reliable 4TMC instruments. The result revealed that the integration of 4TMC test and Partial-Credit Model was effective to be treated as the instrument to measure students’ learning progress. One-way ANOVA test indicated the differences among the students’ competence based on the academic level. On top of that, it was discovered that low-ability students showed slow progress due to the lack of knowledge as well as a misconception in explaining the Concept of Change of State of Matter. All in all, the research regarded that the diagnostic information was necessary for teachers in prospective development of learning strategies and evaluation of science learning.
Enhancing Scientific Discovery Learning by Just-in-Time Prompts in a Simulation-Assisted Inquiry Environment
guidance inquiry learning prompts simulation...
We investigated the effects of just-in-time guidance at various stages of inquiry learning by novice learners. Thirteen participants, randomly assigned to an intervention (n = 8) or control (n = 5) group, were observed as they learned about DC electric circuits using a web-based simulation. Just-in-time instructional prompts to observe, predict, explain, systematically test, collect evidence, and generate rules were strongly associated with diagnosing and correcting misconceptions, and constructing correct scientific concepts. Students’ repeated use of predictions, systematic testing, and evidence-coordinated reasoning often led to formulating new principles, generalizing from observed patterns, verifying comprehension, and experiencing “Aha!” moments. Just-in-time prompts helped learners manage embedded cognitive challenges in inquiry tasks, achieve a comprehensive understanding of the model represented in the simulation, and show significantly higher knowledge gain. Just-in-time prompts also promoted rejection of incorrect models of inquiry and construction of robust scientific mental models. The results suggest ways of customizing guidance to promote scientific learning within simulation environments.
The Mastery of Technological, Pedagogical, and Content Knowledge among Indonesian Biology Teachers
biology teachers indonesia tpack mastery...
The mastery of Technological Pedagogical Content Knowledge (TPACK) is very important for teachers in order to achieve qualified learning. Analyzing the mastery of TPACK by teachers in Indonesia seems to be imperative to provide baseline data to Indonesian government. This study aimed to examine the mastery of TPACK, in particular among biology teachers in terms of their teacher certification status, educational level, and academic background. This research involved 68 biology teachers obtained through proportional random sampling in five districts of Yogyakarta Special Region, Indonesia. The data collection was conducted through a multiple-choice test consisting of 33 items. The results showed that although the teacher’s mastery of TPACK was categorized as fair (60.13), it does not meet the work performance standards as a good teacher in Indonesia which has a minimum score of 76.00. Using Mann Whitney U and Kruskal Wallis Tests (p< 0.05), the evidence revealed that the mastery of TPACK among biology teachers is likely influenced by the academic background, educational level, and teacher certification status.
Student’s Critical Thinking Skills Through Discovery Learning Model Using E-Learning on Environmental Change Subject Matter
critical thinking skills e-learning environmental change discovery learning...
This study aimed to analyze the critical thinking skills of students in learning of environmental change material using e-learning madrasah. This study used explanatory sequential design by mixed-methods experiment. The data were collected by interviewing, observing, and essay testing that have indicators modified from critical thinking skills by Watson-Glaser, Facione, and Ennis. There were 67 participants in this study as 7th grade student at a junior high school in Sleman district. Quantitative data analyzed by determining average score and standard deviations and, qualitative data analyzed from interviews and observation. Quantitative analysis showed that there were 3 levels of student’s critical thinking skills which were 14 students (20.90%) in the high category, 38 students (56.72%) in the middle category, and 15 students (22.38%) in the low category. Qualitative analysis indicated learning model made students to learn actively, independently, and enthusiastically looking for several sources. This study provided information about student critical thinking skills in junior high school, especially in the environmental change matter which are still low. Thus, the alternative learning strategies to improve students critical thinking skills are very needed. Besides, information on the application of the discovery learning model with e-learning Islamic school was obtained in the COVID-19 pandemic.
Influencing Variables and Implications in the Teacher-Student Relationships
learning motivation learning transfer perceived teacher innovation self-efficacy self-regulated learning...
The purpose of the study was to examine correlations between perceived teacher innovation (PTI) and self-regulated learning (SRL), where learning motivation, self-efficacy, and learning transfer help illustrate the interplay between and among influencing variables in the teacher-student relationship. This study gathered 213 valid questionnaires out of 355 participants in the Design Thinking for Data Scientists, which is one of the courses taught from a university in Taiwan. This study has analyzed the possible linkage in the Structural Equation Modeling (SEM) through the path coefficient. The ensuing data analysis study has shown that learning motivation, self-efficacy, and learning transfer not only served as the mediator effects in the PTI and SRL but also played small moderating effects. It appears that when learning motivation, self-efficacy, and learning transfer decrease, the interplay between PTI and SRL becomes stronger. It is necessary to increase the level of intrinsic motivation by the perception of greater innovation in teaching materials. By so doing, students would be more receptive and affective of course contents in the classroom and regulate themselves to achieve educational goals. The implications of teachers' perceptions of pedagogical innovation for learning motivation and learning experience are likewise discussed.
Construct Exploration of Teacher Readiness as an Assessor of Vocational High School Competency Test
competency test construct exploration readiness instruments vocational high school...
Teachers who can adapt and be ready for all changes will also be able to provide a balance to increase the competence of vocational high school students. This is also not denied when teachers become assessors in student competency tests. The objectives of this study were to produce an instrument for the readiness of teachers as assessors; to knowing good grain reliability; to know the characteristics of the instrument; and to know the difficulty level of the item. The method used in this research is instrument development. Respondents were vocational school teachers who were candidates for competency test assessors. Data collection techniques using a questionnaire. Analysis of construct validity using Confirmatory Factor Analysis. Reliability using Cronbach’s alpha. Test the instrument items using the Rasch model. The results are the readiness instruments of the vocational teacher as an assessor has 19 indicators that have been grouped into 5 factors with consistency values being in the same construct (proven construct validity). The result of the calculation of the reliability of this instrument is 0.852, which means that the reliability coefficient is high; There are two items, namely numbers 24 and 18 which indicate the absence of a fit item in the overall item fit criteria; At the item difficulty level, items 8 and 6 have a difficulty score of more than 2, while this indicates that items 8 and 6 have a high difficulty level.
Assessments on Vocational Knowledge and Skills: A Content Validity Analysis
assessments content validity analysis i-cvi modified kappa vocational knowledge...
While previous studies on assessments focused on measurement of principles and constructs, existing attention is given to content validation involving vocational education and skills. The emphasis on content validation has prompted a holistic perspective of teaching and learning to demand alternative research approaches. Using evidence of content validity based on expert judgment and assessment items, this paper argues that vocational knowledge and skills could be determined via constructs and construct functions. Content validity analysis was studied in two major phases, namely, through an assessment of an electrical technology course at a Malaysian higher education institution and expert panels’ examination of items. It was found that to increase confidence in providing reliable instruments for future empirical studies, a careful process in item development and content validity analysis was considered important. Therefore, applying these findings on item analysis and expert panels to reflect content validity can enhance the validity of assessment items.
A Rasch Analysis of Item Quality of the Chemical Literacy Assessment for Investigating Student’s Chemical Literacy on Chemical Rate Concepts
assessment chemical rate rasch analysis students’ chemical literacy...
Assessment is a topic that continues to be developed in science education research. Assessment evaluates not only students' cognitive abilities but also their thinking skills. Therefore, in this study, an assessment that could measure students' chemical literacy was developed. Chemical literacy is a thinking skill that students must develop as part of their chemistry learning. The goal of this study was to assess item' quality, as well as student’ chemical literacy on the concept of chemical rate. The Rasch model was employed to analyze the data in this study. The results of this study depict that the developed assessment had sufficient reliability and validity to be used to assess students' chemical literacy. Furthermore, the analysis of the students’ responses to the items revealed that many students did not understand or were unaware of the context presented. These findings suggest that students' chemical literacy in the material for the reaction rate is still lacking and needs to be improved. As a result, the teacher's role in assisting students in improving their chemical literacy through chemistry learning is critical.
The Interrelationships between Metacognition and Modeling Competency: The Moderating Role of the Academic Year
academic year levels confirmatory factor analysis mathematical modeling metacognition structural equation modelling...
Several concerted movements toward mathematical modeling have been seen in the last decade, reflecting the growing global relationship between the role of mathematics in the context of modern science, technology and real life. The literature has mainly covered the theoretical basis of research questions in mathematical modeling and the use of effective research methods in the studies. Driven by the Realistic Mathematics Education (RME) theory and empirical evidence on metacognition and modeling competency, this research aimed at exploring the interrelationships between metacognition and mathematical modeling and academic year level as a moderator via the SEM approach. This study involved 538 students as participants. From this sample, 133 students (24.7%) were from the first academic year, 223 (41.4%) were from the second and 182 (33.8%) were from the third. A correlational research design was employed to answer the research question. Cluster random sampling was used to gather the sample. We employed structural equation modeling (SEM) to test the hypothesized moderation employing IBM SPSS Amos version 18. Our findings confirmed the direct correlation between metacognition and mathematical modeling was statistically significant. Academic year level as a partial moderator significantly moderates the interrelationships between the metacognitive strategies and mathematical modeling competency. The effect of metacognition on mathematical modeling competency was more pronounced in the year two group compared to the year one and three groups.
Fostering Tertiary Student Professional Mobility Skills via Convergence of the Professional Training and Foreign Language Learning
foreign language learning higher education professional mobility skills professional training tertiary students...
The purpose of the study was to identify how the instructional model that converges professional training and foreign language learning can influence the students’ professional mobility and students’ readiness to build their careers. The study used the methods of a quantitative kind for the evaluation study and descriptive research. The variables for the study were as follows: levels of student professional mobility skills proficiency that included students’ competence in their professional field, foreign language proficiency, students’ networking skills, personality qualities, and sampled students’ satisfaction with the reshaped course. The field phase of the study found that the Erasmus and Work-and-Travel programmes contributed to the former students’ adaptability and flexibility, the experience of work abroad, and practical specialism-related experience gained during study. The students developed their abilities to project a positive social image, ability to build and maintain relationships, foreign language proficiency, proficiency in presenting and negotiating, and theoretical knowledge. The English Language-delivered Professional Mobility course brought shifts in the levels of students’ professional mobility skills. The experimental group students reported that they improved their competence in their professional field, foreign language proficiency, networking skills, and personality qualities. The experimental group students’ judgements concerning the quality of the course were complimentary.
A Game-Based Learning Activity to Promote Conceptual Understanding of Chordates’ Phylogeny and Self-Efficacy to Learn Evolutionary Biology
chordates game-based learning level of use phylogeny self-efficacy...
Understanding phylogenetic trees representing evolutionary relationships of living organisms is essential in school biology. Traditional instructions based on lectures and textbooks with pictorial presentations have been proven ineffective to promote students’ understanding of the concept. This study, therefore, developed a game-based learning activity called the VERT card game to enhance students’ learning of the phylogenetic taxonomy of chordates. The VERT card game was designed to lay the foundation for different characteristics of chordate classes, as well as to allow students to construct and interpret their evolutionary relationships based on the phylogenetic tree. The effectiveness of the VERT card game was verified by a pre-test and post-test design with 109 middle school students in Thailand. The statistical result revealed that students’ mean scores increased significantly in the post-test, compared to the pre-test, indicating their improved understanding. In addition, after participating in the learning activity, the student participants were found to increase their self-efficacy to learn evolutionary biology statistically. Also, it showed positive views towards the usefulness of the developed card game as a large number of them expressed that they would like to use it for their lesson reviews and wished to have this form of learning activity in other topics in biology.
Development of Gazi Functional Vision Assessment Instrument
distance vision functional vision assessment low vision near vision visual field...
This study aimed to develop a valid and reliable instrument that measures the functional vision of students with low vision. Thus, an assessment tool and performance activities were developed for three vision skill groups (near vision skills, distance vision skills, and visual field) that include functional vision skills. The universe was 1485 students studying in various primary and middle schools (from 2nd to 7th grades) affiliated to the Ministry of National Education, and simple random sampling was used to select 310 students. The data were collected using the Gazi Functional Vision Assessment Instrument developed by the researchers. Many-facet Rasch model and generalizability theory were used for the rater reliability of the measurements obtained from the instrument, while discriminant analysis was used for the validity of the measurements. The analysis showed that the measurements were reliable, and the inferences based on these measurements were valid. Thus, this instrument can be used to identify and assess the functional vision status of students with low vision.
Measuring Self-Regulated Learning in the STEM Framework: A Confirmatory Factor Analysis
confirmatory factor analysis reliability self-regulated learning stem validity...
Within the context of Self-Regulated Learning (SRL), a process of directing oneself to facilitate individual learning more effectively, the SRL instrument development is deemed necessary to measure students’ self-reliance in learning mathematics in the science, technology, engineering, and mathematics (STEM) framework. The research aims to develop and test the validity and reliability of an SRL instrument, namely a 14-item SRL questionnaire accommodating four aspects, namely planning, self-monitoring, self-controlling, and evaluation. The study involved 420 junior high school students in East Java, Central Java, and Yogyakarta Special Region. The results show that the questionnaire was developed as planned and that planning, monitoring, controlling, and evaluating aspects can reflect the SRL variable in a valid, reliable, and significant way supported by each aspect's behavior indicator. The SRL variable theoretical model corresponds (good fit) with the empirical data, and all of the items are likely valid and reliable to assess student's mathematics SRL in the STEM framework. The SRL questionnaire was also found suitable for use by teachers to measure junior high school students’ self-reliance in SRL.
Effect of Cooperative Learning on Chemistry Students’ Achievement in Rwandan Day-upper Secondary Schools
academic achievement basic education chemistry education cooperative learning secondary schools in rwanda...
The cooperative learning (CL) is an advanced instructional approach that uses different motivational procedures to make instruction significant and learners more responsible. This study aimed to investigate the effects of cooperative learning on students' achievement in chemistry among the advanced level in 12-year basic education schools; it engaged a quasi-experimental design with one treatment group and a comparison group (control); the first applied cooperative learning in teaching organic chemistry while in the control group, organic chemistry was taught by the conventional teaching methods (CTM). A sample of 257 students participated in the study. The data collected used an organic Chemistry Achievement Test, and its data were analyzed using SPSS version 23.0 and MS Excel 2016. The ANCOVA results showed that learners taught using cooperative learning achieved better than their counterparts in the control group (F=78.07, df=1, 256, p<.001) with the learning gains of 16.0% in traditional methods and 53.6% of cooperative learning approach, respectively. However, there was no statistically significant difference in gender of students. It is recommended that chemistry teachers be trained on cooperative learning and encouraged to apply it in their teaching methods to enhance students' academic achievement.
The Development of Indonesian Accounting Teacher Professional Identity Measurement: An Exploratory Factor Analysis
accounting teacher measurement professional identity scale...
Measuring accounting teachers’ professional identity is significant to do as an alternative to measure the professionalism of accounting teachers in Indonesia based on their professional identity. This research was conducted in two stages of exploratory factor analysis involving 150 accounting teachers as sample in each stage. The data were collected in collaboration with an accounting teacher organization, comprising the Accounting Subject Teacher Deliberation (MGMP) in Central Java through a questionnaire. Data analysis was divided into several steps including face validity and content validity, inter-item correlation matrix, and exploratory factor analysis. The results showed that 23 question items encompassed five components of accounting teacher professional identity; Cultural Knowledge (pedagogical cultural identity), Blending (accommodating students' purposes for school in the learning objectives), Identity Experiencing (by the experience of working life in the past, present, and individual expectations in the future in accounting work setting), Inter-Personal Skill, and Active in Professional Communities. The scale development requires continuous development tailing various new findings in the teacher professional identity and accountant professional identity.
Physics Students’ Conceptual Understanding of Electricity and Magnetism in Nine Years Basic Education in Rwanda
electric current electricity electrostatics magnetism students’ misconceptions...
We investigate students’ misconceptions in electrostatics, direct current (DC) and magnetism which are important in electricity and magnetism. We developed and administered a multiple-choice questionnaire test to reveal students’ misconceptions related to charged bodies, lightning, electric fields, electric potential, forces, DC resistive electric circuits and magnets. This test aimed at obtaining quantitative information about misconceptions and was administered to 380 senior two students from Nine Year Basic Education (9YBE) Schools. The selected students have some experience with the new Rwandan secondary physics Competence Based Curriculum (CBC) that is currently under implementation. We find that senior two students have several common misconceptions related to these concepts. The data indicate that although students have some backgrounds on the subject matter, they still seem to believe that if the two charges are separated by a distance, a large-charged object exerts a greater force of attraction or repulsion on the small one. Considerable number of participated students held the misconception of considering current consumption in the resistor/bulb or the electrical devices in the circuits. They also believed that the battery was a continuous current source. The findings also revealed that students held a misconception that a bar magnet when broken into pieces, it is demagnetized. Moreover, a considerable number of participants hold the misconception that all metals are attracted by a magnet. Our study also revealed some of the statistically significant differences in terms of either gender or location of schools for some items.
Mathematics Mobile Blended Learning Development: Student-Oriented High Order Thinking Skill Learning
e-learning r & d smartphone application thiagarajan model...
This study aims to develop a mathematics learning application, namely Android-based mobile learning to increase students' High Order Thinking Skills (HOTs). The result of mathematics learning media is a valid and practical mobile learning application product. "Mastering Math" is the name of a mathematics e-learning application designed as a mobile or smartphone application, with specifications for the OS Android. The procedure for the development of virtual mathematical media used the development of the 4D model of Thiagarajan: (1) define; (2) design; (3) develop, and (4) disseminate. The trials conducted included five expert judgments and a small group. The research instruments used were a validation sheet, a practical assessment sheet by the teacher, a practical assessment sheet by students, and a media effectiveness test instrument. Data analysis was performed using Cochran's Q test for similarity of expert validation and qualitative analysis. The teaching materials used are junior high school teaching materials with validity and practicality in the good category to increase students' HOTs. This research implies that the learning of mathematics is more effective and efficient, students' divergent thinking develops, and their learning motivation for mathematics increases.