' instrument development' Search Results
Development of a Self-Evaluation Instrument with Programmatic Assessment Components for Undergraduate Medical Students
instrument development medical education programmatic assessment...
This study aimed to develop and test a student self-assessment instrument based on the programmatic assessment (PA) components. We applied a series of psychometric research methods by (a) conducting a literature study to find PA constructs, (b) developing the students' self-questionnaires, (c) ensuring content validity, (d) testing face validity, and (e) conducting reliability tests that involve medical students, medical teachers, medical educationalist, and an international PA expert. Face validity (readability test) was conducted with 30 medical students from an Indonesian university who were in their last year of pre-clinical education and had average scores above or equal to their classmates. The confirmatory factor analysis (CFA) was used to report the instruments’ validity and reliability. The final instrument was tested on 121 medical students with excellent GPAs from another medical school with a middle-level accreditation. The PA consists of five components: ‘learning activities’, ‘assessment activities’, 'supporting activities’, 'intermediate evaluations’, and ‘final evaluations'. These components are conveyed through 41 relevant statements with a four-point Likert scale and three yes/no statements. According to the respondents, there was a lack of 'supporting activities' and 'intermediate evaluation' components in the PA in their universities. This study has developed and tested a five-component evaluation instrument based on medical students' perceptions regarding PA implementation.
Development and Validation of a Concept Inventory for Interpreting Kinematics Graphs in the Tanzanian Context
concept inventory kinematics graphs physics teachers tanzania context...
This paper discusses the development and validation of a concept inventory for interpreting kinematics graphs in the Tanzanian context. The study involved 61 participants comprising physics pre-service teachers, secondary school teachers, diploma college tutors, and a university lecturer from Tanzania. We developed 25 multiple-choice questions for interpreting kinematics graphs. The different steps in the development process used are selecting the topic, setting objectives, constructing questions, validating questions, and reliability testing. We carried out descriptive and inferential statistical analysis by using Statistical Package for Social Science (SPSS) version 22 followed by item analysis for pre-and post-piloting. Findings revealed normal distribution scores with a mean and standard deviation of 39.28±10.893 for pre-piloting and 40.16±8.08 for post-piloting. It also revealed no significant difference between pre-and post-piloting results with a p-value of 0.414. In addition, correlation coefficients for test re-test reliability were .783 and .878 for single and average measures respectively. Moreover, item analysis in terms of difficulty index, discrimination index, and distractor efficiency agreed with the published standards. Based on these findings, the study recommends the use of developed and validated kinematics graphs concept inventory by physics educators in both research and classroom instructions in the Tanzanian context.
Development of Online Local History Learning Media Based on Virtual Field Trips to Enhance the Use of Primary Source Evidence
history learning use primary source evidence skill virtual field trip...
It is important for students who learn history to have the skills to think, read and analyze historical sources because past events can only be reconstructed and understood from these numerous resources. Various media methods are needed to support the development of these skills, especially in online learning. Therefore, this research aims to create a virtual field trip (VFT) based history learning media to help students improve their thinking skills using primary source evidence. It was carried out by using the research and development (R&D) method consisting of four stages, namely analysis, designs, conducting trials, and testing media effectiveness. The sample subjects consisted of six teams as expert validators, seven history teachers, 70 and 280 Class X students who assessed the product's practicality and determined the developed media's effectiveness. Data were collected through expert validation, student and teacher response questionnaire sheets, as well as description exams. The level of validity and practicality of the medium were determined using descriptive analysis, while the N-Gain approach evaluated the media's effectiveness. The expert validation result is very good, with an average score of 3.77. The teacher and student response tests showed an average score of 4.67, indicating that the VFT medium is practical for learning history. The N-Gain value of 72% showed that the students' abilities to use primary source evidence are increasing. Therefore, using VFT based history classes to develop explanation skills using primary source evidence is feasible, practical, and useful.
Evaluation of Preservice Teachers’ Performance in School through Video Observations during the COVID-19 Pandemic
observation preservice teachers rubrics student evaluation teacher education...
Lesson study, observation and analysis are relevant to professional development and initial teacher education. As a strategy, it helps to bridge the gap between theory and practice. The health conditions brought on by the COVID-19 pandemic forced the restriction of the tutors’ direct observation of preservice teachers at school. This study analyses preservice teachers’ performance through video observations to evaluate their professional activity at school during the COVID-19 pandemic. The Fifteen Items Revised Tsang-Hester Observation Rubric (FIR-THOR) was administered to a sample of 166 preservice teachers in their internship schools and their video recordings each one of 45-minute teaching lessons were analysed. The results show that the FIR-THOR appears as a robust instrument, which allows us to conclude that the instrument works well in the three five-items dimensions that compose it - Instruction, Management, and Assessment - proving to be reliable for assessing teacher intervention in the classroom. Among the three dimensions, the preservice teachers’ performance stands out in the Management of the classroom, as well as in the classroom Instruction. This contribution is relevant considering the potential of lesson analysis in learning and professional development during initial teacher training.
How Students Generate Patterns in Learning Algebra? A Focus on Functional Thinking in Secondary School Students
functional relationships functional thinking generalization learning algebra...
This research aims to describe secondary school students' functional thinking in generating patterns in learning algebra, particularly in solving mathematical word problems. In addressing this aim, a phenomenological approach was conducted to investigate the meaning of functional relationships provided by students. The data were collected from 39 ninth graders (13-14 years old) through a written test about generating patterns in linear functions. The following steps were conducting interviews with ten representative students to get detailed information about their answers to the written test. All students' responses were then analyzed using the thematic analysis software ATLAS.ti. The findings illustrate that students employed two types of approaches in solving the problem: recursive patterns and correspondence. Students favored the recursive patterns approach in identifying the pattern. They provided arithmetic computation by counting term-to-term but could not represent generalities with algebraic symbols. Meanwhile, students evidenced for correspondence managed to observe the relation between two variables and create the symbolic representation to express the generality. The study concludes that these differences exist due to their focus on identifying patterns: the recursive pattern students tend to see the changes in one variable, whereas the correspondence ones relate to the corresponding pair of variables.
Online Social Support and Psychological Well-Being of Caregivers of Children with Autism Spectrum Disorder
caregiver neurodevelopmental disorder online network...
This study aimed to evaluate the effect of online social support (OSS) on the psychological well-being (PWB) of caregivers of children with autism spectrum disorder (ASD). The role of gender as a moderator variable in the relationship between online social support and psychological well-being was also investigated. A quantitative research design was used to collect data from 154 caregivers of children with ASD in Indonesia using PWB and OSS questionnaires adapted into Bahasa Indonesia. Data were analyzed using SMART PLS 3.0. Online social support influences the psychological well-being of caregivers of children with ASD. At the dimension level, several OSS dimensions also affect PWB. The effect of online social support on psychological well-being is the same in both the male and female groups. This means that male and female groups benefit equally from online social support. Future research should combine the study with a qualitative method to gather data from caregivers on how OSS affects their PWB in order to gain a holistic perspective. It could be a suggestion to policymakers to provide beneficial online social media for caregivers of children with ASD.
Psychometric Analysis of the Social Support Scale Among Indonesian Academicians
factor analysis reliability social support validity...
The current study investigates the psychometric characteristics of the Social Support Scale as an instrument for assessing social support for academics. The original version of the scale was adapted and translated into Indonesian and was administered to academics in Indonesia through a google form. The data were then analyzed to investigate the reliability, construct validity, and structure of factors of the instrument. Confirmatory factor analysis confirms that the three-dimension model was the best model regarding the internal structure. Our findings also advocate the Social Support Scale as a valid and reliable tool for assessing social support in Indonesian academics. Thus, it can be employed to examine lecturers’ social support level which helps the universities to build a supportive working climate, as well as improve the relationship quality between employees.
The Effect of Character Teaching on College Student Social-Emotional Character Development: A Case in Indonesia
character teaching college student socioemotional development...
This study aimed to investigate the effect of character teaching on college student socioemotional character development. The study was conducted at IAIN Pontianak, Universitas Tanjungpura and Universitas Muhammadiyah Pontianak. The sample was 1284 students, 388 male and 896 female. Partial least square-structural equation modeling (PLS-SEM) data analysis using SmartPLS was used. The findings reveal that character teaching has a significant and positive effect on college student honesty, prosociality, respect at home, respect at school, self-control, and self-development. This study suggests that colleges/universities ensure that lecturers supervise student assignments, seriousness and discipline, check students’ attendance strictly, give course assessment samples, and grade their assignments on schedule. At the end of the conclusion, implications and suggestions are given.
Science Awareness: Analysis of Moroccan Curriculum Framework for Preschool Education
curricular framework early childhood morocco pre-school education scientific awareness...
Morocco has undergone significant reforms in the education and training field, including the implementation of preschool education as a compulsory stage in the education system. Several studies have shown that attitudes toward science tend to decline between the ages of 11 and 14. Therefore, it is crucial to promote the acquisition of different modes of reasoning and forms of thought from early childhood. The primary objective of preschool education in Morocco should be to promote positive attitudes toward science. This study aims to analyze the preschool program prescribed in the Moroccan curriculum framework with regard to scientific awareness as well as its methodological and practical implications. The analysis was conducted using a designed grid and including the following criteria: construction of school science; axiological and psychological foundations of science learning; objectives and competencies; contents; approaches; activities; teaching strategies; didactic resources; pedagogical design and evaluation. The study's findings revealed that the Moroccan Curriculum Framework for Preschool Education featured a number of dimensions related directly to scientific awareness. However, no explicit statements about scientific awareness or science literacy were made. Moreover, some elements suggested in the program document were out of phase with the current trends of scientific awareness. Therefore, the study offered some suggestions for improving the proposal provided by this pedagogical document. In conclusion, Morocco's focus on preschool education is a positive step towards building a more scientifically literate society. However, to fully benefit from it, the guidance document must be revised to reflect current scientific awareness trends.
Measurement of Students' Chemistry Practicum Skills Using Many Facets Rash Model
chemistry practicum mfrm performance assessment process assessment product assessment...
The accuracy of assessing the capabilities of the process and product in chemical practice activities requires appropriate measurement procedures to be followed. It is crucial to identify the components that can introduce bias while measuring student abilities during the measurement process. This study aims to identify the components or criteria used by teachers to assess student performance in practicum activities and analyze the quality of the rubrics developed. The study was conducted with the participation of three raters, 27 high school students, and nine assessment criteria. A quantitative descriptive approach was employed using the many-facet Rasch model (MFRM) analysis for measurement. The results of the MFRM analysis show no significant measurement bias, with data measurement facets fitting the MFRM model. The reliability of all the facets meets the criteria, and the scale predictor functions appropriately. While all students can easily pass four out of nine items, five items can only be partially passed by students. The assessment criteria that require special attention include communication skills, tools and assembly, interpretation, cleanliness, and accuracy when performing practicums. These criteria provide feedback for teachers and students to ensure successful practicum activities. The Discussion section of this study delves into the findings and their implications.
The Assistive Technology for Teaching and Learning of Social Skills for Autism Spectrum Disorder Children: Multimedia Interactive Social Skills Module Application
asd children autism missm application mobile application social skills...
An earlier study found that assistive technology based on mobile applications significantly improved how social skills were taught to and learned by autism spectrum disorder (ASD) children. Nevertheless, the content of the existing mobile applications is inadequate for capturing the diversity of Malaysian culture, making it unacceptable for local use. Considering cultural norms is a factor in developing social skills in ASD children. It is therefore necessary to develop new assistive technology based on mobile applications that consider Malaysian cultural norms. As a result, the Multimedia Interactive Social Skills Module (MISSM) application was created based on the Addie Model, which offers a systematic process for assisting in developing successful instructional material by fusing instructional theory with learning theory. The MISSM application is based on Malaysia's current social skills curriculum, which helps ASD children become socially competent. Hopefully, it will help them develop better social skills and achieve academically. Finally, local culture-sensitive material for assistive technology based on mobile applications would support Malaysia's adoption of a technology-based teaching and learning strategy and contribute to a better understanding of social skills.
Evaluating the Results of PISA Assessment: Are There Gaps Between the Teaching of Mathematical Literacy at Schools and in PISA Assessment?
education gaps mathematical competence mathematical literacy pisa assessment...
The problems in education in the countries of the Organization for Economic Cooperation and Development (OECD) vary from country to country. The differences between "upper class" and "lower class" countries in PISA assessment results have led to a research gap. The purpose of this study was to (a) test students' mathematical literacy skills on the Program for International Student Assessment (PISA) test and compare the results using the sum of means across OECD countries; (b) examine the relationship between students' mathematical competence, precision, and self-perception of mathematical literacy skills in the PISA test; and (c) analyze the gaps that exist between the implementation of mathematics instruction in school and the mathematical literacy as measured on the PISA test. This study was designed as a mixed method with an explanatory sequential design. The data collection methods included test procedures, questionnaires, and interviews. The result of this study showed that the overall mean score obtained was below the OECD average. In general, the respondents achieved only level 2 mathematics proficiency. A significant relationship was found between mathematical competence, precision, and self-perception in mathematical skills. On the other hand, there was a gap, namely the difference at the implementation level, where mathematical literacy measured by PISA differed from the measurement of mathematical learning achievement by teachers in school. The results showed that teaching that emphasizes only problem-solving procedures affects low mathematical competence and is not useful enough for students to deal with the PISA mathematics test.
The Moderating Role of Entrepreneurial Self-Efficacy and Locus of Control on the Effect of the University Environment and Program on Entrepreneurial Intention and Attitudes
entrepreneurial intention and attitudes entrepreneurial self-efficacy locus of control student entrepreneurship university environment...
This article examines the influence of the university environment and learning programs on students' entrepreneurial intentions and attitudes, considering the moderating roles of entrepreneurial self-efficacy and locus of control. The empirical analysis employs a multilevel (hierarchical) linear model, utilizing responses from 713 students across 30 universities in Kazakhstan who participated in the GUESSS 2021 project survey. Our findings reveal that students' entrepreneurial intentions are directly influenced by entrepreneurial self-efficacy and locus of control. However, the locus of control is also indirectly influenced by the university environment and learning program. The learning program's effect on both entrepreneurial aspirations and attitudes is mediated by self-efficacy. Locus of control, conversely, negatively affects both entrepreneurial attitudes and intentions in program learning. The study's results underscore that student entrepreneurship is shaped by personal factors such as self-efficacy and locus of control, alongside the university context. Interestingly, the findings also indicate interdependencies between these factors, further influencing students' entrepreneurial intentions and attitudes.
The Impacts of Heritage Education on Students’ Nationalism and Patriotism: A Case Study at a Private University in Vietnam
heritage education patriotism nationalism traditional musical instruments vovinam...
Heritage education is an integral component of general and higher education programs. It helps students understand the national culture and arouses their love for the country. The quantitative study was conducted with the participation of 822 students in the FPT University system. Multiple linear regression analysis and Pearson correlation results help determine the relationship between heritage education’s learning outcomes, including Vovinam martial arts and traditional musical instruments, and students’ patriotic and nationalistic attitudes. Accordingly, promoting learning outcomes related to Skills, Attitudes, and Behaviors positively impacts the development of students’ patriotism and nationalism. The study affirms the role of heritage education programs in the education system in Vietnam, especially at the university level. It confirms the necessity of this type of education at all stages of learners’ development, especially in the research context at FPT University.
Strengthening Pedagogical Content Knowledge in Designing Laboratory Activity Based on Small-Scale Chemistry Practicum Approach
laboratory activity pedagogical content knowledge small-scale chemistry...
The purpose of this research is to strengthen pedagogical content knowledge (PCK) in designing laboratory activities based on small-scale chemistry approaches. This research is action research involving 60 trainee teachers with stages that include (a) Reflect; (b) Plan; (c) Act; (d) Observe; (e) Reflect (2nd); (f) Plan (2nd). Qualitative data were collected through (a) Questionnaires reflecting on experiences in practicing chemistry learning and responses to the importance of learning, (b) a Portfolio of chemistry practicum design, (c) documentation of the process of carrying out design, implementation, and practicum evaluation activities, (d) field notes, (e) reflection sheet, and (f) Portfolio of follow-up plans. The data is displayed through the R computation system with data pre-processing stages in the teacher's reflection text which includes basic cleaning, case folding, normalization, stemming, and deleting meaningless words. Display data in the form of word clouds, frequency expression diagrams, and tabulations. Descriptive narratives are used to analyze the documentation obtained in the action process. The teacher group demonstrated performance in implementing small-scale practicum activities. Teachers are increasingly skilled in modifying conventional laboratory equipment, minimizing the amount of chemical use, minimizing waste disposal, and increasing efficiency in the duration of practicum implementation. The follow-up plan for this activity includes quality improvement in aspects of (a) skill in using laboratory equipment, (b) understanding of chemical concepts, (c) equipment availability, materials, and work procedures, and (d) implementation of chemistry practicum.
Relationship between Mentors’ Roles and Mentees’ Leadership Development: The Mediating Role of Mentees’ Self-efficacy
mentees’ leadership development mentees’ self-efficacy mentors’ roles...
Limited latest studies circulated in the 21st century of world university ranking reveal that well-designed mentoring programs will not increase mentees’ leadership development if mentors have not implemented effective roles in the mentoring programs. Although many studies have been done, the mediating effect of mentors’ roles is little known in the tertiary education mentoring research literature. This study is done to examine the correlation between mentors’ roles, mentees’ self-efficacy, and mentees’ leadership development. This study employed a cross-sectional research design. A purposive sampling plan was employed to collect 761 survey questionnaires from undergraduate students at non-research-based public universities in Sarawak. The survey data were analyzed by the SmartPLS package to determine the validity and reliability of the study instrument, and thus test hypotheses for the direct effects model and mediating model. The outcomes of the SmartPLS path model analysis showed that the majority of participants felt that the levels of information exchange, help, self-efficacy, and leadership development are high. This situation explains that the ability of mentors to appropriately implement information exchange and help in mentoring programs has strongly evoked mentees’ self-efficacy. Consequently, this self-efficacy can lead to higher leadership development. This finding can help practitioners to understand the diverse paradigms of mentees’ self-efficacy concept and plan the integration of academic and social-based approaches in formulating mentoring programs to prepare successful graduates in a time of rapid global change.
Development of Waves Critical Thinking Test: Physics Essay Test for High School Student
assessment in physics essay test physics essay test waves critical thinking test...
This study aims to produce a product to evaluate students' critical thinking skills that departs from physics content where students often have misconceptions. This research is a development research with research stages covering a) research and review literature; (b) planning chapter objectives; (c) developing a preliminary form; (d) field-testing the preliminary form; (e) Revise the preliminary form; (f) conducting a main field-test. The Waves Critical Thinking (WCT) test developed consists of 7 questions with 15 specific domains. Total percentage of content validity test was obtained 87.98% with appropriate criteria and based on the construct validity WCT test, the Goodness of Fit criteria were obtained which were classified as fit. The test instrument being tested consists of 15 objective items. The reliability of WCT test results 0.597 as a Cronbach's alpha score with the medium category and all the components have a good level of composite reliability. The outcome of the study was the WCT test with a valid state for measuring students' CT in a specific domain of physics wave material.
Students’ Learning Independence and Critical Thinking Ability Using Mobile Learning Technology
learning independence critical thinking ability mobile learning technology...
21st-century learning requires teachers and students to integrate literacy skills, scientific literacy, mathematics, reading, writing, and technology in the learning process. Students must have initiative, discipline, responsibility, confidence, motivation for independent learning, and the ability to think critically about the problems presented. This study aims to determine students' autonomous knowledge and critical thinking abilities (CTA) using mobile learning technology (MLT). This research is a quantitative study involving 83 students from four junior high schools in the city of Mataram. The data collection for independent learning and students' CTA was carried out by giving tests and non-tests to students. The test conducted was a written test in the form of a description of 10 questions covering indicators of CTA. The non-test was conducted by giving a student learning independence questionnaire with as many as 15 statements, including five indicators of learning independence. This quantitative research data analysis uses the Rash modeling application with the help of Ministep software. The analysis results show that the learning independence of male and female students in the four junior high schools obtained a percentage of 77.38% in the “good” category. Each indicator of learning independence accepts a percentage above 70%, which is in the excellent category. Meanwhile, the CTA of male and female students from the four junior high schools obtained 75.28% in the “good” category. Each indicator of CTA also gets a percentage of more than 70%, meaning that each indicator is in a good category.
The Development of Teacher Performance Assessment Instruments in Boarding School
assessment boarding school teacher’s performance...
The objective of this study is to create a tool for evaluating teachers’ effectiveness in boarding schools. Planning and preparation stages, instrument testing, and measurements were used in this study to implement research on the creation of the Mardapi model instrument. In order to generate instrument items, the planning and preparation stage tasks included a literature assessment of teacher performance appraisal manuals. Data were gathered utilizing documentation approaches, and descriptive and qualitative analysis was performed. Six specialists validated the built instruments, which were subsequently put through limited testing at two boarding schools and extensive trials at nine boarding schools in Surakarta residency area. The Aiken formula was used to examine the expert’s evaluation data, and confirmatory factor analysis was used to analyze the test results. The results of this study indicate that the instrument for assessing teacher performance in boarding schools meets the validity criteria. This is indicated by the existence of loading factor values ranging from .51 to .72 (>.4) and t-sign values ranging from 4.75 to 9.25 (>1.96) and meeting the requirements of a fit model since Chi-square = 1307.95 < 2524 (2*df), p-value = .17956 (>.05), and RSMEA value = .014 (<.08). The instrument items are reliable assessment packages, and this is shown by the reliability value of omega .967 > .70. Because there is a guarantee of validity and reliability, the test can be used to further assess teacher performance in boarding schools.
Course Dropout Intention Scale: Development and Validation of a New Brief Measure in Academic College Context
brief measure college student course dropout dropout intention dropout studies...
University students may encounter situations where they perform poorly in a course and contemplate dropping out. This intention to drop out of a course manifests not only in thoughts or ideas but also in a cognitive self-evaluation of their performance and skills, enabling them to reflect on the possibility of dropping out. In this sense, there is a shortage of instruments that evaluate the intention to drop out of a course, so the aim was to develop and validate the Course Dropout Intention Scale (CDIS). Data from two samples (N1 = 198; N2 = 675) were used; the first was for the EFA, and the second was for the CFA, GRM, and SEM. The one-factor model was derived from the EFA and confirmed in the second sample, exhibiting appropriate goodness-of-fit indices. Similarly, the GRM obtained adequate fit indices; all items discriminated adequately, and the difficulty parameter had a monotonic increase. The SEM model of the effect of satisfaction with studies on the CDIS showed a negative and statistically significant effect. Thus, it was demonstrated that the CDIS is a robust instrument in its psychometric properties and empirical evidence with other variables.