' content validity analysis' Search Results
Mathematics Pre-Service Teachers’ Numerical Thinking Profiles
numerical thinking reasoning self-efficacy...
Numerical thinking is needed to recognize, interpret, determine patterns, and solve problems that contain the context of life. Self-efficacy is one aspect that supports the numerical thinking process. This study aims to obtain a numerical thinking profile of Mathematics pre-service teachers based on self-efficacy. This study used descriptive qualitative method. The data obtained were based on the results of questionnaires, tests, and interviews. The results of the self-efficacy questionnaire were analyzed and categorized (high, moderate, and low). Two informants took each category. The results showed the following: informants in the high self-efficacy category tend to be able to interpret information, communicate information, and solve problems with systematic steps. Informants in the moderate self-efficacy category tend to be able to interpret and communicate information, but tend to be hesitant in choosing the sequence of problem-solving steps. Meanwhile, informants in the low self-efficacy category tend not to be able to fully interpret the information. As a result, the process of communicating information and solving problems goes wrong. Another aspect found in this study is the need for experience optimization, a good understanding of mathematical content, and reasoning in the numerical thinking process.
Developing Assessment Instrument Using Polytomous Response in Mathematics
assessment instrument classical and modern theory vocational school polytomous responses...
This research is a developmental research aiming at developing a good mathematical test instrument using polytomous responses based on classical and modern theories. This research design uses the Plomp model, which consists of five stages, (1) preliminary investigation, (2) design, (3) realization/construction, (4) revision, and (5) implementation (testing). The study was conducted in three vocational schools in Lampung Province, Indonesia. The study involved 413 students, consisting of 191 male and 222 female students. The data were collected through questionnaire and test. The questionnaire was used to identify the assessment instruments currently employed by teachers and to be validated by the experts of mathematics and educational evaluation. The test used an open polytomous response test numbering of 40 items. The data were analyzed using both classical and modern theories. The results show that (1) the open polytomous response test has a good category according to classical and modern theory. However, the discrimination power of test items in classical theory needs several revisions, (2) the assessment instrument using the polytomous response of open multiple choice can guarantee information on the actual competence of students. This is proven by the fact that there is a harmony between the analysis result obtained from classical and modern theory from the students' arguments when giving reasons for their choices. Therefore, the open polytomous response test can be used as an alternative to learning assessment.
Development of Attitude Assessment Instruments Towards Socio-Scientific Issues in Chemistry Learning
attitude chemistry learning factor analysis socio-scientific issue...
A socio-scientific issue is one of the learning techniques used today, which uses various scientific sources to make students think scientifically to conduct a dialogue and discuss solving a problem. Various problems in socio-scientific are controversial, requiring reasoning, and ethical evaluation in the decision-making process. A conflict between chemical reason and students' social point of view will cause students' different assessments and attitudes towards the socio-scientific issue. This study is a research and development (R&D) that focuses on the instrument's validity with the factor analysis technique to assess attitudes towards the socio-scientific issue in chemistry learning. CFA and EFA analysis found five factors in the tool: anxiety, interests, likes, benefits, confidence, validity, and reliability. The total reliability coefficient is .853. Of the eight instrument feasibility analysis requirements, seven instruments were declared fit to meet construct validity.
Social Opportunities or Barriers to Metacognition: A Case Study of Social Factors for Pre-Service Teachers’ Metacognition
family friends metacognition school social media teachers the turkish culture...
This mixed method case study examined potential influences of social agents or immediate environments on individuals’ metacognition. Via quantitative methodologies, 122 pre-service teachers’ metacognition was measured by the Turkish Metacognitive Awareness Inventory, and metacognitive components did not show any variations across majors, locations of previous studies, the highest degree of education in the family, frequently communicated friends, and regions. Regression analyses revealed that friends were a significant predictor for metacognition. Also, focus group interviews were analyzed thematically via deductive codes regarding the theory of metacognition. Findings confirmed that friends may support individual metacognition at all levels, metacognitive knowledge, regulation, and experiences through cooperation, modeling, reflections, discussions, feedback, and peer evaluation. Pre-service teachers’ engagement on the social media may also support their regulatory strategies due to models’ task performances or by their reflecting upon those performances. Teachers and family may support metacognitive knowledge, specifically career goals via expectations, anecdotes, and experiences. On the other hand, schools and the Turkish culture may impose some limitations on the youth, and they may engage in reflection and self-questioning to manoeuvre negative experiences or conflicts. Thereby, cross-national and longitudinal studies are highly suggested to explicate the social foundations of metacognition.
The Effects of The Blended Project-Based Literacy that Integrates School Literacy Movement Strengthening Character Education Learning Model on Metacognitive Skills, Critical Thinking, and Opinion Expression
blended li-pro-gp learning model critical thinking metacognitive skills opinion expression...
Metacognitive, critical thinking and opinion expression are in high demand. This study aimed to investigate the effects of the blended project- based literacy that integrates school literacy movement strengthening character education (literasi berbasis proyek terintegrasi GLS dan PPK: Li-Pro-GP) learning model on students' metacognitive skills, critical thinking, and opinion expression. A post-test experimental design was used to answer the research question. The study was conducted from August to October 2021 at Government Junior High School 23 Malang. Seventh-grade students were selected as research participants. The participants included 30 students from class VII-2. The research instrument was five essay questions to measure critical thinking skills. Material and assessment experts validated the essay questions developed by the researcher. The items that were declared valid were tested for validity. The result showed five valid items with high reliability of .670. Metacognitive skills were measured using the Metacognition Awareness Instrument (MAI), which consists of 40 items. The questions declared valid were tested for validity with a very high reliability of .953 for 37 items, and only three items were invalid. The ability to express an opinion was measured with an observation questionnaire validated by experts with a valid instrument score. Data analysis was performed by path analysis using the SmartPLS software. The results showed that the Li-Pro-GP blended learning model significantly strengthened students' metacognitive skills, critical thinking, and opinion formation.
Examining the Associations Between Calibration Accuracy and Executive Functions in Physical Education
calibration accuracy executive functions physical education sports performance...
This study examined students’ calibration of performance in a sport skill in relation to their performance in an executive functions test. A total of 265 students in the fourth, fifth, and sixth grades participated in the study. The students took an executive functions test, and then they were tested on a basketball shooting test, after having provided a personal estimation regarding their performance. Based on students’ actual and estimated performance, the bias index was calculated to classify students into three categories; accurates, underestimators and overestimators, while the accuracy index (absolute values of the bias index) was also calculated. The results showed a positive but small magnitude relation between students’ scores in the executive functions test and their performance calibration, while accurate scored higher on the executive function test compared to over estimators and under estimators. These results are similar to those of previous studies with elementary school children that employed cognitive tasks and were discussed with reference to theoretical and empirical implications.
The Development of a Four-Tier Diagnostic Test Based on Modern Test Theory in Physics Education
developing test four-tiers diagnostic test modern test theory...
Diagnostic tests are generally two or three-tier and based on classical test theory. In this research, the Four-Tier Diagnostic Test (FTDT) was developed based on modern test theory to determine understanding of physics levels: scientific conception (SC), lack of knowledge (LK), misconception (MSC), false negatives (FN), and false positives (FP). The goals of the FTDT are to (a) find FTDT constructs, (b) test the quality of the FTDT, and (c) describe students' conceptual understanding of physics. The development process was conducted in the planning, testing, and measurement phases. The FTDT consists of four-layer multiple-choice with 100 items tested on 700 high school students in Yogyakarta. According to the partial credit models (PCM), the student's responses are in the form of eight categories of polytomous data. The results of the study show that (a) FTDT is built on the aspects of translation, interpretation, extrapolation, and explanation, with each aspect consisting of 25 items with five anchor items; (b) FTDT is valid with an Aiken's V value in the range of 0.85-0.94, and the items fit PCM with Infit Mean Square (INFIT MNSQ) of 0.77-1.30, item difficulty index of 0.12-0.38, and the reliability coefficient of Cronbach's alpha FTDT is 0.9; (c) the percentage of conceptual understanding of physics from large to small is LK type 2 (LK2), FP, LK type 1 (LK1), FN, LK type 3 (LK3), SC, LK type 4 (LK4), and MSC. The percentage sequence of MSC based on the successive material is momentum, Newton's law, particle dynamics, harmonic motion, work, and energy. In addition, failure to understand the concept sequentially is due to Newton's law, particle dynamics, work and energy, momentum, and harmonic motion.
Parents’ Perspectives on Distance Learning Mathematics During the COVID-19 Pandemic: A Phenomenological Study in Indonesia
the pandemic distance learning learning mathematics...
‘Panic-gogy’ is a term that describes the educational situation during the pandemic due to the transformation phenomenon from face-to-face learning to distance learning. Various types of research are used to uncover the constraints of this phenomenon, but not many researchers use phenomenological studies with parents as participants. Therefore, we used a phenomenological study to describe parents’ views on the constraints, expectations, and approvals regarding the preparation of distance learning modules at the junior high school level (aged 13-15 years). Data collection was carried out using semi-structured interviews. Data were analyzed using NVivo-12-assisted thematic analysis. The main findings are that most parents experience problems. Namely, children do not understand mathematics material, incomplete explanations of material from teachers, internet disturbances, and quota limitations, and children cannot learn mathematics optimally during the distance learning period. Most parents want face-to-face learning to be carried out immediately, teachers to provide detailed explanations, and use digital learning platforms. In addition, 85% of parents agree that mathematics teachers should develop distance learning modules. However, because the pandemic is still not over, this study recommends using blended learning to maintain the quality of mathematics learning.
Development of a Self-Evaluation Instrument with Programmatic Assessment Components for Undergraduate Medical Students
instrument development medical education programmatic assessment...
This study aimed to develop and test a student self-assessment instrument based on the programmatic assessment (PA) components. We applied a series of psychometric research methods by (a) conducting a literature study to find PA constructs, (b) developing the students' self-questionnaires, (c) ensuring content validity, (d) testing face validity, and (e) conducting reliability tests that involve medical students, medical teachers, medical educationalist, and an international PA expert. Face validity (readability test) was conducted with 30 medical students from an Indonesian university who were in their last year of pre-clinical education and had average scores above or equal to their classmates. The confirmatory factor analysis (CFA) was used to report the instruments’ validity and reliability. The final instrument was tested on 121 medical students with excellent GPAs from another medical school with a middle-level accreditation. The PA consists of five components: ‘learning activities’, ‘assessment activities’, 'supporting activities’, 'intermediate evaluations’, and ‘final evaluations'. These components are conveyed through 41 relevant statements with a four-point Likert scale and three yes/no statements. According to the respondents, there was a lack of 'supporting activities' and 'intermediate evaluation' components in the PA in their universities. This study has developed and tested a five-component evaluation instrument based on medical students' perceptions regarding PA implementation.
Evaluating the Results of PISA Assessment: Are There Gaps Between the Teaching of Mathematical Literacy at Schools and in PISA Assessment?
education gaps mathematical competence mathematical literacy pisa assessment...
The problems in education in the countries of the Organization for Economic Cooperation and Development (OECD) vary from country to country. The differences between "upper class" and "lower class" countries in PISA assessment results have led to a research gap. The purpose of this study was to (a) test students' mathematical literacy skills on the Program for International Student Assessment (PISA) test and compare the results using the sum of means across OECD countries; (b) examine the relationship between students' mathematical competence, precision, and self-perception of mathematical literacy skills in the PISA test; and (c) analyze the gaps that exist between the implementation of mathematics instruction in school and the mathematical literacy as measured on the PISA test. This study was designed as a mixed method with an explanatory sequential design. The data collection methods included test procedures, questionnaires, and interviews. The result of this study showed that the overall mean score obtained was below the OECD average. In general, the respondents achieved only level 2 mathematics proficiency. A significant relationship was found between mathematical competence, precision, and self-perception in mathematical skills. On the other hand, there was a gap, namely the difference at the implementation level, where mathematical literacy measured by PISA differed from the measurement of mathematical learning achievement by teachers in school. The results showed that teaching that emphasizes only problem-solving procedures affects low mathematical competence and is not useful enough for students to deal with the PISA mathematics test.
The Development of Teacher Performance Assessment Instruments in Boarding School
assessment boarding school teacher’s performance...
The objective of this study is to create a tool for evaluating teachers’ effectiveness in boarding schools. Planning and preparation stages, instrument testing, and measurements were used in this study to implement research on the creation of the Mardapi model instrument. In order to generate instrument items, the planning and preparation stage tasks included a literature assessment of teacher performance appraisal manuals. Data were gathered utilizing documentation approaches, and descriptive and qualitative analysis was performed. Six specialists validated the built instruments, which were subsequently put through limited testing at two boarding schools and extensive trials at nine boarding schools in Surakarta residency area. The Aiken formula was used to examine the expert’s evaluation data, and confirmatory factor analysis was used to analyze the test results. The results of this study indicate that the instrument for assessing teacher performance in boarding schools meets the validity criteria. This is indicated by the existence of loading factor values ranging from .51 to .72 (>.4) and t-sign values ranging from 4.75 to 9.25 (>1.96) and meeting the requirements of a fit model since Chi-square = 1307.95 < 2524 (2*df), p-value = .17956 (>.05), and RSMEA value = .014 (<.08). The instrument items are reliable assessment packages, and this is shown by the reliability value of omega .967 > .70. Because there is a guarantee of validity and reliability, the test can be used to further assess teacher performance in boarding schools.
Indonesian Teachers' Acceptance on Online Teaching Technology During the COVID-19 Pandemic
facilitating condition pandemic pls-sem technology acceptance model tpack self-efficacy...
This study investigates the impact of external variables, technological pedagogical and content knowledge (TPACK) self-efficacy, and facilitating conditions on teacher adoption of online teaching technology during the COVID-19 pandemic. It employs explanatory research to characterize the effect of external variables on the variables of the technology acceptance model. 240 high school teachers filled out Google Forms survey questionnaires for six research variables and analyzed by the SmartPLS program. The result indicates that attitude and perceived usefulness significantly and positively influence behavioral intention. Perceived usefulness and ease of use have a strong positive effect on attitude. Furthermore, perceived ease of use has a considerable effect on perceived usefulness. Perceived usefulness and ease of use are not significantly influenced by external variables. Facilitating conditions significantly positively affect behavioral intention, whereas TPACK self-efficacy negatively affects behavioral intention.
Evaluation of the Pedagogical Impact of the Educational Usage of 3D Printing in Czech Lower Secondary and Grammar Schools
3d print education pedagogical impact teaching aids...
In this article, we discuss the impacts of using 3D printing in education. Our primary goal is to evaluate the pedagogical impact of lessons utilizing 3D printing. We asked one hundred ninety students in four reference schools about the acceptability of existing 3D materials for teaching. Although the results show high attractiveness for the target group, it turned out that the available lessons primarily focus on the acquisition of technical skills and do not use the potential of education in other areas. We, therefore, proposed a concept for creating multidisciplinary teaching lessons that connect the technical part with other educational areas. We show the application of our concept in a newly developed lesson in biology, where we again evaluate its acceptance among the students. The results show that although the multidisciplinary lessons are more complex, they are still acceptable to the students, and, most importantly, they add significant educational value. Finally, we discuss the possibilities of incorporating 3D printing into the teaching curriculum. We also use a selected use case to illustrate the real-world problems we have encountered.
Evaluation of the Psychometric Properties of a Scale for Emotional Regulation in Academic Activities
emotional regulation emotions inventory self-control...
This study arises from the need to scientifically investigate how university students deal with their emotions in school situations. Therefore, the objective was to develop an instrument that measured university students' level of emotional regulation during academic activities and evaluate its validity and reliability. After a thorough literature review of the definitions of the constructs, the Emotional Regulation Scale in Academic Activities (ERAAS) was developed. The first version of ERAAS consisted of 18 Likert-type items. A total of 1975 university students in various departments responded to the instrument. Two groups of experts evaluated its content validity. Validity and reliability analysis was performed. According to the EFA, three factors were found: emotional regulation, psychologic inadequate emotional regulation, and physiological insufficient emotional regulation. The final version of the scale consisted of 11 items, the validity and reliability of which could be demonstrated for further research purposes.
Measuring Interest: Development and Application of a Three-Dimensional Situational Interest Short Scale
components of interest scale development situational interest situational interest short scale...
Situational interest is an important factor that has a great influence on learning success in both in-school and out-of-school learning situations. Although there has been extensive research on interest in its diverse forms for decades, an evaluated measurement instrument for situational interest that covers the three theoretically defined components of interest (emotional, cognitive, value-related) is still missing. Therefore, in this study, based on person-object theory of interest, a short scale was developed that can be used in a variety of learning programs independent of content or methods. In study 1, eight suitable items were selected and their structure was examined using exploratory methods. In study 2, the results of study 1 were verified using confirmatory factor analyses. Study 3 shows an example of a practical application of the newly developed scale in two different learning settings. The findings provide evidence that the scale developed here is a practical instrument to measure situational interest taking into account all its components. On the one hand, the scale can help teachers evaluate their educational programs; on the other hand, it can be used by researchers to empirically investigate the construct of interest. Thus, the scale makes an important contribution to research and practice.
Developing Creative Thinking in Preschool Children: A Comprehensive Review of Innovative
comprehensive review creative thinking early childhood...
The ability to think creatively has a vital role in the development of preschool children. This research provides a comprehensive review of innovative approaches and strategies for developing creative thinking in preschool children based on current trends and methodologies used in educational settings. This research shows three significant areas: (a) creative thinking skills in preschool children, (b) factors influencing creative thinking skills in depth, and (c) innovative strategies and approaches to stimulate creative thinking abilities in preschool children. This research uses a literature study method assisted by the publish perish application to find reference sources related to creative thinking abilities in preschool children. Studies show that creative thinking abilities in preschool children enable them to find innovative solutions, help them adapt to challenges, foster self-confidence and courage, and enrich their experience and knowledge of the world around them. Meanwhile, preschool children's creative thinking abilities are influenced by collaboration from the external environment (parents, teachers, and society); providing support and examples for children to develop and stimulate their creative thinking skills is very important.
Analyzing Learning Style Patterns in Higher Education: A Bibliometric Examination Spanning 1984 to 2022 Based on the Scopus Database
bibliometric analysis higher education learning styles scopus...
In an era where diversity and digitalization significantly influence higher education, understanding and adapting to various learning preferences is crucial. This study comprehensively analyzes 394 scholarly articles from 1984 to 2022 using bibliometric methods, providing a dynamic overview of the research patterns in learning styles within higher education. We identified four stages of development during this period: 1984–1995 (Low-interest), 1996–2005 (Early development), 2006–2018 (Development), and 2019–2022 (Intensification). Our analysis highlights that the United States, the United Kingdom, and Australia were the top three leading publishers of research on learning styles in higher education. The results reveal three main topics of publications: educational technology, learning environments, and subject behaviors. This research not only identifies emerging research topics but also underscores the importance of adapting instructional strategies to diverse learning styles to enhance educational outcomes in higher education.
Validation of Students' Green Behavior Instrument Based on Local Potential Using Structural Equation Modeling With Smart Partial Least Squares
instrument validation green behavior local potential structural equation modeling smart partial least squares...
This study aims to develop and validate a green behavior instrument based on local potential using structural equation modeling (SEM) with smart partial least squares (SmartPLS). The instrument consists of 40 statements covering five main indicators: environmental maintenance, waste reduction, saving natural resources, sustainable mobility and consumption, and community education. This study addresses a gap in existing research by creating a context-specific tool for assessing green behavior, incorporating local cultural and ecological factors. While prior studies emphasize global sustainability principles, they often overlook the significance of local practices and values, which are essential for effective environmental education. By integrating local potential, this instrument bridges global sustainability goals with regional contexts, enabling meaningful and practical student engagement. The instrument was validated through content validity testing, exploratory and confirmatory factor analyses, and construct validity and reliability testing using SEM with SmartPLS. The results indicate strong content validity, with content validity index (CVI) values ranging from .80 to .90. After analysis, 34 valid items were retained from the initial 40. This study contributes to the literature by developing an instrument that aligns with global sustainability goals while integrating local cultural practices and ecological contexts. It offers insights into how local knowledge enhances sustainability education, providing a holistic framework for assessing green behavior across diverse regions.
Project-Based Learning as a Catalyst for Fostering Metacognitive Skills in Preservice Science Teachers
metacognition metacognitive skills preservice science teachers project-based learning...
This study examines the impact of Project-Based Learning (PjBL) on developing metacognitive skills among preservice science teachers (PSTs) in Northeast Thailand. A sample of 143 PSTs, including first-year students in General Biology 1, second-year students in General Physics 1, and third-year students in Basic Organic Chemistry, participated in an 18-week programme. The study aimed to assess changes in metacognitive skills before and after PjBL implementation, evaluate differences among academic years, and identify predictors of skill development. The methodology included a six-hour orientation workshop and a collaborative, project-based curriculum. Descriptive and inferential statistics were employed, with the item-objective congruence index (IOC) for content validity, paired samples t-tests for pre- and post-intervention comparisons, and Analysis of Variance (ANOVA) to examine differences across academic years. Multiple regression analysis was used to identify significant predictors of metacognitive skill development. Results showed significant improvements in metacognitive skills post-PjBL, with substantial enhancements across all subjects. ANOVA indicated significant differences among academic years, with third-year students demonstrating the highest metacognitive skill levels. Multiple regression analysis identified participation in PjBL and academic level as significant predictors of metacognitive skill development. These findings highlight the effectiveness of PjBL in enhancing metacognitive skills and underscore the importance of active learning and reflective practices in teacher education programmes. This study provides valuable insights into the impact of PjBL on PSTs' professional growth and instructional efficacy, preparing them for modern classroom challenges.
Validity of Measurement and Causal Model of Online Scam Protection Behavior Among Risk Thai Students
causal model confirmatory factor analysis high school student online scam protection behavior...
This research investigated the validity of measurement and causal model of online scam protection behavior (OSPB) among at risk Thai students. The sample comprised 286 high school students from three demonstration schools under the University. Data were analyzed using descriptive statistics, confirmatory factor analysis (CFA), and structural equation modeling (SEM). The factor loadings for all items satisfied the standard criteria with scores ranging from .40 to .80, item-total correlations ranging from .405 to .718, and Cronbach’s alpha coefficients ranging from .773 to .928. The modified model demonstrated a better fit with the empirical data (χ² = 47.62, df = 37, p = .113, χ²/df = 1.287, RMSEA = .032, SRMR = .028, GFI = .97, CFI = 1.00, NFI = .99). All factors: a) awareness of online risks, b) inhibitory control, c) game-based learning, d) social support, and e) motivation to prevent online scams can predict 81% of OSPB. The motivation to prevent online scams strongly influenced OSPB, with an effect size of .60. Additionally, all factors can predict 88% of the motivation for online scam prevention, suggesting that Protection Motivation Theory (PMT) is a suitable framework for understanding and evaluating Thai students' preventive behaviors in online deception scenarios. This newly developed instrument is highly reliable and can be effectively used by researchers and educators to assess the risk of online fraud victimization among high school students.