'validity analysis' Search Results
Evaluating the Results of PISA Assessment: Are There Gaps Between the Teaching of Mathematical Literacy at Schools and in PISA Assessment?
education gaps mathematical competence mathematical literacy pisa assessment...
The problems in education in the countries of the Organization for Economic Cooperation and Development (OECD) vary from country to country. The differences between "upper class" and "lower class" countries in PISA assessment results have led to a research gap. The purpose of this study was to (a) test students' mathematical literacy skills on the Program for International Student Assessment (PISA) test and compare the results using the sum of means across OECD countries; (b) examine the relationship between students' mathematical competence, precision, and self-perception of mathematical literacy skills in the PISA test; and (c) analyze the gaps that exist between the implementation of mathematics instruction in school and the mathematical literacy as measured on the PISA test. This study was designed as a mixed method with an explanatory sequential design. The data collection methods included test procedures, questionnaires, and interviews. The result of this study showed that the overall mean score obtained was below the OECD average. In general, the respondents achieved only level 2 mathematics proficiency. A significant relationship was found between mathematical competence, precision, and self-perception in mathematical skills. On the other hand, there was a gap, namely the difference at the implementation level, where mathematical literacy measured by PISA differed from the measurement of mathematical learning achievement by teachers in school. The results showed that teaching that emphasizes only problem-solving procedures affects low mathematical competence and is not useful enough for students to deal with the PISA mathematics test.
Mathematical Literacy Skills for Elementary School Students: A Comparative Study Between Interactive STEM Learning and Paper-and-Pencil STEM Learning
experimental research interactive stem mathematical literacy paper and pencil stem...
This study aimed to compare and examine the effectiveness of interactive STEM learning and paper-and-pencil STEM learning in terms of mathematical literacy skills of elementary school students. This research is of a quasi-experimental type with a non-equivalent pretest-posttest control group design. Sampling was carried out on the elementary school populations in Bengkulu and South Sumatra Provinces in two stages. In the first stage, schools in rural and urban areas were selected, and in the second, classes in each school were randomly selected. The selected sample consisted of fifth-grade students of the Public Elementary School of Terawas, Musi Rawas, with an experimental class A (n = 20) and an experimental class B (n = 19), as well as fifth-grade students of the Public Elementary School of Bengkulu City, with an experimental class A (n = 25) and an experimental class B (n = 22). Data collection was conducted using mathematical literacy skills tests in reference to the PISA and Minimum Competency Assessment (level 1–3). Data analysis was performed using descriptive and inferential statistics; it employed an independent t-test for the comparative testing and an N-gain test for testing the effectiveness of STEM learning. The results showed that there were differences in math literacy skills between interactive STEM and paper-and-pencil STEM for students in urban schools, but not significantly different for students in rural schools. General STEM learning was effective in increasing the literacy of elementary school students, and interactive STEM in particular demonstrated the highest level of effectiveness in the urban school.
Effect of Computer Based Test on Motivation: A Meta-Analysis
computer-based test meta-analysis motivation r studio...
This meta-analysis study investigates the effect of computer-based tests on motivation. The random effect model is the basis for calculating the summary effect, and it is found that the 30 articles obtained through the PRISMA method, which consist of four parts, namely identification, screening, eligibility, and included, can be generalized. Data analysis was performed using R studio and OpenMEE. Based on the research results, the p-value <.05 was obtained, so it was concluded that using a computer-based test significantly affected motivation. In the moderator analysis, it was found that computer-based tests were most effective for intrinsic motivation for the motivation variable, university students for the participants variable, and the country of Iran for the region variable. Evaluation of publication bias using the funnel plot and regression method shows no publication bias, proving that the 30 articles analyzed represent all existing studies on computer-based tests.
Optimizing the Creativity of Reflective and Impulsive Students through Writing Articles Based on Information Literacy
cognitive style creativity impulsive information literacy reflective...
Creativity and information literacy are skills necessary for students for task completion in the learning process. One of the tasks assigned to students in learning is to write drafts of scientific articles. Furthermore, teachers must pay attention to cognitive styles in the learning process. This study aimed to describe students' creativity in writing drafts of scientific papers based on information literacy concerning reflective and impulsive cognitive styles. This research was exploratory qualitative research to explain the creativity of reflective and impulsive students in writing scientific article drafts based on information literacy. The research subjects comprised two students for each reflective and impulsive cognitive style. The cognitive style was measured using the Matching Familiar Figure Test instrument. Students' creativity was measured using a test with fluency, flexibility, originality, and elaboration indicators. The results indicated that reflective students were highly creative in writing drafts of scientific articles. Meanwhile, impulsive students were relatively creative in the same activity. In conclusion, students possessing the reflective cognitive style are more creative than students following the impulsive cognitive style in writing drafts of scientific articles based on information literacy. We recommend that writing articles based on information literacy is required to increase HOTs (Higher Order Thinking Skills).
Relationship between Mentors’ Roles and Mentees’ Leadership Development: The Mediating Role of Mentees’ Self-efficacy
mentees’ leadership development mentees’ self-efficacy mentors’ roles...
Limited latest studies circulated in the 21st century of world university ranking reveal that well-designed mentoring programs will not increase mentees’ leadership development if mentors have not implemented effective roles in the mentoring programs. Although many studies have been done, the mediating effect of mentors’ roles is little known in the tertiary education mentoring research literature. This study is done to examine the correlation between mentors’ roles, mentees’ self-efficacy, and mentees’ leadership development. This study employed a cross-sectional research design. A purposive sampling plan was employed to collect 761 survey questionnaires from undergraduate students at non-research-based public universities in Sarawak. The survey data were analyzed by the SmartPLS package to determine the validity and reliability of the study instrument, and thus test hypotheses for the direct effects model and mediating model. The outcomes of the SmartPLS path model analysis showed that the majority of participants felt that the levels of information exchange, help, self-efficacy, and leadership development are high. This situation explains that the ability of mentors to appropriately implement information exchange and help in mentoring programs has strongly evoked mentees’ self-efficacy. Consequently, this self-efficacy can lead to higher leadership development. This finding can help practitioners to understand the diverse paradigms of mentees’ self-efficacy concept and plan the integration of academic and social-based approaches in formulating mentoring programs to prepare successful graduates in a time of rapid global change.
The Implementation of Flipped Learning Model and STEM Approach in Elementary Education: A Systematic Literature Review
elementary education e-learning flipped learning stem technology...
This study aimed to explore the implementation and impact of the Flipped Learning Model (FLM) and STEM Approach in elementary education. The advancement of technology and the Covid-19 pandemic has increased the importance of e-learning, including in elementary schools. The literature review analyzed 193 academic works published in the past six years using NVivo, Mendeley, and VOSviewer software. The validity of the data was verified through the analysis of five online databases. The results showed that STEM research has been well-developed with innovative approaches that improve learning outcomes, while FLM research in elementary schools is limited. The study suggested that combining FLM with STEM Approach (FLM-SA) can optimize learning in the technological era. By integrating FLM-SA, students can engage in active learning experiences in class and acquire fundamental knowledge outside of class, offering a solution to e-learning challenges. The study emphasized the strong connection between FLM and STEM Approach and how they can support each other to enhance student learning.
The Development of Teacher Performance Assessment Instruments in Boarding School
assessment boarding school teacher’s performance...
The objective of this study is to create a tool for evaluating teachers’ effectiveness in boarding schools. Planning and preparation stages, instrument testing, and measurements were used in this study to implement research on the creation of the Mardapi model instrument. In order to generate instrument items, the planning and preparation stage tasks included a literature assessment of teacher performance appraisal manuals. Data were gathered utilizing documentation approaches, and descriptive and qualitative analysis was performed. Six specialists validated the built instruments, which were subsequently put through limited testing at two boarding schools and extensive trials at nine boarding schools in Surakarta residency area. The Aiken formula was used to examine the expert’s evaluation data, and confirmatory factor analysis was used to analyze the test results. The results of this study indicate that the instrument for assessing teacher performance in boarding schools meets the validity criteria. This is indicated by the existence of loading factor values ranging from .51 to .72 (>.4) and t-sign values ranging from 4.75 to 9.25 (>1.96) and meeting the requirements of a fit model since Chi-square = 1307.95 < 2524 (2*df), p-value = .17956 (>.05), and RSMEA value = .014 (<.08). The instrument items are reliable assessment packages, and this is shown by the reliability value of omega .967 > .70. Because there is a guarantee of validity and reliability, the test can be used to further assess teacher performance in boarding schools.
Course Dropout Intention Scale: Development and Validation of a New Brief Measure in Academic College Context
brief measure college student course dropout dropout intention dropout studies...
University students may encounter situations where they perform poorly in a course and contemplate dropping out. This intention to drop out of a course manifests not only in thoughts or ideas but also in a cognitive self-evaluation of their performance and skills, enabling them to reflect on the possibility of dropping out. In this sense, there is a shortage of instruments that evaluate the intention to drop out of a course, so the aim was to develop and validate the Course Dropout Intention Scale (CDIS). Data from two samples (N1 = 198; N2 = 675) were used; the first was for the EFA, and the second was for the CFA, GRM, and SEM. The one-factor model was derived from the EFA and confirmed in the second sample, exhibiting appropriate goodness-of-fit indices. Similarly, the GRM obtained adequate fit indices; all items discriminated adequately, and the difficulty parameter had a monotonic increase. The SEM model of the effect of satisfaction with studies on the CDIS showed a negative and statistically significant effect. Thus, it was demonstrated that the CDIS is a robust instrument in its psychometric properties and empirical evidence with other variables.
Self-Directed Learning Readiness Model: A Mediating Role of Self-Efficacy among Need-Supportive Teaching Style, Transformational Parenting and Emotional Intelligence
emotional intelligence need-supportive teaching style self-directed learning readiness self-efficacy transformational parenting...
The study aimed to explore the self-directed learning readiness model and its relationship with various factors such as emotional intelligence, transformational parenting, need-supportive teaching style, and self-efficacy as potential mediators. The research was conducted with 415 junior high school students in Surabaya, Indonesia. To ensure the reliability and validity of the instruments used in the study, confirmatory factor analysis was performed. The loading factor values of all the items in the instruments were found to be greater than .50 indicating a satisfactory level of validity. Additionally, the reliability coefficient of all the instruments exceeded .90 demonstrating good internal consistency. Analysis using structural equation modeling (SEM) demonstrated that the theoretical model of self-directed learning readiness was consistent with empirical conditions because it meets the standard value of goodness of fit. Furthermore, through the indirect effect tests, it was discovered that need-supportive teaching style, emotional intelligence, and transformational parenting significantly influenced self-directed learning readiness, with self-efficacy acting as a mediator. Among the factors examined, self-efficacy was found to have the greatest impact in explaining readiness for self-directed learning readiness.
Community-Based Project Learning: Empowering Students' Self-Regulated Learning and Creativity
community creativity project self-regulated learning...
Changes and challenges in the highly dynamic world of education require postgraduate students to manage their learning well and create something from their creative thinking according to the needs of the field. One of them is the activity of students in developing integrated natural science teaching materials is very necessary because learning at the primary level still uses integrated or thematic learning. Furthermore, students also need to be encouraged to be adaptive to these challenges by empowering their independence in learning. The ability to manage learning and creativity to create something new is highly prioritized for college graduates to contribute generously to their environment. This study aims to describe the empowerment of self-regulated learning and student creativity in developing natural science teaching materials in collaboration through community-based project learning. This study used a quasi-experimental design with a single-subject design type. The instruments used to retrieve data are creativity assessment rubrics and self-regulated learning questionnaires. The conclusion is that students are intrinsically and extrinsically motivated to fulfill the given tasks. Learning is essential for increasing competence, and learning strategies have been adjusted to the material's complexity or the difficulty level of the studied content. The aspect of student creativity in developing Integrated Science teaching materials shows the existence of change from stage one to the next and good categories.
Indonesian Teachers' Acceptance on Online Teaching Technology During the COVID-19 Pandemic
facilitating condition pandemic pls-sem technology acceptance model tpack self-efficacy...
This study investigates the impact of external variables, technological pedagogical and content knowledge (TPACK) self-efficacy, and facilitating conditions on teacher adoption of online teaching technology during the COVID-19 pandemic. It employs explanatory research to characterize the effect of external variables on the variables of the technology acceptance model. 240 high school teachers filled out Google Forms survey questionnaires for six research variables and analyzed by the SmartPLS program. The result indicates that attitude and perceived usefulness significantly and positively influence behavioral intention. Perceived usefulness and ease of use have a strong positive effect on attitude. Furthermore, perceived ease of use has a considerable effect on perceived usefulness. Perceived usefulness and ease of use are not significantly influenced by external variables. Facilitating conditions significantly positively affect behavioral intention, whereas TPACK self-efficacy negatively affects behavioral intention.
A Psychometric Validation of the Sociomathematical Norm Scale for Senior High School Students in Mathematics Learning
developments scale learning mathematics; psychometric validation rasch model sociomathematical norms...
Students in mathematics classes do not understand the importance of sociomathematical norms in learning mathematics. This causes sociomathematical norms not to be teachers' focus when learning mathematics. Besides, there is no standardized instrument for assessing this norm, so developing this instrument is necessary to measure socio-mathematical norms in learning mathematics. This study aims to create and verify the psychometric validity of the sociomathematical norm scale. This research used a survey method with 505 senior high school students from Jakarta and West Java as respondents. The results showed that 25 items had convergent validity, with a loading factor value of > 0.700, meaning they could be declared valid. Concurrent validity indicates that each sociomathematical norms indicator is valid as a whole. Discriminant validity shows that the average variance extracted value on the diagonal is higher than the other values, so each item is declared valid. It was concluded that each item of the sociomathematical norms instrument has accuracy in its measurement function. The reliability test shows that each sociomathematical norms item is declared reliable. The reliability value of the sociomathematical norm item is .99, and the person's reliability is .86. Thus, the instruments developed can measure sociomathematical norms in learning mathematics.
Developing an Augmented Reality-Assisted Worksheet to Support the Digital Science Practicum
augmented reality learning technology digital science practicum...
The purpose of this research is to develop a worksheet that can support a digital science practicum. Conducting a needs analysis comes first in the development of worksheets, then comes product creation. The product produced based on the needs test analysis is a worksheet with the help of science worksheet-augmented reality (SWAR). Two knowledgeable education professionals then evaluate the finished product and test it out on participants or students. The results of the study show that worksheets equipped with augmented reality media are necessary. Meanwhile, the resulting product is valid in an almost perfect category (Pe = 0.7219; Po = 0.9744; K = 0.9078). Student perceptions of the products produced are at an "excellent" level in each category (ME-Av, mean = 3.466; CO-Av, mean = 3.472; CT-Av, mean = 3.503; ST-Av, mean = 3,507; TA-Av, mean = 3.440; IN-Av, mean = 3.640; MO-Av, mean = 3.640). There is a significant inverse relationship between media features (ME-Av) and student interest (IN-Av) based on Pearson's correlation test with r = -.50 (p < .50). Further explanation is presented based on the data that has been collected.
Development and Psychometric Validation of an Information Competency Assessment: The Information Management Brief Scale
information competency information literacy information management inventory inventory...
Today's college students relate directly to the information through which they learn. They are the ones who detect the information they need, search and evaluate it, and also use it to develop academic projects. Information literacy programs have increased in universities to support the development of these skills to students. The aim of this study was to provide an instrument that allows the measurement of information competency in higher level students and generate evidence of its validity and reliability. The Information Management Brief Inventory (IMBS) was developed, which consisted of 16 Likert type items. IMBS was applied to a sample of 1,937 students from a public university in northern Mexico. For the evaluation of the construct validity and identification of the factor grouping of the items, an exploratory factor analysis (EFA) was carried out. Confirmatory factor analysis (CFA) was carried out to explore the goodness of fit of the model. It was found that the 16 items were grouped into three factors: information management, access to information and information ethics. The psychometric properties of IMBS were adequate.
Evaluation of the Pedagogical Impact of the Educational Usage of 3D Printing in Czech Lower Secondary and Grammar Schools
3d print education pedagogical impact teaching aids...
In this article, we discuss the impacts of using 3D printing in education. Our primary goal is to evaluate the pedagogical impact of lessons utilizing 3D printing. We asked one hundred ninety students in four reference schools about the acceptability of existing 3D materials for teaching. Although the results show high attractiveness for the target group, it turned out that the available lessons primarily focus on the acquisition of technical skills and do not use the potential of education in other areas. We, therefore, proposed a concept for creating multidisciplinary teaching lessons that connect the technical part with other educational areas. We show the application of our concept in a newly developed lesson in biology, where we again evaluate its acceptance among the students. The results show that although the multidisciplinary lessons are more complex, they are still acceptable to the students, and, most importantly, they add significant educational value. Finally, we discuss the possibilities of incorporating 3D printing into the teaching curriculum. We also use a selected use case to illustrate the real-world problems we have encountered.
Sleep Preferences and Chronotype Traits Impact on Academic Performance Among University Students
academic achievement college students daytime and nighttime classes post-pandemic sleep preferences...
Due to irregular daytime routines, chronotype changes, side jobs and exam periods, after the COVID-19 pandemic, university students are trying to find new balances in their everyday life. The aim of the present study is to analyze the impact of daytime chronotype and hour preferences for the circadian rhythm on academic achievement among university students, considering their sleep habits and class frequencies in daytime and nighttime classes. Furthermore, this study aimed to analyze the differences in chronotype preferences with regard to age, sex, and academic schedule students are attending. A sample of 87 university second-year Psychology and Management students attending the academic year 2021/2022 after the governmental relief measures of the COVID-19 pandemic completed a 13-item questionnaire on sleep habits and preferences. Further variables encompassed sleep behaviors, such as age, sex, daytime and nighttime classes, as well as academic achievement. The results of the study showed that university students had a higher preference for the morningness type. Additionally, chronotype traits explained 30% (values from regression analysis) of academic achievement but did not directly impact academic results. The sleep&amp;amp;amp;ndash;wake cycle diverged among age groups because the youngest participants (19&amp;amp;amp;ndash;21 years old) and older participants (35&amp;amp;amp;ndash;44 years old) reported higher academic scores during the first semester and the full academic year. No significant differences were identified with respect to sex. There is a lack of literature explaining the effect of sleep hours on academic achievement among students after stay-at-home rules during the COVID-19 pandemic. Thus, it is imperative to understand the difficulties students face with regard to their studying hours, working shifts, and daytime or nighttime classes to create a sustainable university system that attends to students&amp;amp;amp;rsquo; needs and necessities.
Evaluation of the Psychometric Properties of a Scale for Emotional Regulation in Academic Activities
emotional regulation emotions inventory self-control...
This study arises from the need to scientifically investigate how university students deal with their emotions in school situations. Therefore, the objective was to develop an instrument that measured university students' level of emotional regulation during academic activities and evaluate its validity and reliability. After a thorough literature review of the definitions of the constructs, the Emotional Regulation Scale in Academic Activities (ERAAS) was developed. The first version of ERAAS consisted of 18 Likert-type items. A total of 1975 university students in various departments responded to the instrument. Two groups of experts evaluated its content validity. Validity and reliability analysis was performed. According to the EFA, three factors were found: emotional regulation, psychologic inadequate emotional regulation, and physiological insufficient emotional regulation. The final version of the scale consisted of 11 items, the validity and reliability of which could be demonstrated for further research purposes.
Measuring Interest: Development and Application of a Three-Dimensional Situational Interest Short Scale
components of interest scale development situational interest situational interest short scale...
Situational interest is an important factor that has a great influence on learning success in both in-school and out-of-school learning situations. Although there has been extensive research on interest in its diverse forms for decades, an evaluated measurement instrument for situational interest that covers the three theoretically defined components of interest (emotional, cognitive, value-related) is still missing. Therefore, in this study, based on person-object theory of interest, a short scale was developed that can be used in a variety of learning programs independent of content or methods. In study 1, eight suitable items were selected and their structure was examined using exploratory methods. In study 2, the results of study 1 were verified using confirmatory factor analyses. Study 3 shows an example of a practical application of the newly developed scale in two different learning settings. The findings provide evidence that the scale developed here is a practical instrument to measure situational interest taking into account all its components. On the one hand, the scale can help teachers evaluate their educational programs; on the other hand, it can be used by researchers to empirically investigate the construct of interest. Thus, the scale makes an important contribution to research and practice.
Conceptual Model for the Assessment of Academic Productivity in Research Seedbeds From a Systematic Review
formative research higher education measurement productivity research seedbeds...
Higher education institutions have focused their efforts on promoting research seedbeds as a strategy for formative research. In this regard, the impact of such a strategy remains unknown due to the lack of models that enable its evaluation. Therefore, this study aimed to design an evaluation model for the academic productivity of research seedbeds based on the available evidence in the literature. To achieve this, a systematic review was conducted following the PRISMA model, analyzing 53 documents including articles, book chapters, and conference proceedings from the SCOPUS, ProQuest, Jstor, Scielo, and ScienceDirect databases. The results identified indicators that allowed for the design of a model based on six constructs: research training, institutional capabilities, bibliographic production, innovation and development, social appropriation of knowledge, and human resource training. It was concluded that the indicators evaluating research seedbeds seek greater scientific development involving students and improving the quality of research products, which directly impacts the institutional research mission.
The Influence of a Robotics Program on Students’ Attitudes Toward Effective Communication
attitude effective communication robotics students...
This research aimed to explore the influence of a robotic program using the robot kit "RoboBuilder RQ+110" on students' attitudes toward effective communication. The study used a quantitative research design and involved 475 grade 4 (10 years old) students from Malaysia's Selangor and Malacca states. A quasi-experimental research (pre-test & post-test) approach with control and experimental groups was adopted, and the data were analyzed with inferential statistical test and repeated measures analysis of variance (ANOVA) using SPSS 25 software at 0.05 significance level. Questionnaires were administered to collect data from the experimental and control groups. The results showed statistically significant changes (α ≤ .05) in attitudes toward effective communication for the experimental group that received a robotics program compared with the control group. The study results suggest that innovative technological tools or programs such as robotics programs are recommended as innovative science, technology, engineering, and mathematics (STEM) program rooted in constructivism to improve students' attitudes toward effective communication.