'Assessment construct' Search Results
Evaluating the Results of PISA Assessment: Are There Gaps Between the Teaching of Mathematical Literacy at Schools and in PISA Assessment?
education gaps mathematical competence mathematical literacy pisa assessment...
The problems in education in the countries of the Organization for Economic Cooperation and Development (OECD) vary from country to country. The differences between "upper class" and "lower class" countries in PISA assessment results have led to a research gap. The purpose of this study was to (a) test students' mathematical literacy skills on the Program for International Student Assessment (PISA) test and compare the results using the sum of means across OECD countries; (b) examine the relationship between students' mathematical competence, precision, and self-perception of mathematical literacy skills in the PISA test; and (c) analyze the gaps that exist between the implementation of mathematics instruction in school and the mathematical literacy as measured on the PISA test. This study was designed as a mixed method with an explanatory sequential design. The data collection methods included test procedures, questionnaires, and interviews. The result of this study showed that the overall mean score obtained was below the OECD average. In general, the respondents achieved only level 2 mathematics proficiency. A significant relationship was found between mathematical competence, precision, and self-perception in mathematical skills. On the other hand, there was a gap, namely the difference at the implementation level, where mathematical literacy measured by PISA differed from the measurement of mathematical learning achievement by teachers in school. The results showed that teaching that emphasizes only problem-solving procedures affects low mathematical competence and is not useful enough for students to deal with the PISA mathematics test.
Mathematical Literacy Skills for Elementary School Students: A Comparative Study Between Interactive STEM Learning and Paper-and-Pencil STEM Learning
experimental research interactive stem mathematical literacy paper and pencil stem...
This study aimed to compare and examine the effectiveness of interactive STEM learning and paper-and-pencil STEM learning in terms of mathematical literacy skills of elementary school students. This research is of a quasi-experimental type with a non-equivalent pretest-posttest control group design. Sampling was carried out on the elementary school populations in Bengkulu and South Sumatra Provinces in two stages. In the first stage, schools in rural and urban areas were selected, and in the second, classes in each school were randomly selected. The selected sample consisted of fifth-grade students of the Public Elementary School of Terawas, Musi Rawas, with an experimental class A (n = 20) and an experimental class B (n = 19), as well as fifth-grade students of the Public Elementary School of Bengkulu City, with an experimental class A (n = 25) and an experimental class B (n = 22). Data collection was conducted using mathematical literacy skills tests in reference to the PISA and Minimum Competency Assessment (level 1–3). Data analysis was performed using descriptive and inferential statistics; it employed an independent t-test for the comparative testing and an N-gain test for testing the effectiveness of STEM learning. The results showed that there were differences in math literacy skills between interactive STEM and paper-and-pencil STEM for students in urban schools, but not significantly different for students in rural schools. General STEM learning was effective in increasing the literacy of elementary school students, and interactive STEM in particular demonstrated the highest level of effectiveness in the urban school.
The Impact of Educational Robotics on Cognitive Outcomes in Primary Students: A Meta-Analysis of Recent Studies
cognitive outcomes educational robotics elementary education meta-analysis primary students...
In recent years, educational robotics has gained ground in educational policy around the world, and primary education is no exception. However, there has not yet been a thorough synthesis of methodologically appropriate empirical research on the effects of robotics upon cognitive performance among primary school students, which this paper attempted to do. Following literature screening, a total of eight studies published between 2018 and 2022 with a sample size of 567 children met inclusion criteria and were meta-analyzed. Resultantly, a medium aggregate effect size in favor of robotics experiments emerged (standardized mean difference of .641), which was significantly higher compared to non-robotics learning (p <.01). No between-study heterogeneity was detected. Subgroup analysis revealed a slightly larger overall effect for interventions on first- to third-graders rather than those in grades 4-6. Additionally, the analysis indicates that in order to enhance cognitive abilities in primary students, robotics interventions should be no longer than four weeks and involve robot construction. Based on the findings, implications, and suggestions are outlined for future research and practice.
Introducing Contextual Teaching and Learning as a Transition from Textbook-Based Curriculum to the National Curriculum
contextual teaching and learning efl elt speaking skills recount text...
The teaching of speaking in English as a foreign language (EFL) classes in the Province of Aceh did not rely on the suggested techniques and methods. This teacher-designed technique, which was mainly textbook-based, has left an unpleasant learning experience among students. Therefore, we conducted a quantitative research study to experiment with how students responded to contextual teaching and learning (CTL) to see the effect of transitioning from a teacher-established method to a systematically planned learning approach and compare how students progressed over time. The experiment was carried out by teachers who had received assistance in preparing the lesson and practicing the lesson plan. The six-meeting experiment was conducted in 11 small classes, with a total sample of 132 students. The student improvement after the first four meetings (cycle 1) was compared using inferential statistical analyses with that after eight meetings (cycle 2). The results show that the student’s achievement significantly improved in the first cycle and continued to improve, although at a lower rate, in the second cycle. This result suggests that CTL can be used to transition from a traditional teaching method to a more established method in EFL teaching. Therefore, teachers need help planning their teaching and practicing how to implement the teaching plan accurately.
Development of Waves Critical Thinking Test: Physics Essay Test for High School Student
assessment in physics essay test physics essay test waves critical thinking test...
This study aims to produce a product to evaluate students' critical thinking skills that departs from physics content where students often have misconceptions. This research is a development research with research stages covering a) research and review literature; (b) planning chapter objectives; (c) developing a preliminary form; (d) field-testing the preliminary form; (e) Revise the preliminary form; (f) conducting a main field-test. The Waves Critical Thinking (WCT) test developed consists of 7 questions with 15 specific domains. Total percentage of content validity test was obtained 87.98% with appropriate criteria and based on the construct validity WCT test, the Goodness of Fit criteria were obtained which were classified as fit. The test instrument being tested consists of 15 objective items. The reliability of WCT test results 0.597 as a Cronbach's alpha score with the medium category and all the components have a good level of composite reliability. The outcome of the study was the WCT test with a valid state for measuring students' CT in a specific domain of physics wave material.
The Relationship Between the Daily Use of Digital Technologies and the Reading and Information Literacy Skills of 15-Year-Old Students
information and communication technologies information literacy pisa2018 reading literacy secondary school...
Digital technologies in all forms have become ubiquitous in our media-rich, modern information society, but the connection between their use and information literacy is not always clear. This paper examines the impact of daily use of digital technologies on the reading and information literacy skills of 15-year-old students in Slovenia, based on data from the Programme for International Student Assessment (PISA) 2018 study. The study examines PISA 2018 variables related to Information and Communication Technologies (ICT), as well as a reading task involving the use of ICT. The sample consists of 2612 Slovenian students with a gender distribution of 50.8% girls and 49.2% boys. The study explores students' experiences, enjoyment, self-efficacy, autonomy, and independence in using ICT and learning about its use and identifies two groups of students: one group that is curious and another that is cautious. The results of confirmatory factor analysis (CFA) and structural equation modelling (SEM) show that the constructs of enjoyment, self-efficacy, learning, autonomy, and independence are highly/strongly correlated but have a low/insignificant impact on information literacy skills.
Semantic Correlation Model of Socio-Formative Data for Curricular Planning Evaluation
curriculum planning curricular evaluation natural language processingi semantic correlation socio-formative data...
The study presents a semantic correlation model (SCM) of socioformative data, which is designed to support the evaluation of curriculum planning (CPE) that is developed from indicators derived from curriculum components such as graduate profile, study plan, area plan and subject plan. The objective of the research was to design a semantic correlation model of socio-formative data to support the evaluation of curriculum planning in accordance with the objectives of sustainable development in education. The study is a quasi-experimental research based in a Likert questionnaire applied on a group of 10 students (16 and 18 years old) belonging to the eleventh grade of the urban official educational institutions of Marsella, in the department of Risaralda in Colombia. The results indicate that the model has an impact on the evaluation of curricular planning, concluding that the design and implementation of a semantic correlation model of sociodemographic data does have an impact on the evaluation of curricular planning of a classroom subject in an educational institution in Marsella.
Course Dropout Intention Scale: Development and Validation of a New Brief Measure in Academic College Context
brief measure college student course dropout dropout intention dropout studies...
University students may encounter situations where they perform poorly in a course and contemplate dropping out. This intention to drop out of a course manifests not only in thoughts or ideas but also in a cognitive self-evaluation of their performance and skills, enabling them to reflect on the possibility of dropping out. In this sense, there is a shortage of instruments that evaluate the intention to drop out of a course, so the aim was to develop and validate the Course Dropout Intention Scale (CDIS). Data from two samples (N1 = 198; N2 = 675) were used; the first was for the EFA, and the second was for the CFA, GRM, and SEM. The one-factor model was derived from the EFA and confirmed in the second sample, exhibiting appropriate goodness-of-fit indices. Similarly, the GRM obtained adequate fit indices; all items discriminated adequately, and the difficulty parameter had a monotonic increase. The SEM model of the effect of satisfaction with studies on the CDIS showed a negative and statistically significant effect. Thus, it was demonstrated that the CDIS is a robust instrument in its psychometric properties and empirical evidence with other variables.
Gender Perception of Students in Compulsory Education Regarding Mathematics and Reading
compulsory education gender stereotyping mathematics achievement reading skills...
This study explores the extent to which the gendered views exist among students in Kosovo’s compulsory education (primary and lower secondary schools) regarding mathematics and reading. It analyzes students’ perceptions of these academic domains concerning the performance of their peers (the same others) from the gender perspective. Additionally, it examines students’ perspectives on the opinions of their parents and teachers (their significant others) regarding girls’ and boys’ performance in math and reading. Furthermore, the study investigates whether students hold gender-stereotypical attitudes toward professions related to math and those that heavily rely on reading skills. The survey method was used to conduct this study. A sample of 531 students in compulsory education participated in this study, completing a paper-based questionnaire consisting of 14 items evenly distributed between mathematics and reading. The findings indicate that around half of the respondents believe that girls and boys perform equally well in both mathematics and reading and that parents and teachers hold the same views regarding the performance of their children/students in these academic domains. However, among the remaining portion of respondents who expressed gendered views, a higher percentage favored boys as being more proficient in math, while girls were seen as superior in reading skills. This study emphasized the need to address and mitigate these gender stereotypes, to ensure that students of both genders can pursue their careers successfully without any limitations.
Preschool Teachers’ Issues and Beliefs in English Language Teaching: A Systematic Review (2012-2022)
belief elt in preschool issues preschool teacher...
The introduction of English language teaching (ELT) at the preschool level has been widely discussed by researchers. While most agree with ELT at preschool level, considerable issues are faced in learning a second, third, or foreign language. Therefore, this systematic review discusses the issues preschool teachers face in implementing ELT and their beliefs on how ELT should be applied to young children. Using three renowned databases, namely Scopus, Web of Science (WoS), and Educational Resources Information Centre (ERIC), 34 articles were extracted out of 85 articles, from 2012 to 2022, with exclusion and inclusion criteria taken into consideration. The findings of this study showcased eight main issues faced by preschool teachers in implementing ELT: English language proficiency, pedagogical skills, teacher perception, curriculum, teaching resources, training, socio-cultural, and classroom environment. In terms of preschool teachers' beliefs about ELT, there are four main issues: Bilingual education, children's characteristics, curriculum alteration, and teachers’ experience. Generally, these findings will guide teachers, responsible authorities, and researchers to acquire an overview of the actual issues that occur in the implementation of ELT in preschools as well as the appropriate measures to overcome them, starting from the preschool teachers' beliefs.
Self-Directed Learning Readiness Model: A Mediating Role of Self-Efficacy among Need-Supportive Teaching Style, Transformational Parenting and Emotional Intelligence
emotional intelligence need-supportive teaching style self-directed learning readiness self-efficacy transformational parenting...
The study aimed to explore the self-directed learning readiness model and its relationship with various factors such as emotional intelligence, transformational parenting, need-supportive teaching style, and self-efficacy as potential mediators. The research was conducted with 415 junior high school students in Surabaya, Indonesia. To ensure the reliability and validity of the instruments used in the study, confirmatory factor analysis was performed. The loading factor values of all the items in the instruments were found to be greater than .50 indicating a satisfactory level of validity. Additionally, the reliability coefficient of all the instruments exceeded .90 demonstrating good internal consistency. Analysis using structural equation modeling (SEM) demonstrated that the theoretical model of self-directed learning readiness was consistent with empirical conditions because it meets the standard value of goodness of fit. Furthermore, through the indirect effect tests, it was discovered that need-supportive teaching style, emotional intelligence, and transformational parenting significantly influenced self-directed learning readiness, with self-efficacy acting as a mediator. Among the factors examined, self-efficacy was found to have the greatest impact in explaining readiness for self-directed learning readiness.
MIB-Inquiry-Infographic Android Application and Its Impact on Students' Critical Thinking Skills during the COVID-19 Pandemic
critical thinking skill infographic inquiry momentum-impulse e-book...
Momentum-impulse requires critical thinking skills, and teaching should be encouraging for students. Critical thinking skills can be fostered through inquiry-based learning. During the COVID-19 pandemic, familiar learning media were used for students. Therefore, it is necessary to develop creative learning media. This developmental research aimed to create a momentum-impulse e-book based on inquiry supported by infographics (MIB -In-graph) to enhance students' critical thinking skills. The developmental model was a 4D model with field testing, i.e., a pretest-posttest control group design with three classes. Descriptive analysis showed that MIB-In-graph, an Android application, received a good average rating in content, worksheets, and forms. Students’ responses were very positive. Mixed design ANOVA showed that the mean score of students’ critical thinking skills increased significantly from the pretest to the posttest in each class and students’ critical thinking skills in the experimental class was more salient than control class 1 and control class 2. The highest difference in mean scores was in the experimental class. The differences were influenced by various factors such as learning approaches, media use, pictures, and collaboration.
A Psychometric Validation of the Sociomathematical Norm Scale for Senior High School Students in Mathematics Learning
developments scale learning mathematics; psychometric validation rasch model sociomathematical norms...
Students in mathematics classes do not understand the importance of sociomathematical norms in learning mathematics. This causes sociomathematical norms not to be teachers' focus when learning mathematics. Besides, there is no standardized instrument for assessing this norm, so developing this instrument is necessary to measure socio-mathematical norms in learning mathematics. This study aims to create and verify the psychometric validity of the sociomathematical norm scale. This research used a survey method with 505 senior high school students from Jakarta and West Java as respondents. The results showed that 25 items had convergent validity, with a loading factor value of > 0.700, meaning they could be declared valid. Concurrent validity indicates that each sociomathematical norms indicator is valid as a whole. Discriminant validity shows that the average variance extracted value on the diagonal is higher than the other values, so each item is declared valid. It was concluded that each item of the sociomathematical norms instrument has accuracy in its measurement function. The reliability test shows that each sociomathematical norms item is declared reliable. The reliability value of the sociomathematical norm item is .99, and the person's reliability is .86. Thus, the instruments developed can measure sociomathematical norms in learning mathematics.
Development and Psychometric Validation of an Information Competency Assessment: The Information Management Brief Scale
information competency information literacy information management inventory inventory...
Today's college students relate directly to the information through which they learn. They are the ones who detect the information they need, search and evaluate it, and also use it to develop academic projects. Information literacy programs have increased in universities to support the development of these skills to students. The aim of this study was to provide an instrument that allows the measurement of information competency in higher level students and generate evidence of its validity and reliability. The Information Management Brief Inventory (IMBS) was developed, which consisted of 16 Likert type items. IMBS was applied to a sample of 1,937 students from a public university in northern Mexico. For the evaluation of the construct validity and identification of the factor grouping of the items, an exploratory factor analysis (EFA) was carried out. Confirmatory factor analysis (CFA) was carried out to explore the goodness of fit of the model. It was found that the 16 items were grouped into three factors: information management, access to information and information ethics. The psychometric properties of IMBS were adequate.
Institutional and Teaching Practices for Student Retention: Accounts from Four High Schools of Valparaíso, Chile
school dropout institutional practices teaching practices student retention...
Although central governments, particularly in Latin America and the Caribbean, have defined reducing school dropout rates as a priority, and drawn policies accordingly, there are still young people who do not finish secondary education, and numbers are still alarming. Therefore, it is necessary to observe educational communities and analyze how they interpret and implement guidelines issued by the central government. The following study sought to describe the institutional and teaching practices deployed by four high schools in Valparaíso (Chile) in order to achieve student retention. A qualitative approach was employed. The management team, support professionals, teachers, students, and their families were interviewed. The information gathered was analyzed using the Grounded Theory. As a main finding, establishments use practices such as monitoring attendance, providing support to students facing problematic situations, and encouraging them during class, through a series of strategies. It is recommended that researchers implement this type of methodology for other study objectives, and that the central government consider these results to provide feedback on its policies.
Conceptual Model for the Assessment of Academic Productivity in Research Seedbeds From a Systematic Review
formative research higher education measurement productivity research seedbeds...
Higher education institutions have focused their efforts on promoting research seedbeds as a strategy for formative research. In this regard, the impact of such a strategy remains unknown due to the lack of models that enable its evaluation. Therefore, this study aimed to design an evaluation model for the academic productivity of research seedbeds based on the available evidence in the literature. To achieve this, a systematic review was conducted following the PRISMA model, analyzing 53 documents including articles, book chapters, and conference proceedings from the SCOPUS, ProQuest, Jstor, Scielo, and ScienceDirect databases. The results identified indicators that allowed for the design of a model based on six constructs: research training, institutional capabilities, bibliographic production, innovation and development, social appropriation of knowledge, and human resource training. It was concluded that the indicators evaluating research seedbeds seek greater scientific development involving students and improving the quality of research products, which directly impacts the institutional research mission.
Revisit Attraction–Selection–Attrition Model for Teacher Retention in International Schools
attraction onboarding selection talent management...
The Attraction-Selection-Attrition (ASA) model is a prominent framework for supporting employee retention, stating that organisations attract, select, and retain people who share their values. However, the ASA model only extends to the end of the recruitment stage and lacks clarity on how to assist newcomers in the assimilation process when they first join the organisation. This research proposed a refinement of the ASA paradigm by incorporating the assimilation process of new hires into the new school culture and environment. This study employed a qualitative research approach by interviewing ten participants about the retention process from high teacher retention international schools in Malaysia. Thematic data analysis revealed a new paradigm, 'Attraction-Selection-Onboarding-Retention (ASOR), ' designed to increase teacher retention in international schools. The ASOR model could assist school administrators and human resource managers working in a related setting in properly engaging the workforce to increase teacher retention. This would benefit school sustainability, performance and the local community's economy.
Influence of Motivation Climate on Service-Learning Benefits among Physical Education Students
academic learning gender differences motivation physical education service-learning benefits...
Service-learning (SL) emphasizes the fusion and integration of community service and academic learning, while Physical Education (PE) is oriented towards community health and well-being, aligning with Sustainable Development Goals. The study's primary objective is to discern the benefits perceived by PE students when engaged in SL courses and to test the correlation between benefits and the motivational climate they experience. Additionally, the research explores potential gender-specific variations in students' attitudes. The research was conducted with a survey on a sample of 58 students responding to a Motivational Climate in Physical Education Scale (MPCES) and the SErvice LEarning Benefit Scale (SELEB), which assesses the motivation of students and their perceptions of SL benefits. Descriptive statistics was used to analyse the data. Pearson's correlation coefficient was used to test the relationship between the core constructs - SL benefits and student motivation, and t-tests to evaluate gender differences in SL benefits. Key findings underscore that students primarily perceived the greatest advantages from SL in the domain of knowledge application, with comparatively lower scores in general life skills. Notably, female students, on the whole, exhibited higher ratings in both SL benefits and student motivation compared to their male counterparts. Nonetheless, specific exceptions emerged in certain sub-scales, including social relatedness and ego climate within the MPCES scale, as well as critical thinking within the SELEB scale. According to the results, it is suggested that cultivating a student-centered learning environment can augment engagement and motivation in the realm of physical education (PE). Furthermore, the delineated gender differences offer valuable insights for educators, highlighting the need for tailored approaches to accommodate the diverse preferences and requirements of male and female students.
Research on STEM in Early Childhood Education from 1992 to 2022: A Bibliometric Analysis from the Web of Science Database
bibliometric early childhood education stem education web of science...
STEM education is an irreplaceable movement of educational systems across the globe in the 21st century. Both Pre-K, K-12, and higher education institutions consider STEM as an innovative approach to integrate and reform the teaching and learning processes. The purpose of this paper is to examine the development of studies on STEM in the Early Childhood Education context from 1992 to 2022. We investigated a dataset of 308 scholarly works from the Clarivate Web of Science database and figured a diversified collection of research focuses on topics such as children’s readiness, outcomes, teachers’ competency in designing and implementing STEM activities, and the role of computational thinking and robotics. The findings of this paper revealed the dominant contribution of researchers from the USA regarding research quantity and impact, as well as their collaborations with researchers from Western countries. In addition, we also figured out the top influencing authors, documents, and journals as a suggestion for scholars who are new to this topic. However, we would like to note that our findings depended on the quality of the imported database from the WoS system, which covers top-tier journals only.
The Influence of a Robotics Program on Students’ Attitudes Toward Effective Communication
attitude effective communication robotics students...
This research aimed to explore the influence of a robotic program using the robot kit "RoboBuilder RQ+110" on students' attitudes toward effective communication. The study used a quantitative research design and involved 475 grade 4 (10 years old) students from Malaysia's Selangor and Malacca states. A quasi-experimental research (pre-test & post-test) approach with control and experimental groups was adopted, and the data were analyzed with inferential statistical test and repeated measures analysis of variance (ANOVA) using SPSS 25 software at 0.05 significance level. Questionnaires were administered to collect data from the experimental and control groups. The results showed statistically significant changes (α ≤ .05) in attitudes toward effective communication for the experimental group that received a robotics program compared with the control group. The study results suggest that innovative technological tools or programs such as robotics programs are recommended as innovative science, technology, engineering, and mathematics (STEM) program rooted in constructivism to improve students' attitudes toward effective communication.