'assessment construct' Search Results
Promoting Outcomes-Based Instructional Materials: Testing the Effectiveness of Print Modules for Business Students
business students human resource management methodological triangulation outcomes-based education print modules...
Education delivers systematic instruction so effective learning acquisition may take place. It molds students into holistic well-being to contribute to various industries; hence, relevant competencies are developed. Strengthening education significantly encompasses the production of formfitting and distinct instructional materials to invite a sequential way of presenting quality instruction. This research is focused on knowing the effectiveness of the modules developed in Human Resource Management for Filipino business students. Specifically, it is developmental research and utilizes a pretest and post-test control group design. Numerical data were supported by phenomenological interviews, strengthening the study's results. It involved 80 college students classified as the experimental and control group. Moreover, the interview includes 10 participants. Findings reveal that utilizing the modules realized the increase in performance of the experimental group due to their exposure to the materials. However, one of the pitfalls has been revealed in utilizing self-directed learning material; thus, academic performance will only improve if students are organized to set their own goals and learning pace. Using outcomes-based instructional materials leads to substantiating learning, effectively enticing learners' interest. It maximizes students' motivation and participation since topics are well-planned and designed comprehensively. The materials are an essential tool in inviting the enthusiasm of business students to engage in learning. These are valuable means to encourage independent learning without sacrificing the competencies to be learned and applied by the learners.
Measurement of Students' Chemistry Practicum Skills Using Many Facets Rash Model
chemistry practicum mfrm performance assessment process assessment product assessment...
The accuracy of assessing the capabilities of the process and product in chemical practice activities requires appropriate measurement procedures to be followed. It is crucial to identify the components that can introduce bias while measuring student abilities during the measurement process. This study aims to identify the components or criteria used by teachers to assess student performance in practicum activities and analyze the quality of the rubrics developed. The study was conducted with the participation of three raters, 27 high school students, and nine assessment criteria. A quantitative descriptive approach was employed using the many-facet Rasch model (MFRM) analysis for measurement. The results of the MFRM analysis show no significant measurement bias, with data measurement facets fitting the MFRM model. The reliability of all the facets meets the criteria, and the scale predictor functions appropriately. While all students can easily pass four out of nine items, five items can only be partially passed by students. The assessment criteria that require special attention include communication skills, tools and assembly, interpretation, cleanliness, and accuracy when performing practicums. These criteria provide feedback for teachers and students to ensure successful practicum activities. The Discussion section of this study delves into the findings and their implications.
Evaluating the Results of PISA Assessment: Are There Gaps Between the Teaching of Mathematical Literacy at Schools and in PISA Assessment?
education gaps mathematical competence mathematical literacy pisa assessment...
The problems in education in the countries of the Organization for Economic Cooperation and Development (OECD) vary from country to country. The differences between "upper class" and "lower class" countries in PISA assessment results have led to a research gap. The purpose of this study was to (a) test students' mathematical literacy skills on the Program for International Student Assessment (PISA) test and compare the results using the sum of means across OECD countries; (b) examine the relationship between students' mathematical competence, precision, and self-perception of mathematical literacy skills in the PISA test; and (c) analyze the gaps that exist between the implementation of mathematics instruction in school and the mathematical literacy as measured on the PISA test. This study was designed as a mixed method with an explanatory sequential design. The data collection methods included test procedures, questionnaires, and interviews. The result of this study showed that the overall mean score obtained was below the OECD average. In general, the respondents achieved only level 2 mathematics proficiency. A significant relationship was found between mathematical competence, precision, and self-perception in mathematical skills. On the other hand, there was a gap, namely the difference at the implementation level, where mathematical literacy measured by PISA differed from the measurement of mathematical learning achievement by teachers in school. The results showed that teaching that emphasizes only problem-solving procedures affects low mathematical competence and is not useful enough for students to deal with the PISA mathematics test.
Mathematical Literacy Skills for Elementary School Students: A Comparative Study Between Interactive STEM Learning and Paper-and-Pencil STEM Learning
experimental research interactive stem mathematical literacy paper and pencil stem...
This study aimed to compare and examine the effectiveness of interactive STEM learning and paper-and-pencil STEM learning in terms of mathematical literacy skills of elementary school students. This research is of a quasi-experimental type with a non-equivalent pretest-posttest control group design. Sampling was carried out on the elementary school populations in Bengkulu and South Sumatra Provinces in two stages. In the first stage, schools in rural and urban areas were selected, and in the second, classes in each school were randomly selected. The selected sample consisted of fifth-grade students of the Public Elementary School of Terawas, Musi Rawas, with an experimental class A (n = 20) and an experimental class B (n = 19), as well as fifth-grade students of the Public Elementary School of Bengkulu City, with an experimental class A (n = 25) and an experimental class B (n = 22). Data collection was conducted using mathematical literacy skills tests in reference to the PISA and Minimum Competency Assessment (level 1–3). Data analysis was performed using descriptive and inferential statistics; it employed an independent t-test for the comparative testing and an N-gain test for testing the effectiveness of STEM learning. The results showed that there were differences in math literacy skills between interactive STEM and paper-and-pencil STEM for students in urban schools, but not significantly different for students in rural schools. General STEM learning was effective in increasing the literacy of elementary school students, and interactive STEM in particular demonstrated the highest level of effectiveness in the urban school.
Introducing Contextual Teaching and Learning as a Transition from Textbook-Based Curriculum to the National Curriculum
contextual teaching and learning efl elt speaking skills recount text...
The teaching of speaking in English as a foreign language (EFL) classes in the Province of Aceh did not rely on the suggested techniques and methods. This teacher-designed technique, which was mainly textbook-based, has left an unpleasant learning experience among students. Therefore, we conducted a quantitative research study to experiment with how students responded to contextual teaching and learning (CTL) to see the effect of transitioning from a teacher-established method to a systematically planned learning approach and compare how students progressed over time. The experiment was carried out by teachers who had received assistance in preparing the lesson and practicing the lesson plan. The six-meeting experiment was conducted in 11 small classes, with a total sample of 132 students. The student improvement after the first four meetings (cycle 1) was compared using inferential statistical analyses with that after eight meetings (cycle 2). The results show that the student’s achievement significantly improved in the first cycle and continued to improve, although at a lower rate, in the second cycle. This result suggests that CTL can be used to transition from a traditional teaching method to a more established method in EFL teaching. Therefore, teachers need help planning their teaching and practicing how to implement the teaching plan accurately.
Development of Waves Critical Thinking Test: Physics Essay Test for High School Student
assessment in physics essay test physics essay test waves critical thinking test...
This study aims to produce a product to evaluate students' critical thinking skills that departs from physics content where students often have misconceptions. This research is a development research with research stages covering a) research and review literature; (b) planning chapter objectives; (c) developing a preliminary form; (d) field-testing the preliminary form; (e) Revise the preliminary form; (f) conducting a main field-test. The Waves Critical Thinking (WCT) test developed consists of 7 questions with 15 specific domains. Total percentage of content validity test was obtained 87.98% with appropriate criteria and based on the construct validity WCT test, the Goodness of Fit criteria were obtained which were classified as fit. The test instrument being tested consists of 15 objective items. The reliability of WCT test results 0.597 as a Cronbach's alpha score with the medium category and all the components have a good level of composite reliability. The outcome of the study was the WCT test with a valid state for measuring students' CT in a specific domain of physics wave material.
The Relationship Between the Daily Use of Digital Technologies and the Reading and Information Literacy Skills of 15-Year-Old Students
information and communication technologies information literacy pisa2018 reading literacy secondary school...
Digital technologies in all forms have become ubiquitous in our media-rich, modern information society, but the connection between their use and information literacy is not always clear. This paper examines the impact of daily use of digital technologies on the reading and information literacy skills of 15-year-old students in Slovenia, based on data from the Programme for International Student Assessment (PISA) 2018 study. The study examines PISA 2018 variables related to Information and Communication Technologies (ICT), as well as a reading task involving the use of ICT. The sample consists of 2612 Slovenian students with a gender distribution of 50.8% girls and 49.2% boys. The study explores students' experiences, enjoyment, self-efficacy, autonomy, and independence in using ICT and learning about its use and identifies two groups of students: one group that is curious and another that is cautious. The results of confirmatory factor analysis (CFA) and structural equation modelling (SEM) show that the constructs of enjoyment, self-efficacy, learning, autonomy, and independence are highly/strongly correlated but have a low/insignificant impact on information literacy skills.
Semantic Correlation Model of Socio-Formative Data for Curricular Planning Evaluation
curriculum planning curricular evaluation natural language processingi semantic correlation socio-formative data...
The study presents a semantic correlation model (SCM) of socioformative data, which is designed to support the evaluation of curriculum planning (CPE) that is developed from indicators derived from curriculum components such as graduate profile, study plan, area plan and subject plan. The objective of the research was to design a semantic correlation model of socio-formative data to support the evaluation of curriculum planning in accordance with the objectives of sustainable development in education. The study is a quasi-experimental research based in a Likert questionnaire applied on a group of 10 students (16 and 18 years old) belonging to the eleventh grade of the urban official educational institutions of Marsella, in the department of Risaralda in Colombia. The results indicate that the model has an impact on the evaluation of curricular planning, concluding that the design and implementation of a semantic correlation model of sociodemographic data does have an impact on the evaluation of curricular planning of a classroom subject in an educational institution in Marsella.
Course Dropout Intention Scale: Development and Validation of a New Brief Measure in Academic College Context
brief measure college student course dropout dropout intention dropout studies...
University students may encounter situations where they perform poorly in a course and contemplate dropping out. This intention to drop out of a course manifests not only in thoughts or ideas but also in a cognitive self-evaluation of their performance and skills, enabling them to reflect on the possibility of dropping out. In this sense, there is a shortage of instruments that evaluate the intention to drop out of a course, so the aim was to develop and validate the Course Dropout Intention Scale (CDIS). Data from two samples (N1 = 198; N2 = 675) were used; the first was for the EFA, and the second was for the CFA, GRM, and SEM. The one-factor model was derived from the EFA and confirmed in the second sample, exhibiting appropriate goodness-of-fit indices. Similarly, the GRM obtained adequate fit indices; all items discriminated adequately, and the difficulty parameter had a monotonic increase. The SEM model of the effect of satisfaction with studies on the CDIS showed a negative and statistically significant effect. Thus, it was demonstrated that the CDIS is a robust instrument in its psychometric properties and empirical evidence with other variables.
Preschool Teachers’ Issues and Beliefs in English Language Teaching: A Systematic Review (2012-2022)
belief elt in preschool issues preschool teacher...
The introduction of English language teaching (ELT) at the preschool level has been widely discussed by researchers. While most agree with ELT at preschool level, considerable issues are faced in learning a second, third, or foreign language. Therefore, this systematic review discusses the issues preschool teachers face in implementing ELT and their beliefs on how ELT should be applied to young children. Using three renowned databases, namely Scopus, Web of Science (WoS), and Educational Resources Information Centre (ERIC), 34 articles were extracted out of 85 articles, from 2012 to 2022, with exclusion and inclusion criteria taken into consideration. The findings of this study showcased eight main issues faced by preschool teachers in implementing ELT: English language proficiency, pedagogical skills, teacher perception, curriculum, teaching resources, training, socio-cultural, and classroom environment. In terms of preschool teachers' beliefs about ELT, there are four main issues: Bilingual education, children's characteristics, curriculum alteration, and teachers’ experience. Generally, these findings will guide teachers, responsible authorities, and researchers to acquire an overview of the actual issues that occur in the implementation of ELT in preschools as well as the appropriate measures to overcome them, starting from the preschool teachers' beliefs.
MIB-Inquiry-Infographic Android Application and Its Impact on Students' Critical Thinking Skills during the COVID-19 Pandemic
critical thinking skill infographic inquiry momentum-impulse e-book...
Momentum-impulse requires critical thinking skills, and teaching should be encouraging for students. Critical thinking skills can be fostered through inquiry-based learning. During the COVID-19 pandemic, familiar learning media were used for students. Therefore, it is necessary to develop creative learning media. This developmental research aimed to create a momentum-impulse e-book based on inquiry supported by infographics (MIB -In-graph) to enhance students' critical thinking skills. The developmental model was a 4D model with field testing, i.e., a pretest-posttest control group design with three classes. Descriptive analysis showed that MIB-In-graph, an Android application, received a good average rating in content, worksheets, and forms. Students’ responses were very positive. Mixed design ANOVA showed that the mean score of students’ critical thinking skills increased significantly from the pretest to the posttest in each class and students’ critical thinking skills in the experimental class was more salient than control class 1 and control class 2. The highest difference in mean scores was in the experimental class. The differences were influenced by various factors such as learning approaches, media use, pictures, and collaboration.
A Psychometric Validation of the Sociomathematical Norm Scale for Senior High School Students in Mathematics Learning
developments scale learning mathematics; psychometric validation rasch model sociomathematical norms...
Students in mathematics classes do not understand the importance of sociomathematical norms in learning mathematics. This causes sociomathematical norms not to be teachers' focus when learning mathematics. Besides, there is no standardized instrument for assessing this norm, so developing this instrument is necessary to measure socio-mathematical norms in learning mathematics. This study aims to create and verify the psychometric validity of the sociomathematical norm scale. This research used a survey method with 505 senior high school students from Jakarta and West Java as respondents. The results showed that 25 items had convergent validity, with a loading factor value of > 0.700, meaning they could be declared valid. Concurrent validity indicates that each sociomathematical norms indicator is valid as a whole. Discriminant validity shows that the average variance extracted value on the diagonal is higher than the other values, so each item is declared valid. It was concluded that each item of the sociomathematical norms instrument has accuracy in its measurement function. The reliability test shows that each sociomathematical norms item is declared reliable. The reliability value of the sociomathematical norm item is .99, and the person's reliability is .86. Thus, the instruments developed can measure sociomathematical norms in learning mathematics.
Development and Psychometric Validation of an Information Competency Assessment: The Information Management Brief Scale
information competency information literacy information management inventory inventory...
Today's college students relate directly to the information through which they learn. They are the ones who detect the information they need, search and evaluate it, and also use it to develop academic projects. Information literacy programs have increased in universities to support the development of these skills to students. The aim of this study was to provide an instrument that allows the measurement of information competency in higher level students and generate evidence of its validity and reliability. The Information Management Brief Inventory (IMBS) was developed, which consisted of 16 Likert type items. IMBS was applied to a sample of 1,937 students from a public university in northern Mexico. For the evaluation of the construct validity and identification of the factor grouping of the items, an exploratory factor analysis (EFA) was carried out. Confirmatory factor analysis (CFA) was carried out to explore the goodness of fit of the model. It was found that the 16 items were grouped into three factors: information management, access to information and information ethics. The psychometric properties of IMBS were adequate.
Conceptual Model for the Assessment of Academic Productivity in Research Seedbeds From a Systematic Review
formative research higher education measurement productivity research seedbeds...
Higher education institutions have focused their efforts on promoting research seedbeds as a strategy for formative research. In this regard, the impact of such a strategy remains unknown due to the lack of models that enable its evaluation. Therefore, this study aimed to design an evaluation model for the academic productivity of research seedbeds based on the available evidence in the literature. To achieve this, a systematic review was conducted following the PRISMA model, analyzing 53 documents including articles, book chapters, and conference proceedings from the SCOPUS, ProQuest, Jstor, Scielo, and ScienceDirect databases. The results identified indicators that allowed for the design of a model based on six constructs: research training, institutional capabilities, bibliographic production, innovation and development, social appropriation of knowledge, and human resource training. It was concluded that the indicators evaluating research seedbeds seek greater scientific development involving students and improving the quality of research products, which directly impacts the institutional research mission.
Research on STEM in Early Childhood Education from 1992 to 2022: A Bibliometric Analysis from the Web of Science Database
bibliometric early childhood education stem education web of science...
STEM education is an irreplaceable movement of educational systems across the globe in the 21st century. Both Pre-K, K-12, and higher education institutions consider STEM as an innovative approach to integrate and reform the teaching and learning processes. The purpose of this paper is to examine the development of studies on STEM in the Early Childhood Education context from 1992 to 2022. We investigated a dataset of 308 scholarly works from the Clarivate Web of Science database and figured a diversified collection of research focuses on topics such as children’s readiness, outcomes, teachers’ competency in designing and implementing STEM activities, and the role of computational thinking and robotics. The findings of this paper revealed the dominant contribution of researchers from the USA regarding research quantity and impact, as well as their collaborations with researchers from Western countries. In addition, we also figured out the top influencing authors, documents, and journals as a suggestion for scholars who are new to this topic. However, we would like to note that our findings depended on the quality of the imported database from the WoS system, which covers top-tier journals only.
The Influence of a Robotics Program on Students’ Attitudes Toward Effective Communication
attitude effective communication robotics students...
This research aimed to explore the influence of a robotic program using the robot kit "RoboBuilder RQ+110" on students' attitudes toward effective communication. The study used a quantitative research design and involved 475 grade 4 (10 years old) students from Malaysia's Selangor and Malacca states. A quasi-experimental research (pre-test & post-test) approach with control and experimental groups was adopted, and the data were analyzed with inferential statistical test and repeated measures analysis of variance (ANOVA) using SPSS 25 software at 0.05 significance level. Questionnaires were administered to collect data from the experimental and control groups. The results showed statistically significant changes (α ≤ .05) in attitudes toward effective communication for the experimental group that received a robotics program compared with the control group. The study results suggest that innovative technological tools or programs such as robotics programs are recommended as innovative science, technology, engineering, and mathematics (STEM) program rooted in constructivism to improve students' attitudes toward effective communication.
Teachers’ Topic-Specific Pedagogical Content Knowledge: A Driver in Understanding Graphs in Dynamics of Market
dynamics of market economics teachers graphs topic-specific pedagogical content knowledge...
Understanding graphs in the dynamics of market (DM) is a challenge to learners; its teaching demands a specific kind of teacher’s knowledge. This study aims to examine the topic-specific pedagogical content knowledge (TSPCK) of experienced economics teachers in teaching graphs in DM to enhance learners’ understanding of the topic. It reports using a qualitative approach underpinned by the TSPCK framework for teaching specific topics developed by Mavhunga. Data were collected through classroom observations and analyzed thematically using a case study of two economics teachers. The study revealed that adopting a step-by-step approach and the use of worked graphical examples promote an understanding of graphs in DM. It also established that active learning is preferable to the predominant chalk-and-talk (lecture) method of teaching graphs in DM. The study proposed a Dynamics of Market Graphical Framework (DMG-Framework) to enable teachers, particularly pre-service teachers in lesson delivery, to enhance learners’ understanding of graphs in DM. The result of this study will broaden the international view in the teaching of graphs in DM.
Implementing the Quality of Life and Potential of Social Farming
intellectual disabilities personal outcome scale quality of life social farming...
The present study explores the Quality of Life (QoL) of young people with intellectual disabilities engaged in a social farming initiative, known as ‘‘Tuttincampo: Social Farming and Inclusivity’’. The project stands as an innovative approach to improving social inclusion and providing vocational education and training. The initiative seeks to offer a viable alternative to traditional rehabilitation day centers by establishing a network of both public and private institutions. To explore the QoL of the young people we analyze data from the Personal Outcome Scale (POS), a tool that investigates the perception of QoL through self-assessment and hetero-assessment. Data were collected at the beginning and at the end of the social agriculture project. The results obtained confirm the importance of planning pedagogical actions to support social inclusion and vocational training for people with intellectual disabilities, highlighting, as well, the potential of social farming as a new “space” to achieve a higher level of QoL.
Developing Students' Critical Thinking: Examining the Influence of Learning Management Approaches Through Meta-Analysis and Propensity Score Matching
critical thinking learning management approaches meta-analysis propensity score matching research synthesis...
Critical thinking is a skill that enables individuals to keep pace with changes and enhances crucial competencies for contemporary competitiveness. Many researchers have studied learning management approaches to develop students' critical thinking, resulting in a substantial body of knowledge but lacking clear systematic summaries. The researchers aimed to (a) examine the effect sizes and research characteristics influencing students' critical thinking, and (b) compare the effect sizes of learning management approaches after adjusting with propensity score matching from 108 graduate research published between 2002 and 2021. Data were collected using research characteristics recording forms and research quality assessment questionnaires. Effect sizes were calculated using Glass's method and analyzed through random effect, fixed effect, and regression meta-analysis. Findings revealed that (a) research on developing learning management approaches influences students' critical thinking at a high level (d ̅ = 1.669), with nine research characteristics, including the field of publication, courses, total duration, teacher learning process, learning media, measurement and evaluation, research design, research statistics, and research quality, statistically significantly influencing students' critical thinking, and (b) after adjustment, inquiry-based learning significantly influences students' critical thinking. Recommendations for developing students' critical thinking include learning activities that encourage problem exploration, expanding thinking through collaborative analysis, and applying diverse media and activity sheets tailored to context suitability.
Writing PISA-Like Mathematics Items: The Case of Tertiary Mathematics Instructors from a State University in the Philippines
context-based math items item-writing mathematical literacy pisa mathematics assessment framework pisa-like mathematics items...
Mathematics test items in International Large-Scale Assessments (ILSAs) such as the Programme of International Student Assessment (PISA) and the Trends in International Mathematics and Science Study (TIMSS) are nested in contexts defined in their assessment framework (e.g., the Personal, Occupational, Societal, and Scientific contexts in PISA). This study followed the item-writing activities of four tertiary mathematics instructors in the Philippines as they constructed context-based mathematics items. They were tasked to write four items each, following a set of specifications for PISA content and context categories. The data consisted of transcripts from the focus-group discussion which was conducted days after the task. The transcripts were then analyzed using thematic analysis. The results of this study showed that the phenomenon of item-writing in the context of writing PISA-like mathematics items had two themes: the phases of item-writing and the dimensions of item-writing. Findings showed that the respondents struggled to find realistic contexts and that they engaged in a problem-solving task likened to solving a puzzle as they attempted to satisfy the content, context, and process categories in the table of specifications (TOS). This study contributes to filling in the research gap on item-writing activities, particularly those of mathematics teachers in the Philippines- a country whose recent mathematical performance in the PISA 2018, TIMSS 2019, and PISA 2022 was nothing short of dismal.