'Assessments' Search Results
Effects of a Transformative Learning Program for Developing Active Global Citizenship among Thai Students
active citizenship global citizenship transformative learning undergraduate students educational management...
This experimental research aimed to examine the effectiveness of the transformative learning program (TLP) on the active global citizenship (AGC) of 60 undergraduate students who had joined student affairs engaging in community development, working with a volunteer spirit, and community service. The participants were randomly assigned into experimental and control groups (n=30 for each group). The data were collected using the AGC Scale with a reliability of .968. Assessments were conducted three times: before, after the experiment, and follow-up. The TLP consisted of five steps: (a) Review social issues and crises contributing to disorientation; (b) Reflect critically to reach solutions; (c) Reformulate the meaning of perspectives to plan a course of action based on new perspectives; (e) Accept and improve new practices; and (f) Evaluate. MANOVA was performed to analyze the data. The results showed that students in the experimental group had a higher mean score of AGC than the control group, both after treatment and at follow-up (p < .05); the mean scores of the AGC of the experimental group after treatment and at follow-up were higher than the mean score before treatment (p < .05); and the mean score of AGC of the experimental group at follow up was higher than the score after treatment with no statistical significance. In conclusion, educational personnel could use this TLP to promote AGC for university students.
Grade-3 Learners’ Performance and Conceptual Understanding Development in Technology-Enhanced Teaching With Interactive Mathematics Software
conceptual understanding interactive mathematics software lower primary school mathematics education rwanda...
This study presented the effect of interactive mathematics (IM) software assisted-teaching on primary three learners' conceptual understanding and performance. The cognitive theory of multimedia learning (CTML) supported the quasi-experimental design of this study drawing on IM software features that fit a multimedia tool for effective learning. This study used a sample of 138 lower primary learners. Learners’ test scores and examples of their work provided data to be analyzed. Learners' conceptual understanding was measured using the percentage of learners who performed a particular item and analyzed using sample learners' work while the overall performance was measured using the mean class scores. From the data analysis, IM-assisted teaching influenced conceptual understanding and performance based on a .05 p-value, the effect size of significance, and learning gains. The analysis of learners’ workings revealed different errors in addition, subtraction, division, and multiplication, which were remarkably reduced in the post-test by IM-supported teaching. This evidenced conceptual understanding development by IM-supported teaching. The study suggested the integration of IM in the Rwandan Competence-Based curriculum and its use as an instructional tool in teaching and learning mathematics at the primary level. Besides, it was recommended that Rwanda Education Board support teachers in developing basic computer skills to effectively create and monitor a multimedia learning environment for effective learning. Furthermore, further similar research would improve the literature about interactive technologies in supporting quality mathematics delivery and outcomes.
Numerical Ratings and Content Labeling of Speeches in an Educational Public Speaking Program
evaluations public speaking rhetoric speeches...
Education in public speaking often relies largely on qualitative feedback. In this study, we explored how a numerical feedback form based on a validated scale could be used in an educational public speaking program. Data were collected at three clubs of Toastmasters International. Speech content was labeled to enable statistical analysis of correlations between speech content and audience ratings. 216 speeches by 59 speakers were evaluated by audience members, providing 1416 individual evaluations. All rating categories correlated strongly with each other. Speeches mentioning relationships, personal stories and positive emotions were rated more favorably. Speeches given in-person were rated more highly in several dimensions compared to speeches given through online video. There were some sex differences in choice of content and emotional expressiveness, but not in audience ratings of speech quality. Overall, the study found that the method was useful for both providing individual feedback and aggregated data for research purposes.
Constructive Cognitive Assessment of Learning in a Course on the Computational Cognition in Psychology Students
academic learning cognitive evaluation mental representation of knowledge natural semantic networks...
Learning evaluation is a complex task, and this study illustrates the Constructive Assessment of Learning as a complementary alternative to evaluate the computational cognition schema construction. The authors designed a mental representational task under the Chronometric Constructive Cognitive Learning Evaluation Model. Control and experimental groups performed a conceptual definition task based on the Natural Semantic Network technique (NSN). They defined ten target concepts related to computational cognition theory, using verbs, nouns, and adjectives as definers. Afterward, the participants rated the conceptual quality of each definer one by one, on a scale of one to ten; the higher the rating, the greater the quality of the definer to define the target concept. The results indicate that the NSN technique was sensitive to measuring and discriminating cognitive changes in knowledge structures produced by the specific learning of computational cognition theory. In contrast, the learning of broad psychology subjects produced general cognitive changes without organization related to the specific learning of the evaluated course. Data showed more sophisticated cognitive change patterns on the evaluated schema in the experimental group than in the control group. The findings of this study suggest that cognitive assessment techniques can be helpful in the formative assessment of learning and provide clear indicators of students' knowledge management skills.
EFL Educators’ Insights into Online Education and its Impact on Teaching during the COVID-19 Pandemic
affective factors efl online education pedagogical practices student achievement...
After months of 100% online teaching due to the pandemic produced by COVID-19, the return to face-to-face classes is being experienced. This study focused on finding the English as a foreign language (EFL) University professors’ perspectives of online education during that time. The information was collected from three Ecuadorian universities: The Technical University of Ambato, The Higher Polytechnic School of Chimborazo, and The University of Cuenca. The survey was designed with 26 questions about professors’ perceptions of online teaching and its impact on their pedagogical practices, affective factors, and student achievement. Software R, and the Cronbach's alpha tests were used as statistical tools, along with Kendall's Tau_b, and the Kruskal-Wallis test. The results showed that teaching online not only represents a solution in cases where face-to-face education is not possible, but also offers teachers the opportunity to experience the benefits of using technological tools and innovative strategies. Although some drawbacks, such as lack of time and real interaction were encountered, online teaching resulted in an alternative methodology that engaged learners.
Measurement of Students' Chemistry Practicum Skills Using Many Facets Rash Model
chemistry practicum mfrm performance assessment process assessment product assessment...
The accuracy of assessing the capabilities of the process and product in chemical practice activities requires appropriate measurement procedures to be followed. It is crucial to identify the components that can introduce bias while measuring student abilities during the measurement process. This study aims to identify the components or criteria used by teachers to assess student performance in practicum activities and analyze the quality of the rubrics developed. The study was conducted with the participation of three raters, 27 high school students, and nine assessment criteria. A quantitative descriptive approach was employed using the many-facet Rasch model (MFRM) analysis for measurement. The results of the MFRM analysis show no significant measurement bias, with data measurement facets fitting the MFRM model. The reliability of all the facets meets the criteria, and the scale predictor functions appropriately. While all students can easily pass four out of nine items, five items can only be partially passed by students. The assessment criteria that require special attention include communication skills, tools and assembly, interpretation, cleanliness, and accuracy when performing practicums. These criteria provide feedback for teachers and students to ensure successful practicum activities. The Discussion section of this study delves into the findings and their implications.
Evaluating the Results of PISA Assessment: Are There Gaps Between the Teaching of Mathematical Literacy at Schools and in PISA Assessment?
education gaps mathematical competence mathematical literacy pisa assessment...
The problems in education in the countries of the Organization for Economic Cooperation and Development (OECD) vary from country to country. The differences between "upper class" and "lower class" countries in PISA assessment results have led to a research gap. The purpose of this study was to (a) test students' mathematical literacy skills on the Program for International Student Assessment (PISA) test and compare the results using the sum of means across OECD countries; (b) examine the relationship between students' mathematical competence, precision, and self-perception of mathematical literacy skills in the PISA test; and (c) analyze the gaps that exist between the implementation of mathematics instruction in school and the mathematical literacy as measured on the PISA test. This study was designed as a mixed method with an explanatory sequential design. The data collection methods included test procedures, questionnaires, and interviews. The result of this study showed that the overall mean score obtained was below the OECD average. In general, the respondents achieved only level 2 mathematics proficiency. A significant relationship was found between mathematical competence, precision, and self-perception in mathematical skills. On the other hand, there was a gap, namely the difference at the implementation level, where mathematical literacy measured by PISA differed from the measurement of mathematical learning achievement by teachers in school. The results showed that teaching that emphasizes only problem-solving procedures affects low mathematical competence and is not useful enough for students to deal with the PISA mathematics test.
Similarities and Dissimilarities in Student Grades Distributions, Over Time and by Gender
distribution’s proximity statistics equivalence testing gender disparity student grades...
The focus of this article is to analyze the distribution patterns of student grades over time for different subjects and by gender. Specifically, we examined the final term grades of upper secondary students in Portuguese public schools across four subjects (Mathematics, Portuguese Language, Philosophy, and Physical Education) from the academic years 2013-2014 to 2017-2018. These grades reflect the teachers' perceptions of the students' knowledge gained throughout the academic year. We expected to see some regularity in the grade distributions over time for a particular subject. However, we found that the similarity of grades across subjects and time was so striking that differences were barely noticeable by visual inspection. Due to the very large sample sizes (in the order of tens of thousands), the quantification of similarities and dissimilarities was done through distribution’s proximity statistics and not by classic statistical methods, like Chi-Square or comparison of means tests. Additionally, we applied a methodology of multiple equivalence tests to globally compare the relative frequencies of each of the grades in pairs of independent samples. Our analysis showed that there was a high level of similarity in grades for the same subject over time, but we also found differences between subjects and between genders.
The Implementation of Flipped Learning Model and STEM Approach in Elementary Education: A Systematic Literature Review
elementary education e-learning flipped learning stem technology...
This study aimed to explore the implementation and impact of the Flipped Learning Model (FLM) and STEM Approach in elementary education. The advancement of technology and the Covid-19 pandemic has increased the importance of e-learning, including in elementary schools. The literature review analyzed 193 academic works published in the past six years using NVivo, Mendeley, and VOSviewer software. The validity of the data was verified through the analysis of five online databases. The results showed that STEM research has been well-developed with innovative approaches that improve learning outcomes, while FLM research in elementary schools is limited. The study suggested that combining FLM with STEM Approach (FLM-SA) can optimize learning in the technological era. By integrating FLM-SA, students can engage in active learning experiences in class and acquire fundamental knowledge outside of class, offering a solution to e-learning challenges. The study emphasized the strong connection between FLM and STEM Approach and how they can support each other to enhance student learning.
Students’ Perspectives on Civic Education through Digital Citizenship in the Virtual Era
citizens skills digital ethics digital literacy rights and responsibility university students...
This study aimed to determine Indonesian students’ perspectives on digital citizenship skills. Digital literacy is one of the most important needs in the community and the school environment. As educational institutions, universities are expected to integrate and develop an IT-based learning environment to help students develop digital skills. This study used social media and knowledge of rights and responsibilities in cyberspace to examine university students' digital-based skills. A descriptive method with a qualitative approach was also used to describe the perspectives of students about their rights and responsibilities. Participants included 12 students from state universities in Jakarta and Lampung. Data was collected through interviews and 90-minute focus group discussions (FGD). The results showed that the top three considerations that emphasized ethics in cyberspace were maintaining privacy, not spreading fake news, and respecting the Internet community. In this context, individuals must uphold their rights and responsibilities in the virtual world, and university students are expected to apply digital ethics appropriately.
Preschool Teachers’ Issues and Beliefs in English Language Teaching: A Systematic Review (2012-2022)
belief elt in preschool issues preschool teacher...
The introduction of English language teaching (ELT) at the preschool level has been widely discussed by researchers. While most agree with ELT at preschool level, considerable issues are faced in learning a second, third, or foreign language. Therefore, this systematic review discusses the issues preschool teachers face in implementing ELT and their beliefs on how ELT should be applied to young children. Using three renowned databases, namely Scopus, Web of Science (WoS), and Educational Resources Information Centre (ERIC), 34 articles were extracted out of 85 articles, from 2012 to 2022, with exclusion and inclusion criteria taken into consideration. The findings of this study showcased eight main issues faced by preschool teachers in implementing ELT: English language proficiency, pedagogical skills, teacher perception, curriculum, teaching resources, training, socio-cultural, and classroom environment. In terms of preschool teachers' beliefs about ELT, there are four main issues: Bilingual education, children's characteristics, curriculum alteration, and teachers’ experience. Generally, these findings will guide teachers, responsible authorities, and researchers to acquire an overview of the actual issues that occur in the implementation of ELT in preschools as well as the appropriate measures to overcome them, starting from the preschool teachers' beliefs.
Vocational High School Students’ Perception of Assessments in Online Learning: For, As, and Of Learning
assessment online learning vocational high school...
Implementing online learning has led to several issues, especially those related on assessments to measure students’ learning achievement. This study aimed to obtain accurate information on learning assessments for vocational high school (VHS) students during online learning, including assessment for learning (AfL), assessment as learning (AaL), and assessment of learning (AoL). It also investigated students’ perceptions of the assessments based on their grades. This quantitative research employed the survey method, collecting data through questionnaires. The population of this research is VHS students in Indonesia, totaling 86,885 students. The participants of this study were 487 VHS students. The data were analyzed using descriptive and ANOVA techniques. The results show that most VHS students positively perceive the assessment of learning achievements in online learning for AfL, AaL, and AoL aspects. Moreover, there is a significant difference in students' perceptions of the assessment in online learning based on grades. The perception of class XII students is the highest (average value = 3.90) of all classes, while the other classes have an average value of 3.38 for class XI, and the average value of class X is 3.81.
Fostering Decision-Making and Ethics: Problem-Based Learning for Female Tertiary Learners in Israel
decision-making developing a teaching unit ethical thinking problem-based learning...
This study aimed to evaluate the impact of problem-based learning (PBL) within a teaching unit on the advancement of ethical reasoning and decision-making skills among Israeli female tertiary students. Employing a quasi-experimental design, 48 female students were distributed into three groups, with two serving as control groups receiving conventional curriculum-based instruction and one as an experimental group exposed to the PBL methodology. Both before and after implementation, all groups underwent assessments using a decision-making competency test and an ethical reasoning scale. The results unequivocally demonstrated the significant enhancement of decision-making abilities and ethical thinking through the implementation of the PBL strategy. Comparative analysis revealed substantial improvements in the experimental group compared to the control groups, emphasizing the efficacy of PBL in fostering comprehensive skill development. Furthermore, a positive correlation between ethical thinking and decision-making skills further reinforces the beneficial outcomes associated with PBL. These findings advocate for the widespread integration of PBL techniques across various academic disciplines.
Teachers’ Topic-Specific Pedagogical Content Knowledge: A Driver in Understanding Graphs in Dynamics of Market
dynamics of market economics teachers graphs topic-specific pedagogical content knowledge...
Understanding graphs in the dynamics of market (DM) is a challenge to learners; its teaching demands a specific kind of teacher’s knowledge. This study aims to examine the topic-specific pedagogical content knowledge (TSPCK) of experienced economics teachers in teaching graphs in DM to enhance learners’ understanding of the topic. It reports using a qualitative approach underpinned by the TSPCK framework for teaching specific topics developed by Mavhunga. Data were collected through classroom observations and analyzed thematically using a case study of two economics teachers. The study revealed that adopting a step-by-step approach and the use of worked graphical examples promote an understanding of graphs in DM. It also established that active learning is preferable to the predominant chalk-and-talk (lecture) method of teaching graphs in DM. The study proposed a Dynamics of Market Graphical Framework (DMG-Framework) to enable teachers, particularly pre-service teachers in lesson delivery, to enhance learners’ understanding of graphs in DM. The result of this study will broaden the international view in the teaching of graphs in DM.
Developing Creative Thinking in Preschool Children: A Comprehensive Review of Innovative
comprehensive review creative thinking early childhood...
<p style="text-align:justify">The ability to think creatively has a vital role in the development of preschool children. This research provides a comprehensive review of innovative approaches and strategies for developing creative thinking in preschool children based on current trends and methodologies used in educational settings. This research shows three significant areas: (a) creative thinking skills in preschool children, (b) factors influencing creative thinking skills in depth, and (c) innovative strategies and approaches to stimulate creative thinking abilities in preschool children. This research uses a literature study method assisted by the publish perish application to find reference sources related to creative thinking abilities in preschool children. Studies show that creative thinking abilities in preschool children enable them to find innovative solutions, help them adapt to challenges, foster self-confidence and courage, and enrich their experience and knowledge of the world around them. Meanwhile, preschool children's creative thinking abilities are influenced by collaboration from the external environment (parents, teachers, and society); providing support and examples for children to develop and stimulate their creative thinking skills is very important.</p>
An Integrated Framework of Online Learning Effectiveness in Institutions of Higher Learning
online assessment practices online course design online learning support perceived online learning...
<p><p style="text-align:justify">In the early stages of adopting online learning, both learners and teachers displayed resistance, but the COVID-19 pandemic has forced a widespread shift to digital learning. To facilitate this transition, there is a growing focus on highlighting the effectiveness of online learning, which directly impacts learning outcomes. This study investigates online learning effectiveness through an integrated framework that considers online assessment practices and online course design as independent variables, with online learning support as a moderating variable. Understanding the effectiveness of online learning is crucial as hybrid learning becomes the &quot;new norm&quot; in education, combining online and offline methods for teaching the digital generation. Using a quantitative research design involving 232 students at Universiti Kebangsaan Malaysia, the study found that online assessment practices and course design significantly influence students perceived learning outcomes in an online learning environment. Additionally, online learning support positively moderates this relationship. These findings offer a comprehensive perspective on how online assessment practices, course design, and support systems contribute to the quality of higher education in Malaysia amidst evolving educational practices.</p></p>
Student Teachers’ Knowledge of School-level Geometry: Implications for Teaching and Learning
computer-aided mathematics instruction school-level geometry student teachers teaching and learning...
<p style="text-align:justify">This study aimed to assess the geometric knowledge of student teachers from a university in the Eastern Cape province of South Africa. The study used a sample of 225 first-year student teachers who completed school mathematics baseline assessments on a computer- aided mathematics instruction (CAMI) software. The study adopted a descriptive cross-sectional research design, using quantitative data to measure student teachers’ geometry achievement level, and qualitative data to explain the challenges encountered. The results show that student teachers exhibited a low level of understanding of school-level geometry. The low achievement levels were linked to various factors, such as insufficient grasp of geometry concepts in their secondary school education, difficulty in remembering what was done years ago, low self-confidence, and lack of Information and Communications Technology (ICT) skills along with the limited time for the baseline tests. These results suggest that appropriate measures should be taken to ensure that student teachers acquire the necessary subject-matter knowledge to teach effectively in their future classrooms.</p>
Writing PISA-Like Mathematics Items: The Case of Tertiary Mathematics Instructors from a State University in the Philippines
context-based math items item-writing mathematical literacy pisa mathematics assessment framework pisa-like mathematics items...
Mathematics test items in International Large-Scale Assessments (ILSAs) such as the Programme of International Student Assessment (PISA) and the Trends in International Mathematics and Science Study (TIMSS) are nested in contexts defined in their assessment framework (e.g., the Personal, Occupational, Societal, and Scientific contexts in PISA). This study followed the item-writing activities of four tertiary mathematics instructors in the Philippines as they constructed context-based mathematics items. They were tasked to write four items each, following a set of specifications for PISA content and context categories. The data consisted of transcripts from the focus-group discussion which was conducted days after the task. The transcripts were then analyzed using thematic analysis. The results of this study showed that the phenomenon of item-writing in the context of writing PISA-like mathematics items had two themes: the phases of item-writing and the dimensions of item-writing. Findings showed that the respondents struggled to find realistic contexts and that they engaged in a problem-solving task likened to solving a puzzle as they attempted to satisfy the content, context, and process categories in the table of specifications (TOS). This study contributes to filling in the research gap on item-writing activities, particularly those of mathematics teachers in the Philippines- a country whose recent mathematical performance in the PISA 2018, TIMSS 2019, and PISA 2022 was nothing short of dismal.
Quantifying Influence: Propensity Score Matching Unravels the True Effect Sizes of Learning Management Models on Students’ Analytical Thinking
analytical thinking learning management models meta-analysis propensity score matching research synthesis...
Analytical thinking is crucial for developing problem-solving, decision-making, and higher-order thinking skills. Many researchers have consistently developed learning management models to enhance students' analytical thinking, resulting in extensive knowledge but lacking clear systematic summaries. This study aims to: (a) explore the effect sizes and research characteristics influencing students' analytical thinking, and (b) compare the effect sizes of learning management models after adjusting for propensity score matching. In exploring 131 graduate research papers published between 2002 and 2021, the research utilized forms for recording research characteristics and questionnaires for assessing research quality for data collection. Effect sizes were calculated using Glass's method, while data analysis employed random effects, fixed effects, and regression meta-analysis methods. The findings indicate that (a) research on learning management models significantly impacts students' analytical thinking at a high level (d̅ = 1.428). Seven research characteristics, including year of publication, field of research, level, duration per plan, learning management process, measurement and evaluation, and research quality, statistically influence students' analytical thinking, and (b) after propensity score matching, learning through techniques such as KWL, KWL-plus, Six Thinking Hats, 4MAT, and Mind Mapping had the highest influence on students' analytical thinking. Recommendations for developing students' analytical thinking involve creating a learning management process that fosters understanding, systematic practical training, expanding thinking through collaborative exchanges, and assessments using learning materials and tests to stimulate increased analytical thinking.
Combining Performance-Based and Self-Reported Measures of Executive Functions: Are Both Meaningful in Predicting Study Success in Higher Education Students?
executive functions higher education performance-based measurements self-reported measurements study success...
Research in higher education has revealed a significant connection between executive functions (EF) and study success. Previous investigations have typically assessed EF using either neuropsychological tasks, which provide direct and objective measures of core EF such as inhibition, working memory, and cognitive flexibility, or self-report questionnaires, which offer indirect and subjective assessments. However, studies rarely utilize both assessment methods simultaneously despite their potential to offer complementary insights into EF. This study aims to evaluate the predictive capabilities of performance-based and self-reported EF measures on study success. Employing a retrospective cohort design, 748 first-year Applied Psychology students completed performance-based and self-report questionnaires to assess EF. Maximum likelihood correlations were computed for 474 students, with data from 562-586 first-year students subsequently subjected to hierarchical regression analysis, accommodating pairwise missing values. Our results demonstrate minimal overlap between performance-based and self-reported EF measures. Additionally, the model incorporating self-reported EF accounted for 13% of the variance in study success after one year, with the inclusion of performance-based EF raising this proportion to 16%. Self-reported EF assessments modestly predict study success. However, monitoring levels of self-reported EF could offer valuable insights for students and educational institutions, given that EF play a crucial role in learning. Additionally, one in five students reports experiencing significant EF difficulties, highlighting the importance of addressing EF concerns for learning and study success.