'rubrics' Search Results
Reliability of the Analytic Rubric and Checklist for the Assessment of Story Writing Skills: G and Decision Study in Generalizability Theory
story writing skills performance assessment checklist rubric generalizability theory...
The purpose of study is to examine the reliability of analytical rubrics and checklists developed for the assessment of story writing skills by means of generalizability theory. The study group consisted of 52 students attending the 5th grade at primary school and 20 raters in Mersin University. The G study was carried out with the fully crossed hxpxg (story x rater x performance task) design, where the scoring keys were determined as fix facet. Decision Study was carried out by changing the task facet conditions. As a result, it was observed in both scoring keys that the sources of variance related to the stories had a high variance percentage in the main effects while "hp (story and rater interaction effects)" a high variance percentage in the interaction effects. The highest variance in the design belongs to the interaction effect "hpg (story, rater and performance task interaction effects)". This can be an indicator for the existence of different sources of variability and error, which are not included in the design. Examining the G and phi coefficients calculated for both scoring keys, it was determined that scoring with analytic rubrics is more reliable and generalizable. According to the decision studies, it was decided that the number of tasks used in this study is to be most appropriate.
Improving the Quality of Teaching Internships with the Help of the Platforms
teaching internship platforms motivation collaboration higher education...
This article presents an empirical study on the perceptions of university students toward the development of the teaching practicum, using the CourseSites platform as a communication and support tool for their training. The opinions of the students were collected through a questionnaire. The sample consisted of 1500 students who were registered in the degrees of Early Childhood Education, Primary Education and Pedagogy (2008-2018). A descriptive, inferential and multi-level analysis was conducted, which confirmed that future teachers had activated their professional competences, as they had the chance to share their internship experiences with their faculty members and with their own classmates.
Summative Assessment, Test Scores and Text Quality: A Study of Cohesion as an Unspecified Descriptor in the Assessment Scale
academic writing cohesion english as a foreign language language testing summative assessment texture writing quality...
Summative assessment of students' writing predicts not only the extent to which the course learning objectives have been achieved but also reveals the relevance of the assessment design with the construct of writing being assessed. Any dichotomy between the assessment criteria and the construct of writing or between the assessment criteria and test scoring procedures can produce unreliable and invalid interpretations of the students' writing proficiency. Assuming cohesion as a measure of writing quality, the present study chose samples of academic writing which did not specify cohesion as a descriptor in the assessment scale. A cohesion index was, therefore, developed to investigate how cohesive devices created texture in the sample texts and correlated with the test scores. Descriptive statistics and non-parametric correlation analysis revealed that cohesive devices were positively associated with appropriate use to create texture; however, they only weakly correlated with the test scores. The findings imply that there is the need for developing assessment criteria which consistently measures the text-forming resources to reliably ascertain the writing proficiency of the students. The study recommends a research initiative based on an analytical assessment criteria to ensure a more accurate analysis of the role of cohesion in text-formation and writing quality.
Where Exactly for Enhance Critical and Creative Thinking: The Use of Problem Posing or Contextual Learning
critical thinking creative thinking problem posing contextual learning...
Learning models that can improve critical thinking, skills collaborate, communicate, and creative thinking are needed in the 21st-century education era. Critical and creative thinking are the two essential competencies of the four skills required in the 21st century. However, both are still difficult to achieve well by students due to a lack of thinking skills during mathematics learning. This study was conducted to determine the model of learning that is appropriate to develop students' critical and creative thinking skills. The study used three-class samples from eighth grade. The first class is given the problem-posing lesson; the second class is given contextual learning and third class as a control class. The results of the study indicate that improving students' critical and creative thinking skills are included in the moderate category for types using contextual learning and problem-posing. Also, it is found that contextual learning is more effective for improving critical thinking skills when compared with learning problem posing and expository learning. Meanwhile, learning problem posing is more useful to enhance creative thinking skills compared with contextual and expository learning.
Development of Web-based Application for Teacher Candidate Competence Instruments: Preparing Professional Teachers in the IR 4.0 Era
instrument application ir 40 pedagogy professional social personality...
This research aimed to develop a web-based application for teacher candidate competence instruments to prepare professional teachers in the Industrial Revolution 4.0 (IR 4.0) era. Teacher candidate competencies consist of pedagogical, professional, social, and personality competences. This is a research and development with 8 stages, involving the development of instrument grids/ construct, focus group discussions, instrument item development, instrument validation, manual instrument testing, application development, application assessment by experts, application trial, and final revision of the application. The initial focus group discussions involved 9 experts, while the instrument validation involved 35 experts consisting of 21 experts for pedagogical and professional competences, 7 experts for social competences, 7 experts for the personality competences, and 4 media experts. The trial involved a total of 107 Mathematics, Indonesian, and English student teacher candidates. Expert validation was analyzed using the Aiken formula; application effectiveness and readability were described based on expert judgment, and discrimination tests on the results of social and personality competence tests between the study programs used the Multivariate Analysis of Variants. The results showed that there were no differences in social and personality competences between Mathematics, Indonesian, and English prospective teachers. The developed instruments for pedagogical, professional, personality, and social competences were deemed valid. The application has met the readability aspect and is scored well by experts with an average assessment rating of .78. These results suggest that the application can be used by the government as a solution to assess teacher candidate competences in the IR 4.0 era.
Digital Andragogical Competences of Ecuadorian Higher Education Teachers during the COVID-19 Pandemic
higher education technology teaching competences virtual education andragogy...
The changes brought about in higher education by the Coronavirus disease (COVID-19) pandemic require effective action. Teachers must be trained to work on university platforms. The study allows us to analyse the current educational problems, which are found in many countries, not only in Ecuador. The research aimed to determine the virtual andragogical competencies of Ecuadorian university education during the COVID-19 pandemic. A mixed research approach was used. A quantitative analysis was applied first, followed by a qualitative analysis. The sample selection was participatory and non-probabilistic. The sample consisted of 1003 active higher education teachers in Ecuador. A questionnaire of 106 questions divided into four variables was applied. A multiple analysis of variance (MANOVA) was performed. The analyses demonstrated the need to apply four integral competencies. First the teacher must "Know how to be", through continuous ICT training. After the teacher has been trained, he/she must "Know". This process involves mastering educational technology. After updating knowledge, they must "Know how to live together". Develop critical and constructive communication. Then "Know how to do" by applying an effective guiding methodology. Teacher training under the competency-based approach is seen as a viable alternative.
Quantitative Literacy and Reasoning of Freshman Students with Different Senior High School Academic Background Pursuing STEM-Related Programs
numeracy quantitative literacy quantitative reasoning stem...
This paper investigates the quantitative literacy and reasoning (QLR) of freshmen students pursuing a Science, Technology, Engineering, and Mathematics (STEM)–related degree but do not necessarily have a Senior High School (SHS) STEM background. QLR is described as a multi-faceted skill focused on the application of Mathematics and Statistics rather than just a mere mastery of the content domains of these fields. This article compares the QLR performance between STEM and non-STEM SHS graduates. Further, this quantitative-correlational study involves 255 freshman students, of which 115 have non-STEM academic background from the SHS. Results reveal that students with a SHS STEM background had significantly higher QLR performance. Nevertheless, this difference does not cloud the fact that their overall QLR performance marks the lowest when compared to results of similar studies. This paper also shows whether achievement in SHS courses such as General Mathematics, and Statistics and Probability are significant predictors of QLR. Multivariate regression analysis discloses that achievement in the latter significantly relates to QLR. However, the low coefficient of determination (10.30%) suggests that achievement in these courses alone does not account to the students’ QLR. As supported by a deeper investigation of the students’ answers, it is concluded that QLR indeed involves complex processes and is more than just being proficient in Mathematics and Statistics.
Observed Quality of Formative Peer and Self-Assessment in Everyday Mathematics Teaching and its Effects on Student Performance
everyday mathematics teaching formative assessment learning process peer assessment self-assessment...
The positive effect of peer assessment and self-assessment strategies on learners' performance has been widely confirmed in experimental or quasi-experimental studies. However, whether peer and self-assessment within everyday mathematics teaching affect student learning and achievement, has rarely been studied. This study aimed to determine with what quality peer and self-assessment occur in everyday mathematics instruction and whether and which students benefit from it in terms of achievement and the learning process. Two lessons on division were video-recorded and rated to determine the quality of peer and self-assessment. Six hundred thirty-four students of fourth-grade primary school classes in German-speaking Switzerland participated in the study and completed a performance test on division. Multilevel analyses showed no general effect of the quality of peer or self-assessment on performance. However, high-quality self-assessment was beneficial for lower-performing students, who used a larger repertoire of calculation strategies, which helped them perform better. In conclusion, peer and self-assessment in real-life settings only have a small effect on the student performance in this Swiss study.
Students’ External Representation Patterns of Suspending Objects in Static Fluid
external representation pattern floating sinking static fluid suspending...
This study aims to explore the pattern of external representation of suspending objects in a static fluid. The study used a qualitative descriptive method involving 57 elementary, junior, senior school, and university students. Data collection implemented a 30-item test covering the dominant context of suspending and partially floating and sinking. Some of phenomenographic steps were adapted in data analysis. Based on the data analysis, it can be concluded that there is a dominant external representation pattern, where there is a simplification of the depiction of suspending objects. Suspending position tends to be locked in a limited area, namely in the middle of the depth of the liquid. In the context of suspending objects' cuts, the cuts were generally represented by an upward shifting pattern. Factors that influence the pattern of representation are the involvement of intuition in conceptualizing the phenomena presented, and the conceptual aspect of density has not been integrated into the reasoning process for compiling external representations, both diagrams, and texts. Research limitation is presented in this article.
The Effectiveness of Multimedia Learning for Distance Education Toward Early Childhood Critical Thinking During the COVID-19 Pandemic
critical thinking distance education early childhood multimedia learning...
The government has imposed social restrictions during the COVID-19 pandemic, affecting the education sector, including the early childhood school. Distance education offers different methods from the conventional methods, as the students are expected to gain the same skills, including critical thinking skills. Therefore, teachers must provide distance learning innovations using relevant learning media, such as multimedia-based learning. This research aims to assess the efficacy of multimedia learning in early childhood distance learning. This research is a quantitative model with a quasi-experimental pretest and posttest design. The data collection technique utilized questionnaires given to 30 samples of early childhood children. The data were statistically analyzed using SPSS software. The results confirmed that multimedia-based learning for distance learning could develop critical thinking skills in early childhood children during the COVID-19 pandemic. The results of this study offer exploration of learning strategies to improve children’s critical thinking.
The Effectiveness of Collaborative Learning on Critical Thinking, Creative Thinking, and Metacognitive Skill Ability: Meta-Analysis on Biological Learning
biological learning collaborative learning creative thinking critical thinking metacognitive skill meta-analysis...
This review explores research into the effects of collaborative learning interventions on critical thinking, creative thinking, and metacognitive skill ability on biological learning. The search was conducted from 2000 to 2021. We found 36 critical thinking studies, 18 creative thinking studies, and 14 metacognitive skill studies that met the criteria. The results showed that collaborative learning influences large categories (ES=4.23) on critical thinking, influences large categories (ES= 7.84) on creative thinking, and influences large categories (ES= 8.70) on metacognitive skill. The study's findings show that collaborative learning interventions have the highest impact on metacognitive abilities. Based on these findings, we provide insights for education research and practitioners on collaborative learning interventions that seem to benefit the empowerment of high levels of thinking at various levels of education to be combined with various other interventions in the future. The type of intervention, level of education, materials used, and study quality criteria were included in the study.
Enhancing Oral Skills and Motivation Through Role-Playing Activities in Medical Students
english for medical purposes intervention program oral skills role-playing...
Nowadays, Peruvian physicians commonly give oral medical reports to a patient´s family in English. For this reason, this research seeks to demonstrate the effectiveness of an Intervention Program for improving oral skills through role-playing activities, one hand, and, on the other, it aims to discover the kind of motivation, both goals in 40 students belonging to the Medicine Faculty of Universidad Nacional de Piura. This study has two parts, in the first quantitative phase, it measured the level of oral skills in these students, through an oral pre-test. After that, the students participated in an intervention program consisting of role-playing activities where the doctors usually use radiography to explain a medical condition. Then, the students were evaluated on their oral skills using an imaginary hospital situation similar to the pre-test. In the second part, the qualitative phase measured the Motivation of these students using the Attitude Motivation Test Battery (AMTB) in addition, a semi-structured interview could support the findings obtained in the aforementioned survey. The main findings were the improvement of oral skills and both Integrative and instrumental motivation in these students thanks to role-playing activities application.
The Use of Collaborative Strategies to Improve Students' Writing Ability and Self-Efficacy: A Mixed Method Study
collaborative strategy writing ability writing self-efficacy...
This study explored the effects of collaborative writing strategies on students' writing skills and self-efficacy. The study used a mixed methods design combining quantitative and qualitative approaches. Several instruments were used in data collection, including questionnaires, writing tests, writing assessment rubrics, and semi-structured interviews. The participants were randomly divided into two groups: the experimental group and the control group, which comprised 62 students. Data from the questionnaire and writing tests were analyzed using one-way MANOVA and MANCOVA tests, while interview data were explored using thematic analysis techniques. Participants were randomly divided into two groups: the experimental group and the control group. The results showed that collaborative writing strategies could improve students' writing skills and self-efficacy. Moreover, the qualitative results showed that most students responded positively to using these strategies to improve their writing skills and self-efficacy.
Numerical Ratings and Content Labeling of Speeches in an Educational Public Speaking Program
evaluations public speaking rhetoric speeches...
Education in public speaking often relies largely on qualitative feedback. In this study, we explored how a numerical feedback form based on a validated scale could be used in an educational public speaking program. Data were collected at three clubs of Toastmasters International. Speech content was labeled to enable statistical analysis of correlations between speech content and audience ratings. 216 speeches by 59 speakers were evaluated by audience members, providing 1416 individual evaluations. All rating categories correlated strongly with each other. Speeches mentioning relationships, personal stories and positive emotions were rated more favorably. Speeches given in-person were rated more highly in several dimensions compared to speeches given through online video. There were some sex differences in choice of content and emotional expressiveness, but not in audience ratings of speech quality. Overall, the study found that the method was useful for both providing individual feedback and aggregated data for research purposes.
Evaluation of Preservice Teachers’ Performance in School through Video Observations during the COVID-19 Pandemic
observation preservice teachers rubrics student evaluation teacher education...
Lesson study, observation and analysis are relevant to professional development and initial teacher education. As a strategy, it helps to bridge the gap between theory and practice. The health conditions brought on by the COVID-19 pandemic forced the restriction of the tutors’ direct observation of preservice teachers at school. This study analyses preservice teachers’ performance through video observations to evaluate their professional activity at school during the COVID-19 pandemic. The Fifteen Items Revised Tsang-Hester Observation Rubric (FIR-THOR) was administered to a sample of 166 preservice teachers in their internship schools and their video recordings each one of 45-minute teaching lessons were analysed. The results show that the FIR-THOR appears as a robust instrument, which allows us to conclude that the instrument works well in the three five-items dimensions that compose it - Instruction, Management, and Assessment - proving to be reliable for assessing teacher intervention in the classroom. Among the three dimensions, the preservice teachers’ performance stands out in the Management of the classroom, as well as in the classroom Instruction. This contribution is relevant considering the potential of lesson analysis in learning and professional development during initial teacher training.
Measurement of Students' Chemistry Practicum Skills Using Many Facets Rash Model
chemistry practicum mfrm performance assessment process assessment product assessment...
The accuracy of assessing the capabilities of the process and product in chemical practice activities requires appropriate measurement procedures to be followed. It is crucial to identify the components that can introduce bias while measuring student abilities during the measurement process. This study aims to identify the components or criteria used by teachers to assess student performance in practicum activities and analyze the quality of the rubrics developed. The study was conducted with the participation of three raters, 27 high school students, and nine assessment criteria. A quantitative descriptive approach was employed using the many-facet Rasch model (MFRM) analysis for measurement. The results of the MFRM analysis show no significant measurement bias, with data measurement facets fitting the MFRM model. The reliability of all the facets meets the criteria, and the scale predictor functions appropriately. While all students can easily pass four out of nine items, five items can only be partially passed by students. The assessment criteria that require special attention include communication skills, tools and assembly, interpretation, cleanliness, and accuracy when performing practicums. These criteria provide feedback for teachers and students to ensure successful practicum activities. The Discussion section of this study delves into the findings and their implications.
Community-Based Project Learning: Empowering Students' Self-Regulated Learning and Creativity
community creativity project self-regulated learning...
Changes and challenges in the highly dynamic world of education require postgraduate students to manage their learning well and create something from their creative thinking according to the needs of the field. One of them is the activity of students in developing integrated natural science teaching materials is very necessary because learning at the primary level still uses integrated or thematic learning. Furthermore, students also need to be encouraged to be adaptive to these challenges by empowering their independence in learning. The ability to manage learning and creativity to create something new is highly prioritized for college graduates to contribute generously to their environment. This study aims to describe the empowerment of self-regulated learning and student creativity in developing natural science teaching materials in collaboration through community-based project learning. This study used a quasi-experimental design with a single-subject design type. The instruments used to retrieve data are creativity assessment rubrics and self-regulated learning questionnaires. The conclusion is that students are intrinsically and extrinsically motivated to fulfill the given tasks. Learning is essential for increasing competence, and learning strategies have been adjusted to the material's complexity or the difficulty level of the studied content. The aspect of student creativity in developing Integrated Science teaching materials shows the existence of change from stage one to the next and good categories.
Enhancing Learner Autonomy and Cultural Awareness: Strategies of Vietnamese Tertiary-Level EFL Teachers
cultural awareness learner autonomy teachers’ strategies vietnamese tertiary-level efl teachers...
This qualitative study investigates the strategies employed by Vietnamese tertiary-level English as a Foreign Language (EFL) teachers to promote learner autonomy (LA) and enhance cultural awareness. This research provides a deeper understanding of EFL teaching practices in this setting, conducted in the context of Vietnam’s evolving educational landscape, where English proficiency and cultural competence are increasingly prioritized. The study utilized semi-structured interviews with nine EFL teachers from two different Vietnamese tertiary institutions, representing various career stages: novice, mid-career, and near-end career. Thematic analysis was employed to analyze the data, revealing a range of strategies encompassing collaborative learning, technology integration, personalized feedback, real-life scenarios and role-play, reflective learning practices, local culture incorporation, contextualized language instruction, critical thinking, and cultural analysis, student-centered environments, interdisciplinary approaches, language skills for intercultural communication, and authentic material use. Findings highlight the multifaceted nature of language teaching, emphasizing not just linguistic competence but also cultural understanding and LA. These strategies are crucial in a globalized world where intercultural communication is a key skill. The study suggests the need for continuous professional development and policy support for diverse and holistic teaching practices. It offers practical insights for EFL educators, particularly in similar socio-cultural contexts, on integrating various strategies to enhance language skills and cultural awareness.