'reliability analysis' Search Results
The Effects of The Blended Project-Based Literacy that Integrates School Literacy Movement Strengthening Character Education Learning Model on Metacognitive Skills, Critical Thinking, and Opinion Expression
blended li-pro-gp learning model critical thinking metacognitive skills opinion expression...
Metacognitive, critical thinking and opinion expression are in high demand. This study aimed to investigate the effects of the blended project- based literacy that integrates school literacy movement strengthening character education (literasi berbasis proyek terintegrasi GLS dan PPK: Li-Pro-GP) learning model on students' metacognitive skills, critical thinking, and opinion expression. A post-test experimental design was used to answer the research question. The study was conducted from August to October 2021 at Government Junior High School 23 Malang. Seventh-grade students were selected as research participants. The participants included 30 students from class VII-2. The research instrument was five essay questions to measure critical thinking skills. Material and assessment experts validated the essay questions developed by the researcher. The items that were declared valid were tested for validity. The result showed five valid items with high reliability of .670. Metacognitive skills were measured using the Metacognition Awareness Instrument (MAI), which consists of 40 items. The questions declared valid were tested for validity with a very high reliability of .953 for 37 items, and only three items were invalid. The ability to express an opinion was measured with an observation questionnaire validated by experts with a valid instrument score. Data analysis was performed by path analysis using the SmartPLS software. The results showed that the Li-Pro-GP blended learning model significantly strengthened students' metacognitive skills, critical thinking, and opinion formation.
Effects of Project-Based Learning on Postgraduate Students' Research Proposal Writing Skills
academic achievement postgraduate students project-based learning research methodology research proposal writing skills...
Research is considered a vital component for propelling progress and development. This study aims to investigate the effects of problem-based learning (PBL) in the teaching of research methodology and statistics courses on improving research writing skills and enhancing course achievement. It also projects an action plan model for the effective implementation of PBL in the instructional aspect. The study utilised a positivist research paradigm based on action research design using the technique of content analysis. Employing a universal rubric, 45 proposals of graduate programme students enrolled in the College of Education at Minia University in North Upper Egypt were subjected to content analysis to rate students’ skills in writing research proposals before and after the delivery of the course. The students volunteered to participate in the study after they were given a synopsis of the aims and procedures. Students’ achievement was assessed through a test consisting of 90 items, developed primarily for this purpose at the end of the second semester in the academic year 2018–2019. The post-content analysis revealed a significant improvement in scientific research skills, with a considerable difference between the pre- and post-achievement scores. It is imperative to consider the feasibility of using the PBL approach in teaching research methodology and statistics courses for graduate students. The study recommended the adoption of PBL in undergraduate programmes as well as in high school education.
Primary School Teachers' Determinants of Integrated Teaching for Realistic Math Education
exploratory factor analysis confirmatory factor analysis integrated teaching practical setting realistic math education...
The purpose of this study was to explore the factor structure of a measurement and to evaluate its internal reliability. Overall, 525 math-majoring elementary school teachers volunteered to participate in this study by answering online survey questions via Google Form. These samples were randomly partitioned into 262 participants for exploratory factor analysis (EFA) and 263 observations for confirmatory factor analysis (CFA). The EFA tended to largely prefer a four-factor solution, which was proven to explain over 68% of the variation in the data. Awareness, effectiveness, engagement, and opportunity were the provisional labels for these hidden variables. The CFA results verified and validated the four-factor model, with all test measures exceeding the specified thresholds, suggesting an acceptable and excellent fit. The results of this study, on the one hand, provide four key areas for realistic math teachers, educators, and policymakers to discuss as opposed to examining individual indicators, and on the other hand, they serve as a foundation for interested researchers to conduct additional analyses, such as multivariate linear regression or complement for cluster analysis.
The Use of Collaborative Strategies to Improve Students' Writing Ability and Self-Efficacy: A Mixed Method Study
collaborative strategy writing ability writing self-efficacy...
This study explored the effects of collaborative writing strategies on students' writing skills and self-efficacy. The study used a mixed methods design combining quantitative and qualitative approaches. Several instruments were used in data collection, including questionnaires, writing tests, writing assessment rubrics, and semi-structured interviews. The participants were randomly divided into two groups: the experimental group and the control group, which comprised 62 students. Data from the questionnaire and writing tests were analyzed using one-way MANOVA and MANCOVA tests, while interview data were explored using thematic analysis techniques. Participants were randomly divided into two groups: the experimental group and the control group. The results showed that collaborative writing strategies could improve students' writing skills and self-efficacy. Moreover, the qualitative results showed that most students responded positively to using these strategies to improve their writing skills and self-efficacy.
The Development of a Four-Tier Diagnostic Test Based on Modern Test Theory in Physics Education
developing test four-tiers diagnostic test modern test theory...
Diagnostic tests are generally two or three-tier and based on classical test theory. In this research, the Four-Tier Diagnostic Test (FTDT) was developed based on modern test theory to determine understanding of physics levels: scientific conception (SC), lack of knowledge (LK), misconception (MSC), false negatives (FN), and false positives (FP). The goals of the FTDT are to (a) find FTDT constructs, (b) test the quality of the FTDT, and (c) describe students' conceptual understanding of physics. The development process was conducted in the planning, testing, and measurement phases. The FTDT consists of four-layer multiple-choice with 100 items tested on 700 high school students in Yogyakarta. According to the partial credit models (PCM), the student's responses are in the form of eight categories of polytomous data. The results of the study show that (a) FTDT is built on the aspects of translation, interpretation, extrapolation, and explanation, with each aspect consisting of 25 items with five anchor items; (b) FTDT is valid with an Aiken's V value in the range of 0.85-0.94, and the items fit PCM with Infit Mean Square (INFIT MNSQ) of 0.77-1.30, item difficulty index of 0.12-0.38, and the reliability coefficient of Cronbach's alpha FTDT is 0.9; (c) the percentage of conceptual understanding of physics from large to small is LK type 2 (LK2), FP, LK type 1 (LK1), FN, LK type 3 (LK3), SC, LK type 4 (LK4), and MSC. The percentage sequence of MSC based on the successive material is momentum, Newton's law, particle dynamics, harmonic motion, work, and energy. In addition, failure to understand the concept sequentially is due to Newton's law, particle dynamics, work and energy, momentum, and harmonic motion.
Impact of Mobile Technology on Collaborative Learning in Engineering Studies
collaborative learning engineering study malaysia higher education mobile technology smartpls...
Collaborative learning has been identified as an essential aspect in the process of learning. As accelerated advancement continues to characterize the developments of technology, innovative mobile technology appears to be transforming the way collaborative learning is taking shape. This study focused on identifying whether mobile technology has a significant impact on collaborative learning in engineering studies in a private University in Malaysia. Using a quantitative approach, an online survey was administered for the data collection. Some 221 participants were selected randomly among undergraduate engineering students in the University. Data were analyzed using SmartPLS. The research findings revealed that mobile technology has a significant impact on collaborative learning. The findings also indicated that two of the mobile technology dimensions, namely mobility and immediacy have significant impact on collaborative learning. Consequently, this research suggests engineering educators can integrate mobile technology into their future instruction for more collaborative learning and create a smart workforce consisting of fast and adaptive engineers as well as other learners in Malaysia.
Learning Materials and Their Prototypes for Academic Writing Skills: The Needs of Indonesian Lecturers in the Post-COVID-19 Era
academic writing skills learning materials lecturers’ needs post-covid-19 prototype...
This study aims to investigate lecturers' needs for academic writing learning materials and determine their prototypes. This study is qualitative research in the form of an exploratory case study. The research instruments were semi-open-ended questionnaires and unstructured and open-ended interview guides. The data were analyzed using content analysis. The results show that the developed learning material for academic writing skills contains seven needs for lecturers in the Department of Indonesian Language and Literature. Four of them have not been found by previous researchers. The results from this study provide new knowledge and contribution to the literature about the need to prototype the learning materials. The lecturers or other researchers can use these seven needs in prototyping learning materials for academic writing skills, such as the needs of learning materials, their forms, presentation system, language use, evaluation form, main menu design, and the way of creating learning materials.
The Impact of Academic Stress on Cyberloafing with Fatigue as a Mediating Variable: Study of Students in Bandung City-Indonesia During a Pandemic
academic cyberloafing fatigue stress students...
The evolution of the COVID-19 pandemic has affected various aspects of human life, with numerous activities carried out through networks, including education. Lecturers need to change their teaching strategies to make students able to accept the material provided. On the other hand, students must manage their lives without being limited by space and time to avoid stress and cyberloafing, especially in the academic field. Cyberloafing is the act of accessing the internet during study hours for personal interests. Therefore, this research aims to determine the effect of academic stress on cyberloafing and whether fatigue is a mediating variable between both factors. Data were collected from 284 students studying in Bandung, West Java, Indonesia. The results showed that the academic stress felt by students has a positive and significant effect on cyberloafing behavior. Although fatigue positively affects both factors, it does not mediate the relationship between them. The managerial implications in this research are expected to be used as material for evaluating online learning methods for students, as well as to make them aware of the negative impact of cyberloafing behavior during lectures.
Research on Factors that Influence College Academic Performance: A Structural Equation Modelling Approach
academic performance emotion engagement self-control self-efficacy...
This study used the structural equation modeling (SEM) approach to test a model that hypothesized the influence of self-efficacy, self-control, emotion, and engagement on student academic performance. The structural equation modeling model was developed to link all the study variables with a literature review to describe the interrelationship. Data collected were from 413 college students in their second year. The results show that self-efficacy, self-control, emotion, and engagement predict student academic performance. And through emotion and student engagement, both self-efficacy and self-control predict student academic performance indirectly. Practically the measures used in this study give more information about the learning environment in higher education settings than those usually come from traditional practices faculty received in the classroom, such as student rating forms and feedback. The main findings of this study have some implications for higher education, theory development, measurement, and future research.
The Efficiency of Tailored Systems for Language Education: An App Based on Scientific Evidence and for Student-Centered Approach
immigration mobile-assisted language learning refugees second language technology-based education...
In the vulnerable and unstable contexts that characterize populations in mobility between countries, especially immigrants and refugees, the second language learning has assumed new traits of difficulty. To help the new generation of learners, mainly with origin in forced immigration, the mobile-assisted learning helps motivation for language learning and reduces anxiety related to language acquisition. Attending to this challenge educational scenario, this review study presents a literature systematic analysis and a concrete technology tool that advocates the student-centered approach. A mobile pedagogical plan was developed for the learning of European Portuguese as a Second Language and as a Foreign Language. A critical review of 38 studies was conducted to understand how the mobile-assisted learning responds to the inclusion and education, especially concerning minorities. Based on previous empirical data with 108 immigrants, we understand the type of tasks that new immigrants have more difficulty learning in Portuguese. It was developed as a mobile app for Android, IOS, computers and tablets: the GoGenius app. In mobile format, individuals can access fourteen themed units with a symmetrical game architecture. These games focused the tasks and themes with priority for new language learners who recently arrived in a hosting country. These units involve a consistent number of working hours that intentionally intend to complement to the contact hours that the subjects have in classroom contexts or in unstable communication contexts (daily communication). This technology project aims to match “tailored” psychological and technological resources. Flipped classroom approach showed how mobile-assisted learning reinforces the educational goals worldwide, specifically for language learning. However, mobile tools should be well structured and centered on students’ needs, especially with migration backgrounds.
Development of a Self-Evaluation Instrument with Programmatic Assessment Components for Undergraduate Medical Students
instrument development medical education programmatic assessment...
This study aimed to develop and test a student self-assessment instrument based on the programmatic assessment (PA) components. We applied a series of psychometric research methods by (a) conducting a literature study to find PA constructs, (b) developing the students' self-questionnaires, (c) ensuring content validity, (d) testing face validity, and (e) conducting reliability tests that involve medical students, medical teachers, medical educationalist, and an international PA expert. Face validity (readability test) was conducted with 30 medical students from an Indonesian university who were in their last year of pre-clinical education and had average scores above or equal to their classmates. The confirmatory factor analysis (CFA) was used to report the instruments’ validity and reliability. The final instrument was tested on 121 medical students with excellent GPAs from another medical school with a middle-level accreditation. The PA consists of five components: ‘learning activities’, ‘assessment activities’, 'supporting activities’, 'intermediate evaluations’, and ‘final evaluations'. These components are conveyed through 41 relevant statements with a four-point Likert scale and three yes/no statements. According to the respondents, there was a lack of 'supporting activities' and 'intermediate evaluation' components in the PA in their universities. This study has developed and tested a five-component evaluation instrument based on medical students' perceptions regarding PA implementation.
Development and Validation of a Concept Inventory for Interpreting Kinematics Graphs in the Tanzanian Context
concept inventory kinematics graphs physics teachers tanzania context...
This paper discusses the development and validation of a concept inventory for interpreting kinematics graphs in the Tanzanian context. The study involved 61 participants comprising physics pre-service teachers, secondary school teachers, diploma college tutors, and a university lecturer from Tanzania. We developed 25 multiple-choice questions for interpreting kinematics graphs. The different steps in the development process used are selecting the topic, setting objectives, constructing questions, validating questions, and reliability testing. We carried out descriptive and inferential statistical analysis by using Statistical Package for Social Science (SPSS) version 22 followed by item analysis for pre-and post-piloting. Findings revealed normal distribution scores with a mean and standard deviation of 39.28±10.893 for pre-piloting and 40.16±8.08 for post-piloting. It also revealed no significant difference between pre-and post-piloting results with a p-value of 0.414. In addition, correlation coefficients for test re-test reliability were .783 and .878 for single and average measures respectively. Moreover, item analysis in terms of difficulty index, discrimination index, and distractor efficiency agreed with the published standards. Based on these findings, the study recommends the use of developed and validated kinematics graphs concept inventory by physics educators in both research and classroom instructions in the Tanzanian context.
Evaluation of Preservice Teachers’ Performance in School through Video Observations during the COVID-19 Pandemic
observation preservice teachers rubrics student evaluation teacher education...
Lesson study, observation and analysis are relevant to professional development and initial teacher education. As a strategy, it helps to bridge the gap between theory and practice. The health conditions brought on by the COVID-19 pandemic forced the restriction of the tutors’ direct observation of preservice teachers at school. This study analyses preservice teachers’ performance through video observations to evaluate their professional activity at school during the COVID-19 pandemic. The Fifteen Items Revised Tsang-Hester Observation Rubric (FIR-THOR) was administered to a sample of 166 preservice teachers in their internship schools and their video recordings each one of 45-minute teaching lessons were analysed. The results show that the FIR-THOR appears as a robust instrument, which allows us to conclude that the instrument works well in the three five-items dimensions that compose it - Instruction, Management, and Assessment - proving to be reliable for assessing teacher intervention in the classroom. Among the three dimensions, the preservice teachers’ performance stands out in the Management of the classroom, as well as in the classroom Instruction. This contribution is relevant considering the potential of lesson analysis in learning and professional development during initial teacher training.
Psychometric Analysis of the Social Support Scale Among Indonesian Academicians
factor analysis reliability social support validity...
The current study investigates the psychometric characteristics of the Social Support Scale as an instrument for assessing social support for academics. The original version of the scale was adapted and translated into Indonesian and was administered to academics in Indonesia through a google form. The data were then analyzed to investigate the reliability, construct validity, and structure of factors of the instrument. Confirmatory factor analysis confirms that the three-dimension model was the best model regarding the internal structure. Our findings also advocate the Social Support Scale as a valid and reliable tool for assessing social support in Indonesian academics. Thus, it can be employed to examine lecturers’ social support level which helps the universities to build a supportive working climate, as well as improve the relationship quality between employees.
Study Item Parameters of Classical and Modern Theory of Differential Aptitude Test: Is it Comparable?
classical test theory differential aptitude test item parameter modern test theory...
This study aimed to find the Classical Test Theory (CTT) and Modern Test Theory (MTT) item parameters of the Differential Aptitude Test (DAT) and examined their comparability of them. The item parameters being studied are difficulty level and discrimination index. 5.024 data of the result sub-test DAT were documented by the Department of Psychology and Guidance and Counselling bureau. The parameter of classical and modern test items was estimated and correlated by examining the comparability between parameters. The results show that there is a significant correlation between item parameter estimates. The Rasch and IRT 1-PL models have the highest correlation toward CTT regarding the item difficulty level. In contrast, model 2-PL has the highest correlation toward CTT in the item discrimination index. Overall, the study concluded that CTT and MTT were comparable in estimating item parameters of DAT and thus could be used independently or complementary in developing DAT.
Project-Based Learning as a Strategy in Physical Education Teacher Training: Creating A Cultural Route Promoting Active Commuting
active learning higher education student project...
This study analyzes the narrated reflection of the students in relation to their learning, based on the perceptions that emerge from their experience in the development of the project. Participants were 53 fourth year Pedagogy in Physical Education students, with an average age of 24.3, who were divided into 13 groups. A qualitative study that used the narrated reflection of the students in relation to learning, based on a driving question. In order to help guide the students’ work, and to collect the perceptions they experienced during their participation, the following four components were integrated into the development of the project and included in the final product: a) historical and heritage sites, b) technology used to measure energy expenditure, c) type of active commuting, d) reflection on what was learned. The students designed 13 routes of active commuting through the city, which included different cultural, heritage and historical landmarks. The students analyzed the learning experience, highlighting the importance of knowing and caring for the heritage of the different cities around which they traveled. PBL can be a didactic alternative in initial Physical Education teacher training to achieve learning by linking subject content with the motivations and interests of the students.
The Effectiveness of The Educare Program in Improving Pro-Social Attitudes to Prevent Bullying in Inclusive Schools
bullying prevention educare program inclusive school pro-social attitude...
The fundamental challenge in implementing inclusive schools is related to accepting students with special needs by other students. Lack of acceptance and respect for differences often trigger acts of bullying. There are insufficient studies describing that the perpetrator of bullying in school is a student with special needs. This study aims to measure the effectiveness of the educare program in improving students' pro-social attitudes to prevent bullying in inclusive schools. The Educare Program consisted of four lesson plan themes and became a treatment instrument. Single subject research (SSR) was used for the research method, implementing the baseline-intervention-maintenance (AB+M) phase with multiple baselines across subjects. Three students, including a student with a disability and a low pro-social attitude, were the subjects of this study. The data were collected through observation and analyzed through graphical visual inspection focusing on trend, level, latency, and percentage of all non-overlapping data (PAND). The results of the study presented in polygon graphs and PAND showed that the Educare Program is very effective in increasing students' pro-social attitudes. Almost all scores of pro-social attitudes obtained through trend with PAND reached 96.11%.
The Assistive Technology for Teaching and Learning of Social Skills for Autism Spectrum Disorder Children: Multimedia Interactive Social Skills Module Application
asd children autism missm application mobile application social skills...
An earlier study found that assistive technology based on mobile applications significantly improved how social skills were taught to and learned by autism spectrum disorder (ASD) children. Nevertheless, the content of the existing mobile applications is inadequate for capturing the diversity of Malaysian culture, making it unacceptable for local use. Considering cultural norms is a factor in developing social skills in ASD children. It is therefore necessary to develop new assistive technology based on mobile applications that consider Malaysian cultural norms. As a result, the Multimedia Interactive Social Skills Module (MISSM) application was created based on the Addie Model, which offers a systematic process for assisting in developing successful instructional material by fusing instructional theory with learning theory. The MISSM application is based on Malaysia's current social skills curriculum, which helps ASD children become socially competent. Hopefully, it will help them develop better social skills and achieve academically. Finally, local culture-sensitive material for assistive technology based on mobile applications would support Malaysia's adoption of a technology-based teaching and learning strategy and contribute to a better understanding of social skills.
Evaluating the Results of PISA Assessment: Are There Gaps Between the Teaching of Mathematical Literacy at Schools and in PISA Assessment?
education gaps mathematical competence mathematical literacy pisa assessment...
The problems in education in the countries of the Organization for Economic Cooperation and Development (OECD) vary from country to country. The differences between "upper class" and "lower class" countries in PISA assessment results have led to a research gap. The purpose of this study was to (a) test students' mathematical literacy skills on the Program for International Student Assessment (PISA) test and compare the results using the sum of means across OECD countries; (b) examine the relationship between students' mathematical competence, precision, and self-perception of mathematical literacy skills in the PISA test; and (c) analyze the gaps that exist between the implementation of mathematics instruction in school and the mathematical literacy as measured on the PISA test. This study was designed as a mixed method with an explanatory sequential design. The data collection methods included test procedures, questionnaires, and interviews. The result of this study showed that the overall mean score obtained was below the OECD average. In general, the respondents achieved only level 2 mathematics proficiency. A significant relationship was found between mathematical competence, precision, and self-perception in mathematical skills. On the other hand, there was a gap, namely the difference at the implementation level, where mathematical literacy measured by PISA differed from the measurement of mathematical learning achievement by teachers in school. The results showed that teaching that emphasizes only problem-solving procedures affects low mathematical competence and is not useful enough for students to deal with the PISA mathematics test.
Mathematical Literacy Skills for Elementary School Students: A Comparative Study Between Interactive STEM Learning and Paper-and-Pencil STEM Learning
experimental research interactive stem mathematical literacy paper and pencil stem...
This study aimed to compare and examine the effectiveness of interactive STEM learning and paper-and-pencil STEM learning in terms of mathematical literacy skills of elementary school students. This research is of a quasi-experimental type with a non-equivalent pretest-posttest control group design. Sampling was carried out on the elementary school populations in Bengkulu and South Sumatra Provinces in two stages. In the first stage, schools in rural and urban areas were selected, and in the second, classes in each school were randomly selected. The selected sample consisted of fifth-grade students of the Public Elementary School of Terawas, Musi Rawas, with an experimental class A (n = 20) and an experimental class B (n = 19), as well as fifth-grade students of the Public Elementary School of Bengkulu City, with an experimental class A (n = 25) and an experimental class B (n = 22). Data collection was conducted using mathematical literacy skills tests in reference to the PISA and Minimum Competency Assessment (level 1–3). Data analysis was performed using descriptive and inferential statistics; it employed an independent t-test for the comparative testing and an N-gain test for testing the effectiveness of STEM learning. The results showed that there were differences in math literacy skills between interactive STEM and paper-and-pencil STEM for students in urban schools, but not significantly different for students in rural schools. General STEM learning was effective in increasing the literacy of elementary school students, and interactive STEM in particular demonstrated the highest level of effectiveness in the urban school.