'assessment instrument' Search Results
Development and Validation of Teachers’ Assessment Belief of Mathematical Thinking Instrument
assessment beliefs assessment forms assessment purpose mathematics beliefs mathematical thinking...
This study was conducted to corroborate in understanding the teachers’ beliefs about assessment practices. The prior studies related to teachers’ assessment beliefs in mathematics have been done to assess teachers’ beliefs in the general context of mathematics teaching. This study developed an instrument to assess teachers’ assessment beliefs of mathematical thinking. The research aimed to develop and validate a scale of assessment beliefs of mathematical thinking by using the confirmatory factor analysis. The first draft of the scale contained 25 items. The sample of the study consisted of 537 mathematics teachers from public schools in Oman. The instrument was a questionnaire with a 5-point Likert scale. The scale was validated by asking a number of experts in mathematics educational measurement and evaluation. Exploratory and confirmatory factor analysis was applied to test the model of assessment beliefs of mathematical thinking scale using AMOS 25.0. All constructs had acceptable reliability. The model had a good model fit for the assessment beliefs of mathematical thinking scale which obtainable from the fit indices tests. The findings revealed that all fit criteria indices were realized. The results also showed acceptable validity and construct reliability for the scale.
Quantitative Literacy and Reasoning of Freshman Students with Different Senior High School Academic Background Pursuing STEM-Related Programs
numeracy quantitative literacy quantitative reasoning stem...
This paper investigates the quantitative literacy and reasoning (QLR) of freshmen students pursuing a Science, Technology, Engineering, and Mathematics (STEM)–related degree but do not necessarily have a Senior High School (SHS) STEM background. QLR is described as a multi-faceted skill focused on the application of Mathematics and Statistics rather than just a mere mastery of the content domains of these fields. This article compares the QLR performance between STEM and non-STEM SHS graduates. Further, this quantitative-correlational study involves 255 freshman students, of which 115 have non-STEM academic background from the SHS. Results reveal that students with a SHS STEM background had significantly higher QLR performance. Nevertheless, this difference does not cloud the fact that their overall QLR performance marks the lowest when compared to results of similar studies. This paper also shows whether achievement in SHS courses such as General Mathematics, and Statistics and Probability are significant predictors of QLR. Multivariate regression analysis discloses that achievement in the latter significantly relates to QLR. However, the low coefficient of determination (10.30%) suggests that achievement in these courses alone does not account to the students’ QLR. As supported by a deeper investigation of the students’ answers, it is concluded that QLR indeed involves complex processes and is more than just being proficient in Mathematics and Statistics.
Factors Affecting Student Satisfaction with Higher Education Service Quality in Vietnam
an giang university higher education services student satisfaction vietnam...
Higher education plays an important role in providing students with knowledge and skills to enter the labor market. The quality of higher education, the satisfaction of the quality of higher education has been concerned by many individuals and organizations. The study aims to explore the factors affecting student satisfaction with the quality of higher education services in Vietnam. Research data was collected from survey results by questionnaires from 396 students of An Giang University, Vietnam National University Ho Chi Minh City, Vietnam. SPSS 20, AMOS 24 software is used for analysis and evaluation of scales through Cronbach's Alpha reliability coefficient; exploratory factor analysis EFA; CFA confirmatory factor; SEM linear regression analysis to test the hypotheses. The results of the SEM model study show that there are six factors affecting student satisfaction with the quality of higher education services in Vietnam, including teaching staff; facilities and teaching facilities; ability to serve; educational activities; student support activities; education programs. From the research results, discussions on educational administration are proposed to improve student satisfaction with the quality of higher education services in Vietnam.
Development of Affective Self-Assessment Instrument of Chemistry for High School Student as the Daily Assessment Guideline
affective domain reliability validity...
The study objectives were (1) developing a valid and reliable Affective Self-assessment Instrument of Chemistry for High School Student and (2) discovering the chemistry affective domain ability trend of high school students based on gender. The current development study utilized 10 non-test instrument development procedures from Mardapi. The study population was all high school students in Yogyakarta Special Region. The sample size was 405 students categorized into two stages and sampling techniques, i.e., the trial stage using cluster random sampling and the measurement stage using simple random sampling. The data analysis techniques were validity test using the Aiken index and construct validity and reliability using the second-order Confirmatory Factor Analysis model. The study findings were (1) the Affective Self-assessment Instrument of Chemistry for High School Student had 15 valid and reliable items and 15 available items to be utilized by teachers to measure students’ affective in the learning process and (2) the chemistry affective domain ability trend of male high school students was dominated by the “good” category and “very good” category for female students.
The Development of Historical Thinking Assessment to Examine Students’ Skills in Analyzing the Causality of Historical Events
causality historical events historical thinking skills...
This research aimed to develop a historical thinking assessment for students' skills in analyzing the causality of historical events. The development process of Gall and colleagues and Rasch analysis models were used to develop an assessment instrument consisting of two processes, including the analysis of the framework of cause and consequence, the validity, reliability, and difficultness test. This research involved 150 senior high school students, with data collected using the validation sheet, tests, and scoring rubric. The results were in the form of an essay test consisting of six indicators of analyzing cause and consequence. The instruments were valid, reliable, and suitable for assessing students’ skills in analyzing the causality of historical events. The developed instruments were paired with a historical thinking skills assessment to improve the accuracy of the information about students' level of historical thinking skills in the learning history.
Exploratory and Confirmatory Factor Analysis for Disposition Levels of Computational Thinking Instrument Among Secondary School Students
attitudes computational thinking disposition factor analysis...
Computational thinking (CT) is a method for solving complex problems, but also gives people an inventive inspiration to adapt to our smart and changing society. Globally it has been considered as vital abilities for solving genuine issues successfully and efficiently in the 21st century. Recent studies have revealed that the nurture of CT mainly centered on measuring the technical skill. There is a lack of conceptualization and instruments that cogitate on CT disposition and attitudes. This study attends to these limitations by developing an instrument to measure CT concerning dispositions and attitudes. The instruments' validity and reliability testing were performed with the participation from secondary school students in Malaysia. The internal consistency reliability, standardized residual variance, construct validity and composite reliability were examined. The result revealed that the instrument validity was confirmed after removing items. The reliability and validity of the instrument have been verified. The findings established that all constructs are useful for assessing the disposition of computer science students. The implications for psychometric assessment were evident in terms of giving empirical evidence to corroborate theory-based constructs and also validating items' quality to appropriately represent the measurement.
Observed Quality of Formative Peer and Self-Assessment in Everyday Mathematics Teaching and its Effects on Student Performance
everyday mathematics teaching formative assessment learning process peer assessment self-assessment...
The positive effect of peer assessment and self-assessment strategies on learners' performance has been widely confirmed in experimental or quasi-experimental studies. However, whether peer and self-assessment within everyday mathematics teaching affect student learning and achievement, has rarely been studied. This study aimed to determine with what quality peer and self-assessment occur in everyday mathematics instruction and whether and which students benefit from it in terms of achievement and the learning process. Two lessons on division were video-recorded and rated to determine the quality of peer and self-assessment. Six hundred thirty-four students of fourth-grade primary school classes in German-speaking Switzerland participated in the study and completed a performance test on division. Multilevel analyses showed no general effect of the quality of peer or self-assessment on performance. However, high-quality self-assessment was beneficial for lower-performing students, who used a larger repertoire of calculation strategies, which helped them perform better. In conclusion, peer and self-assessment in real-life settings only have a small effect on the student performance in this Swiss study.
Moderating the Neuropsychological Impact of Online Learning on Psychology Students
higher education neuropsychological impact online learning psychology students...
The purpose of the study was to identify what neuropsychological effect online learning had on psychology students and how it could be moderated. The study was descriptive and combined qualitative and quantitative methods to address the research questions. The study relied on three phases such as baseline study, experiment, and reporting. The experiment utilised neuropsychology tests adopted from the NeurOn platform. It was found that the Psychology students’ perceptions of e-learning and their emotional reaction to them were found not to be appreciative. The practices in breathing exercises, meditation, or yoga were proved to be able to moderate the impact of online learning on the experimental group students’ attentional capacities, memory processes, and cognition abilities. The above findings were supported by the results obtained for the neuropsychology tests and the experimental group students’ self-reflections yielded from the use of the MovisensXS App. The students confirmed that breathing exercises, meditation, or yoga reduced study stress and burnout caused by e-learning and improved their academic performance. The focus group online discussion also showed that integration of breathing exercises, meditation, and yoga helped the experimental group students keep emotional balance, concentrate on their studies easier, remember more information, and meet deadlines in completing assignments. The education scientists are suggested to study how the e-learning curriculum could be reshaped so that it used relaxation practices on regular basis.
Validating Student’s Green Character Instrument Using Factor and Rasch Model
green character instrument factor and rasch analysis...
Many researchers have separately developed instruments to measure environmental characteristics such as attitudes, values, and knowledge. However, there is no instrument used to measure all these aspects in one comprehensive instrument. This study is meant to develop and validate a green character instrument which reveals student behavior and awareness of the environment. The instrument consists of 40 statement items consisting of 5 aspects, namely private pro-environmental behavior, public pro-environmental behavior, environmental knowledge, environmental values, and environmental attitudes. It was implemented on 1,398 students from 15 universities in Indonesia. The instrument content validation was analyzed by three experts using content validity index (CVI). The construct validity was analyzed using exploratory factor analysis, confirmatory factor analysis, and RASCH analysis. The content validity results obtained CVI scores ranging between 0.8 and 0.9 with a good category, while item reliability was in a fairly good category with a high level of separation index. Construct validation resulted in 34 items (4 items were eliminated after Exploratory and Confirmatory Factor Analysis, and 2 items were eliminated after RASCH analysis) spread over five constructs, namely environmental behavior, environmental knowledge, environmental values, environmental attitudes, and environmental habits. The resulting instrument has a good level of item difficulty, with a well understood response set which can be understood easily by respondents, and without bias. Therefore, it can be used to measure the students’ green character on both male and female.
Construction of the Character Assessment Instrument for 21st Century Students in High Schools
assessment construct character validity reliability...
The study of character becomes a very important discussion in the 21st century. So that the integration of character values is very important both in the process and in educational assessment. The purpose of this study was to test the validity and reliability of the character assessment instrument for 21st-century high school students. The research approach used was quantitative with a sample of 200 high school students. Data analysis carried out includes validity and reliability tests. The test results of the instrument showed that the construct of the student character assessment instrument was declared valid and reliable. The content validity test shows the value of Aiken's > .80 in the high category. In the construct validation test with EFA, all variables have a loading factor > .5. In the CFA test, the model is declared fit with the estimated standard loading value of .40 and the t-count value > 1.96. Meanwhile, while in testing the reliability of the instrument obtained composite > .70 Cronbach's Alpha reliability > .70 which means reliable. So that this instrument is declared valid and reliable to measure the character of students in high school.
Predictive Power of Five-Factor Mentoring Model on Student Teachers’ Teaching Self-Efficacy Beliefs
five-factor mentoring model teaching self-efficacy teaching practicum...
This study investigated student teachers’ teaching self-efficacy level and factors that predict it (using five-factor mentoring model). Two hundred and ten third and fourth-year student teachers (N=100/N=110; 93.8% females) were involved in the study and asked to complete a self-report questionnaire. The “Mentoring for Effective Primary Teaching” instrument and “Teachers' Sense of Efficacy Scale” were used to collect the data. Findings indicated that higher levels of student teachers' self-efficacy are positively associated with the level of mentoring experience during the teaching practicum. The results found that fourth-year students reported significantly higher levels of teaching self-efficacy than third-year students. This study reported that there is a significant mean difference in student teachers’ self-efficacy beliefs in terms of having parents in the teaching profession. A multiple regression found that mentor teachers’ personal attributes are the best predictor of student teachers' teaching self-efficacy beliefs.
Reshaping the Preservice Preschool Teachers’ Curriculum to Give the Emphasis to the Managerial Domain
guided interim directorship graduates majoring in preschool education higher education managerial domain of the curriculum...
The purpose of the study was to determine whether emphasising the managerial domain of the preservice preschool teachers’ curriculum is capable to improve their management and leadership skills. This study used the mixed-method methodology that combined the exploratory design and the experimental design. It included three basic phases such as feasibility assessment of making changes to the curriculum, intervention, and controlled observation, followed by the analytical phase. It was proved that the university curriculum upgraded the training approach by using the guided interim directorship. This change addressed the Professional Standard requirements for the preschool heads as well as job requirements. The intervention produced a positive shift in students’ skills of micromanagement, long-term planning, communicating vision, emotional control, and mentoring. There was a shift from the basic level of management skills before the intervention to the intermediate level of the skills after the intervention. The number of students with a superior level of skills increased by 11.54% as well. The students’ comments concerning the integration of the managerial component into the curriculum were complimentary. The observers’ reports suggested that they appreciated the students' work which was the outcome of the updated curriculum.
Developing Assessment Instrument Using Polytomous Response in Mathematics
assessment instrument classical and modern theory vocational school polytomous responses...
This research is a developmental research aiming at developing a good mathematical test instrument using polytomous responses based on classical and modern theories. This research design uses the Plomp model, which consists of five stages, (1) preliminary investigation, (2) design, (3) realization/construction, (4) revision, and (5) implementation (testing). The study was conducted in three vocational schools in Lampung Province, Indonesia. The study involved 413 students, consisting of 191 male and 222 female students. The data were collected through questionnaire and test. The questionnaire was used to identify the assessment instruments currently employed by teachers and to be validated by the experts of mathematics and educational evaluation. The test used an open polytomous response test numbering of 40 items. The data were analyzed using both classical and modern theories. The results show that (1) the open polytomous response test has a good category according to classical and modern theory. However, the discrimination power of test items in classical theory needs several revisions, (2) the assessment instrument using the polytomous response of open multiple choice can guarantee information on the actual competence of students. This is proven by the fact that there is a harmony between the analysis result obtained from classical and modern theory from the students' arguments when giving reasons for their choices. Therefore, the open polytomous response test can be used as an alternative to learning assessment.
The Effectiveness of Multimedia Learning for Distance Education Toward Early Childhood Critical Thinking During the COVID-19 Pandemic
critical thinking distance education early childhood multimedia learning...
The government has imposed social restrictions during the COVID-19 pandemic, affecting the education sector, including the early childhood school. Distance education offers different methods from the conventional methods, as the students are expected to gain the same skills, including critical thinking skills. Therefore, teachers must provide distance learning innovations using relevant learning media, such as multimedia-based learning. This research aims to assess the efficacy of multimedia learning in early childhood distance learning. This research is a quantitative model with a quasi-experimental pretest and posttest design. The data collection technique utilized questionnaires given to 30 samples of early childhood children. The data were statistically analyzed using SPSS software. The results confirmed that multimedia-based learning for distance learning could develop critical thinking skills in early childhood children during the COVID-19 pandemic. The results of this study offer exploration of learning strategies to improve children’s critical thinking.
Learning Motivation, Democratic Parenting, and Peer Relations Predict Academic Self-Concept
academic self-concept democratic parenting learning motivation peer relations students...
Students' academic self-concept is a concerning concept in educational research. The purpose of this research is to examine the simultaneous influence and relationship of learning motivation, democratic parenting, and peer relations with academic self-concept in students. This is a correlational research with a cluster random sampling method used to collect data from 962 students. The result showed that learning motivation, democratic parenting, and peer relations had a partial and simultaneous relationship with students' academic self-concept. Furthermore, support from guidance and counselors, homeroom teachers, and parents is essential for students to actualize and develop their character optimally and effectively.
Analysis of Requirements for the Digital Competence of a Future Teacher
assessment of digital competence content of digital competencies digital competence digital competence of a future teacher education structure...
The article discusses the topical issue of a model of digital competencies for a future teacher. The analysis of the composition and structure of the most relevant models of digital competencies of a citizen and a modern teacher is carried out. In addition, the article reveals approaches to the formation of the content of digital competence, and provides the results of an empirical study, which consists in analyzing the results of a survey of practicing teachers and teacher-training students in order to identify the most demanded digital competencies of a future teacher. The article substantiates the authors’ content of the competence of a future teacher, a university student. The purpose of this article is to develop a theoretical model of digital competence of a future teacher, taking into account the dynamic technologisation of the modern world and the peculiarities of Russian education, based on an analysis of approaches to determining the content of its digital competencies. According to the analysis of studies, the issue of teachers’ digital competence is not sufficiently disclosed. Numerous studies on digital competencies of a person, teacher, etc. do not fully solve the problem of assessing the digital competence of future teachers.
Primary School Mathematics Teachers’ Beliefs About Teaching in Synchronous Virtual Classrooms: A Mixed Method Study
active learning beliefs mathematical achievement primary school mathematics teachers synchronous virtual classrooms teaching competence...
This study was conducted following the initial stage of the transition to distance education necessitated by the onset of the COVID-19 pandemic and meeting the various challenges that came with it. At this point, countries and teachers have gained experience in preparing and delivering online education. Therefore, the study aimed to identify the beliefs of primary school mathematics teachers about teaching in synchronous virtual classrooms. It adopted a mixed methods approach, following a convergent parallel design. The overall study sample comprised 410 male and female teachers. A questionnaire was used to collect quantitative data across three dimensions (teaching efficiency, employing the philosophy of active learning, mathematical achievement). There were 31 items (verified for validity and reliability) comprising statements measured using a five-point Likert scale, together with open-ended options for further elaboration. In total, 130 teachers completed the questionnaire. Interviews were conducted with 10 teachers to collect qualitative data. The results show means in the range 3–5.75 for agreement with statements concerning the beliefs of mathematics teachers about teaching in virtual classrooms in the following order of importance: teaching competence; mathematical achievement; employing the philosophy of active learning. The study also found no statistically significant differences attributable to the variables of gender, qualification, or teaching experience, and also that many factors are considered to affect teaching in synchronous virtual classrooms related to the teacher, the family, and the student.
Development of Attitude Assessment Instruments Towards Socio-Scientific Issues in Chemistry Learning
attitude chemistry learning factor analysis socio-scientific issue...
A socio-scientific issue is one of the learning techniques used today, which uses various scientific sources to make students think scientifically to conduct a dialogue and discuss solving a problem. Various problems in socio-scientific are controversial, requiring reasoning, and ethical evaluation in the decision-making process. A conflict between chemical reason and students' social point of view will cause students' different assessments and attitudes towards the socio-scientific issue. This study is a research and development (R&D) that focuses on the instrument's validity with the factor analysis technique to assess attitudes towards the socio-scientific issue in chemistry learning. CFA and EFA analysis found five factors in the tool: anxiety, interests, likes, benefits, confidence, validity, and reliability. The total reliability coefficient is .853. Of the eight instrument feasibility analysis requirements, seven instruments were declared fit to meet construct validity.
Teacher-Student Performance Criteria During Online Classes due to COVID-19: Self-Report by Postgraduate Students in Education
didactic pandemic performance school lockdown teaching...
During didactic interactions, teachers and students employ competencies and skills that correspond functionally to one another, and several models propose to typify didactic performances in higher education. For this study, we chose the didactic performance interbehavioral model as the substantive theory to identify six pairs of didactic performance criteria through self-evaluations from graduate students. These included: Competency exploration–precurrent learning behaviors, Criteria explicitness–Criteria identification, Illustration–Participation, Practice supervision–Relevant practice, Feedback–Improvement, and Evaluation–Application.309 Peruvian students from an in-person postgraduate course in Education Sciences filled out two scales (via Google Forms) to assess teacher-student performance criteria during online classes. Convergent and divergent validity were obtained separately for six teacher/student performance constructs through a confirmatory analysis using LISREL 8. Moreover, differences according to sex were only significant for the Illustration teacher criterion (favoring men) and the Application student criterion (favoring women). Students rated Explicitness of criteria and Illustration as the teacher performance criteria most frequently seen during online classes. On the other hand, Criteria identification ranked the highest in terms of the students’ performance criteria, followed by Feedback–Improvement. Another conclusion was that the didactic performance interbehavioral model could be empirically supported by the two self-assessment questionnaires, which yielded good convergent and divergent validity of constructs.
Enhancing Oral Skills and Motivation Through Role-Playing Activities in Medical Students
english for medical purposes intervention program oral skills role-playing...
Nowadays, Peruvian physicians commonly give oral medical reports to a patient´s family in English. For this reason, this research seeks to demonstrate the effectiveness of an Intervention Program for improving oral skills through role-playing activities, one hand, and, on the other, it aims to discover the kind of motivation, both goals in 40 students belonging to the Medicine Faculty of Universidad Nacional de Piura. This study has two parts, in the first quantitative phase, it measured the level of oral skills in these students, through an oral pre-test. After that, the students participated in an intervention program consisting of role-playing activities where the doctors usually use radiography to explain a medical condition. Then, the students were evaluated on their oral skills using an imaginary hospital situation similar to the pre-test. In the second part, the qualitative phase measured the Motivation of these students using the Attitude Motivation Test Battery (AMTB) in addition, a semi-structured interview could support the findings obtained in the aforementioned survey. The main findings were the improvement of oral skills and both Integrative and instrumental motivation in these students thanks to role-playing activities application.