'psychometric evaluation' Search Results
Cognitive Analysis of Meaning and Acquired Mental Representations as an Alternative Measurement Method Technique to Innovate E-Assessment
e-assessment learning knowledge representation connectionism educational technology innovation neural nets...
Empirical directions to innovate e-assessments and to support the theoretical development of e-learning are discussed by presenting a new learning assessment system based on cognitive technology. Specifically, this system encompassing trained neural nets that can discriminate between students who successfully integrated new knowledge course content from students who did not successfully integrate this new knowledge (either because they tried short-term retention or did not acquire new knowledge). This neural network discrimination capacity is based on the idea that once a student has integrated new knowledge into long-term memory, this knowledge will be detected by computer-implemented semantic priming studies (before and after a course) containing schemata-related words from course content (which are obtained using a natural semantic network technique). The research results demonstrate the possibility of innovating e-assessments by implementing mutually constrained responsive and constructive cognitive techniques to evaluate online knowledge acquisition.
11
The Relationship between Resilience and Constant Hope in Students Studying Sports Science
sports science constant hope resilience...
Individuals face negative events throughout their lives and such events can cause problems in every aspect of life. A high level of resilience is required to cope with such negative events. There are various factors that affect resilience. Hope is one of those factors. This factor provides a strong structure to individuals and keeps identified objectives alive. Based on this view, the aim of this study was to investigate the relationship between resilience and constant hope of students studying in a sports science department. Accordingly, the study group of this study consisted of 203 students with 91 female and 112 male students studying in a sports science faculty/school of physical education and sports of universities. The data collection tools of this study were the “Resilience Scale” and the “Constant Hope Scale”. Additionally, to collect information about the students, the “Personal Information Form” developed by the researchers was adopted during the data collection process. The analysis of the obtained data was done with descriptive statistics, t-test for independent two groups, one- way variance analysis (Anova), and Pearson Correlation. To determine which groups caused the statistical difference after one-way variance analysis (Anova), the Tukey HSD multiple comparative test was applied. The results of the study indicated that the data obtained on a scale basis had normal distribution. While there was no significant difference for gender between the relationship of resilience and constant hope, there was a statistically significant difference between different age groups. Additionally, the correlation analysis indicated that there was a positive, moderate level relationship between the two scales.
A Path Analysis Model Pertinent to Undergraduates’ Academic Success: Examining Academic Confidence, Psychological Capital and Academic Coping Factors
academic success academic confidence psychological capital academic coping strategies university students...
The major purpose of this study was to create a path analysis model of academic success in a group of university students, which included the variables of academic confidence and psychological capital with a mediator variable - academic coping. 400 undergraduates from Marmara University and Istanbul Commerce University who were in sophomore, junior and senior years participated in the study. The Academic Behavioral Confidence Scale, the Academic Coping Strategies Scale and the Psychological Capital Test Battery composed of the Academic Self-Efficacy Scale, the Life Orientation Test, the Hope Scale and the Resilience Scale were utilized to disclose the predictive roles of these variables on academic success. The results of path analyses showed that academic confidence and psychological capital had pivotal direct and indirect effects on academic success via the mediator variable – academic coping. Academic coping had also a direct influence on academic success. The findings of the study are essential for telling both vocational counselors and educational psychologists the fact that career interventions for university students should consider the non-cognitive factors on their academic achievements.
11
Investigation of the 5th Grade Students’ Engagements in Mathematics Course towards Student Opinions
maths secondary school cognitive engagement social engagement emotional engagement...
The research was conducted to determine the opinions of students (10-11 years) on their engagement to mathematics course. These students are 5th grade students at a secondary school in Turkey. Qualitative research method was used in the research. At the study, designed as case study, a total of seven secondary school students were participated the research. The study group was constituted with “snowball sampling” technique of purposeful sampling methods. The data was collected by a semi-structured interview form. Sixteen-page interviews obtained from the interviews were transferred to the computer. Data analysis was performed in content analysis. Codes were listed as a result of analysis. Common themes were constituted from the codes. As a result of the research, three themes, (cognitive, social and emotional engagement) eleven sub-themes and eighty nine codes were determined. It was seen that the students’ most preferred superficial strategies in terms of cognitive engagement; negative opinions towards group work in terms of social engagement; value given to math course in terms of emotional engagement. Students preferred least getting support sub-theme in terms of cognitive engagement; competitive sub-theme in terms of social engagement; value to the mathematics teacher sub-theme in terms of emotional engagement.
The Efficiency of Training a Teacher at Higher Education Institutions of Different Profiles
master’s degree programme higher education institution higher education institution of pedagogical non-pedagogical profile pedagogical reflection...
The article reveals the problem of empirical research of training higher education institutions teachers in the context of the master’s degree programme. This study specifies and adapts the methods of diagnostics, criteria for conducting teacher training which are reasonable, psychologically and pedagogically approved and could be implemented in the institutions of higher education of different profiles. It was found out that the training of a teacher within the boundaries of the master’s degree programme of institutions of higher education is an actual task of three-level training of a specialist in Ukraine and requires a differentiated approach for institutions of higher education of various profiles. The components of the programme, based on their comparative characteristics, the status of teacher training in higher education institutions of different profiles with the application of certain criteria, indicators and levels were determined. Comparative analysis of the results of determining the levels of activity empathy and pedagogical reflection formation at the final stage of the study showed objective differences in teacher training in the context of the master’s degree programme of institutions of higher education of different profiles. The perspective directions of the problem under consideration are the study of the didactic conditions of effective teacher training for the master's degree in higher education and the development of the Concept of master’s training in higher education institutions on this basis, the analysis of the influence of the main factors on the formation of a teacher of a higher educational institution in the context of a master’s degree programme, in the profile professional training.
Psychometric and Structural Evaluation of the Physics Metacognition Inventory Instrument
psychometric evaluation physics metacognition inventory problem solving...
The purpose of this study is to evaluate the psychometric and structural instruments of the Physics Metacognition Inventory (PMI) developed by Taasoobshirazi, Bailey, and Farley (2015). The PMI consists of 26 items in six factors. The English and Indonesian versions were tested on an English course (N = 37) in the Geophysics study program at Tadulako University. The trials were conducted separately within a two-week interval. The data collected from 364 students of the Physics Education Department, University of Tadulako were analyzed using the Exploratory Factor Analysis (EFA). Later, data were collected from 351 students of some Indonesian universities which have physics education study programs, and the data were analyzed using the Confirmatory Factor Analysis (CFA). The EFA result reveals six factors based on the rotation result with the maximum loading factor. The CFA result shows the RMSEA values of .018, 2 (284) = 316.32 (χ2 / df = 1,11), GFI = .93, CFI = .99, AGFI = .92 and NFI = .93 which meet the cut-off statistic value, and therefore, the model is considered fit, with the Construct Reliability Estimation (CR) of .93, Composite Reliability of = .95, and maximum reliability of Ω = .96. The results obtained reveal that the PMI scale has good, valid and reliable psychometric properties. Therefore, PMI can be used to measure the level of metacognition of students when solving physics problems. Future studies using PMI are also discussed.
The Effect of Emotional Intelligence, Self-Efficacy, Subjective Well-Being and Resilience on Student Teachers’ Perceived Practicum Stress: A Malaysian Case Study
emotional intelligence self-efficacy subjective well-being resilience perceived practicum stress...
Stress is inevitable in the world of teaching and practicum training and therefore, student teachers naturally incur a certain level of stress due to the demands for them to use various knowledge and skills in real school and classroom environment. Hence, practicum stress needs to be addressed accordingly. The central focus of this study is using a partial least square-structural equation modeling to explore the inter-relationships among the student teachers’ personal resources to mitigate practicum stress. A sample of 200 student teachers selected by purposive sampling from teacher education institutions in Sabah, Malaysia was used in this study. This study collected data via survey methods using a questionnaire developed from several existing scales. Findings showed that emotional intelligence, self-efficacy, and subjective well-being were able to explain resilience with good predictive accuracy and relevance but poorly for practicum stress. These findings were suggestive of the need to include additional constructs to explain perceived practicum stress better in future exploratory research.
An Explanation of Happiness with Secure Attachment, Basic Psychological Needs and Hope: The Case of Turkish University Students
happiness hope psychological needs attachment university students...
In this study we aimed to investigate the role of hope, secure attachment with the parents, and satisfaction levels of the basic psychological needs (autonomy, competence and relatedness) of university students in predicting their happiness levels. A total of 558 university students were recruited and 70% of them were female and 30% of them were male. Ages of the participants ranged from 18 to 29. The data were collected in classroom settings using personal information form, the Oxford Happiness Scale, the Attachment with the Parents Scale, the Basic Psychological Needs Scale, and the Dispositional Hope Scale. Results indicated that that the satisfaction levels of the competence needs were the most powerful predictor of happiness among university students. The satisfaction levels of autonomy, relatedness needs, and a secure attachment to the father, along with hope contributed little to the explanation of happiness; whereas, a secure attachment to the mother was not a predictor of happiness of the university students. The findings were discussed within the framework of the developmental characteristics of university students and the characteristics of collectivist societies.
HOTSEP: Revised Anderson’s Taxonomy in Environmental Learning of COVID-19
covid-19 environmental learning hotsep...
Environmental learning in the 21st century requires a high level of thinking ability, especially to solve environmental problems when COVID-19 pandemic. This was to develop a new level of thinking, namely Higher Order Thinking Skills of Environmental Problem (HOTSEP) which is a revision of Anderson's Taxonomy. The purpose of this study was to measure students HOTSEP in the context of environmental problems related to COVID-19. The research method used in this research was descriptive. The sample used 277 university students from several cities in Indonesia. The instrument used HOTSEP which has 3 categories of thinking level start from develop innovation about environment (C6), solve environmental problem (C5), criticize environmental problem (C4). The results showed that students HOTSEP were still in the very low category (33.64). This study concludes that the HOTSEP of students was still low and needs to be improved to the understanding of COVID-19 concept in environmental learning. Suggestion for further research was HOTSEP need to implement in school or university for several environmental learning topics in many subjects/courses start from Natural Science, Social Science, Engineering, and others relevant subject. HOTSEP can be measured not only in school or university, HOTSEP can be implement in community and public.
Assessment of the Validity and Reliability of Mental Health Instruments of High School Student in Indonesia
validity reliability mental health item measurement adolescence indonesia...
This study aims to develop a standard instrument for measuring mental health among urban adolescents in Indonesia. The objective is to produce valid and reliable school adolescent mental health instruments to be used by agencies or schools to identify students' mental health. The survey was conducted in Jakarta and South Tangerang with a total of 1007 respondents divided into two experiments where the first trial was conducted on 597 students and the second trial was conducted on 410 students. Measurements were made using a Likert scale questionnaire. Instrument testing begins with a theoretical validity test by 4 experts and 20 panelists who test the instrument material in terms of construction, content and language. Experts analyze and correct the instrument qualitatively. The instrument was then reviewed and analyzed quantitatively by panelists using the Aiken index. At this stage, 44 items, 9 indicators and 3 variable dimensions were obtained. The next test is done by testing the validity empirically, by analyzing the measurement model using Confirmatory Factor Analysis (CFA) with the LISREL 8.80 Full Version program. By using the criteria for the SLF value ≥0.30 and t-value ≥1.96, and calculating the reliability with the construct reliability (CR) at the level> 0.70, the results of the second trial showed that 35 items were valid. The observations of the model fitness through Goodness-of-Fit test showed that there is a fitness between the theoretical model and the empirical model for the mental health instruments in this study.
Psychological Capital and Teacher Well-being: The Mediation Role of Coping with Stress
coping with stress mediation analysis psychological capital teacher well-being university teachers...
This study aimed to investigate the mediation role of coping with stress between psychological capital and teacher well-being based on positive psychology, conservation resource, and broaden-and-build theories. Participants in this study were 836 teachers from three clustered, ethnically diverse public universities. Our findings showed that, in line with previous studies, the psychological capital (PsyCap), coping with stress (CWS), and teacher well-being (TWB) dimensions showed the best fit in our data. PsyCap was related positively to TWB (total and dimensions), CWS, coping through withdrawal, and negative coping with acceptance and change. The indirect effect of PsyCap on TWB through coping with stress was fully mediated. PsyCap also positively and directly affected TWB and CWS. Coping through acceptance and change were fully mediated by PsyCap and TWB dimensions, while coping through withdrawal was not. PsyCap directly and positively affected coping with stress (acceptance and change) and negatively affected coping through withdrawal. Future theoretical and practical implications are discussed.
Adaptation and Evaluation of Psychometric Properties of Students’ Approaches to Learning in a Sample of Mexican High School Students
approaches to learning high school students learning scale...
The reason of to be of any educational model is to ensure that its students are self-regulated, which implies the setting of objectives, the monitoring of their actions in order to reach them, the control of their cognitive processes, the use of diverse learning and motivation skills. One way to collaborate in this is to evaluate the student's current situation in order to intervene. Due to the above, the purpose of the study is to determine validity and reliability of the scale Students’ Approaches to Learning (SAL) in Mexican students. The SAL was applied to 894 high school students. Considering the results, the SAL presents good functioning and acceptable psychometric properties. In relation to the internal structure, the results support the composition of the 14 sub-factors of SAL, which is consistent with the original study. The results obtained have enough empirical support to interpret the construct of learning approaches from a multidimensional point of view.
Exploring the Multicomponent Structure of Acceptance Attitudes in Portuguese Children Using the Modified Chedoke-McMaster Attitudes toward Children with Handicaps scale
children with disabilities attitudes catch confirmatory factor analysis measurement invariance...
Social participation represent one of the major outcomes of inclusive education. Students with additional support needs often encountered negative attitudes of social acceptance exhibited by their typically developing peers hindering their social participation in the educational context. This study explored the multicomponent structure of Portuguese children’s attitudes toward their peers with disabilities using a modified short form of the Chedoke-McMaster Attitudes toward Children with Handicaps scale (CATCH). In particular, this study aimed to (a) determine the factor structure of the CATCH and (b) evaluate the measurement invariance across age and gender. To identify the CATCH factor structure, exploratory and confirmatory factor analyses were conducted on data collected from 1,038 children aged 8–18 years. Analyses revealed that a modified short form of the CATCH consisting of a 20-item measure with a three-factor structure displayed acceptable fit and internal consistency indices. This model proved to be invariant across groups. The Portuguese-modified short form of the CATCH, in which cognitive, affective, and behavioral dimensions are represented, has acceptable psychometric properties and the potential to evaluate the effectiveness of educational programs designed to improve children’s attitudes.
The Indonesian Version of the Physics Metacognition Inventory: Confirmatory Factor Analysis and Rasch Model
confirmatory factor analysis physics metacognition inventory psychometric evaluation rasch model scale adaptation...
Metacognition inventory supports increased awareness and self-control to improve student’s academic success, including physics. However, there are limitations to revealing the Physics Metacognition Inventory (PMI), especially in Indonesia. This study aims to explore and evaluate the psychometric properties of PMI. This survey research has involved 479 students from three high schools in Indonesia. The psychometric properties of the I-PMI were evaluated using a Confirmatory Factor Analysis and Rasch Model approach. The results show that the Indonesian Physics Metacognition Inventory (I-PMI) is collected in 6 constructs from 26 items. The validity, reliability, and compatibility tests have also been analyzed with good results. The five rating scales used have adequate functionality. This research has also presented more comprehensive information about the Physics Metacognition Inventory in the context of Indonesian culture. This study has implications for using I-PMI to assess students’ metacognition at the high school level in Indonesia and recommendations for future research.
Exploratory and Confirmatory Factor Analysis for Disposition Levels of Computational Thinking Instrument Among Secondary School Students
attitudes computational thinking disposition factor analysis...
Computational thinking (CT) is a method for solving complex problems, but also gives people an inventive inspiration to adapt to our smart and changing society. Globally it has been considered as vital abilities for solving genuine issues successfully and efficiently in the 21st century. Recent studies have revealed that the nurture of CT mainly centered on measuring the technical skill. There is a lack of conceptualization and instruments that cogitate on CT disposition and attitudes. This study attends to these limitations by developing an instrument to measure CT concerning dispositions and attitudes. The instruments' validity and reliability testing were performed with the participation from secondary school students in Malaysia. The internal consistency reliability, standardized residual variance, construct validity and composite reliability were examined. The result revealed that the instrument validity was confirmed after removing items. The reliability and validity of the instrument have been verified. The findings established that all constructs are useful for assessing the disposition of computer science students. The implications for psychometric assessment were evident in terms of giving empirical evidence to corroborate theory-based constructs and also validating items' quality to appropriately represent the measurement.
The Effectiveness of Multimedia Learning for Distance Education Toward Early Childhood Critical Thinking During the COVID-19 Pandemic
critical thinking distance education early childhood multimedia learning...
The government has imposed social restrictions during the COVID-19 pandemic, affecting the education sector, including the early childhood school. Distance education offers different methods from the conventional methods, as the students are expected to gain the same skills, including critical thinking skills. Therefore, teachers must provide distance learning innovations using relevant learning media, such as multimedia-based learning. This research aims to assess the efficacy of multimedia learning in early childhood distance learning. This research is a quantitative model with a quasi-experimental pretest and posttest design. The data collection technique utilized questionnaires given to 30 samples of early childhood children. The data were statistically analyzed using SPSS software. The results confirmed that multimedia-based learning for distance learning could develop critical thinking skills in early childhood children during the COVID-19 pandemic. The results of this study offer exploration of learning strategies to improve children’s critical thinking.
It Doesn't Mean that Students Don't Have Mathematics Anxiety: A Case Study of Mathematics Learning with Path Analysis
learning achievement mathematical anxiety motivation path analysis...
Mathematics anxiety has always been an interesting topic to study and discuss in the world of education. This study aimed to (1) investigate the impact of teacher roles, mathematics content, and mathematics anxiety on learning motivation, and (2) explore how students manage mathematics anxiety as a stimulus in learning motivation. This research used mixed methods with embedded concurrent design. The research sample was 100 respondents. The questionnaire instrument was arranged based on a Likert scale with 5 answer choices. This study used a structural equation model and confirmatory factor analysis as data analysis methods. The research findings indicated that: (1) a significant direct impact emerged between mathematics anxiety and students' learning motivation, and there was an indirect impact between the teacher's role and mathematics content on learning motivation; (2) students could manage mathematics anxiety when they were in optimal anxiety or positive anxiety so that they could overcome mathematics anxiety as a stimulus for achievement and deconstruct anxiety into motivation according to experience and personal resources. Results of this study confirmed that the statements about mathematics anxiety which always has a negative impact on motivation and learning achievement is not universal, because mathematics anxiety does not always have a negative impact on motivation and learning achievement if this anxiety is managed effectively.
Analysis of the Effect of Social Skills and Disposition of Digital Literacy on Mathematical Literacy Ability
digital literacy disposition mathematical literacy social skills...
This study aims to analyze the characteristics of social skills, digital literacy disposition, and mathematical literacy abilities of 49 students; to analyze the theoretical model of the direct and indirect influence of digital literacy skills and social skills on mathematical literacy skills. The number of samples is 49 of the 12th-grade students at state high school #1 Southern Konawe. The research instruments consisted of a mathematical literacy ability test, a social skills questionnaire, and a digital literacy disposition questionnaire. The data were analyzed by descriptive statistics and structural equational models (SEM) with a Smart PLS 3.0 application. The results showed that students' mathematical literacy skills tended to be better on content and context indicators but they are weak on competency and process indicators. Students' social skills tend to be better on indicators of peer-relationship skills and self-management skills, but are also weak on indicators of academic skills and compliance skills. Mastery of the digital literacy disposition tends to be better on the internet searching, content evaluation, and information sharing indicators but is still weak on knowledge assembly. Furthermore, it was found that (a) social skills have a direct effect on digital literacy disposition but do not directly affect mathematical literacy skills; (b) the digital literacy disposition has a direct effect on mathematical literacy skills.
Development of a Self-Evaluation Instrument with Programmatic Assessment Components for Undergraduate Medical Students
instrument development medical education programmatic assessment...
This study aimed to develop and test a student self-assessment instrument based on the programmatic assessment (PA) components. We applied a series of psychometric research methods by (a) conducting a literature study to find PA constructs, (b) developing the students' self-questionnaires, (c) ensuring content validity, (d) testing face validity, and (e) conducting reliability tests that involve medical students, medical teachers, medical educationalist, and an international PA expert. Face validity (readability test) was conducted with 30 medical students from an Indonesian university who were in their last year of pre-clinical education and had average scores above or equal to their classmates. The confirmatory factor analysis (CFA) was used to report the instruments’ validity and reliability. The final instrument was tested on 121 medical students with excellent GPAs from another medical school with a middle-level accreditation. The PA consists of five components: ‘learning activities’, ‘assessment activities’, 'supporting activities’, 'intermediate evaluations’, and ‘final evaluations'. These components are conveyed through 41 relevant statements with a four-point Likert scale and three yes/no statements. According to the respondents, there was a lack of 'supporting activities' and 'intermediate evaluation' components in the PA in their universities. This study has developed and tested a five-component evaluation instrument based on medical students' perceptions regarding PA implementation.
Sohanjana Antibullying Intervention: Culturally and Socially Targeted Intervention for Teachers in Pakistan to Take Actions Against Bullying
aggression prevention antibullying intervention pakistan’s educational institutions social and cultural adaptation teachers’ professional development...
Several studies have demonstrated that bullying and cyberbullying are prevalent in Pakistani educational institutions, negatively affecting students' physical and mental health. Literature has revealed that it has not always been successful to prevent bullying in Pakistani educational institutions by adapting or adopting antibullying interventions from other countries. Sohanjana Antibullying Intervention is the first contextualized antibullying intervention designed specifically for Pakistani teachers. Assisting teachers in identifying bullying and victimization issues prevalent in educational institutions, intervening quickly to assist pupils, and creating a conducive school environment are the main goals of this program. A description of the Sohanjana intervention program, its modules, and its design is presented in the current study. After a comprehensive literature review on bullying in Pakistan, and conducting a baseline survey for need assessment, the program’s content and activities have been developed. In this 32-hour professional development program, teachers are trained on eight different themes over the course of eight modules. In the present paper, the design, the theoretical background, details of the different modules and preliminary evaluation data of the Sohanjana intervention program are presented. A pilot study of the intervention so far has produced successful results and gathered positive feedback from participants. As a result of the feedback, several recommendations and suggestions are discussed in the study.