'Psychometric evaluation' Search Results
Cognitive Analysis of Meaning and Acquired Mental Representations as an Alternative Measurement Method Technique to Innovate E-Assessment
e-assessment learning knowledge representation connectionism educational technology innovation neural nets...
Empirical directions to innovate e-assessments and to support the theoretical development of e-learning are discussed by presenting a new learning assessment system based on cognitive technology. Specifically, this system encompassing trained neural nets that can discriminate between students who successfully integrated new knowledge course content from students who did not successfully integrate this new knowledge (either because they tried short-term retention or did not acquire new knowledge). This neural network discrimination capacity is based on the idea that once a student has integrated new knowledge into long-term memory, this knowledge will be detected by computer-implemented semantic priming studies (before and after a course) containing schemata-related words from course content (which are obtained using a natural semantic network technique). The research results demonstrate the possibility of innovating e-assessments by implementing mutually constrained responsive and constructive cognitive techniques to evaluate online knowledge acquisition.
11
The Relationship between Resilience and Constant Hope in Students Studying Sports Science
sports science constant hope resilience...
Individuals face negative events throughout their lives and such events can cause problems in every aspect of life. A high level of resilience is required to cope with such negative events. There are various factors that affect resilience. Hope is one of those factors. This factor provides a strong structure to individuals and keeps identified objectives alive. Based on this view, the aim of this study was to investigate the relationship between resilience and constant hope of students studying in a sports science department. Accordingly, the study group of this study consisted of 203 students with 91 female and 112 male students studying in a sports science faculty/school of physical education and sports of universities. The data collection tools of this study were the “Resilience Scale” and the “Constant Hope Scale”. Additionally, to collect information about the students, the “Personal Information Form” developed by the researchers was adopted during the data collection process. The analysis of the obtained data was done with descriptive statistics, t-test for independent two groups, one- way variance analysis (Anova), and Pearson Correlation. To determine which groups caused the statistical difference after one-way variance analysis (Anova), the Tukey HSD multiple comparative test was applied. The results of the study indicated that the data obtained on a scale basis had normal distribution. While there was no significant difference for gender between the relationship of resilience and constant hope, there was a statistically significant difference between different age groups. Additionally, the correlation analysis indicated that there was a positive, moderate level relationship between the two scales.
A Path Analysis Model Pertinent to Undergraduates’ Academic Success: Examining Academic Confidence, Psychological Capital and Academic Coping Factors
academic success academic confidence psychological capital academic coping strategies university students...
The major purpose of this study was to create a path analysis model of academic success in a group of university students, which included the variables of academic confidence and psychological capital with a mediator variable - academic coping. 400 undergraduates from Marmara University and Istanbul Commerce University who were in sophomore, junior and senior years participated in the study. The Academic Behavioral Confidence Scale, the Academic Coping Strategies Scale and the Psychological Capital Test Battery composed of the Academic Self-Efficacy Scale, the Life Orientation Test, the Hope Scale and the Resilience Scale were utilized to disclose the predictive roles of these variables on academic success. The results of path analyses showed that academic confidence and psychological capital had pivotal direct and indirect effects on academic success via the mediator variable – academic coping. Academic coping had also a direct influence on academic success. The findings of the study are essential for telling both vocational counselors and educational psychologists the fact that career interventions for university students should consider the non-cognitive factors on their academic achievements.
11
Participation in Leisure Activities as an Indicator of Inclusion: A comparison between Children with and without Disabilities in Portugal
participation leisure activities children with disabilities inclusion...
Participation is recognised as an important indicator of school inclusion and educational success of children with and without disabilities and one of the fundamental human rights. In particular, the participation in leisure activities plays a vital role in children’s life and needs to be given a higher attention. The aim of the present exploratory study was to reflect on the inclusion of children with disabilities in Portuguese schools, by portraying and comparing their participation profiles in leisure activities to those of typically developing peers. The participation patterns in leisure activities of 61 children with disabilities and 114 children without disabilities were assessed. Results indicate that the pattern of participation of children with and without disabilities differs whether they are school or community-based activities. Regarding school-based activities, findings reveal that children with disabilities participate more frequently in these activities, but in solitary and constrained spaces at school compared to children without disabilities. For community contexts, our findings indicate that children with disabilities participate in less diverse activities than children without disabilities. In addition, the range of activities is correlated to their level of independence. This exploratory study contributes to an understanding of the pattern of participation of children with and without disabilities.
Investigation of the 5th Grade Students’ Engagements in Mathematics Course towards Student Opinions
maths secondary school cognitive engagement social engagement emotional engagement...
The research was conducted to determine the opinions of students (10-11 years) on their engagement to mathematics course. These students are 5th grade students at a secondary school in Turkey. Qualitative research method was used in the research. At the study, designed as case study, a total of seven secondary school students were participated the research. The study group was constituted with “snowball sampling” technique of purposeful sampling methods. The data was collected by a semi-structured interview form. Sixteen-page interviews obtained from the interviews were transferred to the computer. Data analysis was performed in content analysis. Codes were listed as a result of analysis. Common themes were constituted from the codes. As a result of the research, three themes, (cognitive, social and emotional engagement) eleven sub-themes and eighty nine codes were determined. It was seen that the students’ most preferred superficial strategies in terms of cognitive engagement; negative opinions towards group work in terms of social engagement; value given to math course in terms of emotional engagement. Students preferred least getting support sub-theme in terms of cognitive engagement; competitive sub-theme in terms of social engagement; value to the mathematics teacher sub-theme in terms of emotional engagement.
Controlling Mathematics Anxiety by the Views of Guidance and Psychological Counseling Candidates
guidance and psychological counseling controlling mathematics anxiety mathematics anxiety...
The aim of this study is to reveal the suggestions of guidance and psychological counseling candidates (GPC) in dealing with math anxiety. The study analysed 50 GPC candidates’ opinions and suggestions on math anxiety. The research study utilized case study method. The participants were asked to respond what kind of studies they would suggest to their clienst in order to overcome math anxiety once they begin to work in their profession. The interviews transcripts were converted into written documents. Content analysis was made on those documents to find GPC candidates’ suggestions and opinions. Based on the findings, it can be concluded that the reasons of math anxiety can vary from individual to individual. Therefore, it was emphasized that the studies to determine the causes of math anxiety should be specific for each individual. Then, consultancy service should be formed based on the assessment of reasons that cause anxiety for each person. If the individual's math anxiety is caused by environmental factors such as teachers, families and peers, guidance and psychological counseling services should be offered to these environmental factors.
Evaluation of National Examination (UN) and National-Based School Examination (USBN) in Indonesia
evaluation national examination (un) national-based school examination (unbk)...
This study was conducted to analyze (a) the suitability of National Examination (UN) and national-based school examination (USBN) implementation, which has been running on the current guidelines and efforts to improve students’ achievements, (b) the final examination system that is relevant in measuring student competency achievement based on graduate competence standard. It employed descriptive quantitative evaluation by using CIPP (context, input, process of implementation and product) evaluation model. Participants included the head of the Education and Culture Department, Ministry of Religion, Principals / Madrasas, teachers, and students. To collect the data, questionnaires, interviews, focus group discussions, and documentaries were undertaken. Additionally, the data analysis technique used quantitative and qualitative descriptive statistics. The findings indicate that (1) implementation of the UN and USBN, which has been ongoing, is in accordance with the standard operating procedure (SOP) that has been established by the board of national education standard (BNSP), (2) implementation of UN and USBN can be used to improve performance (3) the final examination system that is able to measure achievement of graduates' competency on certain subjects nationally by referring to the Graduate Competency Standard is computer-based national examination (UNBK). The concluding remarks are an attempt to contribute to the growth of future research in the field of UN and USBN implementation in Indonesia.
The Efficiency of Training a Teacher at Higher Education Institutions of Different Profiles
master’s degree programme higher education institution higher education institution of pedagogical non-pedagogical profile pedagogical reflection...
The article reveals the problem of empirical research of training higher education institutions teachers in the context of the master’s degree programme. This study specifies and adapts the methods of diagnostics, criteria for conducting teacher training which are reasonable, psychologically and pedagogically approved and could be implemented in the institutions of higher education of different profiles. It was found out that the training of a teacher within the boundaries of the master’s degree programme of institutions of higher education is an actual task of three-level training of a specialist in Ukraine and requires a differentiated approach for institutions of higher education of various profiles. The components of the programme, based on their comparative characteristics, the status of teacher training in higher education institutions of different profiles with the application of certain criteria, indicators and levels were determined. Comparative analysis of the results of determining the levels of activity empathy and pedagogical reflection formation at the final stage of the study showed objective differences in teacher training in the context of the master’s degree programme of institutions of higher education of different profiles. The perspective directions of the problem under consideration are the study of the didactic conditions of effective teacher training for the master's degree in higher education and the development of the Concept of master’s training in higher education institutions on this basis, the analysis of the influence of the main factors on the formation of a teacher of a higher educational institution in the context of a master’s degree programme, in the profile professional training.
Psychometric and Structural Evaluation of the Physics Metacognition Inventory Instrument
psychometric evaluation physics metacognition inventory problem solving...
The purpose of this study is to evaluate the psychometric and structural instruments of the Physics Metacognition Inventory (PMI) developed by Taasoobshirazi, Bailey, and Farley (2015). The PMI consists of 26 items in six factors. The English and Indonesian versions were tested on an English course (N = 37) in the Geophysics study program at Tadulako University. The trials were conducted separately within a two-week interval. The data collected from 364 students of the Physics Education Department, University of Tadulako were analyzed using the Exploratory Factor Analysis (EFA). Later, data were collected from 351 students of some Indonesian universities which have physics education study programs, and the data were analyzed using the Confirmatory Factor Analysis (CFA). The EFA result reveals six factors based on the rotation result with the maximum loading factor. The CFA result shows the RMSEA values of .018, 2 (284) = 316.32 (χ2 / df = 1,11), GFI = .93, CFI = .99, AGFI = .92 and NFI = .93 which meet the cut-off statistic value, and therefore, the model is considered fit, with the Construct Reliability Estimation (CR) of .93, Composite Reliability of = .95, and maximum reliability of Ω = .96. The results obtained reveal that the PMI scale has good, valid and reliable psychometric properties. Therefore, PMI can be used to measure the level of metacognition of students when solving physics problems. Future studies using PMI are also discussed.
The Effect of Emotional Intelligence, Self-Efficacy, Subjective Well-Being and Resilience on Student Teachers’ Perceived Practicum Stress: A Malaysian Case Study
emotional intelligence self-efficacy subjective well-being resilience perceived practicum stress...
Stress is inevitable in the world of teaching and practicum training and therefore, student teachers naturally incur a certain level of stress due to the demands for them to use various knowledge and skills in real school and classroom environment. Hence, practicum stress needs to be addressed accordingly. The central focus of this study is using a partial least square-structural equation modeling to explore the inter-relationships among the student teachers’ personal resources to mitigate practicum stress. A sample of 200 student teachers selected by purposive sampling from teacher education institutions in Sabah, Malaysia was used in this study. This study collected data via survey methods using a questionnaire developed from several existing scales. Findings showed that emotional intelligence, self-efficacy, and subjective well-being were able to explain resilience with good predictive accuracy and relevance but poorly for practicum stress. These findings were suggestive of the need to include additional constructs to explain perceived practicum stress better in future exploratory research.
Value Creation of Big Data Utilization: The Next Frontier for Productive Scholarship among Filipino Academics
research productivity big data rasch model productive scholarship academic productivity...
Research productivity plays an important role in the prestige and reputation among higher education institutions. However, the time spent to do research among Filipino academics is the most pressing issue since they can barely meet the requirement for research productivity. Further, the lack of time for data gathering aggravated the drawbacks for research productivity. Data gathering is at the core of almost all research activity, the absence of factual and reliable data will lead to an invalid and illogical inference. In research years, there has been a massive agglomeration of data in large volumes coming from diverse sources pertaining to almost all facets of human activity which is worthy of investigation- known today as Big Data. This research has two (2) main objectives; the first is to find out the underlying reasons why Filipino academics are not enthusiastic to do research. The second is to evaluate the value of big data utilization for research productivity based on the assessment of the faculty members. This research used the Rasch model to measure the responses of Filipino academics with regards to their reasons for not doing enough research work as well as on their assessment for value creation of big data utilization using a polytomous item response selection scale.
An Explanation of Happiness with Secure Attachment, Basic Psychological Needs and Hope: The Case of Turkish University Students
happiness hope psychological needs attachment university students...
In this study we aimed to investigate the role of hope, secure attachment with the parents, and satisfaction levels of the basic psychological needs (autonomy, competence and relatedness) of university students in predicting their happiness levels. A total of 558 university students were recruited and 70% of them were female and 30% of them were male. Ages of the participants ranged from 18 to 29. The data were collected in classroom settings using personal information form, the Oxford Happiness Scale, the Attachment with the Parents Scale, the Basic Psychological Needs Scale, and the Dispositional Hope Scale. Results indicated that that the satisfaction levels of the competence needs were the most powerful predictor of happiness among university students. The satisfaction levels of autonomy, relatedness needs, and a secure attachment to the father, along with hope contributed little to the explanation of happiness; whereas, a secure attachment to the mother was not a predictor of happiness of the university students. The findings were discussed within the framework of the developmental characteristics of university students and the characteristics of collectivist societies.
Design and Validation of Mathematical Literacy Instruments for Assessment for Learning in Indonesia
instruments mathematics literacy content validity construct validity construct reliability...
This study aims to design mathematical literacy instruments that have evidence of content and construct validity and are reliable for use as an Assessment for Learning. The research involved eight experts as instrument validators and 273 eighth-grade students of junior high school in Yogyakarta Province. The results showed that the ten mathematical literacy items developed had the V Aiken coefficient index calculated from 0.781 to 0.906 (> 0.75). The results of adequacy testing of samples with KMO and Bartlett show Chi-Square in the Bartlett test of 608,608, the p-value <0.05 and KMO value of 0.781 (> 0.5). The results of testing of the measurement model with Confirmatory Factor Analysis (CFA) produce a Root Mean Square Error of Approach (RMSEA) value of 0.049 (≤ 0.08), chi-s Square of 33.92 (<2df), the p-value of 0.05004 (≥ 0.05). Nine out of the ten items developed had t-value> 1.96, Standardized Loading Factor (SLF) was greater than the critical limit (> 0.3), and Construct Reliability (CR) of 0.78 (> 0.7). It can be concluded that the developed mathematical literacy instrument can measure what must be measured and nine items significantly reflect the construct or latent variable, as well as the level of consistency of a good score.
HOTSEP: Revised Anderson’s Taxonomy in Environmental Learning of COVID-19
covid-19 environmental learning hotsep...
Environmental learning in the 21st century requires a high level of thinking ability, especially to solve environmental problems when COVID-19 pandemic. This was to develop a new level of thinking, namely Higher Order Thinking Skills of Environmental Problem (HOTSEP) which is a revision of Anderson's Taxonomy. The purpose of this study was to measure students HOTSEP in the context of environmental problems related to COVID-19. The research method used in this research was descriptive. The sample used 277 university students from several cities in Indonesia. The instrument used HOTSEP which has 3 categories of thinking level start from develop innovation about environment (C6), solve environmental problem (C5), criticize environmental problem (C4). The results showed that students HOTSEP were still in the very low category (33.64). This study concludes that the HOTSEP of students was still low and needs to be improved to the understanding of COVID-19 concept in environmental learning. Suggestion for further research was HOTSEP need to implement in school or university for several environmental learning topics in many subjects/courses start from Natural Science, Social Science, Engineering, and others relevant subject. HOTSEP can be measured not only in school or university, HOTSEP can be implement in community and public.
Lecturers’ Aptitudes, Attitudes and Professional Development in Higher Education at University of Cuenca
higher education aptitudes attitudes professional development...
Continuous changes in social demand and development provide an acute and continuous pressure on universities. The question is whether higher education institutions (HEI) in Ecuador deliver graduates with the competences to provide timely economic, ecological, and sustainable solutions. Additionally, HEIs should prepare graduates to find employment in a society characterized by greater uncertainty, extensive use of information technology, speed, risk, complexity and interdisciplinary work. To face this challenge, universities need lecturers to possess a mix of aptitudes, attitudes, and professional development in teaching, research, and services. Unfortunately, knowledge is sparse about the readiness of their pupils to function effectively in a rapidly changing and increasingly globalized environment. Accordingly, this study uses an explanatory sequential mixed-methods approach to explore the impact of lecturers’ aptitudes, attitudes, and professional development on teaching and student learning at the University of Cuenca. Lecturers’ perceptions about their aptitudes and their attitudes are higher than the students’ perceptions. Faculty representatives believe that untenured lecturers have a better attitude and aptitude than the tenured lecturers. A third part of lecturers have achieved one of the required criteria in research development. Students from biological sciences are more satisfied with their lecturers and the competence development that they receive than the students from social sciences or engineering. Understanding the likely implication of the variables, aptitudes, attitudes and professional development, on the quality of teaching and learning is fundamental for the design and carrying out of educational reforms.
Assessment of the Validity and Reliability of Mental Health Instruments of High School Student in Indonesia
validity reliability mental health item measurement adolescence indonesia...
This study aims to develop a standard instrument for measuring mental health among urban adolescents in Indonesia. The objective is to produce valid and reliable school adolescent mental health instruments to be used by agencies or schools to identify students' mental health. The survey was conducted in Jakarta and South Tangerang with a total of 1007 respondents divided into two experiments where the first trial was conducted on 597 students and the second trial was conducted on 410 students. Measurements were made using a Likert scale questionnaire. Instrument testing begins with a theoretical validity test by 4 experts and 20 panelists who test the instrument material in terms of construction, content and language. Experts analyze and correct the instrument qualitatively. The instrument was then reviewed and analyzed quantitatively by panelists using the Aiken index. At this stage, 44 items, 9 indicators and 3 variable dimensions were obtained. The next test is done by testing the validity empirically, by analyzing the measurement model using Confirmatory Factor Analysis (CFA) with the LISREL 8.80 Full Version program. By using the criteria for the SLF value ≥0.30 and t-value ≥1.96, and calculating the reliability with the construct reliability (CR) at the level> 0.70, the results of the second trial showed that 35 items were valid. The observations of the model fitness through Goodness-of-Fit test showed that there is a fitness between the theoretical model and the empirical model for the mental health instruments in this study.
Psychological Capital and Teacher Well-being: The Mediation Role of Coping with Stress
coping with stress mediation analysis psychological capital teacher well-being university teachers...
This study aimed to investigate the mediation role of coping with stress between psychological capital and teacher well-being based on positive psychology, conservation resource, and broaden-and-build theories. Participants in this study were 836 teachers from three clustered, ethnically diverse public universities. Our findings showed that, in line with previous studies, the psychological capital (PsyCap), coping with stress (CWS), and teacher well-being (TWB) dimensions showed the best fit in our data. PsyCap was related positively to TWB (total and dimensions), CWS, coping through withdrawal, and negative coping with acceptance and change. The indirect effect of PsyCap on TWB through coping with stress was fully mediated. PsyCap also positively and directly affected TWB and CWS. Coping through acceptance and change were fully mediated by PsyCap and TWB dimensions, while coping through withdrawal was not. PsyCap directly and positively affected coping with stress (acceptance and change) and negatively affected coping through withdrawal. Future theoretical and practical implications are discussed.
Adaptation and Evaluation of Psychometric Properties of Students’ Approaches to Learning in a Sample of Mexican High School Students
approaches to learning high school students learning scale...
The reason of to be of any educational model is to ensure that its students are self-regulated, which implies the setting of objectives, the monitoring of their actions in order to reach them, the control of their cognitive processes, the use of diverse learning and motivation skills. One way to collaborate in this is to evaluate the student's current situation in order to intervene. Due to the above, the purpose of the study is to determine validity and reliability of the scale Students’ Approaches to Learning (SAL) in Mexican students. The SAL was applied to 894 high school students. Considering the results, the SAL presents good functioning and acceptable psychometric properties. In relation to the internal structure, the results support the composition of the 14 sub-factors of SAL, which is consistent with the original study. The results obtained have enough empirical support to interpret the construct of learning approaches from a multidimensional point of view.
Exploring the Multicomponent Structure of Acceptance Attitudes in Portuguese Children Using the Modified Chedoke-McMaster Attitudes toward Children with Handicaps scale
children with disabilities attitudes catch confirmatory factor analysis measurement invariance...
Social participation represent one of the major outcomes of inclusive education. Students with additional support needs often encountered negative attitudes of social acceptance exhibited by their typically developing peers hindering their social participation in the educational context. This study explored the multicomponent structure of Portuguese children’s attitudes toward their peers with disabilities using a modified short form of the Chedoke-McMaster Attitudes toward Children with Handicaps scale (CATCH). In particular, this study aimed to (a) determine the factor structure of the CATCH and (b) evaluate the measurement invariance across age and gender. To identify the CATCH factor structure, exploratory and confirmatory factor analyses were conducted on data collected from 1,038 children aged 8–18 years. Analyses revealed that a modified short form of the CATCH consisting of a 20-item measure with a three-factor structure displayed acceptable fit and internal consistency indices. This model proved to be invariant across groups. The Portuguese-modified short form of the CATCH, in which cognitive, affective, and behavioral dimensions are represented, has acceptable psychometric properties and the potential to evaluate the effectiveness of educational programs designed to improve children’s attitudes.
The Indonesian Version of the Physics Metacognition Inventory: Confirmatory Factor Analysis and Rasch Model
confirmatory factor analysis physics metacognition inventory psychometric evaluation rasch model scale adaptation...
Metacognition inventory supports increased awareness and self-control to improve student’s academic success, including physics. However, there are limitations to revealing the Physics Metacognition Inventory (PMI), especially in Indonesia. This study aims to explore and evaluate the psychometric properties of PMI. This survey research has involved 479 students from three high schools in Indonesia. The psychometric properties of the I-PMI were evaluated using a Confirmatory Factor Analysis and Rasch Model approach. The results show that the Indonesian Physics Metacognition Inventory (I-PMI) is collected in 6 constructs from 26 items. The validity, reliability, and compatibility tests have also been analyzed with good results. The five rating scales used have adequate functionality. This research has also presented more comprehensive information about the Physics Metacognition Inventory in the context of Indonesian culture. This study has implications for using I-PMI to assess students’ metacognition at the high school level in Indonesia and recommendations for future research.