' validity analysis' Search Results
The Interrelationships between Metacognition and Modeling Competency: The Moderating Role of the Academic Year
academic year levels confirmatory factor analysis mathematical modeling metacognition structural equation modelling...
Several concerted movements toward mathematical modeling have been seen in the last decade, reflecting the growing global relationship between the role of mathematics in the context of modern science, technology and real life. The literature has mainly covered the theoretical basis of research questions in mathematical modeling and the use of effective research methods in the studies. Driven by the Realistic Mathematics Education (RME) theory and empirical evidence on metacognition and modeling competency, this research aimed at exploring the interrelationships between metacognition and mathematical modeling and academic year level as a moderator via the SEM approach. This study involved 538 students as participants. From this sample, 133 students (24.7%) were from the first academic year, 223 (41.4%) were from the second and 182 (33.8%) were from the third. A correlational research design was employed to answer the research question. Cluster random sampling was used to gather the sample. We employed structural equation modeling (SEM) to test the hypothesized moderation employing IBM SPSS Amos version 18. Our findings confirmed the direct correlation between metacognition and mathematical modeling was statistically significant. Academic year level as a partial moderator significantly moderates the interrelationships between the metacognitive strategies and mathematical modeling competency. The effect of metacognition on mathematical modeling competency was more pronounced in the year two group compared to the year one and three groups.
Exploring the Multicomponent Structure of Acceptance Attitudes in Portuguese Children Using the Modified Chedoke-McMaster Attitudes toward Children with Handicaps scale
children with disabilities attitudes catch confirmatory factor analysis measurement invariance...
Social participation represent one of the major outcomes of inclusive education. Students with additional support needs often encountered negative attitudes of social acceptance exhibited by their typically developing peers hindering their social participation in the educational context. This study explored the multicomponent structure of Portuguese children’s attitudes toward their peers with disabilities using a modified short form of the Chedoke-McMaster Attitudes toward Children with Handicaps scale (CATCH). In particular, this study aimed to (a) determine the factor structure of the CATCH and (b) evaluate the measurement invariance across age and gender. To identify the CATCH factor structure, exploratory and confirmatory factor analyses were conducted on data collected from 1,038 children aged 8–18 years. Analyses revealed that a modified short form of the CATCH consisting of a 20-item measure with a three-factor structure displayed acceptable fit and internal consistency indices. This model proved to be invariant across groups. The Portuguese-modified short form of the CATCH, in which cognitive, affective, and behavioral dimensions are represented, has acceptable psychometric properties and the potential to evaluate the effectiveness of educational programs designed to improve children’s attitudes.
Development of Gazi Functional Vision Assessment Instrument
distance vision functional vision assessment low vision near vision visual field...
This study aimed to develop a valid and reliable instrument that measures the functional vision of students with low vision. Thus, an assessment tool and performance activities were developed for three vision skill groups (near vision skills, distance vision skills, and visual field) that include functional vision skills. The universe was 1485 students studying in various primary and middle schools (from 2nd to 7th grades) affiliated to the Ministry of National Education, and simple random sampling was used to select 310 students. The data were collected using the Gazi Functional Vision Assessment Instrument developed by the researchers. Many-facet Rasch model and generalizability theory were used for the rater reliability of the measurements obtained from the instrument, while discriminant analysis was used for the validity of the measurements. The analysis showed that the measurements were reliable, and the inferences based on these measurements were valid. Thus, this instrument can be used to identify and assess the functional vision status of students with low vision.
Measuring Self-Regulated Learning in the STEM Framework: A Confirmatory Factor Analysis
confirmatory factor analysis reliability self-regulated learning stem validity...
Within the context of Self-Regulated Learning (SRL), a process of directing oneself to facilitate individual learning more effectively, the SRL instrument development is deemed necessary to measure students’ self-reliance in learning mathematics in the science, technology, engineering, and mathematics (STEM) framework. The research aims to develop and test the validity and reliability of an SRL instrument, namely a 14-item SRL questionnaire accommodating four aspects, namely planning, self-monitoring, self-controlling, and evaluation. The study involved 420 junior high school students in East Java, Central Java, and Yogyakarta Special Region. The results show that the questionnaire was developed as planned and that planning, monitoring, controlling, and evaluating aspects can reflect the SRL variable in a valid, reliable, and significant way supported by each aspect's behavior indicator. The SRL variable theoretical model corresponds (good fit) with the empirical data, and all of the items are likely valid and reliable to assess student's mathematics SRL in the STEM framework. The SRL questionnaire was also found suitable for use by teachers to measure junior high school students’ self-reliance in SRL.
The Academic Buoyancy Scale: Measurement Invariance across Culture and Gender in Egyptian and Omani Undergraduates
academic buoyancy congeneric reliability measurement invariance...
The academic buoyancy scale (ABS) is one of the most widely used instruments for measuring academic buoyancy. To obtain meaningful and valid comparisons across groups using ABS, however, measurement invariance should be ascertained a priori. To that end, we examined its measurement invariance, validity evidence based on relations to other variables, and score reliability using categorical omega across culture and gender among Egyptian and Omani undergraduates. Participants were 345 college students: Egyptian sample (N=191) and Omani sample (N=154). To assess measurement invariance across culture and gender, multiple–group confirmatory factor analysis was performed with four successive invariance models: (a) configural, (b) metric, (c) scalar, and (d) residual. Results revealed that the unidimensional baseline model had adequate fit to the data in the full sample. Moreover, measurement invariance was found to hold across culture but not across gender and consequently the ABS could be used to yield valid cross-cultural comparisons between the Egyptian and Omani students. Conversely, it cannot be used to yield valid inferences related to comparing gender groups within each culture. Validity evidence based on relations to other variables was supported by the significantly moderate correlation between ABS and academic achievement (GPA; r =.435 and r = .457, P < .01) for the Egyptian and Omani samples, respectively. With regard to score reliability, categorical omega coefficients were moderate across both samples. Educational and psychological implications, limitations and suggestions for improving the scale are discussed.
The Development of Indonesian Accounting Teacher Professional Identity Measurement: An Exploratory Factor Analysis
accounting teacher measurement professional identity scale...
Measuring accounting teachers’ professional identity is significant to do as an alternative to measure the professionalism of accounting teachers in Indonesia based on their professional identity. This research was conducted in two stages of exploratory factor analysis involving 150 accounting teachers as sample in each stage. The data were collected in collaboration with an accounting teacher organization, comprising the Accounting Subject Teacher Deliberation (MGMP) in Central Java through a questionnaire. Data analysis was divided into several steps including face validity and content validity, inter-item correlation matrix, and exploratory factor analysis. The results showed that 23 question items encompassed five components of accounting teacher professional identity; Cultural Knowledge (pedagogical cultural identity), Blending (accommodating students' purposes for school in the learning objectives), Identity Experiencing (by the experience of working life in the past, present, and individual expectations in the future in accounting work setting), Inter-Personal Skill, and Active in Professional Communities. The scale development requires continuous development tailing various new findings in the teacher professional identity and accountant professional identity.
Development and Validation of Teachers’ Assessment Belief of Mathematical Thinking Instrument
assessment beliefs assessment forms assessment purpose mathematics beliefs mathematical thinking...
This study was conducted to corroborate in understanding the teachers’ beliefs about assessment practices. The prior studies related to teachers’ assessment beliefs in mathematics have been done to assess teachers’ beliefs in the general context of mathematics teaching. This study developed an instrument to assess teachers’ assessment beliefs of mathematical thinking. The research aimed to develop and validate a scale of assessment beliefs of mathematical thinking by using the confirmatory factor analysis. The first draft of the scale contained 25 items. The sample of the study consisted of 537 mathematics teachers from public schools in Oman. The instrument was a questionnaire with a 5-point Likert scale. The scale was validated by asking a number of experts in mathematics educational measurement and evaluation. Exploratory and confirmatory factor analysis was applied to test the model of assessment beliefs of mathematical thinking scale using AMOS 25.0. All constructs had acceptable reliability. The model had a good model fit for the assessment beliefs of mathematical thinking scale which obtainable from the fit indices tests. The findings revealed that all fit criteria indices were realized. The results also showed acceptable validity and construct reliability for the scale.
Factors Affecting Student Satisfaction with Higher Education Service Quality in Vietnam
an giang university higher education services student satisfaction vietnam...
Higher education plays an important role in providing students with knowledge and skills to enter the labor market. The quality of higher education, the satisfaction of the quality of higher education has been concerned by many individuals and organizations. The study aims to explore the factors affecting student satisfaction with the quality of higher education services in Vietnam. Research data was collected from survey results by questionnaires from 396 students of An Giang University, Vietnam National University Ho Chi Minh City, Vietnam. SPSS 20, AMOS 24 software is used for analysis and evaluation of scales through Cronbach's Alpha reliability coefficient; exploratory factor analysis EFA; CFA confirmatory factor; SEM linear regression analysis to test the hypotheses. The results of the SEM model study show that there are six factors affecting student satisfaction with the quality of higher education services in Vietnam, including teaching staff; facilities and teaching facilities; ability to serve; educational activities; student support activities; education programs. From the research results, discussions on educational administration are proposed to improve student satisfaction with the quality of higher education services in Vietnam.
Factors and Challenges Influencing the Criminologist Licensure Examination Performance through the Non-passers’ Lens
criminology descriptive phenomenology higher education licensure examination...
This study aimed to explore the perceived factors that influenced the success and challenges experienced when taking licensure examination among Bachelor of Science in Criminology graduates of a state university in the Philippines who failed in the Criminologist Licensure Examinations (CLE). Descriptive-correlational research design was utilized to analyze quantitative data, and Colaizzi’s descriptive phenomenology was used for the thematic analysis of qualitative data. The quantitative findings revealed that home and family factor has a high influence on the success in CLE, while student factor, school factor, review center factor, and personal factor have average influence. Further, ten clusters of themes emerged as factors that influence the success in CLE. Among them were interest and focus on the program, and availability of qualified and dedicated faculty. Among the themes that emerged as challenges were lack of preparedness for the exam because of one’s work, and personal and social pressures. There is a significant difference on the respondents’ perception towards the factors that influence the success in CLE when they are grouped according to sex. Regarding the challenges associated with preparing for and taking the CLE, a significant difference is only observed when respondents are grouped according to their civil status. Generally, married respondents have higher weighted means than the single ones. This implies that the identified challenges affected married respondents more than the single ones. These results can be used to make policies and initiate programs that would enhance graduates’ success in the exam by providing appropriate interventions and early remediations.
Development of Affective Self-Assessment Instrument of Chemistry for High School Student as the Daily Assessment Guideline
affective domain reliability validity...
The study objectives were (1) developing a valid and reliable Affective Self-assessment Instrument of Chemistry for High School Student and (2) discovering the chemistry affective domain ability trend of high school students based on gender. The current development study utilized 10 non-test instrument development procedures from Mardapi. The study population was all high school students in Yogyakarta Special Region. The sample size was 405 students categorized into two stages and sampling techniques, i.e., the trial stage using cluster random sampling and the measurement stage using simple random sampling. The data analysis techniques were validity test using the Aiken index and construct validity and reliability using the second-order Confirmatory Factor Analysis model. The study findings were (1) the Affective Self-assessment Instrument of Chemistry for High School Student had 15 valid and reliable items and 15 available items to be utilized by teachers to measure students’ affective in the learning process and (2) the chemistry affective domain ability trend of male high school students was dominated by the “good” category and “very good” category for female students.
The Development of Historical Thinking Assessment to Examine Students’ Skills in Analyzing the Causality of Historical Events
causality historical events historical thinking skills...
This research aimed to develop a historical thinking assessment for students' skills in analyzing the causality of historical events. The development process of Gall and colleagues and Rasch analysis models were used to develop an assessment instrument consisting of two processes, including the analysis of the framework of cause and consequence, the validity, reliability, and difficultness test. This research involved 150 senior high school students, with data collected using the validation sheet, tests, and scoring rubric. The results were in the form of an essay test consisting of six indicators of analyzing cause and consequence. The instruments were valid, reliable, and suitable for assessing students’ skills in analyzing the causality of historical events. The developed instruments were paired with a historical thinking skills assessment to improve the accuracy of the information about students' level of historical thinking skills in the learning history.
Exploratory and Confirmatory Factor Analysis for Disposition Levels of Computational Thinking Instrument Among Secondary School Students
attitudes computational thinking disposition factor analysis...
Computational thinking (CT) is a method for solving complex problems, but also gives people an inventive inspiration to adapt to our smart and changing society. Globally it has been considered as vital abilities for solving genuine issues successfully and efficiently in the 21st century. Recent studies have revealed that the nurture of CT mainly centered on measuring the technical skill. There is a lack of conceptualization and instruments that cogitate on CT disposition and attitudes. This study attends to these limitations by developing an instrument to measure CT concerning dispositions and attitudes. The instruments' validity and reliability testing were performed with the participation from secondary school students in Malaysia. The internal consistency reliability, standardized residual variance, construct validity and composite reliability were examined. The result revealed that the instrument validity was confirmed after removing items. The reliability and validity of the instrument have been verified. The findings established that all constructs are useful for assessing the disposition of computer science students. The implications for psychometric assessment were evident in terms of giving empirical evidence to corroborate theory-based constructs and also validating items' quality to appropriately represent the measurement.
Effects of Generic and Subject-Didactic Teaching Characteristics on Student Performance in Mathematics in Secondary School: A Scoping Review
generic characteristics instructional quality mathematics achievement mathematics instruction subject-didactic characteristics...
Research on instructional quality has been of great interest for several decades, leading to an immense and diverse body of literature. However, due to different definitions and operationalisations, the picture of what characteristics are important for instructional quality is not entirely clear. Therefore, in this paper, a scoping review was performed to provide an overview of existing evidence of both generic and subject-didactic characteristics with regard to student performance. More precisely, this paper aims to (a) identify both generic and subject-didactic characteristics affecting student performance in mathematics in secondary school, (b) cluster these characteristics into categories to show areas for quality teaching, and (c) analyse and assess the effects of these characteristics on student performance to rate the scientific evidence in the context of the articles considered. The results reveal that teaching characteristics, and not just the instruments for recording the quality of teaching as described in previous research, can be placed on a continuum ranging from generic to subject-didactic. Moreover, on account of the inconsistent definition of subject-didactic characteristics, the category of ‘subject-didactic specifics’ needs further development to establish it as a separate category in empirical research. Finally, this study represents a further step toward understanding the effects of teaching characteristics on student performance by providing an overview of teaching characteristics and their effects and evidence.
Validating Student’s Green Character Instrument Using Factor and Rasch Model
green character instrument factor and rasch analysis...
Many researchers have separately developed instruments to measure environmental characteristics such as attitudes, values, and knowledge. However, there is no instrument used to measure all these aspects in one comprehensive instrument. This study is meant to develop and validate a green character instrument which reveals student behavior and awareness of the environment. The instrument consists of 40 statement items consisting of 5 aspects, namely private pro-environmental behavior, public pro-environmental behavior, environmental knowledge, environmental values, and environmental attitudes. It was implemented on 1,398 students from 15 universities in Indonesia. The instrument content validation was analyzed by three experts using content validity index (CVI). The construct validity was analyzed using exploratory factor analysis, confirmatory factor analysis, and RASCH analysis. The content validity results obtained CVI scores ranging between 0.8 and 0.9 with a good category, while item reliability was in a fairly good category with a high level of separation index. Construct validation resulted in 34 items (4 items were eliminated after Exploratory and Confirmatory Factor Analysis, and 2 items were eliminated after RASCH analysis) spread over five constructs, namely environmental behavior, environmental knowledge, environmental values, environmental attitudes, and environmental habits. The resulting instrument has a good level of item difficulty, with a well understood response set which can be understood easily by respondents, and without bias. Therefore, it can be used to measure the students’ green character on both male and female.
Parental Obstacles During Distance Learning Mathematics in Indonesia: A Phenomenology Study
covid-19 distance learning mathematics panic-gogy phenomenology...
The Coronavirus disease (COVID-19) pandemic has caused an inevitable shift from face-to-face to distance learning, a phenomenon known as panic-gogy. Parents are the main students’ companions while studying at home. Although various studies show the constraints in this condition, few employ phenomenology that accurately describes people’s experience regarding a situation. Therefore, this study aimed to describe parents’ experience during distance learning mathematics using a phenomenology approach. The participants comprised 71 35-50-year-old parents of junior high school students. A Google form with open-ended questions was used as the main instrument in data collection. Data were analyzed using NVivo-12-assisted thematic analysis in coding, while source triangulation was used to strengthen the data trustworthiness. The results showed that students did not learn the content well due to poor explanations by the teacher. Furthermore, they did not study well at home due to signal constraints and quota limitations. This study recommends blended learning by combining limited face-to-face and online learning.
Impact of Modular Distance Learning on High School Students Mathematics Motivation, Interest/Attitude, Anxiety and Achievement during the COVID-19 Pandemic
mathematics achievement mathematics anxiety mathematics interest/attitude mathematics motivation modular learning...
This study examined the impact of modular distance learning on students' motivation, interest/attitude, anxiety and achievement in mathematics. This was done at the Gabaldon, Nueva Ecija, Philippines during the first and second grading of the academic year 2021-2022. The study included both a descriptive-comparative and descriptive-correlational research design. The 207 high school students were chosen using stratified sampling. According to the findings, students have a very satisfactory rating in mathematics. Students agree that they are motivated, enthusiastic, and have a positive attitude toward mathematics. They do, however, agree that mathematics causes them anxiety. When students are subdivided based on sex, their mathematics interest and anxiety differ significantly. However, there was no significant difference in interest/attitude and achievement. When students are divided into age groups, their mathematics motivation, interest/attitude, anxiety, and achievement differ significantly. Students' motivation, anxiety, and achievement differ significantly by year level. There was a positive relationship between and among mathematics motivation, interest/attitude, and achievement. However, there is a negative association between mathematics anxiety and mathematics motivation; mathematics anxiety and mathematical interest/attitude; and mathematics anxiety and mathematical performance. The study's theoretical and practical implications were also discussed, and recommendations for educators and researchers were given.
Construction of the Character Assessment Instrument for 21st Century Students in High Schools
assessment construct character validity reliability...
The study of character becomes a very important discussion in the 21st century. So that the integration of character values is very important both in the process and in educational assessment. The purpose of this study was to test the validity and reliability of the character assessment instrument for 21st-century high school students. The research approach used was quantitative with a sample of 200 high school students. Data analysis carried out includes validity and reliability tests. The test results of the instrument showed that the construct of the student character assessment instrument was declared valid and reliable. The content validity test shows the value of Aiken's > .80 in the high category. In the construct validation test with EFA, all variables have a loading factor > .5. In the CFA test, the model is declared fit with the estimated standard loading value of .40 and the t-count value > 1.96. Meanwhile, while in testing the reliability of the instrument obtained composite > .70 Cronbach's Alpha reliability > .70 which means reliable. So that this instrument is declared valid and reliable to measure the character of students in high school.
Validation of the Short Form of My Class Inventory Within the Vietnamese Educational Context
classroom environment confirmatory factor analysis learning environment my class inventory vietnam...
Recently, researchers have paid more attention to the aspects of classroom learning environments because of their effects on students’ cognitive and effective outcomes. However, current literature reveals the lack of research that explores the factors of classroom environments in Vietnamese context. The present study, therefore, aims to validate the psychometric properties of the 25-items version of the My Class Inventory (MCI), translated into Vietnamese for 487 secondary school students. Factorial analysis showed an acceptable fit for the four-factors structure of the MCI – cohesiveness, competitiveness, satisfaction, and friction – to be appropriate for secondary school students. Internal consistency reliabilities of the general scales and four subscales were satisfactory. Results support the suitability of the MCI to assess students’ classroom environment within Vietnam’s educational context. The study recommended, among other things, that future studies should be conducted to explore the validity of the MCI on other samples of Vietnamese secondary students.
Mathematics Pre-Service Teachers’ Numerical Thinking Profiles
numerical thinking reasoning self-efficacy...
Numerical thinking is needed to recognize, interpret, determine patterns, and solve problems that contain the context of life. Self-efficacy is one aspect that supports the numerical thinking process. This study aims to obtain a numerical thinking profile of Mathematics pre-service teachers based on self-efficacy. This study used descriptive qualitative method. The data obtained were based on the results of questionnaires, tests, and interviews. The results of the self-efficacy questionnaire were analyzed and categorized (high, moderate, and low). Two informants took each category. The results showed the following: informants in the high self-efficacy category tend to be able to interpret information, communicate information, and solve problems with systematic steps. Informants in the moderate self-efficacy category tend to be able to interpret and communicate information, but tend to be hesitant in choosing the sequence of problem-solving steps. Meanwhile, informants in the low self-efficacy category tend not to be able to fully interpret the information. As a result, the process of communicating information and solving problems goes wrong. Another aspect found in this study is the need for experience optimization, a good understanding of mathematical content, and reasoning in the numerical thinking process.
Relationship Between Japanese Language Anxiety, Beliefs About Learning, and Language Use in Japanese Language Classes
beliefs about japanese language learning foreign language environment japanese language anxiety japanese language learning japanese language use...
This study examined the relationship between Japanese language (JL) anxiety, beliefs about JL learning, and the amount of JL used in JL classes. The participants in this study were 670 undergraduate students studying JL at the Institute of Technology in Bangkok, Thailand, as compulsory subjects. A questionnaire survey was conducted, and a stepwise multiple regression analysis found that the amount of JL used by learners had a negative relationship with JL anxiety and a positive relationship with beliefs about JL learning and the amount of JL used by both native Thai and Japanese teachers. In addition, JL anxiety interacted with the amount of JL used by native Japanese teachers and beliefs about JL learning. JL teachers, especially native Japanese teachers, should attempt to reduce their learners' JL anxiety in order to maximize the effect of teachers’ JL use and learners’ beliefs and to support them in using JL more in classes.