'construct reliability' Search Results
The Development of Indonesian Accounting Teacher Professional Identity Measurement: An Exploratory Factor Analysis
accounting teacher measurement professional identity scale...
Measuring accounting teachers’ professional identity is significant to do as an alternative to measure the professionalism of accounting teachers in Indonesia based on their professional identity. This research was conducted in two stages of exploratory factor analysis involving 150 accounting teachers as sample in each stage. The data were collected in collaboration with an accounting teacher organization, comprising the Accounting Subject Teacher Deliberation (MGMP) in Central Java through a questionnaire. Data analysis was divided into several steps including face validity and content validity, inter-item correlation matrix, and exploratory factor analysis. The results showed that 23 question items encompassed five components of accounting teacher professional identity; Cultural Knowledge (pedagogical cultural identity), Blending (accommodating students' purposes for school in the learning objectives), Identity Experiencing (by the experience of working life in the past, present, and individual expectations in the future in accounting work setting), Inter-Personal Skill, and Active in Professional Communities. The scale development requires continuous development tailing various new findings in the teacher professional identity and accountant professional identity.
The Effectiveness of Visual Mind Mapping Strategy for Improving English Language Learners' Critical Thinking Skills and Reading Ability
critical thinking skills english language learners visual mind mapping...
This study investigated the effectiveness of visual mind mapping as a reading strategy for improving English language learners' critical thinking skills. Students from two general English courses were randomly assigned to experimental and control groups. California Critical Thinking Test was used to assess participants' critical thinking skills. The findings revealed a statistically significant difference at (p < .005) in the mean scores of the experiment and control groups in the post-test due to visual mind mapping strategy in favor of the experimental group with a positive and significant impact on participants' critical thinking skills. The findings also showed that the experimental group’s scores were significantly improved in all indicators of critical thinking. The study results showed that visual mind mapping strategy affected the increased of critical thinking skills and reading comprehension ability. The study's findings revealed that using a visual mind mapping strategy had a significant improvement impact on English language learners critical thinking skills and reading ability.
Development and Validation of Teachers’ Assessment Belief of Mathematical Thinking Instrument
assessment beliefs assessment forms assessment purpose mathematics beliefs mathematical thinking...
This study was conducted to corroborate in understanding the teachers’ beliefs about assessment practices. The prior studies related to teachers’ assessment beliefs in mathematics have been done to assess teachers’ beliefs in the general context of mathematics teaching. This study developed an instrument to assess teachers’ assessment beliefs of mathematical thinking. The research aimed to develop and validate a scale of assessment beliefs of mathematical thinking by using the confirmatory factor analysis. The first draft of the scale contained 25 items. The sample of the study consisted of 537 mathematics teachers from public schools in Oman. The instrument was a questionnaire with a 5-point Likert scale. The scale was validated by asking a number of experts in mathematics educational measurement and evaluation. Exploratory and confirmatory factor analysis was applied to test the model of assessment beliefs of mathematical thinking scale using AMOS 25.0. All constructs had acceptable reliability. The model had a good model fit for the assessment beliefs of mathematical thinking scale which obtainable from the fit indices tests. The findings revealed that all fit criteria indices were realized. The results also showed acceptable validity and construct reliability for the scale.
The Role of Second Language Motivation in Constructing the Self: An Empirical Study to Investigate the Role of Motivational Trajectories in Negotiating and Reconstructing Academic Sojourners’ Desired Selves in the UK
identity investment ideological self second language acquisition study abroad motivation...
This study is an endeavour to explicate the dissonance of the linguistic quality outcome of study abroad (SA) experiences by exploring the second language (L2) motivation of six academic sojourners in Manchester. A person-in-context approach revealed that developing intimate relationships with ‘native-speakers’, providing L2-mediated interaction opportunities with international students, and social approval were key determinants of the extent to which SA students were invested in social practices. Such social engagements were found to stem from second language motivation that is part of identity construction process. In addition, the thematic analysis of the narrative inquiries suggests that the global status of the English language defies the traditional conceptualisations of L2 motivation as most participants’ motivations were formed despite their negative or neutral attitudes towards the English community. The findings also endorse the role of the other as a robust motivational source by which learners can replenish their motivation stream, leading to social identity investment to construct their ideological selves. The paper concludes with a recommendation to re-interpret the conceptualisation of the Ideal L2 Self system because ‘native-speakers’ are rarely the closest parallels to L2 learners, and it should incorporate explicit intrinsic orientations. Furthermore, language institutions in SA contexts should direct their focus on establishing conversation clubs and hosting social events for SA students to provide a safe space for their identities to be developed, enacted and reconstructed.
Development of Affective Self-Assessment Instrument of Chemistry for High School Student as the Daily Assessment Guideline
affective domain reliability validity...
The study objectives were (1) developing a valid and reliable Affective Self-assessment Instrument of Chemistry for High School Student and (2) discovering the chemistry affective domain ability trend of high school students based on gender. The current development study utilized 10 non-test instrument development procedures from Mardapi. The study population was all high school students in Yogyakarta Special Region. The sample size was 405 students categorized into two stages and sampling techniques, i.e., the trial stage using cluster random sampling and the measurement stage using simple random sampling. The data analysis techniques were validity test using the Aiken index and construct validity and reliability using the second-order Confirmatory Factor Analysis model. The study findings were (1) the Affective Self-assessment Instrument of Chemistry for High School Student had 15 valid and reliable items and 15 available items to be utilized by teachers to measure students’ affective in the learning process and (2) the chemistry affective domain ability trend of male high school students was dominated by the “good” category and “very good” category for female students.
The Development of Historical Thinking Assessment to Examine Students’ Skills in Analyzing the Causality of Historical Events
causality historical events historical thinking skills...
This research aimed to develop a historical thinking assessment for students' skills in analyzing the causality of historical events. The development process of Gall and colleagues and Rasch analysis models were used to develop an assessment instrument consisting of two processes, including the analysis of the framework of cause and consequence, the validity, reliability, and difficultness test. This research involved 150 senior high school students, with data collected using the validation sheet, tests, and scoring rubric. The results were in the form of an essay test consisting of six indicators of analyzing cause and consequence. The instruments were valid, reliable, and suitable for assessing students’ skills in analyzing the causality of historical events. The developed instruments were paired with a historical thinking skills assessment to improve the accuracy of the information about students' level of historical thinking skills in the learning history.
Exploratory and Confirmatory Factor Analysis for Disposition Levels of Computational Thinking Instrument Among Secondary School Students
attitudes computational thinking disposition factor analysis...
Computational thinking (CT) is a method for solving complex problems, but also gives people an inventive inspiration to adapt to our smart and changing society. Globally it has been considered as vital abilities for solving genuine issues successfully and efficiently in the 21st century. Recent studies have revealed that the nurture of CT mainly centered on measuring the technical skill. There is a lack of conceptualization and instruments that cogitate on CT disposition and attitudes. This study attends to these limitations by developing an instrument to measure CT concerning dispositions and attitudes. The instruments' validity and reliability testing were performed with the participation from secondary school students in Malaysia. The internal consistency reliability, standardized residual variance, construct validity and composite reliability were examined. The result revealed that the instrument validity was confirmed after removing items. The reliability and validity of the instrument have been verified. The findings established that all constructs are useful for assessing the disposition of computer science students. The implications for psychometric assessment were evident in terms of giving empirical evidence to corroborate theory-based constructs and also validating items' quality to appropriately represent the measurement.
The COVID-19 Pandemic’s Impact on 9th Grade Students’ Mathematics Achievement
covid-19 high-school mathematics spain...
In this research, the influence of the Coronavirus disease (COVID-19) pandemic on 9th grade students’ mathematics achievement is analyzed through quantitative and qualitative methods. A posttest only with control group design was used to compare the mathematics marks of 9th grade students from the previous school year (before the pandemic, control group) and the current school year (during the pandemic, experimental group). Seventy-three students from a public high school in Spain attending class on alternate days participated in the study. Three focus group sessions were held with students, and five semi-structured interviews were conducted—two with teachers and three with students’ families. Results show statistically significant differences in students’ mathematics achievement, with students enrolled in 9th grade the previous (pre-pandemic) year outscoring their peers currently enrolled in 9th grade (during the pandemic) by 22.17%. An overall negative effect size of Hedge’s g = -1.11 was reported. Although significant statistical differences between groups were reported for both male and female students, the effect was 42.31% larger for male students (Hedge’s g = -1.11) than for females (Hedge’s g = -0.78). The qualitative information supported the quantitative results. Changes in educational settings, students’ lack of motivation, monotony, and students’ level of responsibility were qualitatively reported as factors that may explain this phenomenon. The main conclusion of this study is that the COVID-19 pandemic may be significantly and negatively affecting 9th grade students’ mathematics achievement.
Validating Student’s Green Character Instrument Using Factor and Rasch Model
green character instrument factor and rasch analysis...
Many researchers have separately developed instruments to measure environmental characteristics such as attitudes, values, and knowledge. However, there is no instrument used to measure all these aspects in one comprehensive instrument. This study is meant to develop and validate a green character instrument which reveals student behavior and awareness of the environment. The instrument consists of 40 statement items consisting of 5 aspects, namely private pro-environmental behavior, public pro-environmental behavior, environmental knowledge, environmental values, and environmental attitudes. It was implemented on 1,398 students from 15 universities in Indonesia. The instrument content validation was analyzed by three experts using content validity index (CVI). The construct validity was analyzed using exploratory factor analysis, confirmatory factor analysis, and RASCH analysis. The content validity results obtained CVI scores ranging between 0.8 and 0.9 with a good category, while item reliability was in a fairly good category with a high level of separation index. Construct validation resulted in 34 items (4 items were eliminated after Exploratory and Confirmatory Factor Analysis, and 2 items were eliminated after RASCH analysis) spread over five constructs, namely environmental behavior, environmental knowledge, environmental values, environmental attitudes, and environmental habits. The resulting instrument has a good level of item difficulty, with a well understood response set which can be understood easily by respondents, and without bias. Therefore, it can be used to measure the students’ green character on both male and female.
Construction of the Character Assessment Instrument for 21st Century Students in High Schools
assessment construct character validity reliability...
The study of character becomes a very important discussion in the 21st century. So that the integration of character values is very important both in the process and in educational assessment. The purpose of this study was to test the validity and reliability of the character assessment instrument for 21st-century high school students. The research approach used was quantitative with a sample of 200 high school students. Data analysis carried out includes validity and reliability tests. The test results of the instrument showed that the construct of the student character assessment instrument was declared valid and reliable. The content validity test shows the value of Aiken's > .80 in the high category. In the construct validation test with EFA, all variables have a loading factor > .5. In the CFA test, the model is declared fit with the estimated standard loading value of .40 and the t-count value > 1.96. Meanwhile, while in testing the reliability of the instrument obtained composite > .70 Cronbach's Alpha reliability > .70 which means reliable. So that this instrument is declared valid and reliable to measure the character of students in high school.
Elementary Teachers’ Development in Using Technological Tools to Engage Students in Online Learning
elementary teachers online learning students’ engagement technological tools tools...
Technological tools are means by which online teaching could encourage the engagement of students, especially elementary students. The present research studies how elementary teachers develop their use of technological tools in their asynchronous and synchronous online teaching, specifically when this online teaching occurs during emergency education. The research was conducted in the academic year 2019/2020. We interviewed two elementary teachers, where one of them taught asynchronous lessons more than synchronous, while the second taught synchronous lessons more than asynchronous. We analyzed the data using two frameworks: one for interaction type and one for engagement type. The research results indicated that different interaction types influenced teachers’ decisions to use technological tools. In addition, what concerned the teachers’ use of tools at the beginning was the cognitive engagement, but they advanced towards focusing on behavioral and the affective engagement.
Relationship Between Japanese Language Anxiety, Beliefs About Learning, and Language Use in Japanese Language Classes
beliefs about japanese language learning foreign language environment japanese language anxiety japanese language learning japanese language use...
This study examined the relationship between Japanese language (JL) anxiety, beliefs about JL learning, and the amount of JL used in JL classes. The participants in this study were 670 undergraduate students studying JL at the Institute of Technology in Bangkok, Thailand, as compulsory subjects. A questionnaire survey was conducted, and a stepwise multiple regression analysis found that the amount of JL used by learners had a negative relationship with JL anxiety and a positive relationship with beliefs about JL learning and the amount of JL used by both native Thai and Japanese teachers. In addition, JL anxiety interacted with the amount of JL used by native Japanese teachers and beliefs about JL learning. JL teachers, especially native Japanese teachers, should attempt to reduce their learners' JL anxiety in order to maximize the effect of teachers’ JL use and learners’ beliefs and to support them in using JL more in classes.
Design and Psychometric Properties of the Strategies for Meaningful Learnings Scale
factor analysis learning strategies meaningful learning reliability validity...
In higher education, it is essential that students apply what they have learned to solve problems in their community. Meaningful learning is the main means to increase the accumulation of knowledge and achieve the transfer of learning, which is why the present study aimed to: design and evaluate the psychometric properties of a scale that measures the application of learning strategies that promote meaningful learning. The participants were 890 university students from Northeast Mexico, with an average age of 20.35 years (SD = 3.94). The sample was randomly divided into two: an exploratory factor analysis was carried out with the first sample and a confirmatory factor analysis was made in the second sample. The results obtained confirm the eight-dimensional structure, which showed an adequate fit to the data (χ2 / gl = 3.57, GFI = .96, AGFI = .95, NFI = .94, RMSEA = .08 and SRMR = .07), high parsimony (RP = .93), in addition to good internal consistency (ω ≥ .80) and convergent validity (AVE ≥ .40). In conclusion, the scale presents adequate psychometric properties to measure the frequency of use of strategies that promote meaningful learning in Mexican university students.
Competency Framework of Agriculture Educators Vocational College: Measurement Model Using Partial Least Square-Structural Equation Modeling
agriculture educators competency framework pls-sem vocational college...
Competent instructors need to have the skills, abilities, and competencies to perform tasks effectively, which will affect student learning achievement. This study is guided by the theory of Boyatzis developed by Spencer and Spencer. The Iceberg Competency Model was used as a guideline to identify the competency elements of educators from the agricultural stream in vocational colleges (KV). This research study aims to explore and identify the existing competency elements of agricultural educators in KV. This study used a study population comprising 243 respondents of agricultural educators in KV. To answer the research question, the data analysis was done by Partial Least Squares - Structural Equation Modeling (PLS-SEM). This study is a study built to observe the relationship between the latent constructs studied. These constructs consisted of exogenous and endogenous constructs. In this study, exogenous constructs comprised value constructs, social roles, self-image, motives, traits and constraints. At the same time, endogenous constructs involved constructs of skills and knowledge. To ensure that the construct of this study gives meaning to the reflective measurement model, it was evaluated based on internal consistency reliability and validity. Regarding the framework, some indicators that did not qualify were dropped based on factor loading and average variance extracted (AVE). From the analysis conducted, 16 indicators were dropped since they did not meet PLS-SEM requirements. The total number of items retained was 71 indicators. At the final stage of this study, the evaluation model was implemented to form a framework involving the evaluation of the constructs linked to each other.
Exploring Factors Influencing Student's Learning Difficulties During Pandemic in Indonesia: A Structural Equation Modelling
learning difficulty learning potential social environment social media activity structural equation modeling...
The pandemic era has caused changes in the learning system. The situation demanded online learning and triggered students to have learning difficulties. The research aims to examine the impact of social media, social environment, and student learning potential on student learning difficulties. This study utilizes a quantitative approach. The respondents were university students experiencing online learning in West Java, Indonesia. A questionnaire validated by four experts was distributed to 539 of them. Accommodating structural equation modeling (SEM) by evaluating the measurement and structural models was used in data analysis. This study revealed that the instrument had good construct validity and reliability. A good instrument will produce a good measurement process so that the instrument can get the data needed. Hypothesis testing shows that high media activity can inhibit students from learning. However, social media activity directly influences learning difficulties. Meanwhile, the variables of learning potential and social environment positively influence student learning difficulties directly or indirectly. There are a few things to note on learning potential, social environment, and social media to delve into their influences on students' learning difficulties.
The Development of a Four-Tier Diagnostic Test Based on Modern Test Theory in Physics Education
developing test four-tiers diagnostic test modern test theory...
Diagnostic tests are generally two or three-tier and based on classical test theory. In this research, the Four-Tier Diagnostic Test (FTDT) was developed based on modern test theory to determine understanding of physics levels: scientific conception (SC), lack of knowledge (LK), misconception (MSC), false negatives (FN), and false positives (FP). The goals of the FTDT are to (a) find FTDT constructs, (b) test the quality of the FTDT, and (c) describe students' conceptual understanding of physics. The development process was conducted in the planning, testing, and measurement phases. The FTDT consists of four-layer multiple-choice with 100 items tested on 700 high school students in Yogyakarta. According to the partial credit models (PCM), the student's responses are in the form of eight categories of polytomous data. The results of the study show that (a) FTDT is built on the aspects of translation, interpretation, extrapolation, and explanation, with each aspect consisting of 25 items with five anchor items; (b) FTDT is valid with an Aiken's V value in the range of 0.85-0.94, and the items fit PCM with Infit Mean Square (INFIT MNSQ) of 0.77-1.30, item difficulty index of 0.12-0.38, and the reliability coefficient of Cronbach's alpha FTDT is 0.9; (c) the percentage of conceptual understanding of physics from large to small is LK type 2 (LK2), FP, LK type 1 (LK1), FN, LK type 3 (LK3), SC, LK type 4 (LK4), and MSC. The percentage sequence of MSC based on the successive material is momentum, Newton's law, particle dynamics, harmonic motion, work, and energy. In addition, failure to understand the concept sequentially is due to Newton's law, particle dynamics, work and energy, momentum, and harmonic motion.
Development of a Self-Evaluation Instrument with Programmatic Assessment Components for Undergraduate Medical Students
instrument development medical education programmatic assessment...
This study aimed to develop and test a student self-assessment instrument based on the programmatic assessment (PA) components. We applied a series of psychometric research methods by (a) conducting a literature study to find PA constructs, (b) developing the students' self-questionnaires, (c) ensuring content validity, (d) testing face validity, and (e) conducting reliability tests that involve medical students, medical teachers, medical educationalist, and an international PA expert. Face validity (readability test) was conducted with 30 medical students from an Indonesian university who were in their last year of pre-clinical education and had average scores above or equal to their classmates. The confirmatory factor analysis (CFA) was used to report the instruments’ validity and reliability. The final instrument was tested on 121 medical students with excellent GPAs from another medical school with a middle-level accreditation. The PA consists of five components: ‘learning activities’, ‘assessment activities’, 'supporting activities’, 'intermediate evaluations’, and ‘final evaluations'. These components are conveyed through 41 relevant statements with a four-point Likert scale and three yes/no statements. According to the respondents, there was a lack of 'supporting activities' and 'intermediate evaluation' components in the PA in their universities. This study has developed and tested a five-component evaluation instrument based on medical students' perceptions regarding PA implementation.
Development of the Multiple Intelligences Promotion Model for Thai Learners
learner model multiple intelligences screening test thai education...
Recently, Thailand's educational policy focused on developing learners’ potential according to multiple intelligences. The research objectives were to develop the multiple intelligences (MI) promotion model and an MI screening test for Thai learners and propose policies to encourage MI so that learners can reach their full potential. The sequential mixed method was applied. First, the model and the MI screening test were developed. The participants were two groups of key informants, comprising 93 and 185 participants, respectively. The sample group consisted of 460 primary and secondary school students selected through multistage random sampling. The MI screening test consisted of characteristics of 45 behavioral observations. The result showed that the developing model was the “A2D model or AAD.” This model consisted of three components: nine areas of intelligence, eight continuity mechanisms, and two success conditions. The MI screening result revealed that most learners had outstanding bodily–kinesthetic intelligence, accounting for 40.4%. The least prominent aspect was musical intelligence, representing 16.2%. The proposal policies comprised (a) The aspect of foundation for learning management with access to the A2D model, consisting of four sub-policy proposals, and (b) The aspect of encouraging learners to develop their full potential, consisting of six sub-policy proposals.
Development and Validation of a Concept Inventory for Interpreting Kinematics Graphs in the Tanzanian Context
concept inventory kinematics graphs physics teachers tanzania context...
This paper discusses the development and validation of a concept inventory for interpreting kinematics graphs in the Tanzanian context. The study involved 61 participants comprising physics pre-service teachers, secondary school teachers, diploma college tutors, and a university lecturer from Tanzania. We developed 25 multiple-choice questions for interpreting kinematics graphs. The different steps in the development process used are selecting the topic, setting objectives, constructing questions, validating questions, and reliability testing. We carried out descriptive and inferential statistical analysis by using Statistical Package for Social Science (SPSS) version 22 followed by item analysis for pre-and post-piloting. Findings revealed normal distribution scores with a mean and standard deviation of 39.28±10.893 for pre-piloting and 40.16±8.08 for post-piloting. It also revealed no significant difference between pre-and post-piloting results with a p-value of 0.414. In addition, correlation coefficients for test re-test reliability were .783 and .878 for single and average measures respectively. Moreover, item analysis in terms of difficulty index, discrimination index, and distractor efficiency agreed with the published standards. Based on these findings, the study recommends the use of developed and validated kinematics graphs concept inventory by physics educators in both research and classroom instructions in the Tanzanian context.
Measurement of Students' Chemistry Practicum Skills Using Many Facets Rash Model
chemistry practicum mfrm performance assessment process assessment product assessment...
The accuracy of assessing the capabilities of the process and product in chemical practice activities requires appropriate measurement procedures to be followed. It is crucial to identify the components that can introduce bias while measuring student abilities during the measurement process. This study aims to identify the components or criteria used by teachers to assess student performance in practicum activities and analyze the quality of the rubrics developed. The study was conducted with the participation of three raters, 27 high school students, and nine assessment criteria. A quantitative descriptive approach was employed using the many-facet Rasch model (MFRM) analysis for measurement. The results of the MFRM analysis show no significant measurement bias, with data measurement facets fitting the MFRM model. The reliability of all the facets meets the criteria, and the scale predictor functions appropriately. While all students can easily pass four out of nine items, five items can only be partially passed by students. The assessment criteria that require special attention include communication skills, tools and assembly, interpretation, cleanliness, and accuracy when performing practicums. These criteria provide feedback for teachers and students to ensure successful practicum activities. The Discussion section of this study delves into the findings and their implications.