'Assessment construct' Search Results
Cognitive Mechanisms Underlying the Engineering Students’ Desire to Cheat During Online and Onsite Statistics Exams
propensity for academic cheating learning evaluation online face-to-face evaluation and cognitive algebra...
A sample of 327 engineering bachelor students from a public university in Mexico took part in an information integration study to explore systematic thinking underlying propensity for cheating during a course exam. All study participants were provided with written descriptions of 12 scenarios pertaining to the academic evaluation criteria and were asked to rate the likelihood that they would cheat under such circumstances. The 12 scenarios reflected the experimental manipulation of three orthogonal factors: teacher’s teaching style, type of exam, and modality of assessment. Analysis results revealed four distinct attitudes toward cheating among students, two of which were independent of context (low and high desire to cheat) while the remaining two were context-dependent (low and moderate desire to cheat). All groups showed systematic thinking underlying their possible desire to cheat that was typified by the use of a summative cognitive rule for integrating information related to academic cheating. However, evaluation of factor relevance varied across the groups.
A Proposal for Holistic Assessment of Computational Thinking for Undergraduate: Content Validity
computational thinking assessment fuzzy delphi method undergraduate education...
Studies have acknowledged computational thinking (CT) as an efficient approach for problem-solving particularly required in digital workplaces. This research aims to identify indicators for a holistic CT assessment instrument for undergraduate students. A three-round fuzzy Delphi study has been conducted to gain comprehensive opinions and consensus from undergraduate lecturers of computer science disciplines and experts from the information technology industry. In round 1, the experts judged a set of predefined indicators describing CT skills and attitudes identified from the literature, while rounds 2 and 3 focused on variables selection. The consensus was achieved on holistic CT, and the indicators are teamwork, communication, spiritual intelligence, generalization, problem-solving, algorithmic thinking, evaluation, abstraction, decomposition, and debugging. Results demonstrate the importance of attitudes in the process of solving a problem and suggest higher education institutions to consider holistic CT in preparing qualified future graduates. Many CT studies focused only on the skills of CT. This study outlines the assessment indicators that consider both CT skills and attitudes, particularly at the undergraduate level.
Developing of Computerized Adaptive Testing to Measure Physics Higher Order Thinking Skills of Senior High School Students and its Feasibility of Use
computerized adaptive testing hots partial credit model item response theory...
The Computer has occupied a comprehensive coverage, especially in education scopes, including in learning-teaching processes, testing, and evaluating. This research aimed to develop computerized adaptive testing (CAT) to measure physics higher-order thinking skills (HOTS), namely PhysTHOTS-CAT. The Research Development used the 4-D developmental model carrying the four phases of define, design, development, and dissemination (4D) developed by Thiagarajan. This testing instrument can give the item test based on the student’s abilities. The research phases include (1) needs analysis and definition, (2) development design (3) development of CAT and assemble the test items into CAT, (4) validation by experts, and (5) feasibility try-out. The findings show that PhysTHOTS-CAT is valid to measure physics HOTS of the 10th-grade students of Senior High School according to 82.28% of teachers and students assessment on PhysTHOTS-CAT content and media. Therefore, it can conclude that PhysTHOTS-CAT can be used and feasible to measure physics HOTS of the 10th-grade students of the Senior High School.
Development of Interpersonal Mindfulness Scale-TR (IMS-TR): Validity and Reliability
mindfulness interpersonal mindfulness validity analysis reliability analysis mindfulness scale...
The purpose of this study is to develop an Interpersonal Mindfulness Scale-TR (IMS-TR) for Turkish culture. For the data collection process, four different sample groups participated in the study. To test the construct validity of the scale an exploratory factor analysis was performed. Results suggested a 13-item, two-factor solution as (1) awareness and (2) being in the moment. Two-factor structure explains 50.65% of the variance. A confirmatory factor analysis results showed good fit for two-factor solution. The Mindfulness in Parenting Questionnaire and the Mindfulness in Marriage Scale were used to examine a convergent validity and positive significant relationships were found between the scales. To test the reliability of the scale Cronbach's Alpha reliability coefficient of the overall scale was determined to be .826. To determine the stability coefficient of the IMS-TR, test-retest method was used and according to result there is a positive relationship between the scales. According to all of these results, it can be said that the IMS-TR has a validity and reliability.
The Correlation between Metacognitive Skills and Critical Thinking Skills at the Implementation of Four Different Learning Strategies in Animal Physiology Lectures
adi learning animal physiology critical thinking skills learning strategy metacognitive skills...
The empowerment of metacognitive skills has an important role in increasing the capacity of critical thinking and active control of students' cognitive processes in learning. Metacognitive skills can be enhanced through the implementation of learning strategies involving higher-order thinking. The RQA, ADI, RQA integrated with ADI are constructivistic learning strategies that can accommodate these skills. The researches specifically examining the correlation between metacognitive skills and critical thinking skills at the implementation of RQA, ADI, and RQA integrated with ADI learning strategies are still rarely found. This research is a correlational research, aiming at revealing the correlation between metacognitive skills and critical thinking skills. The data of metacognitive skills and critical thinking skills are collected by using a valid and reliable essay test. The samples of this research are the fourth semester (IV) biology education students programming Animal Physiology course in the 2016/2017 academic year consisting of 109 students. The results of this research show that (1) there was a significant correlation between metacognitive skills and critical thinking skills at the implementation of the four learning strategies, (2) the regression equations analyzed using Anova obtain regression lines (not coincide), and non parallel regression lines (intersected); meaning that there is a difference in the increase rate and magnitude of the critical thinking skills influenced by the four learning strategies. It is expected that the teachers and the lecturers always strive to improve the quality of the learning process through the implementation of active and constructive learning strategies.
The Effect of Emotional Intelligence, Self-Efficacy, Subjective Well-Being and Resilience on Student Teachers’ Perceived Practicum Stress: A Malaysian Case Study
emotional intelligence self-efficacy subjective well-being resilience perceived practicum stress...
Stress is inevitable in the world of teaching and practicum training and therefore, student teachers naturally incur a certain level of stress due to the demands for them to use various knowledge and skills in real school and classroom environment. Hence, practicum stress needs to be addressed accordingly. The central focus of this study is using a partial least square-structural equation modeling to explore the inter-relationships among the student teachers’ personal resources to mitigate practicum stress. A sample of 200 student teachers selected by purposive sampling from teacher education institutions in Sabah, Malaysia was used in this study. This study collected data via survey methods using a questionnaire developed from several existing scales. Findings showed that emotional intelligence, self-efficacy, and subjective well-being were able to explain resilience with good predictive accuracy and relevance but poorly for practicum stress. These findings were suggestive of the need to include additional constructs to explain perceived practicum stress better in future exploratory research.
Integrating Concepts and Expressions of Inclusion in the K – Curriculum: The Case of the Philippines
inclusive education inclusive concepts and expressions inclusion in the k-curriculum content analysis...
Inclusive education as a curricular trend is implemented by countries as an action taken in response to the collective call of the Salamanca Statement. It carries the tenet that all learners should be educated alongside their peers regardless of physical, cognitive, socio-emotional, and economic, language, cultural, and other perceived differences. School children, as peers of children with special needs, are co-implementers of the inclusive agenda. Young children are competent, possess their views and agencies, and have nascent characteristics that promote inclusion. As such, it is essential to explore how knowledge, skills, attitudes, values, and ethics can further be developed and refined for the sake of creating an inclusive community through integrating them in the school curriculum. This paper sought to analyse the articulation of inclusive concepts and expressions in the K-curriculum and strategies utilized by the teachers to reinforce them. Two documents were analysed in this study to address the research questions: (a) prescribed k-curriculum currently used in the Philippines (b) interview transcripts of the key informants. Through content analysis, results of the study revealed that several inclusive concepts and expressions are articulated in the kindergarten curriculum across domains and are reinforced by teachers using varied strategies. Recommendations of the study are discussed.
Measurement of Metacognition: Adaptation of Metacognitive State Inventory in Spanish to Mexican University Students
metacognition self-regulation metacognitive state inventory inventory...
Some of the most important skills of university students is to develop the capacity to resolve problems posed by their communities, which implies that students become independent, autonomous and self-regulated. Also they need to be capable of monitor, asses and modify their learning through their own process of metacognition, this way they can develop the required knowledge and improve their learning. To analyze it, the objective of this research is to evaluate the psychometric properties of the Metacognitive State Inventory in Mexican university students. For this reason, the Metacognitive State Inventory was applied to 908 students. To confirm a second order hierarchy model with four first order factors, confirmatory factor analysis was used (CFA).Four items were eliminated to obtain a better model fit. Internal consistency was accessed through McDonald's omega coefficient. In this way, evidence of the construct validity and reliability of the instrument was provided. The Inventory of the Metacognitive State was correlated with the CEVEAPEU Questionnaire, obtaining significant positive correlations between both instruments, thus providing certainty of convergent validity.
The Impact of Service-Learning on EFL Teacher Candidates’ Academic and Personal Development
community service peer-tutoring personal growth service-learning significant learning...
Despite its well-documented benefits for training a wide range of professionals, including teacher candidates in almost all content areas, the incorporation of service-learning into foreign language teacher education is relatively new, and most research only dealt with narrative accounts of non-work-related charitable activities. Consequently, this study sought to investigate the impact of the 20-hour peer-tutoring project on the teaching beliefs, community service attitudes, personal and professional development of 14 Turkish EFL teacher candidates. A comparison between their pre- and post-service metaphors revealed a conceptual shift not only in their teaching perspectives from the behaviorist to constructivist paradigm for knowledge acquisition, but also in their community partnership approaches from the unidirectional to reciprocal pattern of altruism towards their tutees. The classification of their written reflections into six types of significant learning demonstrated that despite a relatively greater focus on expressing their foundational knowledge and application practices, a more balanced distribution of learning gains was achieved between the two overarching spheres of academic learning and personal growth, when coursework engagement and multimodal reflections were co-implemented. They reported developing effective teacher dispositions, interpersonal skills and social responsibility, valued intrinsic rewards for their contributions to the youth well-being, and also appreciated the informal professional learning opportunities the peer-tutoring service offered, though without establishing their own learning agendas.
The Role of Pedagogical Practices in Novice Teachers' Work
professional development school (pds) teacher's sense of efficacy attitudes toward the teaching profession novice teachers co-teaching...
Achieving educational goals is based on the skills and competence of teachers; therefore, professional development of teachers is important to policy and decision-makers. Worldwide, the percentage of teachers who leave the profession within their first years of teaching is high therefore, professional support is essential to ease on their integration. Previous research indicates a positive and significant correlation between teachers' self-efficacy and their attitudes toward the teaching profession. Our study included three hypotheses: 1) teachers' pedagogical applications serve as mediators for the relationship between teachers' self-efficacy and their attitudes toward the profession; 2) participating in a professional development school (PDS) training program interacts with teachers' self-efficacy in predicting their attitudes toward the profession; and, 3) participation in a PDS training program will positively affect the two variables. A close and open-ended questionnaire was replied by 300 novice teachers, some of whom participated in the PDS program and others who did not. Findings indicate that the relationship between teachers' sense of self-efficacy and their attitudes towards the teaching profession was partially mediated by: applying constructivist pedagogical practices; matching to differences between learners; collaboration between fellow teachers; accountability; planning and teaching management; and academy-community relationships. Participation in a PDS program was not found as a moderator variable for this relationship, but novice teachers who participated in this program had a significant higher sense of self-efficacy and more positive attitudes towards the teaching profession. Findings are important for designing novice teacher training programs with an emphasis on the implementation of specific pedagogical practices.
Summative Assessment, Test Scores and Text Quality: A Study of Cohesion as an Unspecified Descriptor in the Assessment Scale
academic writing cohesion english as a foreign language language testing summative assessment texture writing quality...
Summative assessment of students' writing predicts not only the extent to which the course learning objectives have been achieved but also reveals the relevance of the assessment design with the construct of writing being assessed. Any dichotomy between the assessment criteria and the construct of writing or between the assessment criteria and test scoring procedures can produce unreliable and invalid interpretations of the students' writing proficiency. Assuming cohesion as a measure of writing quality, the present study chose samples of academic writing which did not specify cohesion as a descriptor in the assessment scale. A cohesion index was, therefore, developed to investigate how cohesive devices created texture in the sample texts and correlated with the test scores. Descriptive statistics and non-parametric correlation analysis revealed that cohesive devices were positively associated with appropriate use to create texture; however, they only weakly correlated with the test scores. The findings imply that there is the need for developing assessment criteria which consistently measures the text-forming resources to reliably ascertain the writing proficiency of the students. The study recommends a research initiative based on an analytical assessment criteria to ensure a more accurate analysis of the role of cohesion in text-formation and writing quality.
Multiple Intelligences-based Creative Curriculum: The Best Practice
model assessment curriculum multiple intelligences kindergarten...
The purpose of this research is: 1) to develop the model and produce the assessment of creative curriculum-based learning program multiple intelligences (MI), 2) to know the characteristics and impacts of developed product models. Research using multi-years by method R & D (Research and Development) with two phases; First phase: 1) Preliminary survey stage, 2) definition stage, 3) design phase, 4) trial stage, and 5) development stage; The second phase: 1) the instrument design stage through the Forum Group Discussion, 2) the product trial phase of 100 children in Sleman Regency, 3) wide-scale implementation of 200 children in Yogyakarta Province, 4) the evaluation phase with construct analysis and achievement of research subjects' performance, 5 ) the stage of measuring the effectiveness of the product with user perception. The subject comprises 200 children of early childhood and 20 kindergarten teachers in 10 kindergartens in the Yogyakarta province in Indonesia, by the approach of Reflective Measurement Theory (RMT). The results showed that: 1) the MI-based creative curriculum assessment model was developed to meet valid, reliable and conformity criteria of an empirical data model, 2) The implementation of the assessment model had fulfilled the requirements worthy of using three criteria aspect; 1) The results of the assessment using creative instruments based on multiple intelligences on children get "very good" results, 2) the readiness of the teacher in learning is included in the "good" category; 3) teacher performance appraisal shows the "very good" category, and 4) the benefits of the products developed are in the "very good" category. It was concluded that the developed product had tested empirically and practically so that it was useful in learning in early childhood.
What I know Best: Assessing Indonesian Student’s Structural Knowledge through Student-Generated Topics
assessment model the flow of thought student-generated topic structural knowledge topic mastery...
Developing Indonesian English as a foreign language (EFL) students’ structural knowledge presents a number of complexities especially in the bilingual context. This study aimed to determine how the structural knowledge patterns of Indonesian EFL students is, and it specifically explored various aspects that make structural knowledge representation difficult. The research also aimed to formulate an accommodative assessment model for the development of students' structural knowledge. Using a case study design, this study involved 120 English literature students (N=120) taking the Psycholinguistics class at one of the tertiary institutions in Malang, Indonesia. The research instruments included essay tests and questionnaires. The research findings showed that students in bilingual contexts have certain diversity and patterns in their structural knowledge. Second, students’ structural knowledge could be influenced by a number of aspects such as topic mastery and the flow of thought. Furthermore, students’ structural knowledge can be accommodated in an adequate evaluation model that measures structural knowledge and critical thinking skills. Further research in the area of content and language assessment will complete the study of the significance of structural knowledge in a bilingual context.
South Kalimantan Local Wisdom-Based Biology Learning Model
biodiversity material biology learning tools south kalimantan local wisdom...
The objectives of this study were to analyze the validity, practicality, and effectiveness of South Kalimantan local wisdom-based biology learning and its effect on student learning outcomes. The research method used is research and development. This research was in a Develop stage of Thiagarajan’s Model. This development has produced learning models (lesson plans, student’s worksheet, learning achievement test questions, teacher activity sheets, student activity sheets, and student response sheets). The local wisdom-based learning model were designed with seven stages using Banjar language (regional language of South Kalimantan). Model that have been developed were tested for the level of validity, practicality, effectiveness, and its effect in learning. The level of validity is determined based on the assessment and review of the four validators. To find out the effectiveness and the effect of the learning model, quasi-experimental design was applied by involving two classes at SMAN 7 Banjarmasin-Indonesia. Data were collected using a variety of instruments, namely the validity assessment sheet, the student’s worksheet and lesson plan sheets, student achievement test questions, and student response sheets. Data analysis was implemented to measure the effectiveness and the effect of learning by calculating n-Gain and ANCOVA, respectively. The results, the learning tools met the "valid" criteria so that it can be implemented. Learning also concluded having good practicality criteria. Moreover, it can be seen that the application of local wisdom-based learning model and tools was quite effective in improving student learning outcomes, in contrast to learning in the control class. Furthermore, ANCOVA test concluded that there were significant differences in learning outcomes between students in the experimental and the control class.
Readiness and Competence of New Teachers for Career as Professional Teachers in Primary Schools
new teacher career new teacher readiness new teacher competence professional teacher teacher professional education...
This study aims at exploring the problem of the readiness and competence of new teachers to teach in primary schools. This study specifically focuses on identifying the readiness of new teachers to conduct teaching professionally, and analyzing their competence in conducting teaching. This study employs a mixed-method research design with data collected from two different approaches: a qualitative approach by conducting interviews and observation, and a quantitative approach by conducting a survey. The data were collected from lecturers, graduate teachers working as teachers, graduate teachers working not as teachers, and users of graduate teachers. The results of data collection and analysis were made into several themes. The results showed that the majority of graduates were ready to join the workforce as professional teachers with the risk that they had to accept the lack of welfare and legitimacy as unprofessional teachers because they had to attend further professional education programs. The education provided by the lecturers during their study in their institution in the aspects of knowledge and skills in the field of study and pedagogy became the foundation for new teachers in starting their careers as professional teachers in schools. A good educational process had produced teachers who have competencies with good categories in various aspects.
Assessment of Skills Development in Brunei Trainee Teachers: Intervention Implications
skills development assessment and evaluation trainee teachers brunei teacher standards brunei...
Teacher education has been innovated in Brunei to support the ongoing inclusive education and curriculum reforms. This survey investigated the development of essential instructional skills in initial Brunei trainee teachers. The sample consisted of 109 student teachers (71 females and 38 males). Significant mean scores (Mean ≥ 4, p< .05) and 95% confidence intervals were used to identify the levels of proficiency and enablers of success in teaching. Participants were proficient on 15 of the 28 skills measured by the Teacher Behaviors Checklist (Approachable; Confident; Effective communicator; Encourages; Enthusiastic; Flexible; Good listener; Humble; Prepared; Professional; Rapport; Respectful; Sensitive; Striving to be a better teacher; Understanding). From independent groups, T-tests and One-Way ANOVA analyses, other significant trends in participants’ performance emerged at p< .05 level of evaluation. Females scored highest on Humble and Realistic expectations while males scored highest on Understanding. Trainee teachers aged 31-35 scored highest on: Promoting critical thinking; and Providing constructive feedback, than counterparts. Participants with higher degrees (e.g. Master of Arts) scored higher on Authoritative skills than those with lower degrees (e.g. Bachelor of Arts). Trainees with teaching experience scored significantly higher on: Accessible; Knowledge about the subject matter; and Technological competence, than those with no experience. The findings suggest the need to help pre-service teachers to gain proficiency in all teacher skills to improve the quality of education in the country. Further research was recommended.
The Spanish Version of the Teacher Efficacy for Inclusive Practice (TEIP) Scale: Adaptation and Psychometric Properties
teacher efficacy for inclusion teip scale spanish adaptation cross-validation studies preservice teacher education...
The Teacher Efficacy for Inclusive Practice (TEIP) scale is an instrument created by Sharma et al. to assess efficacy of instruction in inclusive settings. Despite its increase in use, the TEIP has not been validated with a Spanish teacher population. The aim of this study was to: (1) analyze the psychometric properties and factor structure of the TEIP scale in a sample of Spanish preservice teachers (N = 475; 80% female, 20% male), and (2) examine the level of self-efficacy for inclusive practices that teachers experience when they graduate from their training programs. Exploratory and confirmatory factor analyses indicate that a Spanish version (TEIP-ES) consisting of 15 items with a three-factor construct explains 61.34 percent of total variance. Item total-correlations ranged from .488 to .778, and factor loadings from .590 to .790. Convergent validity with measures of quality of teacher education (TE) programs and self-report of preparedness to teach in inclusive settings was good. In contrast, self-efficacy for inclusive practices was rated moderately low. Overall, these findings support the construct and convergent validity of the TEIP-ES and suggest that it is a useful instrument to measure self-efficacy for inclusion in Spanish preservice teacher populations. This manuscript reports the findings, discusses the implications for the improvement of TE programs, and suggests possible avenues for future related research.
QASEE: A Potential Learning Model to Improve the Critical Thinking Skills of Pre-service Teachers with Different Academic Abilities
academic ability critical thinking skills learning model pre-service teachers teacher education...
Research on critical thinking skills has been frequently carried out, but it has not shown maximum results. This problem is exacerbated by the differences in pre-service teachers’ academic abilities. A new learning model that can improve pre-service teachers’ critical thinking skills and reduce the gap in critical thinking skills among the upper, middle, and lower academic ability pre-service teachers is needed. This research aims at exploring the potential of the QASEE learning model on the critical thinking skills of different academic ability. This quasi-experimental research involved 107 pre-service teachers of Universitas Islam Negeri Raden Fatah, Indonesia. The research classes were divided into three classes, namely the QASEE class (experimental class), the RQA class (positive control class), and the conventional class (negative control class). Each class was further divided into upper, middle, and lower academic categories. The data were collected using an essay test supported by a critical thinking skill rubric. The data were analyzed by using ANCOVA and followed by LSD test. The research results show that the QASEE (Questioning, Answering, Sharing, Extending, and Evaluating) learning model can improve and equalize the critical thinking skills of pre-service teachers with various academic levels. Thus, the QASEE learning model can be used as a new reference to improve pre-service teachers’ critical thinking skills, especially the lower academic ability.
Design and Validation of Mathematical Literacy Instruments for Assessment for Learning in Indonesia
instruments mathematics literacy content validity construct validity construct reliability...
This study aims to design mathematical literacy instruments that have evidence of content and construct validity and are reliable for use as an Assessment for Learning. The research involved eight experts as instrument validators and 273 eighth-grade students of junior high school in Yogyakarta Province. The results showed that the ten mathematical literacy items developed had the V Aiken coefficient index calculated from 0.781 to 0.906 (> 0.75). The results of adequacy testing of samples with KMO and Bartlett show Chi-Square in the Bartlett test of 608,608, the p-value <0.05 and KMO value of 0.781 (> 0.5). The results of testing of the measurement model with Confirmatory Factor Analysis (CFA) produce a Root Mean Square Error of Approach (RMSEA) value of 0.049 (≤ 0.08), chi-s Square of 33.92 (<2df), the p-value of 0.05004 (≥ 0.05). Nine out of the ten items developed had t-value> 1.96, Standardized Loading Factor (SLF) was greater than the critical limit (> 0.3), and Construct Reliability (CR) of 0.78 (> 0.7). It can be concluded that the developed mathematical literacy instrument can measure what must be measured and nine items significantly reflect the construct or latent variable, as well as the level of consistency of a good score.
Investigating English Speaking Problems: Implications for Speaking Curriculum Development in Indonesia
curriculum development english speaking problems implications indonesia...
The present study aims at investigating some English speaking problems found by the students of English language education department at State Islamic Institute of Kudus and exploring some implications for speaking curriculum development of English language education department. This study used a descriptive qualitative approach and the data were taken from semi-structured interviews, observation and focus group discussion (FGD). The results of the analysis reveal that the problems encountered by the students in English language education department in speaking English cover the lack of appropriate vocabulary, the lack of grammar mastery, the lack of correct pronunciation, the lack of input of English outside the class, the lack of confidence and the lack of English speaking curriculum development. There have been some implications for developing English speaking curriculum. First, the curriculum of speaking should be well designed. Second, lecturers should design English speaking curriculum integrated by technology and social media that makes students to enrich some culture, knowledge and experience around the world. Third, lecturers should facilitate the English speaking curriculum with the English speaking community so that the students will have more chance to speak English inside and outside the class.