'language testing' Search Results
Early Literacy Assessment among Kindergarten Teachers in Indonesia: A Phenomenological Study
early literacy assessment kindergarten teachers phenomenology...
The study aims to identify how kindergarten teachers perform early literacy assessments in the classroom and the challenges these teachers have in performing such assessments. During the study, the data were gathered through an in-depth interview in the form of a forum group discussion (FGD). Then, the phenomenological data were attained from 30 public and private Kindergarten teachers. The researchers could illustrate how these kindergarten teachers assessed their children's early literacy through these data. Furthermore, the study results show that the teachers' literacy knowledge has been sufficient and that the literacy programs for the children have been variously designed in each school. The teachers' techniques in performing the early literacy assessment are observation and documentation (portfolio), and the measurement of literacy skills itself refers to the scope of literacy. Concerning the findings, numerous obstacles and expectations that kindergarten teachers have are also discussed within the study.
The Impact of Demographic Information on EFL Teachers’ Responses to ELT Pedagogical Reforms
age efl teachers elt pedagogical reforms gender qualification workplace...
Several reforms have been introduced to help enhance Vietnamese people’s English competencies. However, research on what reforms Vietnamese teachers support or resist is limited. Also, the impact of teachers’ demographic information on their responses to reforms is underrepresented. This mixed-methods study used a questionnaire, responded by 102 English as a foreign language (EFL) teachers, and six semi-structured interviews to address the gap. The results revealed that the teachers supported the reforms in their teaching context. They preferred using their self-developed or self-adapted materials to using required materials. On the other hand, using the VSTEP framework for designing tests was not supported. Teachers’ demographic information, especially educational qualification, significantly differed one’s responses to reforms from those of another. Some practical implications were discussed at the end of this paper. Also, some recommendations were presented to be considered for further studies.
Impact of Mobile Technology on Collaborative Learning in Engineering Studies
collaborative learning engineering study malaysia higher education mobile technology smartpls...
Collaborative learning has been identified as an essential aspect in the process of learning. As accelerated advancement continues to characterize the developments of technology, innovative mobile technology appears to be transforming the way collaborative learning is taking shape. This study focused on identifying whether mobile technology has a significant impact on collaborative learning in engineering studies in a private University in Malaysia. Using a quantitative approach, an online survey was administered for the data collection. Some 221 participants were selected randomly among undergraduate engineering students in the University. Data were analyzed using SmartPLS. The research findings revealed that mobile technology has a significant impact on collaborative learning. The findings also indicated that two of the mobile technology dimensions, namely mobility and immediacy have significant impact on collaborative learning. Consequently, this research suggests engineering educators can integrate mobile technology into their future instruction for more collaborative learning and create a smart workforce consisting of fast and adaptive engineers as well as other learners in Malaysia.
The Efficiency of Tailored Systems for Language Education: An App Based on Scientific Evidence and for Student-Centered Approach
immigration mobile-assisted language learning refugees second language technology-based education...
In the vulnerable and unstable contexts that characterize populations in mobility between countries, especially immigrants and refugees, the second language learning has assumed new traits of difficulty. To help the new generation of learners, mainly with origin in forced immigration, the mobile-assisted learning helps motivation for language learning and reduces anxiety related to language acquisition. Attending to this challenge educational scenario, this review study presents a literature systematic analysis and a concrete technology tool that advocates the student-centered approach. A mobile pedagogical plan was developed for the learning of European Portuguese as a Second Language and as a Foreign Language. A critical review of 38 studies was conducted to understand how the mobile-assisted learning responds to the inclusion and education, especially concerning minorities. Based on previous empirical data with 108 immigrants, we understand the type of tasks that new immigrants have more difficulty learning in Portuguese. It was developed as a mobile app for Android, IOS, computers and tablets: the GoGenius app. In mobile format, individuals can access fourteen themed units with a symmetrical game architecture. These games focused the tasks and themes with priority for new language learners who recently arrived in a hosting country. These units involve a consistent number of working hours that intentionally intend to complement to the contact hours that the subjects have in classroom contexts or in unstable communication contexts (daily communication). This technology project aims to match “tailored” psychological and technological resources. Flipped classroom approach showed how mobile-assisted learning reinforces the educational goals worldwide, specifically for language learning. However, mobile tools should be well structured and centered on students’ needs, especially with migration backgrounds.
Development of a Self-Evaluation Instrument with Programmatic Assessment Components for Undergraduate Medical Students
instrument development medical education programmatic assessment...
This study aimed to develop and test a student self-assessment instrument based on the programmatic assessment (PA) components. We applied a series of psychometric research methods by (a) conducting a literature study to find PA constructs, (b) developing the students' self-questionnaires, (c) ensuring content validity, (d) testing face validity, and (e) conducting reliability tests that involve medical students, medical teachers, medical educationalist, and an international PA expert. Face validity (readability test) was conducted with 30 medical students from an Indonesian university who were in their last year of pre-clinical education and had average scores above or equal to their classmates. The confirmatory factor analysis (CFA) was used to report the instruments’ validity and reliability. The final instrument was tested on 121 medical students with excellent GPAs from another medical school with a middle-level accreditation. The PA consists of five components: ‘learning activities’, ‘assessment activities’, 'supporting activities’, 'intermediate evaluations’, and ‘final evaluations'. These components are conveyed through 41 relevant statements with a four-point Likert scale and three yes/no statements. According to the respondents, there was a lack of 'supporting activities' and 'intermediate evaluation' components in the PA in their universities. This study has developed and tested a five-component evaluation instrument based on medical students' perceptions regarding PA implementation.
Pedagogy-Andragogy Continuum with Cybergogy to Promote Self-Regulated Learning: A Structural Equation Model Approach
andragogy continuum cybergogy pedagogy self-regulated learning...
The increasing sophisticated learning technology and COVID-19 have pushed the teaching-learning process to use pedagogy, andragogy, and cybergogy approaches. The current research aims to investigate the relationship between the practices of these three approaches and student self-regulated learning. The structural equation model used indicates that pedagogy practices may affect the andragogy practices in teaching-learning process. Pedagogy approach shows no direct effect but has an indirect effect on students’ self-regulated learning. The indirect effect comes from the pedagogy-andragogy continuum and the impact of pedagogy instruction on cybergogy practices. Andragogy practices also gives a significant impact on students’ self-regulated learning and how the students use learning technology in cybergogy approach. Andragogy and the continuum of cybergogy promote students’ self-regulated learning. These results indicate that pedagogy-andragogy continuum can have an interplay with cybergogy. The interplay of these approaches may encourage students’ self-regulated learning. The current research can be a baseline to construct a new approach in teaching-learning process and its instructions in the classroom.
Study Item Parameters of Classical and Modern Theory of Differential Aptitude Test: Is it Comparable?
classical test theory differential aptitude test item parameter modern test theory...
This study aimed to find the Classical Test Theory (CTT) and Modern Test Theory (MTT) item parameters of the Differential Aptitude Test (DAT) and examined their comparability of them. The item parameters being studied are difficulty level and discrimination index. 5.024 data of the result sub-test DAT were documented by the Department of Psychology and Guidance and Counselling bureau. The parameter of classical and modern test items was estimated and correlated by examining the comparability between parameters. The results show that there is a significant correlation between item parameter estimates. The Rasch and IRT 1-PL models have the highest correlation toward CTT regarding the item difficulty level. In contrast, model 2-PL has the highest correlation toward CTT in the item discrimination index. Overall, the study concluded that CTT and MTT were comparable in estimating item parameters of DAT and thus could be used independently or complementary in developing DAT.
Effect of Computer Based Test on Motivation: A Meta-Analysis
computer-based test meta-analysis motivation r studio...
This meta-analysis study investigates the effect of computer-based tests on motivation. The random effect model is the basis for calculating the summary effect, and it is found that the 30 articles obtained through the PRISMA method, which consist of four parts, namely identification, screening, eligibility, and included, can be generalized. Data analysis was performed using R studio and OpenMEE. Based on the research results, the p-value <.05 was obtained, so it was concluded that using a computer-based test significantly affected motivation. In the moderator analysis, it was found that computer-based tests were most effective for intrinsic motivation for the motivation variable, university students for the participants variable, and the country of Iran for the region variable. Evaluation of publication bias using the funnel plot and regression method shows no publication bias, proving that the 30 articles analyzed represent all existing studies on computer-based tests.
The Use of the Teddy Talk Test to Determine Speech and Language Development in Children Aged 4 to 5 Years
screening test speech and language testing teddy talk test...
Speech therapy uses a combination of approaches to assess speech and language, including analysis of spontaneous speech, use of standardized scales and assessment by the child’s parents and/or preschool teachers. In this paper, we present the Teddy Talk Test. Using a sample of sixteen children aged 4 to 5 years, we examined whether the test provided representative data on child language development. The parent questionnaire included information on the parents’ education, the parents’ native language, the child’s gender and the language the parents speak with their child. It was found that the Teddy Talk Test has the characteristics of screening tests for speech and language: it is time-efficient, it covers receptive and expressive language tasks, and it allows for rapid assessment of speech and language in large numbers of children. However, since the Teddy Talk Test has not yet been evaluated, we do not know its value regarding sensitivity, specificity and predictive validity.
Writing PISA-Like Mathematics Items: The Case of Tertiary Mathematics Instructors from a State University in the Philippines
context-based math items item-writing mathematical literacy pisa mathematics assessment framework pisa-like mathematics items...
Mathematics test items in International Large-Scale Assessments (ILSAs) such as the Programme of International Student Assessment (PISA) and the Trends in International Mathematics and Science Study (TIMSS) are nested in contexts defined in their assessment framework (e.g., the Personal, Occupational, Societal, and Scientific contexts in PISA). This study followed the item-writing activities of four tertiary mathematics instructors in the Philippines as they constructed context-based mathematics items. They were tasked to write four items each, following a set of specifications for PISA content and context categories. The data consisted of transcripts from the focus-group discussion which was conducted days after the task. The transcripts were then analyzed using thematic analysis. The results of this study showed that the phenomenon of item-writing in the context of writing PISA-like mathematics items had two themes: the phases of item-writing and the dimensions of item-writing. Findings showed that the respondents struggled to find realistic contexts and that they engaged in a problem-solving task likened to solving a puzzle as they attempted to satisfy the content, context, and process categories in the table of specifications (TOS). This study contributes to filling in the research gap on item-writing activities, particularly those of mathematics teachers in the Philippines- a country whose recent mathematical performance in the PISA 2018, TIMSS 2019, and PISA 2022 was nothing short of dismal.