logo logo European Journal of Educational Research

EU-JER is is a, peer reviewed, online academic research journal.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

Eurasian Society of Educational Research
Eurasian Society of Educational Research
Christiaan Huygensstraat 44, Zipcode:7533XB, Enschede, THE NETHERLANDS
Eurasian Society of Educational Research
Headquarters
Christiaan Huygensstraat 44, Zipcode:7533XB, Enschede, THE NETHERLANDS

' validity and reliability' Search Results

Study Item Parameters of Classical and Modern Theory of Differential Aptitude Test: Is it Comparable?

classical test theory differential aptitude test item parameter modern test theory

Farida Agus Setiawati , Rizki Nor Amelia , Bambang Sumintono , Edi Purwanta


...

This study aimed to find the Classical Test Theory (CTT) and Modern Test Theory (MTT) item parameters of the Differential Aptitude Test (DAT) and examined their comparability of them. The item parameters being studied are difficulty level and discrimination index. 5.024 data of the result sub-test DAT were documented by the Department of Psychology and Guidance and Counselling bureau. The parameter of classical and modern test items was estimated and correlated by examining the comparability between parameters. The results show that there is a significant correlation between item parameter estimates. The Rasch and IRT 1-PL models have the highest correlation toward CTT regarding the item difficulty level. In contrast, model 2-PL has the highest correlation toward CTT in the item discrimination index. Overall, the study concluded that CTT and MTT were comparable in estimating item parameters of DAT and thus could be used independently or complementary in developing DAT.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.12.2.1097
Pages: 1097-1107
cloud_download 348
visibility 609
2
Article Metrics
Views
348
Download
609
Citations
Crossref
2

Scopus
1

...

The Think-Pair-Share (TPS) strategy makes the learning environment interactive, lively, collaborative and democratic. It allows students to interact; accept information; develop collaborative discussion skills; refine their thinking; and participate effectively in the classroom. In this study, the researchers investigated the effect of the collaborative discussion strategy (think-pair-share) on developing students' skills in solving engineering mathematical problems. Once we had confirmed the validity and reliability of the tools, we used the quasi-experimental approach. The study sample consisted of 66 students divided into two groups: Namely, an experimental group, which comprised 33 students who studied mathematics using the (think-pair-share) strategy; and a control group, which comprised 33 students who studied in the traditional way. Both groups sat for a pretest and post-test in mathematics. The test results showed that the use of the TPS strategy had a positive effect on developing problem-solving skills compared to the traditional method. In light of these results, the study recommended the use of TPS strategy to improve the skills of students in solving engineering mathematical problems.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.12.2.1123
Pages: 1123-1135
cloud_download 502
visibility 541
2
Article Metrics
Views
502
Download
541
Citations
Crossref
2

Scopus
1

Measurement of Students' Chemistry Practicum Skills Using Many Facets Rash Model

chemistry practicum mfrm performance assessment process assessment product assessment

Melly Elvira , Heri Retnawati , Eli Rohaeti , Syamsir Sainuddin


...

The accuracy of assessing the capabilities of the process and product in chemical practice activities requires appropriate measurement procedures to be followed. It is crucial to identify the components that can introduce bias while measuring student abilities during the measurement process. This study aims to identify the components or criteria used by teachers to assess student performance in practicum activities and analyze the quality of the rubrics developed. The study was conducted with the participation of three raters, 27 high school students, and nine assessment criteria. A quantitative descriptive approach was employed using the many-facet Rasch model (MFRM) analysis for measurement. The results of the MFRM analysis show no significant measurement bias, with data measurement facets fitting the MFRM model. The reliability of all the facets meets the criteria, and the scale predictor functions appropriately. While all students can easily pass four out of nine items, five items can only be partially passed by students. The assessment criteria that require special attention include communication skills, tools and assembly, interpretation, cleanliness, and accuracy when performing practicums. These criteria provide feedback for teachers and students to ensure successful practicum activities. The Discussion section of this study delves into the findings and their implications.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.12.3.1297
Pages: 1297-1315
cloud_download 375
visibility 501
0
Article Metrics
Views
375
Download
501
Citations
Crossref
0

Scopus
0

...

This study aimed to compare and examine the effectiveness of interactive STEM learning and paper-and-pencil STEM learning in terms of mathematical literacy skills of elementary school students. This research is of a quasi-experimental type with a non-equivalent pretest-posttest control group design. Sampling was carried out on the elementary school populations in Bengkulu and South Sumatra Provinces in two stages. In the first stage, schools in rural and urban areas were selected, and in the second, classes in each school were randomly selected. The selected sample consisted of fifth-grade students of the Public Elementary School of Terawas, Musi Rawas, with an experimental class A (n = 20) and an experimental class B (n = 19), as well as fifth-grade students of the Public Elementary School of Bengkulu City, with an experimental class A (n = 25) and an experimental class B (n = 22). Data collection was conducted using mathematical literacy skills tests in reference to the PISA and Minimum Competency Assessment (level 1–3). Data analysis was performed using descriptive and inferential statistics; it employed an independent t-test for the comparative testing and an N-gain test for testing the effectiveness of STEM learning. The results showed that there were differences in math literacy skills between interactive STEM and paper-and-pencil STEM for students in urban schools, but not significantly different for students in rural schools. General STEM learning was effective in increasing the literacy of elementary school students, and interactive STEM in particular demonstrated the highest level of effectiveness in the urban school.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.12.4.1569
Pages: 1569-1582
cloud_download 596
visibility 754
0
Article Metrics
Views
596
Download
754
Citations
Crossref
0

Scopus
0

Relationship between Mentors’ Roles and Mentees’ Leadership Development: The Mediating Role of Mentees’ Self-efficacy

mentees’ leadership development mentees’ self-efficacy mentors’ roles

Aminudin Mokhtar , Azman Ismail , Mustafa Zihni Tunca , Suja Unni Krishnan , Nurul Aini Othman


...

Limited latest studies circulated in the 21st century of world university ranking reveal that well-designed mentoring programs will not increase mentees’ leadership development if mentors have not implemented effective roles in the mentoring programs. Although many studies have been done, the mediating effect of mentors’ roles is little known in the tertiary education mentoring research literature. This study is done to examine the correlation between mentors’ roles, mentees’ self-efficacy, and mentees’ leadership development. This study employed a cross-sectional research design. A purposive sampling plan was employed to collect 761 survey questionnaires from undergraduate students at non-research-based public universities in Sarawak. The survey data were analyzed by the SmartPLS package to determine the validity and reliability of the study instrument, and thus test hypotheses for the direct effects model and mediating model. The outcomes of the SmartPLS path model analysis showed that the majority of participants felt that the levels of information exchange, help, self-efficacy, and leadership development are high. This situation explains that the ability of mentors to appropriately implement information exchange and help in mentoring programs has strongly evoked mentees’ self-efficacy. Consequently, this self-efficacy can lead to higher leadership development. This finding can help practitioners to understand the diverse paradigms of mentees’ self-efficacy concept and plan the integration of academic and social-based approaches in formulating mentoring programs to prepare successful graduates in a time of rapid global change.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.12.4.1719
Pages: 1719-1730
cloud_download 271
visibility 613
0
Article Metrics
Views
271
Download
613
Citations
Crossref
0

Scopus
0

Development of Waves Critical Thinking Test: Physics Essay Test for High School Student

assessment in physics essay test physics essay test waves critical thinking test

Ani Rusilowati , Ridho Adi Negoro , Mahardika Prasetya Aji , Bambang Subali


...

This study aims to produce a product to evaluate students' critical thinking skills that departs from physics content where students often have misconceptions. This research is a development research with research stages covering a) research and review literature; (b) planning chapter objectives; (c) developing a preliminary form; (d) field-testing the preliminary form; (e) Revise the preliminary form; (f) conducting a main field-test. The Waves Critical Thinking (WCT) test developed consists of 7 questions with 15 specific domains. Total percentage of content validity test was obtained 87.98% with appropriate criteria and based on the construct validity WCT test, the Goodness of Fit criteria were obtained which were classified as fit. The test instrument being tested consists of 15 objective items. The reliability of WCT test results 0.597 as a Cronbach's alpha score with the medium category and all the components have a good level of composite reliability. The outcome of the study was the WCT test with a valid state for measuring students' CT in a specific domain of physics wave material.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.12.4.1781
Pages: 1781-1794
cloud_download 336
visibility 387
2
Article Metrics
Views
336
Download
387
Citations
Crossref
2

Scopus
0

The Development of Teacher Performance Assessment Instruments in Boarding School

assessment boarding school teacher’s performance

Minhayati Saleh , Kumaidi Kumaidi , Sudji Munadi , Ahmad Mardalis , Joko Subando


...

The objective of this study is to create a tool for evaluating teachers’ effectiveness in boarding schools. Planning and preparation stages, instrument testing, and measurements were used in this study to implement research on the creation of the Mardapi model instrument. In order to generate instrument items, the planning and preparation stage tasks included a literature assessment of teacher performance appraisal manuals. Data were gathered utilizing documentation approaches, and descriptive and qualitative analysis was performed. Six specialists validated the built instruments, which were subsequently put through limited testing at two boarding schools and extensive trials at nine boarding schools in Surakarta residency area. The Aiken formula was used to examine the expert’s evaluation data, and confirmatory factor analysis was used to analyze the test results. The results of this study indicate that the instrument for assessing teacher performance in boarding schools meets the validity criteria. This is indicated by the existence of loading factor values ranging from .51 to .72 (>.4) and t-sign values ranging from 4.75 to 9.25 (>1.96) and meeting the requirements of a fit model since Chi-square = 1307.95 < 2524 (2*df), p-value = .17956 (>.05), and RSMEA value = .014 (<.08). The instrument items are reliable assessment packages, and this is shown by the reliability value of omega .967 > .70. Because there is a guarantee of validity and reliability, the test can be used to further assess teacher performance in boarding schools.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.13.1.55
Pages: 55-68
cloud_download 249
visibility 631
0
Article Metrics
Views
249
Download
631
Citations
Crossref
0

Scopus
0

Course Dropout Intention Scale: Development and Validation of a New Brief Measure in Academic College Context

brief measure college student course dropout dropout intention dropout studies

Daniel E. Yupanqui-Lorenzo , Lizbeth Angela Jara-Osorio , Carlos Carbajal-León , Tomás Caycho-Rodríguez , Manuel Antonio Cardoza Sernaqué , Kerly Stefanny Duran Quispe


...

University students may encounter situations where they perform poorly in a course and contemplate dropping out. This intention to drop out of a course manifests not only in thoughts or ideas but also in a cognitive self-evaluation of their performance and skills, enabling them to reflect on the possibility of dropping out. In this sense, there is a shortage of instruments that evaluate the intention to drop out of a course, so the aim was to develop and validate the Course Dropout Intention Scale (CDIS). Data from two samples (N1 = 198; N2 = 675) were used; the first was for the EFA, and the second was for the CFA, GRM, and SEM. The one-factor model was derived from the EFA and confirmed in the second sample, exhibiting appropriate goodness-of-fit indices. Similarly, the GRM obtained adequate fit indices; all items discriminated adequately, and the difficulty parameter had a monotonic increase. The SEM model of the effect of satisfaction with studies on the CDIS showed a negative and statistically significant effect. Thus, it was demonstrated that the CDIS is a robust instrument in its psychometric properties and empirical evidence with other variables.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.13.1.103
Pages: 103-113
cloud_download 402
visibility 616
0
Article Metrics
Views
402
Download
616
Citations
Crossref
0

Scopus
0

Community-Based Project Learning: Empowering Students' Self-Regulated Learning and Creativity

community creativity project self-regulated learning

Aynin Mashfufah , I Wayan Dasna , Candra Utama


...

Changes and challenges in the highly dynamic world of education require postgraduate students to manage their learning well and create something from their creative thinking according to the needs of the field. One of them is the activity of students in developing integrated natural science teaching materials is very necessary because learning at the primary level still uses integrated or thematic learning. Furthermore, students also need to be encouraged to be adaptive to these challenges by empowering their independence in learning. The ability to manage learning and creativity to create something new is highly prioritized for college graduates to contribute generously to their environment. This study aims to describe the empowerment of self-regulated learning and student creativity in developing natural science teaching materials in collaboration through community-based project learning. This study used a quasi-experimental design with a single-subject design type. The instruments used to retrieve data are creativity assessment rubrics and self-regulated learning questionnaires. The conclusion is that students are intrinsically and extrinsically motivated to fulfill the given tasks. Learning is essential for increasing competence, and learning strategies have been adjusted to the material's complexity or the difficulty level of the studied content. The aspect of student creativity in developing Integrated Science teaching materials shows the existence of change from stage one to the next and good categories.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.13.2.427
Pages: 427-443
cloud_download 437
visibility 476
0
Article Metrics
Views
437
Download
476
Citations
Crossref
0

Scopus

...

Students in mathematics classes do not understand the importance of sociomathematical norms in learning mathematics. This causes sociomathematical norms not to be teachers' focus when learning mathematics. Besides, there is no standardized instrument for assessing this norm, so developing this instrument is necessary to measure socio-mathematical norms in learning mathematics. This study aims to create and verify the psychometric validity of the sociomathematical norm scale. This research used a survey method with 505 senior high school students from Jakarta and West Java as respondents. The results showed that 25 items had convergent validity, with a loading factor value of > 0.700, meaning they could be declared valid. Concurrent validity indicates that each sociomathematical norms indicator is valid as a whole. Discriminant validity shows that the average variance extracted value on the diagonal is higher than the other values, so each item is declared valid. It was concluded that each item of the sociomathematical norms instrument has accuracy in its measurement function. The reliability test shows that each sociomathematical norms item is declared reliable. The reliability value of the sociomathematical norm item is .99, and the person's reliability is .86. Thus, the instruments developed can measure sociomathematical norms in learning mathematics.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.13.2.541
Pages: 541-556
cloud_download 247
visibility 476
0
Article Metrics
Views
247
Download
476
Citations
Crossref
0

Scopus

Development and Psychometric Validation of an Information Competency Assessment: The Information Management Brief Scale

information competency information literacy information management inventory inventory

Mónica Azucena Castillo-de-León , Luz Marina Méndez-Hinojosa , Magaly Cárdenas-Rodríguez


...

Today's college students relate directly to the information through which they learn. They are the ones who detect the information they need, search and evaluate it, and also use it to develop academic projects. Information literacy programs have increased in universities to support the development of these skills to students. The aim of this study was to provide an instrument that allows the measurement of information competency in higher level students and generate evidence of its validity and reliability. The Information Management Brief Inventory (IMBS) was developed, which consisted of 16 Likert type items. IMBS was applied to a sample of 1,937 students from a public university in northern Mexico. For the evaluation of the construct validity and identification of the factor grouping of the items, an exploratory factor analysis (EFA) was carried out. Confirmatory factor analysis (CFA) was carried out to explore the goodness of fit of the model. It was found that the 16 items were grouped into three factors: information management, access to information and information ethics. The psychometric properties of IMBS were adequate.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.13.2.619
Pages: 619-630
cloud_download 154
visibility 303
0
Article Metrics
Views
154
Download
303
Citations
Crossref
0

Scopus

Evaluation of the Psychometric Properties of a Scale for Emotional Regulation in Academic Activities

emotional regulation emotions inventory self-control

Magaly Cardenas-Rodriguez , Luz Marina Mendez-Hinojosa , Monica Azucena Castillo-de-Leon , Jesus Enrique Esquivel-Cruz , Cesar Alejandro Ortiz-Paez


...

This study arises from the need to scientifically investigate how university students deal with their emotions in school situations. Therefore, the objective was to develop an instrument that measured university students' level of emotional regulation during academic activities and evaluate its validity and reliability. After a thorough literature review of the definitions of the constructs, the Emotional Regulation Scale in Academic Activities (ERAAS) was developed. The first version of ERAAS consisted of 18 Likert-type items. A total of 1975 university students in various departments responded to the instrument. Two groups of experts evaluated its content validity. Validity and reliability analysis was performed. According to the EFA, three factors were found: emotional regulation, psychologic inadequate emotional regulation, and physiological insufficient emotional regulation. The final version of the scale consisted of 11 items, the validity and reliability of which could be demonstrated for further research purposes.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.13.2.665
Pages: 665-677
cloud_download 147
visibility 324
0
Article Metrics
Views
147
Download
324
Citations
Crossref
0

Scopus

...

This study aims to develop a Critical Thinking-Independent Learning (CTIL) model to improve students' critical thinking skills that meet valid, practical, and effective criteria. This type of research was Research and Development (R&D), with a one-group pre-test and post-test design without a controlled class. The CTIL model was validated by three experts in the field of science education and then tested on 156 students in three public junior high schools in Surabaya, Indonesia. The results revealed that: (a) The CTIL model was valid based on the model validity score with an average of 3.73 (very good category) and the validity score of the learning materials with an average of 3.72 (very good category); (b) The practical CTIL model based on the averaged observations of the implementation of learning using the CTIL model was 3.88 (very good category); and (c) The CTIL model was effective based on four determining factors, namely: an increase in critical thinking skills, which was statistically significant at alpha .05; the calculated mean N-gain of .72 (high category), similar mean values for all test classes in all schools participated in this study; the effect size of 3.07 (strong category); and the average student response of 84% (very good category).

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.13.2.747
Pages: 747-762
cloud_download 204
visibility 308
0
Article Metrics
Views
204
Download
308
Citations
Crossref
0

Scopus

Art Teaching: Inclusive Factor and Attention to Diversity

artistic creation art education cultural diversity inclusive education

Hilda María Arévalo-Vásquez , Judith Soledad Yangali-Vicente , Jaime Agustín Sánchez-Ortega


...

The current research aims to analyze art teaching as an inclusive factor and pays attention to diversity in excluded populations to meet the needs of students in the pandemic context. In regard to methodology, we used the naturalistic paradigm, a qualitative approach, and an inductive method with a phenomenological and hermeneutical design. The data collection techniques we used were semi-structured interviews with teachers of the Regular Basic Education in Peru. The findings show that through the mediation of diverse artistic languages and the implementation of different didactic strategies, it is possible to achieve an interaction free from exclusion barriers, driven by good teaching practices that enable the inclusion and attention to the diversity of students, providing them with opportunities to develop capacities and skills to establish better coexistence. We concluded that art education comprises a lasting learning process that guarantees a healthy environment for peaceful coexistence, which today, inclusive teachers, parents, and students should keep in mind.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.13.2.779
Pages: 779-793
cloud_download 206
visibility 391
0
Article Metrics
Views
206
Download
391
Citations
Crossref
0

Scopus

Measuring Interest: Development and Application of a Three-Dimensional Situational Interest Short Scale

components of interest scale development situational interest situational interest short scale

Matthias Winfried Kleespies , Annette Scheersoi , Paul Wilhelm Dierkes , Volker Wenzel


...

Situational interest is an important factor that has a great influence on learning success in both in-school and out-of-school learning situations. Although there has been extensive research on interest in its diverse forms for decades, an evaluated measurement instrument for situational interest that covers the three theoretically defined components of interest (emotional, cognitive, value-related) is still missing. Therefore, in this study, based on person-object theory of interest, a short scale was developed that can be used in a variety of learning programs independent of content or methods. In study 1, eight suitable items were selected and their structure was examined using exploratory methods. In study 2, the results of study 1 were verified using confirmatory factor analyses. Study 3 shows an example of a practical application of the newly developed scale in two different learning settings. The findings provide evidence that the scale developed here is a practical instrument to measure situational interest taking into account all its components. On the one hand, the scale can help teachers evaluate their educational programs; on the other hand, it can be used by researchers to empirically investigate the construct of interest. Thus, the scale makes an important contribution to research and practice.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.13.2.795
Pages: 795-811
cloud_download 219
visibility 335
0
Article Metrics
Views
219
Download
335
Citations
Crossref
0

Scopus

The Influence of a Robotics Program on Students’ Attitudes Toward Effective Communication

attitude effective communication robotics students

Sabariah Sharif , Thiwagar Muniandy , Muralindran Mariappan


...

This research aimed to explore the influence of a robotic program using the robot kit "RoboBuilder RQ+110" on students' attitudes toward effective communication. The study used a quantitative research design and involved 475 grade 4 (10 years old) students from Malaysia's Selangor and Malacca states. A quasi-experimental research (pre-test & post-test) approach with control and experimental groups was adopted, and the data were analyzed with inferential statistical test and repeated measures analysis of variance (ANOVA) using SPSS 25 software at 0.05 significance level. Questionnaires were administered to collect data from the experimental and control groups. The results showed statistically significant changes (α ≤ .05) in attitudes toward effective communication for the experimental group that received a robotics program compared with the control group. The study results suggest that innovative technological tools or programs such as robotics programs are recommended as innovative science, technology, engineering, and mathematics (STEM) program rooted in constructivism to improve students' attitudes toward effective communication.

description Abstract
visibility View cloud_download PDF
10.12973/eu-jer.13.3.1171
Pages: 1171-1184
cloud_download 108
visibility 248
0
Article Metrics
Views
108
Download
248
Citations
Crossref
0

Scopus
0

...