This study is conducted to develop the diagnostic test, which can be used to measure the higher-order thinking skill (HOTs) of students of first-grade senior high school in Bima district, West Nusa Tenggara. The step of developing instruments such as test which using modification model of Oreondo which include two activities such as test designing and test trials. The analysing technique of validity of content used Aiken formula, classical test theory used software Iteman 4.3, the model of Rasch used software Winstep and analysing reliability used software SPSS. The conclusion which can be taken are developing instrument has the characteristics as a useful instrument and fulfil requirement used to measure. This case proved from the data of analysis result which confirm that the instrument has been achieved the content of validity by expert judgment and obtained the empirical evidence, both as classical test theory or Rasch model.

Environmental learning in the 21st century requires students to have Higher Order Thinking Skills (HOTS). The purpose of this study was to measure HOTS students using Higher Order Thinking Skills Assessment based on Environmental Problem (HOTS-AEP). The research method used in this study was descriptive method with a total sample of 248 students consisting of Elementary School (ES), Junior High School (JHS), Bachelor Program (BP), and Master Program (MP). The results showed that students overall have a very low HOTS category. HOTS scores scale of 0-100 on ES (22.3) are still higher than JHS (20.2). Whereas at the university level, BP scores (19.9) are lower than MP (21.4). This showed that learning must be oriented towards increasing HOTS through various media development learning, learning materials, learning models, and strategies. This study concludes that the HOTS score of students was still very low and needs to be improved.

The Computer has occupied a comprehensive coverage, especially in education scopes, including in learning-teaching processes, testing, and evaluating. This research aimed to develop computerized adaptive testing (CAT) to measure physics higher-order thinking skills (HOTS), namely PhysTHOTS-CAT. The Research Development used the 4-D developmental model carrying the four phases of define, design, development, and dissemination (4D) developed by Thiagarajan. This testing instrument can give the item test based on the student’s abilities. The research phases include (1) needs analysis and definition, (2) development design (3) development of CAT and assemble the test items into CAT, (4) validation by experts, and (5) feasibility try-out. The findings show that PhysTHOTS-CAT is valid to measure physics HOTS of the 10th-grade students of Senior High School according to 82.28% of teachers and students assessment on PhysTHOTS-CAT content and media. Therefore, it can conclude that PhysTHOTS-CAT can be used and feasible to measure physics HOTS of the 10th-grade students of the Senior High School.

The empowerment of metacognitive skills has an important role in increasing the capacity of critical thinking and active control of students' cognitive processes in learning. Metacognitive skills can be enhanced through the implementation of learning strategies involving higher-order thinking. The RQA, ADI, RQA integrated with ADI are constructivistic learning strategies that can accommodate these skills. The researches specifically examining the correlation between metacognitive skills and critical thinking skills at the implementation of RQA, ADI, and RQA integrated with ADI learning strategies are still rarely found. This research is a correlational research, aiming at revealing the correlation between metacognitive skills and critical thinking skills. The data of metacognitive skills and critical thinking skills are collected by using a valid and reliable essay test. The samples of this research are the fourth semester (IV) biology education students programming Animal Physiology course in the 2016/2017 academic year consisting of 109 students. The results of this research show that (1) there was a significant correlation between metacognitive skills and critical thinking skills at the implementation of the four learning strategies, (2) the regression equations analyzed using Anova obtain regression lines (not coincide), and non parallel regression lines (intersected); meaning that there is a difference in the increase rate and magnitude of the critical thinking skills influenced by the four learning strategies. It is expected that the teachers and the lecturers always strive to improve the quality of the learning process through the implementation of active and constructive learning strategies.

Environmental learning in the 21st century must be contextual and require the ability of Higher Order Thinking Skills (HOTS) to solve environmental problems such as green consumerism. The purpose of this study was to implement an Android-based Supplementary Book of Green Consumerism (SBGC) to improve students' HOTS abilities in environmental learning. The method used experiment with a sample of 144 students in 8th grade of Junior High School. Students divided into 72 students in control classes and 72 students in experimental classes. The treatment given was in the form of using SBGC in the experimental classes. The results showed that the students HOTS score increased significantly in the pre-post test in the experimental class or when compared to the control class. Increased in the experimental classes from a score 15.7 (very low) to 32.73 (low). Meanwhile, when compared between the experimental classes with a score 32.73 (low) and control classes with a score 25.25 (very low). This showed that SBGC is easy to understand. SBGC is also interesting so that makes students become active in learning. The conclusion of this study was that SBGC can increased students' HOTS in environmental learning.

This research aims to develop open ended-based worksheet in improving students' high-level thinking skills on static fluid materials. The method used in this research is Research and Development (R&D) with 3 steps namely, the initial stage, then the design and development of the product, and finally the product testing. The data analysis technique for product effectiveness is with the main field trials, namely (1) N-gain analysis, (2) paired t-test, (3) ANCOVA, and finally (4) effect size test. From the test results obtained information that conducted 10 students showed the results of the development worksheets obtained the average worth of development products by 90% this value is included in the very high category, while the student response of the average of 88% and also the readability response of 89% in the very high category. In the results of the n-gain analysis also show the value is0.70, that mean medium category. From the results of this study, it can be concluded that worksheets based on open ended can improve students' higher-order thinking skills. So, in further development we suggest that open ended-based on worksheet is not only applied to static fluid material, but also in other materials.

This research aims to find out: (1) the more effective learning model on students' divergent-thinking skills; (2) the better adversity quotient on students' divergent-thinking skills; (3) the better adversity quotient to improve students' divergent-thinking skills in each learning model; and (4) the better learning model to improve students' divergent-thinking skills in each adversity quotient. This research uses a quantitative approach with a quasi-experimental type. The fifth-grade students were selected as the research subjects. This research was carried out at the public elementary schools in Laweyan District, Surakarta, Indonesia. Test and questionnaire techniques were used to collect data. The data analysis was performed with the analysis prerequisite, hypothesis, and multiple-comparison tests. The results showed that the learning model and adversity quotient have an influence on divergent-thinking skills; for each adversity quotient, the thinking actively in a social context learning model is better than the creative problem solving and direct instruction learning model; the creative problem solving learning model is better than the direct instruction learning model; and adversity quotient of the climbers is better than that of the campers and the adversity quotient of the campers is better than that of the quitters in each learning model.

This study aims to design mathematical literacy instruments that have evidence of content and construct validity and are reliable for use as an Assessment for Learning. The research involved eight experts as instrument validators and 273 eighth-grade students of junior high school in Yogyakarta Province. The results showed that the ten mathematical literacy items developed had the V Aiken coefficient index calculated from 0.781 to 0.906 (> 0.75). The results of adequacy testing of samples with KMO and Bartlett show Chi-Square in the Bartlett test of 608,608, the p-value <0.05 and KMO value of 0.781 (> 0.5). The results of testing of the measurement model with Confirmatory Factor Analysis (CFA) produce a Root Mean Square Error of Approach (RMSEA) value of 0.049 (≤ 0.08), chi-s Square of 33.92 (<2df), the p-value of 0.05004 (≥ 0.05). Nine out of the ten items developed had t-value> 1.96, Standardized Loading Factor (SLF) was greater than the critical limit (> 0.3), and Construct Reliability (CR) of 0.78 (> 0.7). It can be concluded that the developed mathematical literacy instrument can measure what must be measured and nine items significantly reflect the construct or latent variable, as well as the level of consistency of a good score.

This study was intended to display the role of eco-school program (Adiwiyata) towards environtmental literacy (EL) of high school students by analyzing, (a) EL of students in Adiwiyata and non-Adiwiyata high schools, and (b) EL of students in Grade X and XI, Adiwiya and non-Adiwiyata high schools in Malang-East Java, Indonesia. The survey involved 275 students. The respondents were from four state high school i.e. SMAN 1, SMAN 3, SMAN 4, and SMAN 7. Data were taken via MSELS questionnaire that was modified and filled online. Aspects of EL include ecological knowledge, environmental affect, cognitive skills, and behavior. The results of multivariate analysis showed that the level of students’ EL was significantly influenced by school type and grade. However, the interaction both of them had no significant effect on their EL. Univariate results on school type factor informed that significant differences occured in all aspects of EL, where the lower identified level of students in Adiwiyata schools compared to Non-Adiwiyata was only in the environmental affect. On the other hand, the significant influence of grade level only occurred in cognitive skills aspect. Broadly speaking, all data analyzes concluded that the application of the Adiwiyata program was able to bring a positive impact on the level of students’ EL. There was also a tendency that the higher the student's grade, the better their EL level.

Environmental learning in the 21st century requires a high level of thinking ability, especially to solve environmental problems when COVID-19 pandemic. This was to develop a new level of thinking, namely Higher Order Thinking Skills of Environmental Problem (HOTSEP) which is a revision of Anderson's Taxonomy. The purpose of this study was to measure students HOTSEP in the context of environmental problems related to COVID-19. The research method used in this research was descriptive. The sample used 277 university students from several cities in Indonesia. The instrument used HOTSEP which has 3 categories of thinking level start from develop innovation about environment (C6), solve environmental problem (C5), criticize environmental problem (C4). The results showed that students HOTSEP were still in the very low category (33.64). This study concludes that the HOTSEP of students was still low and needs to be improved to the understanding of COVID-19 concept in environmental learning. Suggestion for further research was HOTSEP need to implement in school or university for several environmental learning topics in many subjects/courses start from Natural Science, Social Science, Engineering, and others relevant subject. HOTSEP can be measured not only in school or university, HOTSEP can be implement in community and public.

New Inquiry-Based Learning (NIBL) was developed to improve students’ multiple higher-order thinking skills (MHOTS), such as thinking critically, analytically, creatively, and practically (CACP). This study aimed to examine the increase of students’ MHOTS ability, their perceptions of the NIBL model, and the contribution of the NIBL model to the learning outcomes.  A quasi-experiment of the nonequivalent control group design was implemented in this study. Research subjects were university students majoring in chemistry education and enrolling in the Organic Chemistry course. The experiment and the control groups consisted of 34 and 32 students, respectively. The collected data were analyzed by using t-test and ANCOVA procedures. N-Gain scores were calculated to measure the differences in the increase in learning outcomes. Eta square values measured the contribution of NIBL. The results of this study revealed that there were differences in the learning outcomes of the experiment and control group. The CACP thinking skills and the mastery of organic chemistry concepts of the experiment group increased significantly. The N-Gain scores of practical thinking skills aspect were on medium category, and for critical, analytical, and creative thinking, as well as for mastery of organic chemistry concepts were on high categories. For the control group, the N-Gain scores of all categories were on low or medium categories. The NIBL model effectively improved the prospective chemistry teachers’ M-HOTS in terms of CACP thinking skills and contributed significantly to the increase in the students’ mastery of organic chemistry concepts.

Metacognition in science teaching involves processes that include self-awareness and self-regulation. Metacognition enables the teachers to facilitate student learning and to reflect on their teaching in order to enable themselves to improve or to make any changes to their teaching. In particular, teaching activities, especially in the 21st century, do not merely involve the transfer of knowledge and then applying that knowledge into daily life, but teachers need to reflect, plan and evaluate learning outcomes to enhance further in teaching. This study attempts to gain the perspective and implementation of metacognition skills in teaching science in the primary school classroom. The data was collected through a qualitative research method based on interviews with six science teachers in primary school using semi-structured interview protocol. The interview data were analysed for emerging themes, guided by the research questions. Teachers have a similar perspective of the understanding of metacognition in science teaching. Further discussion focuses on the implementation of metacognition in science teaching. This discussion is divided into three aspects, which are constraints faced, overcoming the constraints, and efforts made to implement metacognition in science teaching. Hence, the understanding of science teachers in regards to metacognition in science teaching is important and gives a positive impact towards teaching and learning in primary science teaching.

This study was conducted to determine the effectiveness of virtual laboratory based on semi second life (s-SL) on higher order thinking skills of general senior secondary school in chemistry learning process. The research design was adopted posttest-only design approach to a quasi-experimental. This study was conducted in the one of public general senior secondary school in 3T regions – Bangkalan City – one of the cities in East Java Province, Indonesia. There were 81 students in the grade 11 of natural science who involved in this study. The participants were divided into three groups, namely the students who did practical work by demonstration methods in chemistry real laboratory, the students who did practical work by experiment methods in virtual laboratory based on s-SL, and the students who did practical work by combination both of them (demonstration methods in chemistry real laboratory and experiment methods in virtual laboratory based on s-SL). The students in each group was tested by posttest of higher order thinking skills. The data was analysed with one-way ANOVA. The results of data analysis shows that there is a significance difference of each groups. Virtual laboratory based on s-SL has enough effect on the students’ higher order thinking skills.

The objective of this research is to analyze the twelfth graders' mathematics critical thinking skills using a mathematics learning model to stimulate fundamental critical thinking abilities of science courses in SMA Negeri, Pacitan Regency, East Java Province, Indonesia. This quasi-experimental research design was used in this study with one group posttest only design using multiple substantive posttests. The sample of 141 students from the total population of six public schools involving the twelfth graders of the natural sciences was selected through purposive sampling technique, data were taken through tests of students' critical thinking skills and interviews. The data analysis consists of five stages, namely an analysis of one sample t-test, an analysis of students' grades, an analysis of problem-solving stages, an analysis of critical thinking abilities indicators, and an analysis of mathematics critical thinking abilities indicators. The results showed (1) The results of the one sample t-test show that the mathematics learning model is effective to stimulate critical thinking, which means that the application of the mathematics learning model is effective to stimulate critical thinking; (2) the overall grades of students that met the minimum mastery criteria; (3) the data analysis of eleven problem-solving stages proves that the criteria for critical thinking abilities are categorized as good and very good. The highest score indicator considers the principle and definition of transformation, while the lowest grade indicator is mainly concerned with the questions on right and coherent steps; (4) the critical thinking skills have seven indicators that highlight the criteria of students' critical thinking abilities categorized as good and very good. The indicators that get the highest score determine the definitions of terms, while the indicators of the lowest score determine the action; (5) the results of the analysis show indicators of mathematics critical thinking skills that have eight indicators. The criteria of students' critical thinking abilities met good and very good categories along with indicators with the highest value score by considering the definitions of terms, while the indicators of the lowest score deal with the habit of caution.

Considering the low achievement of Indonesian students in international studies (PISA), which measures Higher-Order Thinking Skill (HOTS) in solving the problem, improving the quality of mathematics learning in Indonesia is very important. The purpose of this research was conducted to explore the variations in students’ learning strategies and students’ Self–Regulated Learning (SRL) in solving mathematical HOT problems. The study employed a mixed-method, namely quantitative and qualitative methods were applied through five tests and seven interviews for over eight weeks. Two types of instruments were employed in this study, and they include tests and interviews. At the initial stage, we randomly selected 30 students from all those in grade 10 (Senior High School ), after which 12 were chosen purposively after the pre-test for an interview, having satisfied all complete group, middle group, and lower group. All of them were treated using metacognitive questions. Data analysis techniques used were percentage, data reduction, presentation, and conclusion. The quantitative results showed the students could generally use orientation, organization, and elaboration learning strategies as observed with 68.3%, 60%, and 56.7% for complete, middle, and lower groups. Moreover, the students were also observed to have conducted three cognitive processes in selecting the rules for solving the mathematical HOT problem, namely using models and drawing, written texts, and combining both. Furthermore, their final solution failures were affected by their misconceptions and errors in creating the mathematical model. The interview results on designing the learning procedures, monitoring the progress, and evaluating the outcomes, show that the students’ SRL level is good for complete (89.3%), middle (75%), and lower groups (60.7%).

The aim of this study is to find out the influence of online project collaborative learning and achievement motivation on problem-solving ability in the area of citizenship. This study uses a quasi-experimental design. The total of study subjects is 71 students of higher education; consist of 36 students as the experimental group and 35 students as the control group. Data of problem-solving ability is obtained by using an essay test, while data of achievement motivation is obtained by using a questionnaire. Data analysis is done with ANOVA (Analysis of Variance). The study results show that online based-project collaborative learning strategy has a positive influence on civic problem-solving ability. There is a difference in civic problem-solving ability between students with high achievement motivation and students with low achievement motivation. Online project collaborative learning strategy and achievement motivation interact in influencing the civic problem-solving ability of students. It is recommended that further study corroborate this finding by testing again the effectiveness of using online-based project collaborative strategy in the aspect of problem-solving in a similar field of study.

Creative thinking skills are 21st century learning needs that can be applied through the Scientific Reading Based Project (SRBP) model. The purpose of this study is to empower creative thinking skills through SRBP models in science learning in elementary school teachers’ education students. This research is mixed research with qualitative and quantitative approaches. Qualitative research is used to explore students' creative thinking abilities. Quantitative research uses a quasi-experimental approach carried out for six months on the candidates of elementary school teachers’ education. Participants in this study were the candidate of elementary school teachers’ education of 75 people who took the Basic Concept of Science subject. Data collection in this study was through observation, documentation, pre-test, and post-test with essay questions to measure creative thinking skills. The final result of the project is the final product to measure creativity. The data analysis used was an ANOVA test to measure every aspect of creative thinking skill. Qualitative analysis was used to describe the learning process and the final project of creativity. The results showed that there was an increase in creative thinking skills from aspects of flexibility, elaboration, fluency and originality. The SRBP model has a positive effect on improving the ability to think creatively.

While previous studies on assessments focused on measurement of principles and constructs, existing attention is given to content validation involving vocational education and skills. The emphasis on content validation has prompted a holistic perspective of teaching and learning to demand alternative research approaches. Using evidence of content validity based on expert judgment and assessment items, this paper argues that vocational knowledge and skills could be determined via constructs and construct functions. Content validity analysis was studied in two major phases, namely, through an assessment of an electrical technology course at a Malaysian higher education institution and expert panels’ examination of items. It was found that to increase confidence in providing reliable instruments for future empirical studies, a careful process in item development and content validity analysis was considered important. Therefore, applying these findings on item analysis and expert panels to reflect content validity can enhance the validity of assessment items.

The Coronavirus disease (COVID-19) pandemic outbreak in the Indonesians nowadays, the public education department established the policy of the online education system to all education levels. Most educators employ an online flipped learning method to support the policy. Research aimed to measure the effect of online based-flipped classroom learning between using Microsoft Team and WhatsApp and student engagement on reading comprehension skills. The research approach was a quasi-experimental model with a 2 x 3 factorial pre-test-post-test non-equivalent control group design. The sample of this investigation was early period undergraduates of the management economics study program. Data analysis employed a two-way ANOVA test. The result confirmed that the online flipped learning scheme using Microsoft Team was better than WhatsApp in improving student engagement and reading comprehension skills. We advise English lecturers to apply better online media services, pay attention to the completeness of the learning features and train their competence in implementing distance learning to use compatible synchronous flipped classroom teaching based on internet technologies.

In recent years, integrating technology into education continues to attract more attention along with the rapid growth of information and communication technology. In the literature, teachers’ technological pedagogical content knowledge (TPACK) plays an essential role in successfully integrating technology into teaching and learning contexts. This study aims to provide a comprehensive view of prior literature and some possible directions for researchers and educators for further TPACK studies. A total of 106 papers were chosen from the Springer database and synthesized. Frequency of annual publications, number of documents with and without TPACK in the title, research methods, number of authors, major contributed countries, most cited papers, and most productive journals in TPACK research were reviewed. The results showed that TPACK has continued to receive attention from researchers in the past decade. Among the reviewed publications, each of the 53 documents included the term TPACK in the title and abstract. To date, qualitative methods were more frequently adopted in TPACK research than quantitative, mixed, and non-empirical methods. Most papers published in TPACK research have two authors. When ranked by country, the US has the highest contribution compared to other countries in this field, followed by Turkey, Australia, Singapore, and Taiwan. The authors with the most cited papers were Min-Hsien Lee and Chin-Chung Tsai with 210 citations. Based on the number of articles published in TPACK, The Asia-Pacific Education Researcher and TechTrends seemed to be the most contributing journal in this field.