UTBK-Based Higher Order Thinking Skills (HOTS) Test Instruments on Reaction Rate Topic
DOI:
https://doi.org/10.23887/jpiundiksha.v11i4.52595Keywords:
HOTS, bloom's taxonomy, test instrument, reaction rateAbstract
One of the efforts that can be support students in developing 21st century skills is to implement learning based on 21st century skills. In addition, another alternative that can be taken is to create, direct, and provide HOTS-based test instruments as an evaluation of learning. This study aims to develop multiple choice test instruments and essays to measure learners' Higher Order Thinking Skills (HOTS) on reaction rate materials. This research uses the Research and Development (R & D) method with the ADDIE (Analysis, Design, Development, Implementation, and Evaluation) development model. The respondents in the study were 150 students of class XII MIPA one of the high schools who had received learning material on reaction rate. The results of the validity of the product contents show that the question instrument is 92.01% valid with an excellent category. The results of empirical validity show that as many as 20 items of multiple-choice questions and 8 items of essay questions are valid and have high reliability with Cronbach Alpha scores of multiple-choice questions of 0.723 and essay questions of 0.736. The difference between the question items from the two types of questions is categorized very well with 20 items of multiple-choice questions categorized as moderate, while in essay questions, 1 question is categorized as easy and 7 questions are categorized as moderate. Furthermore, the question instruments that have been developed can be used to measure the HOTS of students.
References
Afandi, A., Sajidan, S., Akhyar, M., & Suryani, N. (2018). Pre-Service Science Teachers’ Perception About High Order Thinking Skills (HOTS) in the 21st Century. International Journal of Pedagogy and Teacher Education, 2(1), 107. https://doi.org/10.20961/ijpte.v2i1.18254.
Afriani, A., Setyarini, M., & Efkar, T. (2018). Pengembangan Instrumen Asesmen Pengetahuan Berbasis HOTS pada Materi Elektrolit dan Non Elektrolit. Jurnal Pendidikan Dan Pembelajaran Kimia (JPPK), 7(2), 1–12. http://jurnal.fkip.unila.ac.id/index.php/JPK/article/view/16107.
Aldoobie, N. (2015). ADDIE Model. American International Journal of Contemporary Research, 5(6). www.aijcrnet.com/journals/Vol_5_No_6_December_2015/10.pdf.
Amran, A., Perkasa, M., Satriawan, M., Jasin, I., & Irwansyah, M. (2019). Assessing students 21st century attitude and environmental awareness: Promoting education for sustainable development through science education. Journal of Physics: Conference Series, 1157(2). https://doi.org/10.1088/1742-6596/1157/2/022025.
Anderson, L. W., Krathwohl Peter W Airasian, D. R., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M. C. (2001). A Taxonomy for Learning, Teaching, and Assessing. A Revision of Bloom’s Taxonomy of Educational Objectives (Abridged E). Ney York: Longman.
Arikunto, & Suharsimi. (2009). Dasar-dasar evaluasi pendidikan. PT Bumi Aksara.
Aslamiah, A., Abbas, E. W., & Mutiani, M. (2021). 21st-Century Skills and Social Studies Education. The Innovation of Social Studies Journal, 2(2), 82. https://doi.org/10.20527/iis.v2i2.3066.
Brookhart, S. M. (2010). Assess Thinking Higher-Order Skills in Your Classroom.
Chalkiadaki, A. (2018). A systematic literature review of 21st century skills and competencies in primary education. International Journal of Instruction, 11(3), 1–16. https://doi.org/10.12973/iji.2018.1131a.
Chamisah. (2017). TIMSS and PISA-How They Help The Improvement of Education Assessment in Indonesia. Conference Proceedings ARICIS I, 42–56. https://doi.org/10.22373/aricis.v1i0.935
Creswell, J. W. (2013). Educational Research Planning, Conducting, and Evaluating Quantittaive and Qualitative Research (Fourth Edi). Pearson.
Damaianti, V. S., Abidin, Y., & Rahma, R. (2020). Higher order thinking skills-based reading literacy assessment instrument: An Indonesian context. Indonesian Journal of Applied Linguistics, 10(2). https://doi.org/10.17509/ijal.v10i2.28600.
Danczak, S. M., Thompson, C. D., & Overton, T. L. (2020). Development and validation of an instrument to measure undergraduate chemistry students’ critical thinking skills. Chemistry Education Research and Practice, 21(1), 62–78. https://doi.org/10.1039/C8RP00130H.
Dinni, H. N. (2018). Pengembangan Mutu Pendidikan Menuju Era Global: Penguatan Mutu Pembelajaran dengan Penerapan HOTS (High Order Thinking Skills). PRISMA I, 1, 170–176. https://journal.unnes.ac.id/sju/index.php/prisma/article/view/19597.
Fadillah, A., & Ni’mah. (2019). Analisis literasi matematika siswa dalam memecahkan soal matematika PISA konten change and relationship. JTAM (Jurnal Teori Dan Aplikasi Matematika), 3(2), 127–131. https://doi.org/10.31764/jtam.v3i2.1035.
Ghani, I. B. A., Ibrahim, N. H., Yahaya, N. A., & Surif, J. (2017). Enhancing students’ HOTS in laboratory educational activity by using concept map as an alternative assessment tool. Chemistry Education Research and Practice, 18(4), 849–874. https://doi.org/10.1039/c7rp00120g.
Hairida. (2017). Pengembanagan Instrumen untuk Mengukur Self Efficacy Siswa dalam Pembelajaran Kimia. EDUSAINS, 9(1), 53–59. https://www.neliti.com/publications/177946/pengembangan-instrumen-untuk-mengukur-self-efficacy-siswa-dalam-pembelajaran-kim.
Hakimah, N., Muchson, M., Herunata, H., Permatasari, M. B., & Santoso, A. (2021). Identification student misconceptions on reaction rate using a Google forms three-tier tests. AIP Conference Proceedings, 2330(March). https://doi.org/10.1063/5.0043114.
Handayanti, Y., Setiabudi, A., & Nahadi, N. (2015). Analisis Profil Model Mental Siswa Sma Pada Materi Laju Reaksi. Jurnal Penelitian Dan Pembelajaran IPA, 1(1), 107. https://doi.org/10.30870/jppi.v1i1.329.
Harta, J., Rasuh, N. T., & Seriang, A. (2020). Using HOTS-Based Chemistry National Exam Questions to Map the Analytical Abilities of Senior High School Students. Journal of Science Learning, 3(3), 143–148. https://doi.org/10.17509/jsl.v3i3.22387.
Heong, Y. M., Yunos, J. M., Othman, W., Hassan, R., Kiong, T. T., & Mohamad, M. M. (2012). The Needs Analysis of Learning Higher Order Thinking Skills for Generating Ideas. Procedia - Social and Behavioral Sciences, 59, 197–203. https://doi.org/10.1016/j.sbspro.2012.09.265.
Ichsan, I. Z., Hasanah, R., Ristanto, R. H., Rusdi, R., Cahapay, M. B., Widiyawati, Y., & Rahman, M. M. (2020). Designing an Innovative Assessment of HOTS in the Science Learning for the 21st Century. Jurnal Penelitian Dan Pembelajaran IPA, 6(2), 211. https://doi.org/10.30870/jppi.v6i2.4765.
Jusniar, J., Effendy, E., Budiasih, E., & Sutrisno, S. (2020). Misconceptions in rate of reaction and their impact on misconceptions in chemical equilibrium. European Journal of Educational Research, 9(4), 1405–1423. https://doi.org/10.12973/eu-jer.9.4.1405.
Kamin, Y., Chinedu, C. ., & Olabiyi, O. . (2015). Strategies for Improving Higher Order Thinking Skills in Teaching and Learning of Design and Technology Education. Journal of Technical Education and Training, 7(2), 35–43. https://publisher.uthm.edu.my/ojs/index.php/JTET/article/view/1081.
Klosterman, M. L., & Sadler, T. D. (2010). Multi-level assessment of scientific content knowledge gains associated with socioscientific issues-based instruction. International Journal of Science Education, 32(8), 1017–1043. https://doi.org/10.1080/09500690902894512.
Kusuma, M. D., Rosidin, U., Abdurrahman, A., & Suyatna, A. (2017). The Development of Higher Order Thinking Skill (Hots) Instrument Assessment In Physics Study. IOSR Journal of Research & Method in Education (IOSRJRME), 07(01), 26–32. https://doi.org/10.9790/7388-0701052632.
Lai, E. R., & Viering, M. (2012). Assessing 21 st Century Skills : Integrating Research Findings National Council on Measurement in Education. Pearson, April, 1–67. https://eric.ed.gov/?id=ED577778.
Laliyo, L. A. R., Botutihe, D. N., & Panigoro, C. (2019). The Development of Two-Tier Instrument Based On Distractor to Assess Conceptual Understanding Level and Student Misconceptions in Explaining Redox Reactions. International Journal of Learning, Teaching and Educational Research, 18(9), 216–237. https://doi.org/10.26803/ijlter.18.9.12.
Lee, J., & Choi, H. (2017). What affects learner’s higher-order thinking in technology-enhanced learning environments? The effects of learner factors. Computers and Education, 115, 143–152. https://doi.org/10.1016/j.compedu.2017.06.015.
Mahanal, S. (2019). Asesmen Keterampilan Berpikir Tingkat Tinggi. Jurnal Penelitian Dan Pengkajian Ilmu Pendidikan: E-Saintika, 3(2), 51. https://doi.org/10.36312/e-saintika.v3i2.128.
Narayanan, S., & Adithan, M. (2015). Analysis Of Question Papers In Engineering Courses With Respect To Hots (Higher Order Thinking Skills). American Journal of Engineering Education (AJEE), 6(1), 1–10. https://doi.org/10.19030/ajee.v6i1.9247.
Novatania, D. W., & Kamaludin, A. (2021). Development of High Order Thinking Skills (HOTS) Test Instruments on Thermochemistry Topics. JTK (Jurnal Tadris Kimiya), 6(2), 174–184. https://doi.org/10.15575/jtk.v6i2.12746.
Nugraha, V. D., Muntholib, M., Joharmawan, R., Parlan, P., Yahmin, Y., & Su’Aidy, M. (2020). The development of the acid-base chemistry test oriented to higher order thinking skills for 11th grade students. AIP Conference Proceedings, 2215(April). https://doi.org/10.1063/5.0000546.
Ramdani, A., Jufri, A. W., Gunawan, G., Hadisaputra, S., & Zulkifli, L. (2019). Pengembangan Alat Evaluasi Pembelajaran Ipa Yang Mendukung Keterampilan Abad 21. Jurnal Penelitian Pendidikan IPA, 5(1). https://doi.org/10.29303/jppipa.v5i1.221.
Redhana, I. W. (2019). Mengembangkan Keterampilan Abad Ke-21 Dalam Pembelajaran Kimia. Jurnal Inovasi Pendidikan Kimia, 13(1). https://journal.unnes.ac.id/nju/index.php/JIPK/article/view/17824.
Reza, M., Puspita, K., & Oktaviani, C. (2021). Quantitative Analysis Towards Higher Order Thinking Skills of Chemistry Multiple Choice Questions for University Admission. Jurnal IPA & Pembelajaran IPA, 5(2), 172–185. https://doi.org/10.24815/jipi.v5i2.20508.
Rintayati, P., Lukitasari, H., & Syawaludin, A. (2020). Development of Two-Tier Multiple Choice Test to Assess Indonesian Elementary Students’ Higher-Order Thinking Skills. International Journal of Instruction, 14(1), 555–566. https://doi.org/10.29333/IJI.2021.14133A.
Sarah, F., Khaldun, I., & Gani, A. (2021). The Development Higher Order Thinking Skill (Hots) As Questions In Chemistry Study (Solubility And Solubility Product Constant). Jurnal Pendidikan Sains (Jps), 9(1), 51. https://doi.org/10.26714/jps.9.1.2021.51-60.
Sepriyanti, N., Nelwati, S., Kustati, M., & Afriadi, J. (2022). The Effect Of 21st-Century Learning On Higher-Order Thinking Skills (HOTS) And Numerical Literacy Of Science Studnts In Indonesia Based On Gender. 11(2), 314–321. https://doi.org/10.15294/jpii.v11i2.36384.
Sugiyono, P. (2017). Statistik untuk Penelitian. CV. ALFABETA.
Sulaiman, J., & Ismail, S. N. (2020). Teacher competence and 21st century skills in transformation schools 2025 (TS25). Universal Journal of Educational Research, 8(8), 3536–3544. https://doi.org/10.13189/ujer.2020.080829.
Susiaty, U. D., & Oktaviana, D. (2019). Analisis Kebutuhan Instrumen Tes Berdasarkan Revisi Taksonomi Bloom Untuk Mengukur Higher Order Thinking Skills Siswa. Proceedings of the 1st ICOLED – IKIP-PGRI Pontianak, 171–178. https://pbing.org/wp-content/uploads/2020/04/20192-0completebook.pdf#page=181.
Widiyawati, Y., Nurwahidah, I., & Sari, D. S. (2019). Pengembangan Instrumen Integrated Science Test Tipe Pilihan Ganda Beralasan Untuk Mengukur HOTS Peserta Didik. Saintifika, 21(2), 1–14. https://core.ac.uk/download/pdf/297204372.pdf.
Widyaningsih, S. W., Yusuf, I., Prasetyo, Z. K., & Istiyono, E. (2021). The development of the hots test of physics based on modern test theory: Question modeling through e-learning of moodle lms. International Journal of Instruction, 14(4), 51–68. https://doi.org/10.29333/iji.2021.1444a.
Yan, Y. K., & Subramaniam, R. (2018). Using a multi-tier diagnostic test to explore the nature of students’ alternative conceptions on reaction kinetics. Chemistry Education Research and Practice, 19(1), 213–226. https://doi.org/10.1039/C7RP00143F.
Downloads
Published
Issue
Section
License
Copyright (c) 2022 Zelen Surya Minata Minata, Nur Indah Agustina, Annida Elfiana Citra Ardianty, Sri Rahayu, Muntholib
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with the Jurnal Pendidikan Indnesia agree to the following terms:
- Authors retain copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work. (See The Effect of Open Access)
