Validity of Items and Spurious Overlap (ESO) Effects Unidimensionally and Multidimensionally (A Study of the Effects of Spurious Overlap on the Test of Logical Thinking Ability
DOI:
https://doi.org/10.23887/jere.v8i1.75209Keywords:
Item Validity, Spurious Overlap, Unidimensionality, Multidimensionality, Logical Thinking AbilityAbstract
At the junior high school level, there are still very few standardized tests of logical thinking abilities that can be used to measure students' logical thinking abilities. This research aims to analyze the validity of items and the effect of spurious overlap (ESO) unidimensionally and multidimensionally (a study of the effect of spurious overlap on tests of logical thinking abilities. This research is a type of instrument calibration research. The population of this research is all students of class VIII at junior high school, with the sample in the form of answers from 100 students’ selected using purposive sampling. Data collection method using tests. The results of data analysis obtained findings from testing the validity of unidimensional logical thinking ability test items before being corrected for the spurious overlap effect; 49 items were suitable for use as part of the test, and testing the validity of the multidimensional logical thinking ability test items before being corrected for the spurious overlap effect, 49 items are suitable for use as test constructors, in the unidimensional test of item validity after being corrected for the spurious overlap effect, 47 items are suitable for use as test constructors; and testing the validity of the multidimensional logical thinking ability test items before being corrected for the spurious overlap effect, 45 items are suitable to be used as test components, and the unidimensional ESO coefficient is smaller when compared to the multidimensional ESO coefficient of the items that make up the logical thinking ability test.
References
Abate, T., Michael, K., & Angell, C. (2020). Assessment of scientific reasoning: Development and validation of scientific reasoning assessment tool. EURASIA Journal of Mathematics, Science and Technology Education, 16(12). https://doi.org/10.29333/ejmste/9353.
Agung, A. A. G. (2018). Metodologi Penelitian Kuantitatif (Perspektif Manajemen Pendidikan). Universitas Pendidikan Ganesha.
Bashooir, K., & Supahar, S. (2018). Validitas dan reliabilitas instrumen asesmen kinerja literasi sains pelajaran fisika berbasis STEM. Jurnal Penelitian Dan Evaluasi Pendidikan, 22(2), 219–230. https://doi.org/10.21831/pep.v22i2.19590.
Baskara, G. W., & Yudiana, K. (2021). Tes Tertulis Berbasis HOTS pada Pembelajaran IPA Menggunakan Google Form Siswa Kelas IV SD. Mimbar PGSD Undiksha, 9(3), 416–423. https://doi.org/10.23887/jjpgsd.v9i3.39223.
Bhaw, N., Kriek, J., & Lemmer, M. (2023). Insights from coherence in students’ scientific reasoning skills. Heliyon, 9(7), e17349. https://doi.org/10.1016/j.heliyon.2023.e17349.
Darmayasa, I. K., Jampel, N., & Simamora, A. (2018). Pengembangan E-Modul Ipa Berorientasi Pendidikan Karakter Di Smp Negeri 1 Singaraja. Jurnal Edutech, 6(1), 53–65. https://doi.org/10.23887/jeu.v6i1.20267.
Erfan, M., Maulyda, M. A., Hidayati, V. R., Astria, F. P., & Ratu, T. (2020). Analisis kualitas soal kemampuan membedakan rangkaian seri dan paralel melalui teori tes klasik dan model rasch. Indonesian Journal of Educational Research and Review, 3(1), 11–19. https://doi.org/10.23887/ijerr.v3i1.24080.
Janna, N. M., & Herianto. (2021). Konsep uji validitas dan reliabilitas. Jurnal Darul Dakwah Wal-Irsyad (DDI), 18210047, 1–12.
Karjo, Ashadi, & Sugiyarto. (2019). Penerapan Pendekatan Saintifik Dalam Pembelajaran Biologi Menggunakan Model GI Dan STAD Ditinjau Dari Kemampuan Berpikir Deduktif Dan Motivasi Berprestasi. Inkuiri: Jurnal Pendidikan IPA, 8(2), 162 – 171. https://doi.org/10.20961/inkuiri.v8i2.37755.
Khasanah, M. M., Ramli, M., & Dwiastuti, S. (2020). Developing a Dynamic Assessment Instrument to Assess Reasoning Skills About Bacteria. Jurnal Penelitian Dan Evaluasi Pendidikan, 24(1), 62–75. https://doi.org/10.21831/pep.v24i1.28815.
Kurnia, A., Sukarmin, & Sunarno, W. (2021). Profil Kemampuan Berpikir Kreatif Siswa Menggunakan Soal Tes Pilihan Ganda pada Pembelajaran Ilmu Pengetahuan Alam. Indonesian Journal of Educational Science (IJES), 4(1), 27–32. https://doi.org/10.31605/ijes.v4i1.1147.
Larasati, D. A., & Widyastuti, T. (2020). Pengembangan Skala Pemaafan Diri (Self-forgiveness). Acta Psychologia, 2(1), 80–90. https://doi.org/10.21831/ap.v1i1.34121.
Leonard, K., Sepehri, P., Cheri, B., & Kelly, D. M. (2023). Relational complexity influences analogical reasoning ability. Iscience, 26(4), 106392. https://doi.org/10.1016/j.isci.2023.106392.
Lestari, N., & Harjono, N. (2021). Pengembangan Instrumen Penilaian Karakter PPK Aspek Kemandirian Pada Siswa SD Kelas 4. MIMBAR PGSD Undiksha, 9(1). https://doi.org/10.23887/jjpgsd.v9i1.33379.
Muluki, A. (2020). Analisis Kualitas Butir Tes Semester Ganjil Mata Pelajaran IPA Kelas IV Mi Radhiatul Adawiyah. Jurnal Ilmiah Sekolah Dasar, 4(1), 86–96. https://doi.org/10.23887/jisd.v4i1.23335.
Nuraeni, M. I., & Habibi, M. W. (2021). Pengembangan Bahan Ajar IPA Berbentuk Komik Pada Materi Sistem Ekskresi Untuk SMP/MT’s Kelas VIII. Experiment: Journal of Science Education, 1(1). https://doi.org/10.18860/experiment.v1i1.11116.
Paramartha, W. E., Dharsana, I. K., & Padmi, N. M. D. (2022). Kalibrasi Item Instrumen Kecenderungan Nomophobia Pada Remaja Milenial. Jurnal Bimbingan Dan Konseling Indonesia, 7(2), 339–349. https://doi.org/10.23887/jurnal_bk.v7i2.1581.
Pelikan, A., Herzel, H., Kramer, A., & Ananthasubramaniam, B. (2022). Venn diagram analysis overestimates the extent of circadian rhythm reprogramming. The FEBS Journal, 289(21), 6605–6621. https://doi.org/10.1111/febs.16095.
Puger, I. G. N., & Dewi, K. Y. F. (2023). Validitas Butir Kuesioner Perilaku Siswa Berbasiskan Ajaran Karmapatha Secara Unidimensi Dan Multidimensi Sebelum Dikoreksi Oleh Efek Spurious Overlap. Daiwi Widya, 10(1), 1–12. https://doi.org/10.37637/dw.v10i1.1387.
Purnama Dewi, L. P. (2018). Penerapan Model Pembelajaran Quantum Teaching berbantuan Media Konkret untuk Meningkatkan Hasil Belajar IPA. Journal of Education Action Research, 2(1), 23. https://doi.org/10.23887/jear.v2i1.13727.
Putra, A., Syarifuddin, H., & Zulfah, Z. (2018). Validitas Lembar Kerja Peserta Didik Berbasis Penemuan Terbimbing dalam Upaya Meningkatkan Pemahaman Konsep dan Kemampuan Penalaran Matematis. Edumatika : Jurnal Riset Pendidikan Matematika, 1(2), 56. https://doi.org/10.32939/ejrpm.v1i2.302.
Rezeki, S., & Ishafit, I. (2017). Pengembangan Media Pembelajaran Interaktif untuk Sekolah Menengah Atas Kelas XI pada Pokok Bahasan Momentum. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 3(1), 29. https://doi.org/10.21009/1.03104.
Septriningsih, A. S. ., Bektiarso, S., & T, P. (2010). Pengaruh Model Problem Based Instruction Terhadap Keterampilan Proses Sains dan Hasil Belajar Siswa Dalam Pembelajaran IPA di SMP. Jurnal Pembelajaran IPA, 3(6).
Talman, K., Vierula, J., Kanerva, A. M., Virkki, O., Koivisto, J. M., & Haavisto, E. (2021). Instruments for assessing reasoning skills in higher education: A scoping review. Assessment & Evaluation in Higher Education, 46(3), 376–392. https://doi.org/10.1080/02602938.2020.1776212.
Voskoglou, M., & Broumi, S. (2022). A Hybrid Method For The Assessment of Analogical Reasoning Skills. Journal of Fuzzy Extension and Applications, 3(2), 152–157. https://doi.org/10.22105/jfea.2022.342139.1220.
Warju, W., Ariyanto, S. R., Soeryanto, S., & Trisna, R. A. (2020). Analisis Kualitas Butir Soal Tipe HOTS pada Kompetensi Sistem REM di Sekolah Menengah Kejuruan. Jurnal Pendidikan Teknologi Dan Kejuruan, 17(1), 95–104. https://doi.org/10.23887/jptk-undiksha.v17i1.22914.
Wulandari, A. I., & Radia, E. H. (2021). Pengembangan Instrumen Penilaian Sikap Tanggung Jawab Pembelajaran Tematik Terpadu Kelas V SD. MIMBAR PGSD Undiksha, 9(1), 10–18. https://doi.org/10.23887/jjpgsd.v9i1.32979.
Xu, W., Geng, F., & Wang, L. (2022). Relations of computational thinking to reasoning ability and creative thinking in young children: Mediating role of arithmetic fluency. Thinking Skills and Creativity, 4, 101041. https://doi.org/10.1016/j.tsc.2022.101041.
Yugakisha, M. S., & Jayanta, I. N. L. (2021). Instrumen Penilaian Motivasi Belajar Ipa. Jurnal Pedagogi Dan Pembelajaran, 4(2), 402–408. https://doi.org/10.23887/jp2.v4i2.35918.
Yusup, F. (2018). Uji Validitas Dan Reliabilitas Instrumen Penelitian Kuantutatif. Jurnal Tarbiyah: Jurnal Ilmiah Kependidikan, 7(1), 17–23. https://doi.org/10.21831/jorpres.v13i1.12884.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 I Gusti Ngurah Puger
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with the Journal of Evaluation and Research in Education (JERE) agree to the following terms:
- Authors retain copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work. (See The Effect of Open Access)
