Assessing Higher-Order Thinking Skills in Physics: A Comparative Study of Paper-Based and Computer-Based Method

Authors

DOI:

https://doi.org/10.26740/jdpe.v1i2.41235

Keywords:

21st Century Skills, Computer-Based Test (CBT), Higher-Order Thinking Skills (HOTs), Paper-Based Test (PBT), Physics Assessment

Abstract

Objective: This research is a quasi-experimental investigation with a non-equivalent control group design, aiming to analyse the differences in the use of CBT and PBT methods for HOTs' question assessments. Method: This research employed a quantitative approach, conducting statistical tests using SPSS 26 on each of 35 students by comparing the N-Gain results in the control group using PBT and the experimental group using CBT. Furthermore, normality tests, homogeneity tests, and independent sample-T tests were conducted to determine the significance of the differences between CBT and PBT results. Results:  The N-Gain of the experimental group is 0.7652 higher than the N-Gain of the control group is 0.2272. Therefore, the CBT method is more effective than the PBT method. The datum distributed normally and homogeneously both to control group and experimental group, resulting the Sig. (2-tailed) in the independent sample-T test is 0.000 < 0.05. It is concluded, that there is a significant difference between the use of the PBT and CBT methods for assessing HOTs questions. Novelty: This research compares the use of digital and conventional technology in physics learning, especially to improve students' cognitive domain in achieving high-order thinking skills (HOTs), which is one of the important aspects of 21st-century education.

References

Aldilla, D. I. (2023). Gambaran hasil evaluasi proses belajar mahasiswa menggunakan metode paper based test dan computer based test. Jurnal Medika Hutama, 4(4), 3546-3555. https://doi.org/10.53039/jmh.v4i04Juli.661

Amalia, D., & Hadi, W. (2020). Analisis kesalahan siswa dalam menyelesaikan soal HOTS berdasarkan kemampuan penalaran matematis. Transformasi: Jurnal Pendidikan Matematika Dan Matematika, 4(1), 219-236. https://doi.org/10.36526/tr.v4i1.904

Annisak, W., & Pathoni, H. (2017). Desain pengemasan test diagnostik miskonsepsi berbasis CBT (Computer Based Test). Edufisika: Jurnal Pendidikan Fisika, 2(1), 1-12. https://doi.org/10.22437/edufisika.v2i01.3939

Ariani, M., Zulhawati, Z., Haryani, H., Zani, B. N., Husnita, L., Firmansyah, M. B., ... & Hamsiah, A. (2023). Penerapan media pembelajaran era digital. PT. Sonpedia Publishing Indonesia.

Choiroh, S. S., Prastowo, S. H. B., & Nuraini, L. (2022). Pengaruh penggunaan e-LKPD interaktif berbantuan live worksheets terhadap kemampuan berpikir kognitif HOTS fisika siswa SMA. Jurnal Ilmiah Pendidikan Fisika, 6(3), 694-705. https://doi.org/10.20527/jipf.v6i3.6795

Fanani, M. Z. (2018). Strategi pengembangan soal HOTs pada kurikulum 2013. Edudeena: Journal of Islamic Religious Education, 2(1), 57-76. https://doi.org/10.30762/ed.v2i1.582

Fitriana, F., & Sitompul, S. S. (2024). Analisis kemampuan kognitif peserta didik dalam menyelesaikan soal HOTs fisika materi getaran harmonis. Jurnal Dunia Pendidikan, 5(2), 553-565. https://doi.org/10.55081/jurdip.v5i2.2893

Fransiska, A., Prasetyo, E., & Jufriansah, A. (2021). Desain LKPD fisika terintegrasi HOTs untuk meningkatkan kemampuan berpikir kritis peserta didik. Jurnal Pendidikan Fisika Dan Teknologi, 7(2), 153-158. http://dx.doi.org/10.29303/jpft.v7i2.3098

Hake, R. R. (1999). Analyzing change/gain scores. Dept. of Physics, Indiana University.

Hidayah, A. S. (2021). Efektivitas penggunaan Google Form pada penilaian harian aspek kognitif mata pelajaran Al Qur’an Hadis di MTs Ma’arif Nu 1 Cilongok Kabupaten Banyumas [Master's thesis, Institut Agama Islam Negeri Purwokerto (Indonesia)].

Himmah, F., Rufi’i, R. I., & Wiyarno, Y. (2023). Pengembangan aplikasi asesmen diagnostik berbasis Computer Based Test (CBT) menggunakan moodle. JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika), 8(3), 1022-1032. https://doi.org/10.29100/jipi.v8i3.4380

Istiyono, E., Dwandaru, W. S. B., Erfianti, L., & Astuti, W. (2020). Applying CBT in physics learning to measure students’ higher order thinking skills. Journal of Physics: Conference Series, 1440(1), 012061. IOP Publishing. https://doi.org/10.1088/1742-6596/1440/1/012061

Kurniawan, E. S., Mundilarto, E. I., & Istiyono, E. (2024). Improving student higher order thinking skills using Synectic-HOTS-oriented learning model. International Journal of Evaluation and Research in Education, 13(2), 1133–1140. https://doi.org/10.11591/ijere.v13i2.25002

Kusumaningtyas, D. A., Manyunu, M., Kurniasari, E., Awalin, A. N., Rahmaniati, R., & Febriyanti, A. (2024). Enhancing learning outcomes: A study on the development of higher order thinking skills based evaluation instruments for work and energy in high school physics. Indonesian Journal on Learning and Advanced Education (IJOLAE), 6(1), 14-31. https://doi.org/10.23917/ijolae.v6i1.23125

Latifah, U. N., & Suprihatiningrum, J. (2024). The effect of inquiry-based learning on students’ critical thinking ability and activeness in reaction rate material. Lectura: Jurnal Pendidikan, 15(1), 95-106. https://doi.org/10.31849/lectura.v15i1.17368

Mardiyanti, N. E. A., & Jatmiko, B. (2022). Keefektifan pembelajaran fisika dengan model inkuiri terbimbing berbantuan PhET Interactive Simulations untuk meningkatkan kemampuan berfikir kritis siswa SMA. Jurnal Ilmiah Pendidikan Fisika, 6(2), 328. https://doi.org/10.20527/jipf.v6i2.5281

Martatiyana, D. R., Derlis, A., Aviarizki, H. W., Jurdil, R. R., Andayani, T., & Hidayat, O. S. (2023). Analisis komparasi implementasi kurikulum merdeka dan kurikulum 2013. Muallimuna: Jurnal Madrasah Ibtidaiyah, 9(1), 96-109. https://doi.org/10.31602/muallimuna.v9i1.11600

Miladanta, A. N., Nuryantini, A. Y., Farida, I., & Cahyanto, T. (2024). Pengembangan Instrumen Higher Order Thinking Skills (HOTS) materi alat optik melalui validitas, reliabilitas, daya pembeda dan tingkat kesukaran. Jurnal Penelitian Sains dan Pendidikan (JPSP), 4(2), 148-158. https://doi.org/10.23971/jpsp.v4i2.7828

Muliastrini, N. K. E. (2020). New literacy sebagai upaya peningkatan mutu pendidikan sekolah dasar di abad 21. Jurnal Pendidikan Dasar Indonesia (PENDASI), 1(4), 115-125. https://doi.org/10.23887/jpdi.v4i1.3114

Murni, S. (2024). Manajemen penilaian hasil belajar berbasis komputer dalam menguatkan kompetensi profesional guru di MIN 2 Kota Bengkulu [Doctoral dissertation, UIN Fatmawati Sukarno Bengkulu].

Mustari, M. (2023). Teknologi informasi dan komunikasi dalam manajemen pendidikan. Gunung Djati Publishing Bandung.

Ningsih, I. S., & Kamaludin, A. (2022). Development of textbooks with Higher Order Thinking Skills (HOTS) on colligative properties of solutions. Jurnal Pendidikan dan Pembelajaran Kimia, 11(3), 38-47. https://doi.org/10.23960/jppk.v11.i3.2022.05

Nisa, H., Junus, M., & Komariyah, L. (2022). Penerapan model problem based learning berbantuan simulasi PhET berbasis instrumen HOTS terhadap hasil belajar siswa. Jurnal Ilmiah Pendidikan Fisika, 6(3), 560-567. https://doi.org/10.20527/jipf.v6i3.5514

Nurseha, M. L. E., Budiono, A. N., & Wahyuni, W. (2021). Pengaruh ujian ulangan harian menggunakan computer based test terhadap motivasi belajar siswa. Pedagogika, 21-31. https://doi.org/10.37411/pedagogika.v12i1.623

Pora, L. L., Habibi, & Sukroyanti, B. A. (2023). Pengaruh penerapan model pembelajaran discovery learning untuk meningkatkan hasil belajar fisika siswa kelas X. Journal Transformation of Mandalika, 4(4), 105-115. https://doi.org/10.36312/jtm.v4i4.1268

Purwaningsih, E., Sari, S. P., Sari, A. M., & Suryadi, A. (2020). The effect of STEM-PJBL and discovery learning on improving students' problem-solving skills of impulse and momentum topic. Jurnal Pendidikan IPA Indonesia, 9(4), 465-476. https://doi.org/10.15294/jpii.v9i4.26432

Safitri, H., Agatha, F. L., Syiarah, H., & Simamora, N. N. (2022). Analisis pengaruh minat pembelajaran fisika terhadap hasil belajar fisika kelas X di SMAN 4 Kota Jambi. Integrated Science Education Journal, 3(2), 55-61. https://doi.org/10.37251/isej.v3i2.258

Saidah, I. S. (2025). Implementasi pembelajaran pendidikan agama islam dan budi pekerti berbasis media digital dalam meningkatkan kualitas pembelajaran di SD Islam Khalifah Palu [Doctoral dissertation, Universitas Islam Negeri Datokarama Palu].

Sandra, R. O., Maison, M., & Kurniawan, D. A. (2022). Pengembangan instrument miskonsepsi menggunakan dreamweaver berbasis web pada materi tekanan berformat five-tier. Jurnal Fisika: Fisika Sains Dan Aplikasinya, 7(1), 22-28. https://doi.org/10.35508/fisa.v7i1.6575

Saraswati, S., & Hatibe, A. (2023). Pembelajaran modul fisika berbasis inkuiri di masa pandemi di kelas XI SMA Negeri 1 Tinombo. JPFT (Jurnal Pendidikan Fisika Tadulako Online), 11(3), 136-141. https://doi.org/10.22487/jpft.v11i3.2110

Sulistyarini, W. (2022). Analysis of cognitive aspects of test techniques in islamic education learning. EDUKASI: Jurnal Pendidikan Islam, 10(2), 166-190. https://doi.org/10.54956/edukasi.v10i2.278

Tanjung, Y. I., Wulandari, D., Bakar, A., & Ramadhani, I. (2021). The development of online physics test system at SMA CT Foundation Medan. Journal of Physics: Conference Series, 1819(1), 012054. IOP Publishing. https://doi.org/10.15294/jpfi.v19i1.41745

Ummah, K. K. (2019). Pengaruh ujian system CBT (Computer Based Test) mata pelajaran PAI terhadap motivasi belajar siswa di SMAN 10 Surabaya [Undergraduate thesis, UIN Sunan Ampel Surabaya].

Wardani, S. U. K. (2021). Efektivitas penggunaan sistem computer based test dan paper based test dalam pelaksanaan ujian tengah semester Bahasa Indonesia di SMPN 6 Singaraja. Jurnal Pendidikan Bahasa Dan Sastra Indonesia Undiksha, 11(4), 491-500. https://doi.org/10.23887/jjpbs.v11i4.39676

Published

2025-07-12

How to Cite

Rahman Eka Cahya, R. E. C., Budi Jatmiko, B. J., & Hamiydah, S. H. (2025). Assessing Higher-Order Thinking Skills in Physics: A Comparative Study of Paper-Based and Computer-Based Method. Journal of Digitalization in Physics Education, 1(2), 41235. https://doi.org/10.26740/jdpe.v1i2.41235

Issue

Section

Implementation of Digital Technology in Physics Education
Abstract views: 10 , PDF Downloads: 0