Identification of Generative AI Usage Profiles and Implications for Critical Thinking Skills in Physics Learning
DOI:
https://doi.org/10.26740/jpps.v15n2.p83-93Keywords:
Critical Thinking Skills , Generative AI , Physics Learning , Physics , Spearman CorrelationAbstract
Objective: This study aims to map students' GenAI usage profiles during physics learning. In addition, it examines the correlation between these variables and students' critical thinking skills in physics learning. Method: A non-experimental, quantitative, ex post facto design was employed. This design captures phenomena that occur naturally without any intervention. The research instruments consisted of questionnaires and tests. Data were analyzed using descriptive statistics, the Kruskal–Walls test, and Spearman’s correlation test. Results: Students tend to accept answers from GenAI quickly during physics learning. Only a small proportion are accustomed to questioning, verifying, and evaluating GenAI-generated answers. There are differences in critical thinking skills among groups of students with different patterns of GenAI use, with an ε2 of 0.410. The profile of GenAI usage is positively correlated with critical thinking skills, with a correlation coefficient of 0.525, indicating a moderate relationship. Novelty: This study contributes by revealing students' GenAI usage profiles in physics learning and by providing empirical evidence that the quality of ethical and reflective use has a strong influence and is positively correlated with critical thinking skills.Downloads
References
Alkam, R. S., Alsawalqa, R. O., & Alreesi, R. (2026). The moderating role of academic integrity in the relationship between artificial intelligence and critical thinking among graduate students in Jordan. Frontiers in Education, 11. https://doi.org/10.3389/feduc.2026.1776308
Allen, W., Shanker, A., & Rebello, N. S. (2025). Students’ perceptions to a large language model’s generated feedback and scores of argumentation essays. In P. A., Z. J.P., & L. A.E. (Eds.), Physics Education Research Conference Proceedings (pp. 28 – 34). American Association of Physics Teachers. https://doi.org/10.1119/perc.2025.pr.Allen
Anggraeni, D. M., Prahani, B. K., Suprapto, N., Shofiyah, N., & Jatmiko, B. (2023). Systematic review of problem based learning research in fostering critical thinking skills. Thinking Skills and Creativity, 49. https://doi.org/10.1016/j.tsc.2023.101334
Coban, A., Dzsotjan, D., Küchemann, S., Durst, J., Kuhn, J., & Hoyer, C. (2025). Open Access AI support meets AR visualization for Alice and Bob : personalized learning based on individual ChatGPT feedback in an AR quantum cryptography experiment for physics lab courses. EPJ Quantum Technol., 12(1), 15. https://doi.org/10.1140/epjqt/s40507-025-00310-z
Dahlkemper, M. N., Lahme, S. Z., & Klein, P. (2023). How do physics students evaluate artificial intelligence responses on comprehension questions ? A study on the perceived scientific accuracy and linguistic quality of ChatGPT. Physical Review Physics Education Research, 19(1), 10142. https://doi.org/10.1103/PhysRevPhysEducRes.19.010142
Deta, U. A., Ayun, S. K., Laila, L., & Prahani, Binar Kurnia Suprapto, N. (2024). PISA science framework 2018 vs 2025 and its impact in physics education: Literature review. Momentum: Physics Education Journal, 8(1), 95–107. https://doi.org/10.21067/mpej.v8i1.9215
Driessens, O., & Pischetola, M. (2024). Danish university policies on generative AI Problems, assumptions and sustainability blind spots. MedieKultur, 40(76), 31 – 52. https://doi.org/10.7146/mk.v40i76.143595
Facione, P. A. (2013). Critical Thinking : What It Is and Why It Counts. 1–28.
Fathi, T. El, Saad, A., Larhzil, H., Lamri, D., & Ibrahmi, E. M. Al. (2025). Integrating generative AI into STEM education : enhancing conceptual understanding, addressing misconceptions, and assessing student acceptance. Disciplinary and Interdisciplinary Science Education Research, 2025(7), 6. https://doi.org/10.1186/s43031-025-00125-z
Garcia Ramos, J., & Wilson-Kennedy, Z. (2025). The use of artificial intelligence in STEM communication-intensive courses and its impact on science identity. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1644873
Gaurina, M., Hrepić, Z., Nikolaus, P., & Dželalija, M. (2022). How gamification impacts physics? New Perspectives in Science Education - International Conference, 2022(11).
Gervacio, A. P. (2024). Exploring how generative AI contributes to the motivated engagement and learning production of science-oriented students. Environment and Social Psychology, 9(11). https://doi.org/10.59429/esp.v9i11.3194
Gravetter, F. J., & Wallnau, L. B. (2016). Statistics for The Behavioral Sciences. Cengage Learning. https://books.google.co.id/books?id=rBNfzgEACAAJ
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate Data Analysis (7th ed.). Pearson.
Kang, E., & Park, J. H. (2024). Analysis of elementary school students’ understanding and confidence in AI-generated responses –focusing on scientific concepts related to light; [AI 생성 응답에대한초등학생의이해및확신도분석–빛과 관련된과학적개념을중심으로]. New Physics: Sae Mulli, 74(7), 664 – 677. https://doi.org/10.3938/NPSM.74.664
Karamuk, E. (2025). The automation trap: Unpacking the consequences of over-reliance on AI in education and its hidden costs. In Pitfalls of AI Integration in Education: Skill Obsolescence, Misuse, and Bias (pp. 151 – 174). IGI Global. https://doi.org/10.4018/979-8-3373-0122-8.ch007
Kilde-Westberg, S., Johansson, A., & Enger, J. (2025). Generative AI as a lab partner: A case study. Physical Review Physics Education Research, 21(2). https://doi.org/10.1103/ggy1-3kjk
Lee, J., Cho, K., Shin, S., Yoo, C., & Pak, K. (2026). Integrating Generative AI into the conceptual design process: A case study of hydrogen-powered water mobility. Archives of Design Research, 39(1), 7 – 30. https://doi.org/10.15187/adr.2026.02.39.1.7
Lintangesukmanjaya, R. T., Iswardani, A., & Prahani, B. K. (2025). Improving Critical thinking skills of high school students in physics learning with smartphone-simulation assisted inquiry model. Journal of Digitalization in Physics Education, 1(2), 1–13. https://doi.org/10.26740/jdpe.v1i2.42129
McConnell, T. J., Parker, J., & Eberhardt, J. (2018). Problem-based Learning in the Physical Science Classroom, K–12. NSTA Press (National Science Teaching Association).
Miao, F., Shiohira, K., & Lao, N. (2024). AI competency framework for students. UNESCO. https://doi.org/10.54675/JKJB9835
Miterianifa, M., Ashadi, A., Saputro, S., & Suciati, S. (2021). Critical thinking skills profile of high school students in chemistry learning. Journal of Physics: Conference Series, 1842. https://doi.org/10.1088/1742-6596/1842/1/012046
Mitrevski, B. (2019). Teaching critical thinking and problem solving in physics. AIP Conference Proceedings. https://doi.org/10.1063/1.5091338
Neswary, S. B. A., Prahani, B. K., Wibowo, F. C., & Uulaa, R. F. R. (2023). A profile of senior high school students’ critical thinking skills in physics learning. Journal of Physics: Conference Series, 1. https://doi.org/10.1088/1742-6596/2623/1/012012
Pitts, G., Rani, N., Mildort, W., & Cook, E.-M. (2026). Students’ reliance on AI in higher education: Identifying contributing factors. Communications in Computer and Information Science, 2773 CCIS, 86 – 97. https://doi.org/10.1007/978-3-032-12773-0_9
Rusandi, M. A., Ahman, Saripah, I., Khairun, D. Y., & Mutmainnah. (2023). No worries with ChatGPT: Building bridges between artificial intelligence and education with critical thinking soft skills. Journal of Public Health, 45(3), E602 – E603. https://doi.org/10.1093/pubmed/fdad049
Saikia, H., & Roy, N. R. (2024). Fostering critical thinking skills in modern learners: A peep into higher educational institutions. In Digital Skill Development for Industry 4.0. CRC Press. https://doi.org/10.1201/9781003504894-4
Saphira, H. V, Rizki, I. A., Alfarizy, Y., Saputri, A. D., Ramadani, R., & Suprapto, N. (2022). Profile of students’ critical thinking skills in physics learning: A preliminary study of games application integrated augmented reality. Journal of Physics: Conference Series, 2377(1). https://doi.org/10.1088/1742-6596/2377/1/012088
Silva, C. N. (2010). Ex Post Facto Study. In Encyclopedia of Research Design (pp. 466–466). SAGE Publications, Inc. https://doi.org/10.4135/9781412961288.n145
Tang, Q., Deng, W., Huang, Y., Wang, S., & Zhang, H. (2025). Can generative artificial intelligence be a good teaching assistant?—An empirical analysis based on generative AI-assisted teaching. Journal of Computer Assisted Learning, 41(3). https://doi.org/10.1111/jcal.70027
Trúsiková, A., & Velmovská, K. (2022). Indicators of critical thinking and physics experiments. In B. M. J., G. P., G. S., & S. D. (Eds.), Journal of Physics: Conference Series (Vol. 2297, Issue 1). Institute of Physics. https://doi.org/10.1088/1742-6596/2297/1/012011
Wheatley, A., & Hervieux, S. (2025). Artificial Intelligence and Libraries. In D. Baker & L. Ellis (Eds.), Encyclopedia of Libraries, Librarianship, and Information Science (First Edition) (First Edition, pp. 286–290). Academic Press. https://doi.org/10.1016/B978-0-323-95689-5.00275-3
Williamson, B. (2024). The social life of AI in education. International Journal of Artificial Intelligence in Education, 34(1), 97–104. https://doi.org/10.1007/s40593-023-00342-5
Wulandari, R., Jatmiko, B., Budiyanto, M., Hariyono, E., Lestari, N. A., & Prahani, B. K. (2021). A critical thinking skill profile of science education undergraduate student in basic physics. Journal of Physics: Conference Series, 2110. https://doi.org/10.1088/1742-6596/2110/1/012030
Yu, L., & Zin, Z. M. D. (2023). The critical thinking-oriented adaptations of problem-based learning models: A systematic review. Frontiers in Education, 8. https://doi.org/10.3389/feduc.2023.1139987
Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: a systematic review. Smart Learning Environments, 11(1). https://doi.org/10.1186/s40561-024-00316-7
Zhang, W., & Liu, X. (2025). Artificial intelligence-generated content empowers college students’ critical thinking skills: what, how, and why. Education Sciences, 15(8). https://doi.org/10.3390/educsci15080977
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 JPPS (Jurnal Penelitian Pendidikan Sains)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Abstract views: 182
,
PDF Downloads: 85
