Recommendations For Improving Application Services Using Root Cause Analysis Based On User Review Sentiment Analysis (Case Study: Digital Korlantas Polri)

Authors

  • Lintang Iqhtiar Dwi Mawarni Universitas Negeri Surabaya
  • I Kadek Dwi Nuryana Universitas Negeri Surabaya
  • Ika Qutsiati Utami Universitas Airlangga
  • Nisa Dwi Septiyanti National Central University

DOI:

https://doi.org/10.26740/jetis.v2i02.43514

Keywords:

IndoBERT, Guided-LDA, GPT-02, Topic Modelling, Root Cause Analysis

Abstract

Abstract. Amid the wave of digital transformation, the Digital Korlantas Polri application emerged as a solution and breakthrough in the digital-based SIM (driver's license) issuance process. However, concerns regarding the application’s performance quality remain, one of which can be assessed through user comments on the Google Play Store. A disparity was found between the app’s rating and the content of user reviews, raising questions about the actual quality of the application. This study aims to identify the root causes of user issues with the Digital Korlantas Polri application and generate improvement recommendations based on the identified problems. The research utilizes the pre-trained IndoBERT model for sentiment classification, followed by semi-supervised topic modeling using Guided LDA to uncover hidden patterns in the review data. Furthermore, the pre-trained GPT-2 model is employed as a text generator to produce application improvement recommendations based on the identified issues. Evaluation results show that the sentiment model achieved a confidence score of 0.99, the Guided LDA model reached a coherence score of 0.51, and the GPT-2 model yielded a perplexity value of 1.3. Overall, the models successfully fulfilled their respective roles, enabling more effective and efficient analysis, and generating realistic and timely recommendations for addressing the identified issues

References

Abrori, N. Y. A. (2024). Optimasi layanan Warung Ayam Bakar Lientang dengan root cause analysis berdasarkan hasil analisis sentimen berbasis aspek. Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer. https://j-ptiik.ub.ac.id/index.php/j-ptiik/article/view/13615

Alam, H. K., & Hanny Purnamasari. (2024). EFEKTIVITAS DIGITALISASI PELAYANAN PUBLIK MELALUI APLIKASI DIGITAL KORLANTAS POLRI. Moderat : Jurnal Ilmiah Ilmu Pemerintahan, 10(3), 511–522. https://doi.org/10.25157/moderat.v10i3.3668

Darwis, D., Siskawati, N., & Abidin, Z. (2021). Penerapan Algoritma Naive Bayes Untuk Analisis Sentimen Review Data Twitter Bmkg Nasional. Jurnal Tekno Kompak, 15(1), 131. https://doi.org/10.33365/jtk.v15i1.744

Graber, M. L., Cooper, S., & Kachalia, A. (2024). Root cause analysis of cases involving diagnosis. Diagnosis, 11(1), 1–8. https://doi.org/10.1515/dx-2024-0102

Halim, N. (2020). Analisis End-User Computing Satisfaction (EUCS) pada aplikasi mobile Universitas Bina Darma. SISTEMIK: Jurnal Sistem Informasi, 9(1), 1–8. https://doi.org/10.32520/stmsi.v9i1.625

Hyun, J. H., & Oh, Y. (2024). Latent Dirichlet Allocation (LDA) topic models for space syntax studies on spatial experience. City, Territory and Architecture, 11(1), 1–20. https://doi.org/10.1186/s40410-023-00223-3

Islam, S., Elmekki, H., Elsebai, A., Bentahar, J., Drawel, N., Rjoub, G., & Pedrycz, W. (2024). A comprehensive survey on applications of transformers for deep learning tasks. Expert Systems with Applications, 241, 122666. https://doi.org/10.1016/j.eswa.2023.122666

Lee, J. H., & Oh, Y. (2024). Latent Dirichlet Allocation (LDA) topic models for Space Syntax studies on spatial experience. City Territory and Architecture, 11(1), 1–20. https://doi.org/10.1186/s40410-023-00223-3

Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., Wu, Z., Zhao, L., Zhu, D., Li, X., Qiang, N., Shen, D., Liu, T., & Ge, B. (2023). Summary of ChatGPT-Related research and perspective towards the future of large language models. Meta-Radiology, 1(2), 100017. https://doi.org/10.1016/j.metrad.2023.100017

Utami, M., Rusdi, M., Arif, I. A., Atmansyah, L., & Indar, N. I. N. (2023). Efektivitas Pelayanan Digital di Kepolisian RI: Studi Kasus Kota Makassar. Development Policy and Management Review (DPMR), 63–79. https://doi.org/10.61731/dpmr.v3i1.29951

Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N., & Mian, A. (2025). A comprehensive overview of large language models. ACM Transactions on Intelligent Systems and Technology, 16(5), 1–72. https://doi.org/10.1145/3744746

Park, S. K. (2021). Root cause analysis based on relations among sentiment words. Cognitive Computation, 13, 903–918. https://doi.org/10.1007/s12559-021-09872-3

POLRI, K. (2021). Digital Korlantas POLRI [Mobile app]. Google Play Store. https://play.google.com/store/apps/details?id=id.qoin.korlantas.user&hl=id

Rahimi, H., Mimno, D., Hoover, J., Naacke, H., Constantin, C., & Amann, B. (2024). Contextualized topic coherence metrics. In Findings of the Association for Computational Linguistics: EACL 2024 (pp. 1760–1773). https://doi.org/10.18653/v1/2024.findings-eacl.123

Sayeed, M. S., Mohan, V., & Muthu, K. S. (2023). BERT: A review of applications in sentiment analysis. HighTech and Innovation Journal, 4(2), 453–462. https://doi.org/10.28991/HIJ-2023-04-02-015

Schröer, C., Kruse, F., & Gomez, J. M. (2021). A systematic literature review on applying CRISP-DM process model. Procedia Computer Science, 181, 526–534. https://doi.org/10.1016/j.procs.2021.01.198

Wu, X., Nguyen, T., & Luu, A. T. (2024). A survey on neural topic models: methods, applications, and challenges. Artificial Intelligence Review, 57(2). https://doi.org/10.1007/s10462-023-10661-7

Zhang, H., & Shafiq, M. O. (2024). Survey of transformers and towards ensemble learning using transformers for natural language processing. Journal of Big Data, 11, 25. https://doi.org/10.1186/s40537-023-00842-0

Zhao, Z., Fan, W., Li, J., Liu, Y., Mei, X., Wang, Y., Wen, Z., Wang, F., Zhao, X., Tang, J., & Li, Q. (2024). Recommender systems in the era of large language models (LLMs). IEEE Transactions on Knowledge and Data Engineering, 36(11), 6889–6907. https://doi.org/10.1109/TKDE.2024.3392335

Zhou, K., Wang, J., Ashuri, B., & Chen, J. (2023). Discovering the research topics on construction safety and health using semi-supervised topic modeling. Buildings, 13(5), 1169. https://doi.org/10.3390/buildings13051169

Downloads

Published

2026-09-30

How to Cite

Mawarni, L. I. D., I Kadek Dwi Nuryana, Utami, I. Q., & Septiyanti, N. D. (2026). Recommendations For Improving Application Services Using Root Cause Analysis Based On User Review Sentiment Analysis (Case Study: Digital Korlantas Polri). Journal of Education Technology and Information System , 2(02), 91–112. https://doi.org/10.26740/jetis.v2i02.43514
Abstract views: 134 , PDF Downloads: 9