Text Stemming and Lemmatization of Regional Languages in Indonesia: A Systematic Literature Review
Downloads
Background: Stemming is significantly essential in natural language processing (NLP) due to the ability to minimize word variations to fundamental forms. This procedure facilitates the analysis of textual data and enhances the precision of classification and information retrieval.
Objective: Previous related systematic literature review has not been conducted on stemming and lemmatization in regional languages in Indonesia. Therefore, this study aims to conduct a systematic literature review to capture the latest developments in stemming and lemmatization in regional languages in Indonesia.
Methods: This study was carried out using Kitchenham method, analyzing 35 studies extracted from 740, which were obtained from Scopus, IEEE Xplore, and Google Scholar, and published between 2014 and 2023.
Results: The results showed that study trends in stemming possessed the potential to continue developing every year. Additionally, the main element in stemming and lemmatization studies was found to be the availability of digital dictionaries in regional languages. This was because greater number of basic vocabularies contributed more positively to stemming or lemmatization. The availability of word morphology information in regional languages would be constructive for making rule-based stemmers. Meanwhile, corpus-based stemming and lemmatization studies could only be conducted for languages with a large corpus to ensure there were various affixed words to process.
Conclusion: Based on SLR study, stemming and lemmatization in regional languages in Indonesia developed significantly from 2014 to 2023. The two main strategies applied included using available digital dictionaries and language morphology information. However, the main challenges encountered were the limited number of vocabulary words in the dictionaries and testing various rule-based methods.
Keywords: Lemmatization, Morphology, Rule-based, Stemming, Systematic Literature Review.
J. Singh and V. Gupta, "A systematic review of text stemming techniques,” Artif Intell Rev, vol. 48, no. 2, pp. 157–217, Aug. 2017, doi: 10.1007/s10462-016-9498-2.
J. Singh and V. Gupta, "Text stemming: Approaches, applications, and challenges,” ACM Comput Surv, vol. 49, no. 3, Sep. 2016, doi: 10.1145/2975608.
A. Jabbar, S. Iqbal, M. I. Tamimy, S. Hussain, and A. Akhunzada, "Empirical evaluation and study of text stemming algorithms,” Artif Intell Rev, vol. 53, no. 8, pp. 5559–5588, Dec. 2020, doi: 10.1007/s10462-020-09828-3.
A. S. Rizki, A. Tjahyanto, and R. Trialih, "Comparison of stemming algorithms on Indonesian text processing,” Telkomnika (Telecommunication Computing Electronics and Control), vol. 17, no. 1, pp. 95–102, Feb. 2019, doi: 10.12928/TELKOMNIKA.v17i1.10183.
A. Jabbar, S. Iqbal, M. I. Tamimy, A. Rehman, S. A. Bahaj, and T. Saba, "An Analytical Analysis of Text Stemming Methodologies in Information Retrieval and Natural Language Processing Systems,” IEEE Access, vol. 11, pp. 133681–133702, 2023, doi: 10.1109/ACCESS.2023.3332710.
R. Pramana, Debora, J. J. Subroto, A. A. S. Gunawan, and Anderies, "Systematic Literature Review of Stemming and Lemmatization Performance for Sentence Similarity,” in Proceedings of the 2022 IEEE 7th International Conference on Information Technology and Digital Applications, ICITDA 2022, Institute of Electrical and Electronics Engineers Inc., 2022. doi: 10.1109/ICITDA55840.2022.9971451.
A. Maesya, A. Ramadhan, E. Abdurachman, A. Trisetyarso, and M. Zarlis, "Stemming Algorithm for the Indonesian Language: A Scientometric View,” in 2022 IEEE Creative Communication and Innovative Technology, ICCIT 2022, Institute of Electrical and Electronics Engineers Inc., 2022. doi: 10.1109/ICCIT55355.2022.10119050.
Y. K. Paskahningrum, E. Utami, and A. Yaqin, "A Systematic Literature Review of Stemming in Non-Formal Indonesian Language,” in International Journal of Innovative Science and Research Technology, vol. 8, no.1, pp. 62-69, 2023. [Online]. Available: www.ijisrt.com
A. F. Aji et al., "One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia,” pp. 7226–7249, 2022, doi: 10.18653/v1/2022.acl-long.500.
M. D. Sanjaya, B. Indonesia, and D. Daerah, "Bahasa Indonesia dan Daerah Sebagai Perekat Jati Diri dan Martabat Bangsa Di Era Globalisasi” Jurnal Bindo Sastra, vol. 1, no. 1, pp. 10-14, 2017.
M. Abstrak, "Eksistensi Bahasa Indonesia Sebagai Bahasa Persatuan.” Jurnal Sosial Humaniora (JSH), vol. 1, no.2, pp. 172-184, 2008.
S. Cahyawijaya et al., "NusaCrowd: Open Source Initiative for Indonesian NLP Resources,” 2022, [Online]. Available: http://arxiv.org/abs/2212.09648
G. I. Winata et al., "NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages,” EACL 2023 - 17th Conf. Eur. Chapter Assoc. Comput. Linguist. Proc. Conf., pp. 815–834, 2023.
D. Khurana, A. Koli, K. Khatter, and S. Singh, "Natural language processing: state of the art, current trends and challenges,” Multimed Tools Appl, vol. 82, no. 3, pp. 3713–3744, Jan. 2023, doi: 10.1007/s11042-022-13428-4.
R. Fauzan, D. Siahaan, M. Solekhah, V. W. Saputra, A. E. Bagaskara, and M. I. Karimi, "A Systematic Literature Review of Student Assessment Framework in Software Engineering Courses,” Journal of Information Systems Engineering and Business Intelligence, vol. 9, no. 2, pp. 264–275, Oct. 2023, doi: 10.20473/jisebi.9.2.264-275.
M. A. W. Putra Rahmadhan, D. I. Sensuse, R. R. Suryono, and Kautsarina, "Trends and Applications of Gamification in E-Commerce: A Systematic Literature Review,” Journal of Information Systems Engineering and Business Intelligence, vol. 9, no. 1, pp. 28–37, Apr. 2023, doi: 10.20473/jisebi.9.1.28-37.
B. Kitchenham, O. Pearl Brereton, D. Budgen, M. Turner, J. Bailey, and S. Linkman, "Systematic literature reviews in software engineering - A systematic literature review,” Information and Software Technology, vol. 51, no. 1. pp. 7–15, Jan. 2009. doi: 10.1016/j.infsof.2008.09.009.
B. Kitchenham et al., "Systematic literature reviews in software engineering-A tertiary study,” Information and Software Technology, vol. 52, no. 8. Elsevier B.V., pp. 792–805, 2010. doi: 10.1016/j.infsof.2010.03.006.
S. I. Melia, J. Sholihah, D. Nisak, I. S. Juniaristha, and A. T. Ni'mah, "The Ngoko Javanese Stemmer uses the Enhanced Confix Stripping Stemmer Method,” Rekayasa, vol. 16, no. 1, pp. 107–112, Apr. 2023, doi: 10.21107/rekayasa.v16i1.19308.
A. P. Wibawa, F. A. Dwiyanto, I. A. E. Zaeni, R. K. Nurrohman, and A. Afandi, "Stemming javanese affix words using nazief and adriani modifications,” Jurnal Informatika, vol. 14, no. 1, p. 36, Jan. 2020, doi: 10.26555/jifo.v14i1.a17106.
A. P. Wibawa and M. N. Hakim, "Stemming Bahasa Jawa Menggunakan Damerau Levenshtein Distance (Dld),” J. Tek. Inform., vol. 14, no. 1, pp. 22–27, 2021, doi: 10.15408/jti.v14i1.15010.
F. Amin and J. Alfa Razaq, "Implementasi Stemmer Bahasa Jawa dengan Metode Rule Base Approach pada Sistem Temu Kembali Informasi Dokumen Teks Berbahasa Jawa,” Pros. SENDI_U, pp. 199–206, 2018.
N. Hidayatullah, Aji Prasetya Wibawa, and Harits Ar Rosyid, "Penerapan ECS Stemmer untuk Modifikasi Nazief & Adriani Berbahasa Jawa,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 3, no. 3, pp. 343–348, 2019, doi: 10.29207/resti.v3i3.994.
F. Amin, W. Hadikurniawati, S. Wibisono, H. Februariyanti, and J. S. Wibowo, "A hybrid method of rule-based and string matching stemmer for Javanese language,” J. Theor. Appl. Inf. Technol., vol. 95, no. 19, pp. 4973–4982, 2017.
D. E. Cahyani, L. M. T. Utami, and H. Setiadi, "Clustering of Javanese news in Krama Alus Level with Javanese stemming,” 2019 Int. Conf. Inf. Commun. Technol. ICOIACT 2019, pp. 462–467, 2019, doi: 10.1109/ICOIACT46704.2019.8938438.
M. A. Nq, L. P. Manik, and D. Widiyatmoko, "Stemming Javanese: Another Adaptation of the Nazief-Adriani Algorithm,” in 2020 3rd International Seminar on Research of Information Technology and Intelligent Systems, ISRITI 2020, Institute of Electrical and Electronics Engineers Inc., Dec. 2020, pp. 627–631. doi: 10.1109/ISRITI51436.2020.9315420.
S. H. Wijono, M. R. Alhamidi, M. H. Hilman, and W. Jatmiko, "Canonical Segmentation Using Affix Characters as a Unit on Transformer for Javanese Language,” in Proceedings - IWBIS 2021: 6th International Workshop on Big Data and Information Security, Institute of Electrical and Electronics Engineers Inc., 2021, pp. 67–72. doi: 10.1109/IWBIS53353.2021.9631839.
N. W. Wardani and P. G. S. Cipta Nugraha, "Stemming Dokumen Teks Bahasa Bali Dengan Metode Rule Base Approach,” JATISI (Jurnal Tek. Inform. dan Sist. Informasi), vol. 7, no. 3, pp. 510–521, 2020, doi: 10.35957/jatisi.v7i3.538.
G. N. M. Nata and P. P. Yudiastra, "Stemming teks sor-singgih Bahasa Bali,” E-Proceedings KNS&I STIKOM Bali, pp. 608–612, 2017, [Online]. Available: http://knsi.stikom-bali.ac.id/index.php/eproceedings/article/view/111
I. G. A. Purnajiwa Arimbawa and N. A. Sanjaya ER, "Lemmatization in Balinese Language,” JELIKU (Jurnal Elektron. Ilmu Komput. Udayana), vol. 8, no. 3, p. 235, 2020, doi: 10.24843/jlk.2020.v08.i03.p04.
I. P. M. Wirayasa, I. M. A. Wirawan, and I. M. A. Pradnyana, "Algoritma Bastal: Adaptasi Algoritma Nazief & Adriani Untuk Stemming Teks Bahasa Bali,” J. Nas. Pendidik. Tek. Inform., vol. 8, no. 1, p. 60, 2019, doi: 10.23887/janapati.v8i1.13500.
M. A. P. Subali and C. Fatichah, "Kombinasi Metode Rule-Based dan N-Gram Stemming untuk Mengenali Stemmer Bahasa Bali,” J. Teknol. Inf. dan Ilmu Komput., vol. 6, no. 2, p. 219, 2019, doi: 10.25126/jtiik.2019621105.
N. W. Wardani and P. G. S. C. Nugraha, "Stemming Teks Bahasa Bali dengan Algoritma Enhanced Confix Stripping,” International Journal of Natural Science and Engineering, vol. 4, no. 3, pp. 103–113, Dec. 2020, doi: 10.23887/ijnse.v4i3.30309.
O. V. Putra, F. M. Wasmanson, T. Harmini, and S. N. Utama, "Sundanese Twitter Dataset for Emotion Classification,” in CENIM 2020 - Proceeding: International Conference on Computer Engineering, Network, and Intelligent Multimedia 2020, Institute of Electrical and Electronics Engineers Inc., Nov. 2020, pp. 391–395. doi: 10.1109/CENIM51130.2020.9297929.
A. Sutedi, R. Elsen, and M. R. Nasrulloh, "Sundanese Stemming using Syllable Pattern,” Jurnal Online Informatika, vol. 6, no. 2, p. 218, Dec. 2021, doi: 10.15575/join.v6i2.812.
A. Ardiyanti Suryani, D. Hendratmo Widyantoro, A. Purwarianti, and Y. Sudaryat, "The rule-based sundanese stemmer,” ACM Transactions on Asian and Low-Resource Language Information Processing, vol. 17, no. 4, Jul. 2018, doi: 10.1145/3195634.
A. Sutedi, M. R. Nasrulloh, and R. Elsen, "Multi Rule-based and Corpus-based for Sundanese Stemmer,” Jurnal Online Informatika, vol. 7, no. 2, pp. 184–192, Dec. 2022, doi: 10.15575/join.v7i2.846.
A. Maesya, Y. Arifin, A. Zahra, and W. Budiharto, "Development of Sundanese Stemmer Based on Morphophonemics,” in 10th International Conference on ICT for Smart Society, ICISS 2023 - Proceeding, Institute of Electrical and Electronics Engineers Inc., 2023. doi: 10.1109/ICISS59129.2023.10291840.
R. Maulidi, "Modifikasi Metode Enhanced Confix Stripping,” Pros. Semin. Nas. FDI, no. December, pp. 12–15, 2016. [Online]. Available: https://www.researchgate.net/publication/311532738
F. H. Rachman, N. Ifada, S. Wahyuni, G. D. Ramadani, and A. Pawitra, "ModifiedECS (mECS) Algorithm for Madurese-Indonesian Rule-Based Machine Translation,” in 2022 International Conference of Science and Information Technology in Smart Administration, ICSINTESA 2022, Institute of Electrical and Electronics Engineers Inc., 2022, pp. 51–56. doi: 10.1109/ICSINTESA56431.2022.10041470.
E. Lindrawati, E. Utami, and A. Yaqin, "Comparison of Modified Nazief&Adriani and Modified Enhanced Confix Stripping algorithms for Madurese Language Stemming,” INTENSIF: Jurnal Ilmiah Penelitian dan Penerapan Teknologi Sistem Informasi, vol. 7, no. 2, pp. 276–289, Aug. 2023, doi: 10.29407/intensif.v7i2.20103.
Enni Lindrawati, Ema Utami, and A. Yaqin, "ANoM STEMMER: Nazief & Andriani Modification for Madurese Stemming,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 7, no. 6, pp. 1341–1347, Dec. 2023, doi: 10.29207/resti.v7i6.5086.
S. H. Wibowo, R. Toyib, M. Muntahanah, and Y. Darnita, "Time complexity in rejang language stemming,” JURNAL INFOTEL, vol. 14, no. 3, pp. 174–179, Aug. 2022, doi: 10.20895/infotel.v14i3.764.
S. H. Wibowo and S. Wibowo, "Development of Stemming Algorithm for Rejang Language Stemmer Based on Rejang Language Morphology View project Development of Stemming Algorithm for Rejang Language Stemmer Based on Rejang Language Morphology,” Article in Journal of Advanced Research in Dynamical and Control Systems, vol. 11, 2019, [Online]. Available: https://www.researchgate.net/publication/341307354
M. A. Muchtar et al., "Separation of Basic Words in Angkola Batak Text Documents using Enhanced Confix Stripping Stemmer Case: Mandailing Ethnic,” in IOP Conference Series: Materials Science and Engineering, Institute of Physics Publishing, Oct. 2019. doi: 10.1088/1757-899X/648/1/012024.
N. H. Hrp, M. Fikry, and Y. Yusra, "Algoritma Stemming Teks Bahasa Batak Angkola Berbasis Aturan Tata Bahasa,” Journal of Computer System and Informatics (JoSYC), vol. 4, no. 3, pp. 642–648, May 2023, doi: 10.47065/josyc.v4i3.3458.
R. Sovia, S. Defit, and Yuhandri, "Development of the Minangkabau Local Language Translation Machine Based on Stemming,” in Proceeding - 2022 International Symposium on Information Technology and Digital Innovation: Technology Innovation During Pandemic, ISITDI 2022, Institute of Electrical and Electronics Engineers Inc., 2022, pp. 195–198. doi: 10.1109/ISITDI55734.2022.9944457.
R. Sovia, S. Defit, Yuhandri, and Sulastri, "Development of natural language processing on morphology-based Minangkabau language stemming algorithm,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 31, no. 1, pp. 542–552, Jul. 2023, doi: 10.11591/ijeecs.v31.i1.pp542-552.
Muhammad Fikry and Yusra Yusra, "Stemmer Bahasa Melayu Riau Berdasarkan Aturan Morfologi,” Semin. Nas. Teknol. Inf. Komun. dan Ind., no. November, pp. 118–124, 2021, [Online]. Available: https://ejournal.uin-suska.ac.id/index.php/SNTIKI/article/view/14405
A.M, Tamrizal, "Algoritma Stemming untuk Teks Bahasa Kaili”, Magister thesis, Pascasarjana Magister Teknik Informatika, Universitas AMIKOM Yogyakarta, Yogyakarta, 2023.
Z. Abidin, A. Wijaya, and D. Pasha, "Aplikasi Stemming Kata Bahasa Lampung Dialek Api Menggunakan Pendekatan Brute-Force dan Pemograman C#,” Jurnal Media Informatika Budidarma, vol. 5, no. 1, p. 1, Jan. 2021, doi: 10.30865/mib.v5i1.2483.
A. Guterres, Gunawan, and J. Santoso, "Stemming Bahasa Tetun Menggunakan Pendekatan Rule Based,” Teknika, vol. 8, no. 2, pp. 142–147, Oct. 2019, doi: 10.34148/teknika.v8i2.224.
Y. F. Andriani, E. Utami, and S. Suwanto, "Modifikasi Algoritma Porter Stemmer Untuk Stemming Bahasa Sasak,” J. Inf. J. Penelit. dan Pengabdi. Masy., vol. 5, no. 3, pp. 61–64, 2020, doi: 10.46808/informa.v5i3.147.
Copyright (c) 2024 The Authors. Published by Universitas Airlangga.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
All accepted papers will be published under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. Authors retain copyright and grant the journal right of first publication. CC-BY Licenced means lets others to Share (copy and redistribute the material in any medium or format) and Adapt (remix, transform, and build upon the material for any purpose, even commercially).
