Tweets Responding to the Indonesian Government's Handling of COVID-19: Sentiment Analysis Using SVM with Normalized Poly Kernel
Downloads
Background: Handling COVID-19 (Corona Virus Disease-2019) in Indonesia was once trending on Twitter. The Indonesian government's handling evoked pros and cons in the community. Public opinions on Twitter can be used as a decision support system in making appropriate policies to evaluate government performance. A sentiment analysis method can be used to analyse public opinion on Twitter.
Objective: This study aims to understand public opinion trends on COVID-19 in Indonesia both from a general perspective and an economic perspective.
Methods: We used tweets from Twitterscraper library. Because they did not have a label, we provided labels using sentistrength_id and experts to be classified into positive, negative, and neutral sentiments. Then, we carried out a pre-processing to eliminate duplicate and irrelevant data. Next, we employed machine learning to predict the sentiments for new data. After that, the machine learning algorithms were evaluated using confusion matrix and K-fold cross-validation.
Results: The SVM analysis on the sentiments on general aspects using two-classes dataset achieved the highest performance in average accuracy, precision, recall, and f-measure with the value of 82.00%, 82.24%, 82.01%, and 81.84%, respectively.
Conclusion: From the economic perspective, people seemed to agree with the government's policies in dealing with COVID-19; but people were not satisfied with the government performance in general. The SVM algorithm with the Normalized Poly Kernel can be used as an intelligent algorithm to predict sentiment on Twitter for new data quickly and accurately.
Katadata, "Berapa pengguna media sosial indonesia?,” katadata.id, 2019. https://databoks.katadata.co.id/datapublish/2019/02/08/berapa-pengguna-media-sosial-indonesia (accessed May 05, 2020).
AntaraNews, "Pengguna Twitter indonesia tumbuh pesat di 2018,” AntaraNews.com, 2019. https://www.antaranews.com/berita/839825/pengguna-twitter-indonesia-tumbuh-pesat-pada-2018 (accessed May 05, 2020).
Gugus Percepatan Penanganan COVID-19, "Data Covid-19 di Indonesia,” covid19.go.id, 2020. https://covid19.go.id/ (accessed May 14, 2020).
Suara, "Pemerintah Indonesia dinilai lambat mengantisipasi covid-19 sejak dini,” suara.com, 2020. https://www.suara.com/news/2020/04/10/025500/pemerintah-indonesia-dinilai-lambat-mengantisipasi-covid-19-sejak-dini?page=all (accessed May 14, 2020).
DetikNews, "Pemerintah dinilai lambat tangani corona, Jokowi: Kita tak ingin grasa-grusu,” news.detik.com, 2020. https://news.detik.com/berita/d-4987368/pemerintah-dinilai-lambat-tangani-corona-jokowi-kita-tak-ingin-grasa-grusu (accessed May 14, 2020).
I. Zulfa and E. Winarko, "Sentimen analisis tweet berbahasa Indonesia dengan deep belief network,” IJCCS (Indonesian J. Comput. Cybern. Syst., vol. 11, no. 2, pp. 187, 2017, doi: 10.22146/ijccs.24716.
J. Michie, "The covid-19 crisis – and the future of the economy and economics,” Int. Rev. Appl. Econ., vol. 34, no. 3, pp. 301–303, 2020, doi: 10.1080/02692171.2020.1756040.
R. Shahid, S. T. Javed, and K. Zafar, "Feature selection based classification of sentiment analysis using biogeography optimization algorithm,” in 2017 International Conference on Innovations in Electrical Engineering and Computational Technologies (ICIEECT), 2017, pp. 1–5, doi: 10.1109/ICIEECT.2017.7916549.
D. A. Kristiyanti, A. H. Umam, M. Wahyudi, R. Amin, and L. Marlinda, "Comparison of SVM Naí¯ve Bayes Algorithm for sentiment analysis toward West Java Governor candidate period 2018-2023 based on public opinion on Twitter,” in 2018 6th International Conference on Cyber and IT Service Management, CITSM 2018, 2018, pp. 1–6, doi: 10.1109/CITSM.2018.8674352.
G. Singh, B. Kumar, L. Gaur, and A. Tyagi, "Comparison between Multinomial and Bernoulli Naí¯ve Bayes for Text Classification,” in 2019 International Conference on Automation, Computational and Technology Management, ICACTM, 2019, pp. 593–596, doi: 10.1109/ICACTM.2019.8776800.
A. A. Lutfi, A. E. Permanasari, and S. Fauziati, "Sentiment analysis in the sales review of Indonesian marketplace by utilizing Support Vector Machine,” J. Inf. Syst. Eng. Bus. Intell., vol. 4, no. 2, p. 169, 2018, doi: 10.20473/jisebi.4.2.169.
A. M. Rahat, A. Kahir, and A. K. M. Masum, "Comparison of Naive Bayes and SVM Algorithm based on sentiment analysis using review dataset,” in 8th International Conference on System Modeling & Advancement in Research Trends, 2020, pp. 266–270, doi: 10.1109/smart46866.2019.9117512.
S. Rana and A. Singh, "Comparative analysis of sentiment orientation using SVM and Naive Bayes techniques,” in 2nd International Conference on Next Generation Computing Technologies, 2016, pp. 106–111, doi: 10.1109/NGCT.2016.7877399.
U. Kumari, A. K. Sharma, and D. Soni, "Sentiment analysis of smart phone product review using SVM classification technique,” in International Conference on Energy, Communication, Data Analytics and Soft Computing, 2017, pp. 1469–1474.
B. Shamantha Rai, S. M. Shetty, and P. Rai, "Sentiment analysis using machine learning classifiers: evaluation of performance,” in 2019 IEEE 4th International Conference on Computer and Communication Systems, ICCCS, 2019, pp. 21–25, doi: 10.1109/CCOMS.2019.8821650.
M. Wongkar and A. Angdresey, "Sentiment analysis using Naive Bayes Algorithm of the data crawler: Twitter,” in Proceedings of 2019 4th International Conference on Informatics and Computing, ICIC, 2019, pp. 1–5, doi: 10.1109/ICIC47613.2019.8985884.
P. Juneja and U. Ojha, "Casting online votes: To predict offline results using sentiment analysis by machine learning classifiers,” in 8th International Conference on Computing, Communications and Networking Technologies, ICCCNT 2017, 2017, pp. 1–6, doi: 10.1109/ICCCNT.2017.8203996.
M. I. Zul, F. Yulia, and D. Nurmalasari, "Social media sentiment analysis using K-means and naí¯ve bayes algorithm,” in Proceedings - 2018 2nd International Conference on Electrical Engineering and Informatics, 2018, pp. 24–29, doi: 10.1109/ICon-EEI.2018.8784326.
S. L. Ramdhani, R. Andreswari, and M. A. Hasibuan, "Sentiment analysis of product reviews using Naive Bayes Algorithm: A Case Study,” in Proceedings - 2nd East Indonesia Conference on Computer and Information Technology: Internet of Things for Industry, EIConCIT, 2018, pp. 123–127, doi: 10.1109/EIConCIT.2018.8878528.
L. Muflikhah, D. J. Haryanto, A. A. Soebroto, and E. Santoso, "High performance of polynomial kernel at SVM Algorithm for sentiment analysis,” J. Inf. Technol. Comput. Sci., vol. 3, no. 2, p. 194, 2018, doi: 10.25126/jitecs.20183260.
M. M. Hossain and M. S. Miah, "Evaluation of different SVM kernels for predicting customer churn,” in 2015 18th International Conference on Computer and Information Technology, ICCIT 2015, 2016, pp. 1–4, doi: 10.1109/ICCITechn.2015.7488032.
S. Arafin Mahtab, N. Islam, and M. Mahfuzur Rahaman, "Sentiment Analysis on Bangladesh Cricket with Support Vector Machine,” in 2018 International Conference on Bangla Speech and Language Processing, ICBSLP, 2018, pp. 21–22, doi: 10.1109/ICBSLP.2018.8554585.
J. A. Banados and K. J. Espinosa, "Optimizing Support Vector Machine in classifying sentiments on product brands from Twitter,” in IISA 2014 - 5th International Conference on Information, Intelligence, Systems and Applications, 2014, pp. 75–80, doi: 10.1109/IISA.2014.6878768.
S. K. Trivedi and S. Dey, "Effect of Various Kernels and Feature Selection Methods on SVM Performance for Detecting Email Spams,” Int. J. Comput. Appl., vol. 66, no. 21, pp. 18–23, 2013, doi: 10.5120/11240-6433.
A. Alalshekmubarak, A. Hussain, and Q.-F. Wang, "Off-Line Handwritten Arabic Word Recognition Using SVMs with Normalized Poly Kernel,” in Neural Information Processing, 2012, pp. 85–91.
M. O. Pratama et al., "The sentiment analysis of Indonesia commuter line using machine learning based on twitter data,” J. Phys. Conf. Ser., vol. 1193, no. 1, pp. 1–6, 2019, doi: 10.1088/1742-6596/1193/1/012029.
Taspinar, "Twitterscraper Library.” https://github.com/taspinar/twitterscraper (accessed May 07, 2020).
D. H. Wahid and A. SN, "Peringkasan Sentimen Esktraktif di Twitter Menggunakan Hybrid TF-IDF dan Cosine Similarity,” Indonesian J. Comput. Cybern. Syst., vol. 10, no. 2, pp. 207–218, 2016, [Online]. Available: https://journal.ugm.ac.id/ijccs/article/view/16625/11694.
Sastrawi, "Sastrawi Library.” https://pypi.org/project/Sastrawi/ (accessed May 05, 2020).
P. P. M. Surya, L. V. Seetha, and B. Subbulakshmi, "Analysis of user emotions and opinion using Multinomial Naive Bayes Classifier,” in Proceedings of the 3rd International Conference on Electronics and Communication and Aerospace Technology, ICECA 2019, 2019, pp. 410–415, doi: 10.1109/ICECA.2019.8822096.
T. Tokunaga, T. Tokunaga, I. Makoto, and I. Makoto, "Text categorization based on weighted inverse document frequency,” Spec. Interes. Groups Inf. Process Soc. Japan (SIG-IPSJ), 1994, [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.49.7015.
J. Ren, S. D. Lee, X. Chen, B. Kao, R. Cheng, and D. Cheung, "Naive bayes classification of uncertain data,” in Proceedings - IEEE International Conference on Data Mining, ICDM, 2009, no. September 2014, pp. 944–949, doi: 10.1109/ICDM.2009.90.
E. Prasetyo, Data Mining - mengolah data menjadi informasi menggunakan Matlab. Penerbit Andi, 2014.
I. H. Witten, E. Frank, and M. A. Hall, Data Mining Practical Machine Learning Tools and Techniques, Third Edit. Burlington: Elsevier, 2010.
Authors who publish with this journal agree to the following terms:
All accepted papers will be published under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. Authors retain copyright and grant the journal right of first publication. CC-BY Licenced means lets others to Share (copy and redistribute the material in any medium or format) and Adapt (remix, transform, and build upon the material for any purpose, even commercially).
