Aspect-based Sentiment and Correlation-based Emotion Detection on Tweets for Understanding Public Opinion of Covid-19
Downloads
Background: During the Covid-19 period, the government made policies dealing with it. Policies issued by the government invited public opinion as a form of public reaction to these policies. The easiest way to find out the public's response is through Twitter's social media. However, Twitter data have limitations. There is a mix between facts and personal opinions. It is necessary to distinguish between these. Opinions expressed by the public can be both positive and negative, so correlation is needed to link opinions and their emotions.
Objective: This study discusses sentiment and emotion detection to understand public opinion accurately. Sentiment and emotion are analyzed using Pearson correlation to determine the correlation.
Methods: The datasets were about public opinion of Covid-19 retrieved from Twitter. The data were annotated into sentiment and emotion using Pearson correlation. After the annotation process, the data were preprocessed. Afterward, single model classification was carried out using machine learning methods (Support Vector Machine, Random Forest, Naí¯ve Bayes) and deep learning method (Bidirectional Encoder Representation from Transformers). The classification process was focused on accuracy and F1-score evaluation.
Results: There were three scenarios for determining sentiment and emotion, namely the factor of aspect-based and correlation-based, without those factors, and aspect-based sentiment only. The scenario using the two aforementioned factors obtained an accuracy value of 97%, while an accuracy of 96% was acquired without them.
Conclusion: The use of aspect and correlation with Pearson correlation has helped better understand public opinion regarding sentiment and emotion more accurately.
Keywords: Aspect-based sentiment, Deep learning, Emotion detection, Machine learning, Pearson correlation, Public opinion.
A. Roziqin, S. Y. F. Mas'udi, and I. T. Sihidi, "An analysis of Indonesian government policies against COVID-19,” Public Administration and Policy, vol. 24, no. 1, pp. 92–107, 2021, doi: 10.1108/PAP-08-2020-0039.
S. R. Anggraeni, N. A. Ranggianto, I. Ghozali, C. Fatichah, and D. Purwitasari, "Deep learning approaches for multi-label incidents classification from Twitter textual information,” Journal of Information Systems Engineering and Business Intelligence, vol. 8, no. 1, pp. 31–41, 2022, doi: 10.20473/jisebi.8.1.31-41.
I. Aygun, B. Kaya, and M. Kaya, "Aspect based Twitter sentiment analysis on vaccination and vaccine types in COVID-19 pandemic with deep learning,” IEEE J Biomed Health Inform, vol. 26, no. 5, pp. 2360–2369, 2022, doi: 10.1109/JBHI.2021.3133103.
A. García-Pablos, M. Cuadros, and G. Rigau, "W2VLDA: Almost unsupervised system for aspect based sentiment analysis,” Expert Syst Appl, vol. 91, pp. 127–137, 2018, doi: 10.1016/j.eswa.2017.08.049.
I. Surjandari, R. A. Wayasti, E. Laoh, Zulkarnain, A. M. M. Rus, and I. Prawiradinata, "Mining public opinion on ride-hailing service providers using aspect-based sentiment analysis,” International Journal of Technology, vol. 10, no. 4, pp. 818–828, 2019, doi: 10.14716/ijtech.v10i4.2860.
A. Mathur, P. Kubde, and S. Vaidya, "Emotional analysis using Twitter data during pandemic situation: COVID-19.”
M. E. Mowlaei, M. Saniee Abadeh, and H. Keshavarz, "Aspect-based sentiment analysis using adaptive aspect-based lexicons,” Expert Syst Appl, vol. 148, 2020, doi: 10.1016/j.eswa.2020.113234.
A. Nazir, Y. Rao, L. Wu, and L. Sun, "Issues and challenges of aspect-based sentiment analysis: a comprehensive survey,” IEEE Transactions on Affective Computing, vol. 13, no. 2. Institute of Electrical and Electronics Engineers Inc., pp. 845–863, 2022. doi: 10.1109/TAFFC.2020.2970399.
F. A. Acheampong, C. Wenyu, and H. Nunoo-Mensah, "Text-based emotion detection: advances, challenges, and opportunities,” Engineering Reports, vol. 2, no. 7. John Wiley and Sons Inc, 2020. doi: 10.1002/eng2.12189.
P. Nandwani and R. Verma, "A review on sentiment analysis and emotion detection from text,” Social Network Analysis and Mining, vol. 11, no. 1. Springer, 2021. doi: 10.1007/s13278-021-00776-6.
S. Boon-Itt and Y. Skunkan, "Public perception of the COVID-19 pandemic on twitter: sentiment analysis and topic modeling study,” JMIR Public Health Surveill, vol. 6, no. 4, 2020, doi: 10.2196/21978.
A. S. Imran, S. M. Daudpota, Z. Kastrati, and R. Batra, "Cross-cultural polarity and emotion detection using sentiment analysis and deep learning on covid-19 related tweets,” IEEE Access, vol. 8, pp. 181074–181090, 2020, doi: 10.1109/ACCESS.2020.3027350.
C. Qian, N. Mathur, N. H. Zakaria, R. Arora, V. Gupta, and M. Ali, "Understanding public opinions on social media for financial sentiment analysis using AI-based techniques,” Inf Process Manag, vol. 59, no. 6, 2022, doi: 10.1016/j.ipm.2022.103098.
W. J. Wu and Y. Xu, "Correlation analysis of visual verbs' subcategorization based on Pearson's correlation coefficient,” in 2010 International Conference on Machine Learning and Cybernetics, ICMLC 2010, 2010, vol. 4, pp. 2042–2046. doi: 10.1109/ICMLC.2010.5580507.
H. Adamu, S. L. Lutfi, N. H. A. H. Malim, R. Hassan, A. di Vaio, and A. S. A. Mohamed, "Framing twitter public sentiment on Nigerian government COVID-19 palliatives distribution using machine learning,” Sustainability (Switzerland), vol. 13, no. 6, 2021, doi: 10.3390/su13063497.
F. A. Acheampong, H. Nunoo-Mensah, and W. Chen, "Transformer models for text-based emotion detection: a review of BERT-based approaches,” Artif Intell Rev, vol. 54, no. 8, pp. 5789–5829, 2021, doi: 10.1007/s10462-021-09958-2.
S. Thara and S. Sidharth, "Aspect based sentiment classification: Svd features,” in 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), 2017, pp. 2370–2374. doi: 10.1109/ICACCI.2017.8126201.
S. S. Aljameel et al., "A sentiment analysis approach to predict an individual's awareness of the precautionary procedures to prevent covid-19 outbreaks in Saudi Arabia,” Int J Environ Res Public Health, vol. 18, no. 1, pp. 1–12, 2021, doi: 10.3390/ijerph18010218.
I. Perikos and I. Hatzilygeroudis, "Aspect based sentiment analysis in social media with classifier ensembles,” in Proceedings - 16th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2017, 2017, pp. 273–278. doi: 10.1109/ICIS.2017.7960005.
N. Leelawat et al., "Twitter data sentiment analysis of tourism in Thailand during the COVID-19 pandemic using machine learning,” Heliyon, vol. 8, no. 10, 2022, doi: 10.1016/j.heliyon.2022.e10894.
Y. al Amrani, M. Lazaar, and K. E. el Kadirp, "Random forest and support vector machine based hybrid approach to sentiment analysis,” in Procedia Computer Science, 2018, vol. 127, pp. 511–520. doi: 10.1016/j.procs.2018.01.150.
M. G. Sousa, K. Sakiyama, L. D. S. Rodrigues, P. H. Moraes, E. R. Fernandes, and E. T. Matsubara, "BERT for stock market sentiment analysis,” in Proceedings - International Conference on Tools with Artificial Intelligence, ICTAI, Nov. 2019, 2019, pp. 1597–1601. doi: 10.1109/ICTAI.2019.00231.
M. Pota, M. Ventura, H. Fujita, and M. Esposito, "Multilingual evaluation of pre-processing for BERT-based sentiment analysis of tweets,” Expert Syst Appl, vol. 181, 2021, doi: 10.1016/j.eswa.2021.115119.
M. Behzadi, I. G. Harris, and A. Derakhshan, "Rapid Cyber-bullying detection method using Compact BERT Models,” in Proceedings - 2021 IEEE 15th International Conference on Semantic Computing, ICSC 2021, 2021, pp. 199–202. doi: 10.1109/ICSC50631.2021.00042.
Apriantoni Apriantoni, D. Purwitasari, and A. B. Raharjo, "Indonesian tweets dataset for identifying emotion changes among Twitter users following the onset of the COVID-19,” 2022. https://data.mendeley.com/datasets/x8t4gn6mt6 (accessed Feb. 25, 2023).
Dionisius Darryl Hermansyah, "COVID-19 Indonesian tweets,” 2021. https://www.kaggle.com/datasets/dionisiusdh/covid19-indonesian-twitter-sentiment (accessed Feb. 25, 2023).
Buitinck et al, "API design for machine learning software: experiences from the scikit-learn project,” 2013.
"BERT.” https://huggingface.co/docs/transformers/model_doc/bert (accessed Feb. 08, 2023).
J. He, L. Xu, Y. Fan, Z. Xu, M. Yan, and Y. Lei, "Deep learning based valid bug reports determination and explanation,” in Proceedings - International Symposium on Software Reliability Engineering, ISSRE, Oct. 2020, 2020, pp. 184–194. doi: 10.1109/ISSRE5003.2020.00026.
A. Spicer, "Organizational culture and COVID-19,” Journal of Management Studies, vol. 57, no. 8. Blackwell Publishing Ltd, pp. 1737–1740, 2020. doi: 10.1111/joms.12625.
J. M. Baena-Diéz, M. Barroso, S. I. Cordeiro-Coelho, J. L. Diáz, and M. Grau, "Impact of COVID-19 outbreak by income: hitting hardest the most deprived,” Journal of Public Health (United Kingdom), vol. 42, no. 4, pp. 698–703, 2020, doi: 10.1093/pubmed/fdaa136.
M. Kowal et al., "Who is the most stressed during the COVID-19 pandemic? data from 26 countries and areas,” Appl Psychol Health Well Being, vol. 12, no. 4, pp. 946–966, 2020, doi: 10.1111/aphw.12234.
F. Glowacz and E. Schmits, "Psychological distress during the COVID-19 lockdown: the young adults most at risk,” Psychiatry Res, vol. 293, 2020, doi: 10.1016/j.psychres.2020.113486.
P. Jiang, J. J. KlemeÅ¡, Y. van Fan, X. Fu, and Y. M. Bee, "More is not enough: a deeper understanding of the covid-19 impacts on healthcare, energy and environment is crucial,” International Journal of Environmental Research and Public Health, vol. 18, no. 2. MDPI AG, pp. 1–22, 2021. doi: 10.3390/ijerph18020684.
S. P. J. M. Horbach, "Pandemic publishing: Medical journals strongly speed up their publication process for covid-19,” Quantitative Science Studies, vol. 1, no. 3, pp. 1056–1067, 2020, doi: 10.1162/qss_a_00076.
S. Gautam and L. Hens, "COVID-19: impact by and on the environment, health and economy,” Environment, Development and Sustainability, vol. 22, no. 6. Springer, pp. 4953–4954, 2020. doi: 10.1007/s10668-020-00818-7.
Copyright (c) 2023 The Authors. Published by Universitas Airlangga.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
All accepted papers will be published under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. Authors retain copyright and grant the journal right of first publication. CC-BY Licenced means lets others to Share (copy and redistribute the material in any medium or format) and Adapt (remix, transform, and build upon the material for any purpose, even commercially).
