Enhancing the Comprehensiveness of Criteria-Level Explanation in Multi-Criteria Recommender System
Downloads
Background: The explainability of recommender systems (RSs) is currently attracting significant attention. Recent research mainly focus on item-level explanations, neglecting the need to provide comprehensive explanations for each criterion. In contrast, this research introduces a criteria-level explanation generated in a content-based pardigm by matching aspects between the user and item. However, generation may fall short when user aspects do not match perfectly with the item, despite possessing similar semantics.
Objective: This research aims to extend the aspect-matching method by leveraging semantic similarity. The extension provides more detail and comprehensive explanations for recommendations at the criteria level.
Methods: An extended version of the aspect matching (AM) method was used. This method identified identical aspects between users and items and obtained semantically similar aspects with closely related meanings.
Results: Experiment results from two real-world datasets showed that AM+ was superior to the AM method in coverage and relevance. However, the improvement varied depending on the dataset and criteria sparsity.
Conclusion: The proposed method improves the comprehensiveness and quality of the criteria-level explanation. Therefore, the adopted method has the potential to improve the explainability of multi-criteria RSs. The implication extends beyond the enhancement of explanation to facilitate better user engagement and satisfaction.
Keywords: Comprehensiveness, Content-Based Paradigm, Criteria-Level Explanation, Explainability, Multi-Criteria Recommender System
R. Rismala, N. U. Maulidevi, and K. Surendro, “Personalized neural network-based aggregation function in multi-criteria collaborative filtering,” Journal of King Saud University - Computer and Information Sciences, vol. 36, no. 1, p. 101922, Jan. 2024, doi: 10.1016/j.jksuci.2024.101922.
S. M. Al-Ghuribi and S. A. Mohd Noah, “Multi-Criteria Review-Based Recommender System–The State of the Art,” IEEE Access, vol. 7, pp. 169446–169468, 2019, doi: 10.1109/ACCESS.2019.2954861.
F. O. Isinkaye, Y. O. Folajimi, and B. A. Ojokoh, “Recommendation systems: Principles, methods and evaluation,” Egyptian Informatics Journal, vol. 16, no. 3, pp. 261–273, Nov. 2015, doi: 10.1016/j.eij.2015.06.005.
S. Sahu, R. Kumar, P. MohdShafi, J. Shafi, S. Kim, and M. F. Ijaz, “A Hybrid Recommendation System of Upcoming Movies Using Sentiment Analysis of YouTube Trailer Reviews,” Mathematics, vol. 10, no. 9, Art. no. 9, Jan. 2022, doi: 10.3390/math10091568.
A. Shankar et al., “An intelligent recommendation system in e-commerce using ensemble learning,” Multimed Tools Appl, vol. 83, no. 16, pp. 48521–48537, May 2024, doi: 10.1007/s11042-023-17415-1.
P. Keikhosrokiani and G. M. Fye, “A hybrid recommender system for health supplement e-commerce based on customer data implicit ratings,” Multimed Tools Appl, vol. 83, no. 15, pp. 45315–45344, May 2024, doi: 10.1007/s11042-023-17321-6.
S. V. Reddy, V. R. Krishna, R. J. Sapkal, J. Dhanke, S. P. Waghmare, and K. Kumar, “A cutting-edge artificial intelligence paradigm for entertainment-infused music recommendations,” Entertainment Computing, vol. 51, p. 100717, Sep. 2024, doi: 10.1016/j.entcom.2024.100717.
G. K. Shaw et al., “Entertainment Recommendation and Rating System Based on Emotions,” in Building Embodied AI Systems: The Agents, the Architecture Principles, Challenges, and Application Domains, P. Raj, A. Rocha, S. P. Singh, P. K. Dutta, and B. Sundaravadivazhagan, Eds., Cham: Springer Nature Switzerland, 2024, pp. 443–462. doi: 10.1007/978-3-031-68256-8_20.
N. Dehbozorgi, M. T. Kunuku, and S. Pouriyeh, “Personalized Pedagogy Through a LLM-Based Recommender System,” in Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky, A. M. Olney, I.-A. Chounta, Z. Liu, O. C. Santos, and I. I. Bittencourt, Eds., Cham: Springer Nature Switzerland, 2024, pp. 63–70. doi: 10.1007/978-3-031-64312-5_8.
J. Du, K. F. Hew, and L. Zhang, “Designing a recommender system to promote self-regulated learning in online contexts: A design-based study,” Educ Inf Technol, vol. 30, no. 2, pp. 2389–2428, Feb. 2025, doi: 10.1007/s10639-024-12867-w.
A. Yashudas, D. Gupta, G. C. Prashant, A. Dua, D. AlQahtani, and A. S. K. Reddy, “DEEP-CARDIO: Recommendation System for Cardiovascular Disease Prediction Using IoT Network,” IEEE Sensors Journal, vol. 24, no. 9, pp. 14539–14547, May 2024, doi: 10.1109/JSEN.2024.3373429.
C.-L. Ho, W.-L. Chen, and C.-H. Ou, “Constructing a personalized travel itinerary recommender system with the Internet of Things,” Wireless Netw, vol. 30, no. 7, pp. 6555–6567, Oct. 2024, doi: 10.1007/s11276-023-03453-y.
Y. Xian et al., “EX3: Explainable Attribute-aware Item-set Recommendations,” in Fifteenth ACM Conference on Recommender Systems, Amsterdam Netherlands: ACM, Sep. 2021, pp. 484–494. doi: 10.1145/3460231.3474240.
R. Rismala, N. U. Maulidevi, and K. Surendro, “Multi-Attribute BERT for Preferences Completion in Multi-Criteria Recommender System,” in Proceedings of the 2023 12th International Conference on Software and Computer Applications, in ICSCA ’23. New York, NY, USA: Association for Computing Machinery, Jun. 2023, pp. 315–320. doi: 10.1145/3587828.3587875.
C. Musto, M. De Gemmis, P. Lops, and G. Semeraro, “Generating post hoc review-based natural language justifications for recommender systems,” User Model User-Adap Inter, vol. 31, no. 3, pp. 629–673, Jul. 2021, doi: 10.1007/s11257-020-09270-8.
L. Li, Y. Zhang, and L. Chen, “Generate Neural Template Explanations for Recommendation,” in Proceedings of the 29th ACM International Conference on Information & Knowledge Management, Virtual Event Ireland: ACM, Oct. 2020, pp. 755–764. doi: 10.1145/3340531.3411992.
N. Tintarev and J. Masthoff, “Explaining Recommendations: Design and Evaluation,” in Recommender Systems Handbook, F. Ricci, L. Rokach, and B. Shapira, Eds., Boston, MA: Springer US, 2015, pp. 353–382. doi: 10.1007/978-1-4899-7637-6_10.
C. Musto, G. Rossiello, M. de Gemmis, P. Lops, and G. Semeraro, “Combining text summarization and aspect-based sentiment analysis of users’ reviews to justify recommendations,” in Proceedings of the 13th ACM Conference on Recommender Systems, in RecSys ’19. New York, NY, USA: Association for Computing Machinery, Sep. 2019, pp. 383–387. doi: 10.1145/3298689.3347024.
Z. C. Lipton, “The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.,” Queue, vol. 16, no. 3, pp. 31–57, Jun. 2018, doi: 10.1145/3236386.3241340.
C. Molnar, Interpretable Machine Learning. Leanpub, 2024. Accessed: Oct. 02, 2024. [Online]. Available: https://christophm.github.io/interpretable-ml-book/
Y. Zhang, G. Lai, M. Zhang, Y. Zhang, Y. Liu, and S. Ma, “Explicit factor models for explainable recommendation based on phrase-level sentiment analysis,” in Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval, Gold Coast Queensland Australia: ACM, Jul. 2014, pp. 83–92. doi: 10.1145/2600428.2609579.
G. Peake and J. Wang, “Explanation Mining: Post Hoc Interpretability of Latent Factor Models for Recommendation Systems,” in Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, in KDD ’18. New York, NY, USA: Association for Computing Machinery, Jul. 2018, pp. 2060–2069. doi: 10.1145/3219819.3220072.
X. Wang, Y. Chen, J. Yang, L. Wu, Z. Wu, and X. Xie, “A Reinforcement Learning Framework for Explainable Recommendation,” in 2018 IEEE International Conference on Data Mining (ICDM), Nov. 2018, pp. 587–596. doi: 10.1109/ICDM.2018.00074.
Y. Zhang and X. Chen, “Explainable Recommendation: A Survey and New Perspectives,” FNT in Information Retrieval, vol. 14, no. 1, pp. 1–101, 2020, doi: 10.1561/1500000066.
Y. Hou, N. Yang, Y. Wu, and P. S. Yu, “Explainable recommendation with fusion of aspect information,” World Wide Web, vol. 22, no. 1, pp. 221–240, Jan. 2019, doi: 10.1007/s11280-018-0558-1.
N. Wang, H. Wang, Y. Jia, and Y. Yin, “Explainable Recommendation via Multi-Task Learning in Opinionated Text Data,” in The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, Jun. 2018, pp. 165–174. doi: 10.1145/3209978.3210010.
J. L. Herlocker, J. A. Konstan, and J. Riedl, “Explaining collaborative filtering recommendations,” in Proceedings of the 2000 ACM conference on Computer supported cooperative work, Philadelphia Pennsylvania USA: ACM, Dec. 2000, pp. 241–250. doi: 10.1145/358916.358995.
G. Friedrich and M. Zanker, “A Taxonomy for Generating Explanations in Recommender Systems,” AI Magazine, vol. 32, no. 3, Art. no. 3, Jun. 2011, doi: 10.1609/aimag.v32i3.2365.
M. Bilgic and R. J. Mooney, “Explaining Recommendations: Satisfaction vs. Promotion,” eyond personalization workshop, IUI, vol. 5, p. 153, 2005.
M. Coyle and B. Smyth, “Explaining Search Results,” International Joint Conference on Artificial Intelligence, vol. 19, p. 1553, Jul. 2015.
P. Bai, Y. Xia, and Y. Xia, “Fusing Knowledge and Aspect Sentiment for Explainable Recommendation,” IEEE Access, vol. 8, pp. 137150–137160, 2020, doi: 10.1109/ACCESS.2020.3012347.
H. Wang, Y. Lu, and C. Zhai, “Latent aspect rating analysis on review text data: a rating regression approach,” in Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining, in KDD ’10. New York, NY, USA: Association for Computing Machinery, Jul. 2010, pp. 783–792. doi: 10.1145/1835804.1835903.
H. Wang, Y. Lu, and C. Zhai, “Latent aspect rating analysis without aspect keyword supervision,” in Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, in KDD ’11. New York, NY, USA: Association for Computing Machinery, Aug. 2011, pp. 618–626. doi: 10.1145/2020408.2020505.
J. McAuley, J. Leskovec, and D. Jurafsky, “Learning Attitudes and Attributes from Multi-aspect Reviews,” in 2012 IEEE 12th International Conference on Data Mining, Dec. 2012, pp. 1020–1025. doi: 10.1109/ICDM.2012.110.
J. J. McAuley and J. Leskovec, “From amateurs to connoisseurs: modeling the evolution of user expertise through online reviews,” in Proceedings of the 22nd international conference on World Wide Web, Rio de Janeiro Brazil: ACM, May 2013, pp. 897–908. doi: 10.1145/2488388.2488466.
N. R. Ahamed Kabeer, K. H. Gan, and E. Haris, “Domain-Specific Aspect-Sentiment Pair Extraction Using Rules and Compound Noun Lexicon for Customer Reviews,” Informatics, vol. 5, no. 4, Art. no. 4, Dec. 2018, doi: 10.3390/informatics5040045.
D. Chandrasekaran and V. Mago, “Evolution of Semantic Similarity—A Survey,” ACM Comput. Surv., vol. 54, no. 2, pp. 1–37, Mar. 2022, doi: 10.1145/3440755.
M. A. Hadj Taieb, T. Zesch, and M. Ben Aouicha, “A survey of semantic relatedness evaluation datasets and procedures,” Artif Intell Rev, vol. 53, no. 6, pp. 4407–4448, Aug. 2020, doi: 10.1007/s10462-019-09796-3.
C. De Boom, S. Van Canneyt, S. Bohez, T. Demeester, and B. Dhoedt, “Learning Semantic Similarity for Very Short Texts,” in 2015 IEEE International Conference on Data Mining Workshop (ICDMW), Nov. 2015, pp. 1229–1234. doi: 10.1109/ICDMW.2015.86.
J. Pennington, R. Socher, and C. Manning, “Glove: Global Vectors for Word Representation,” in Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar: Association for Computational Linguistics, 2014, pp. 1532–1543. doi: 10.3115/v1/D14-1162.
O. Abiola, A. Abayomi-Alli, O. A. Tale, S. Misra, and O. Abayomi-Alli, “Sentiment analysis of COVID-19 tweets from selected hashtags in Nigeria using VADER and Text Blob analyser,” Journal of Electrical Systems and Information Technology, vol. 10, no. 1, p. 5, Jan. 2023, doi: 10.1186/s43067-023-00070-9.
S. Bag, S. K. Kumar, and M. K. Tiwari, “An efficient recommendation generation using relevant Jaccard similarity,” Information Sciences, vol. 483, pp. 53–64, May 2019, doi: 10.1016/j.ins.2019.01.023.
M. Eminagaoglu, “A new similarity measure for vector space models in text classification and information retrieval,” Journal of Information Science, vol. 48, no. 4, pp. 463–476, Aug. 2022, doi: 10.1177/0165551520968055.
R. Singh and S. Singh, “Text Similarity Measures in News Articles by Vector Space Model Using NLP,” Journal of The Institution of Engineers (India): Series B, vol. 102, pp. 329–388, 2021, doi: https://doi.org/10.1007/s40031-020-00501-5.
MD. A. Iqbal, O. Sharif, M. M. Hoque, and I. H. Sarker, “Word Embedding based Textual Semantic Similarity Measure in Bengali,” Procedia Computer Science, vol. 193, pp. 92–101, Jan. 2021, doi: 10.1016/j.procs.2021.10.010.
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, Minnesota: Association for Computational Linguistics, Jun. 2019, pp. 4171–4186. doi: 10.18653/v1/N19-1423.
X. Chen, Y. Zhang, and J.-R. Wen, “Measuring ‘Why’ in Recommender Systems: a Comprehensive Survey on the Evaluation of Explainable Recommendation,” Feb. 13, 2022, arXiv: arXiv:2202.06466. Accessed: Jan. 25, 2024. [Online]. Available: http://arxiv.org/abs/2202.06466
Copyright (c) 2025 The Authors. Published by Universitas Airlangga.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
All accepted papers will be published under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. Authors retain copyright and grant the journal right of first publication. CC-BY Licenced means lets others to Share (copy and redistribute the material in any medium or format) and Adapt (remix, transform, and build upon the material for any purpose, even commercially).
