Information Quality of Business Intelligence Systems: A Maturity-based Assessment
Downloads
Background: The primary role of a Business Intelligence (BI) system is to provide information to decision-makers within an organization. Moreover, it is crucial to acknowledge that the quality of this information is of greatest significance. Several studies have extensively discussed the importance of information quality in information systems, including BI. However, there is relatively little discussion on the factors influencing 'Information quality”.
Objective: This study aimed to address this literature gap by investigating the determinants of BI maturity that impacted information quality.
Methods: A maturity model comprising three dimensions was introduced, namely Data quality, BI infrastructure, and Data-driven culture. Data were collected from 84 companies and were analyzed using the SEM-PLS approach.
Results: The analysis showed that maturity had a highly positive influence on Information Quality, validating the relevance of the three proposed determinant factors.
Conclusion: This study suggested and strongly supported the importance and relevance of Data quality, BI infrastructure, and Data-driven culture as key dimensions of BI maturity. The robust statistical relationship between maturity and information quality showed the effectiveness of approaching the systems from a maturity perspective. This investigation paved the way for exploring additional dimensions that impact Information quality.
Keywords: BI infrastructure, BI maturity, Data-driven culture, Data quality, Information quality.
C. S. Reddy, R. S. Sangam, and B. Srinivasa Rao, "A Survey on business intelligence tools for marketing, financial, and transportation services,” in Smart Intelligent Computing and Applications, S. C. Satapathy, V. Bhateja, and S. Das, Eds., in Smart Innovation, Systems and Technologies, vol. 105. Singapore: Springer Singapore, 2019, pp. 495–504. doi: 10.1007/978-981-13-1927-3_53.
T. Ermakova, J. Blume, B. Fabian, E. Fomenko, M. Berlin, and M. Hauswirth, "Beyond the hype: why do data-driven projects fail?,” in the Hawaii International Conference on System Sciences, 2021. doi: 10.24251/HICSS.2021.619.
A. Ahmad, "Business intelligence for sustainable competitive advantage,” in Advances in Business Marketing and Purchasing, Emerald Group Publishing Limited, 2015, pp. 3–220. doi: 10.1108/S1069-096420150000022014.
L. Rao-Graham, M. L. McNaughton, and G. Mansingh, Business intelligence for small and medium-sized enterprises: an agile roadmap toward business sustainability, 1st ed. Auerbach Publications, 2019. doi: 10.1201/9780429316371.
P. R. Clavier, H. H. Lotriet, and J. J. van Loggerenberg, "Business intelligence challenges in the context of goods- and service-dominant logic,” in 2012 45th Hawaii International Conference on System Sciences, Maui, HI, USA: IEEE, Jan. 2012, pp. 4138–4147. doi: 10.1109/HICSS.2012.138.
I. Mordor, "Part de marché de la Business Intelligence, taille (2022-27) | Croissance de l'industrie.” https://www.mordorintelligence.com/fr/industry-reports/global-business-intelligence-bi-vendors-market-industry (accessed Jun. 06, 2023).
R. A. Lehman, H. J. Watson, B. H. Wixom, and J. A. Hoffer, "Continental airlines flies high with real-time business intelligence,” MIS Quarterly Executive, vol. 3, no. 4, p. 30, 2008.
B. H. Wixom, H. J. Watson, A. M. Reynolds, and J. A. Hoffer, "Continental airlines continues to soar with business intelligence,” Information Systems Management, vol. 25, no. 2, pp. 102–112, 2008, doi: 10.1080/10580530801941496.
T. H. Davenport and J. G. Harris, "Competing on Analytics,” Harvard Business Review, Jan. 01, 2006. Accessed: Aug. 15, 2021. [Online]. Available: https://hbr.org/2006/01/competing-on-analytics
G. Loveman, "data-mining-at-harrah.pdf,” Harvard Business Review, p. 5, May 2003.
R. SHARDA, D. DURSUN, and E. TURBAN, Business intelligence and analytics: systems for decision support, Tenth edition. Boston: Pearson, 2015.
J. S. Valacich and C. Schneider, Information systems today _ managing in the digital world, SEVENTH EDITION. New Jersey: Pearson Education, 2016.
B. Ramesh and A. Ramakrishna, "Unified business intelligence ecosystem: a project management approach to address business intelligence challenges,” in 2018 Portland International Conference on Management of Engineering and Technology (PICMET), Honolulu, HI: IEEE, Aug. 2018, pp. 1–10. doi: 10.23919/PICMET.2018.8481744.
VentureBeat, "Why do 87% of data science projects never make it into production?,” VentureBeat, Jul. 19, 2019. https://venturebeat.com/ai/why-do-87-of-data-science-projects-never-make-it-into-production/ (accessed Mar. 12, 2023).
J. Pereira, M. Basto, and A. Ferreira-da-Silva, "Comparative Analysis between Statistical and Artificial Intelligence Models in Business Failure Prediction,” JMS, vol. 4, no. 1, p. p114, Feb. 2014, doi: 10.5539/jms.v4n1p114.
M. R. Arizmendi and L. Stapleton, "Failure Factors in the Control of Large-Scale Business Intelligence Systems Development Projects,” IFAC-PapersOnLine, vol. 52, no. 25, pp. 579–584, 2019, doi: 10.1016/j.ifacol.2019.12.609.
J. JakliÄ, P. Coelho, and A. PopoviÄ, "Information Quality Improvement as a Measure of Business Intelligence System Benefits,” WSEAS Transactions on Business and Economics, vol. 6, Sep. 2009.
A. Lönnqvist and V. Pirttimäki, "The measurement of business intelligence,” Information Systems Management, vol. 23, no. 1, p. 9, 2006.
S. Negash and P. Gray, "Business intelligence,” in Ninth Americas Conference on Information Systems, 2003, p. 10.
M. Kowalczyk and P. Buxmann, "Investigating business intelligence and analytics from a decision process perspective: a structured literature review”.
A. PopoviÄ, P. S. Coelho, and J. JakliÄ, "Absorption of information provided by business intelligence systems-the effect of information quality on the use of information in business processes,” in Proceedings of the 12th International Conference on Enterprise Information Systems, Funchal, Madeira, Portugal: SciTePress-Science and and Technology Publications, 2010, pp. 176–181. doi: 10.5220/0002890901760181.
T. de Bruin, M. Rosemann, and R. Freeze, "Understanding the main phases of developing a maturity assessment model,” p. 11, 2005.
N. Ain, G. Vaia, W. H. DeLone, and M. Waheed, "Two decades of research on business intelligence system adoption, utilization and success – A systematic literature review,” Decision Support Systems, vol. 125, p. 113113, Oct. 2019, doi: 10.1016/j.dss.2019.113113.
A. Ait Touil and S. Jabraoui, "Les modèles de maturité de la business intelligence Analyse comparative.,” Revue Marocaine de la Prospective en Sciences de Gestion, vol. 2022, no. 4, p. 16, May 2022.
A. PopoviÄ, P. S. Coelho, C. de Campolide, and J. Jakli, "The impact of business intelligence system maturity on information quality,” Information Research, vol. 14, no. 4, p. 26, 2009.
C. Soh and M. L. Markus, "How it creates business value: a process theory synthesis,” in Proceedings of the Sixteenth International Conference on Information Systems, Amsterdam, The Netherlands, 1995, pp. 29–41.
N. Melville, K. Kraemer, and V. Gurbaxani, "Information technology and organizational performance: an integrative model of it business value,” MIS Quarterly, vol. 28, no. 2, pp. 283–322, 2004, doi: 10.2307/25148636.
R. Skyrius, G. KazakeviÄienÄ—, and V. Bujauskas, "From management information systems to business intelligence: the development of management information needs,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 2, no. 3, Art. no. 3, 2013, doi: 10.9781/ijimai.2013.234.
V.-H. Trieu, "Getting value from business intelligence systems: a review and research agenda,” Decision Support Systems, vol. 93, pp. 111–124, 2017, doi: 10.1016/j.dss.2016.09.019.
L. Fink, N. Yogev, and A. Even, "Business intelligence and organizational learning: an empirical investigation of value creation processes,” Information & Management, vol. 54, no. 1, Art. no. 1, 2017, doi: 10.1016/j.im.2016.03.009.
D. J. Teece, "Explicating dynamic capabilities: the nature and microfoundations of (sustainable) enterprise performance,” Strategic Management Journal, vol. 28, no. 13, Art. no. 13, 2007, doi: 10.1002/smj.640.
D. J. Teece, G. Pisano, and A. Shuen, "Dynamic capabilities and strategic management,” Strategic Management Journal, vol. 18, no. 7, Art. no. 7, 1997, doi: 10.1002/(SICI)1097-0266(199708)18:7<509::AID-SMJ882>3.0.CO;2-Z.
G. Klimko, "Knowledge management and maturity models: Building common understanding,” in Second European conference on knowledge management, in Second European Conference on Knowledge Management. Slovenia: Academic Conferences Limited, 2001, pp. 269–278.
D. Proença and J. Borbinha, "Maturity models for information systems - a state of the art,” Procedia Computer Science, vol. 100, pp. 1042–1049, 2016, doi: 10.1016/j.procs.2016.09.279.
I. H. Rajteric, "Overview of business intelligence maturity models,” Management, vol. 15, no. 1, pp. 47–67, 2010.
G. Lahrmann and F. Marx, "Systematization of maturity model extensions,” in Global Perspectives on Design Science Research, R. Winter, J. L. Zhao, and S. Aier, Eds., in Lecture Notes in Computer Science, vol. 6105. Berlin, Heidelberg: Springer Berlin Heidelberg, 2010, pp. 522–525. doi: 10.1007/978-3-642-13335-0_36.
H. Xu, "ERP implementation satisfaction-a data quality approach,” Journal of Technology Research, vol. 8, p. 17, 2019.
C. Batini and M. Scannapieco, "Data and information quality: dimensions, principles and techniques," in Data-Centric Systems and Applications. Cham: Springer International Publishing, 2016. doi: 10.1007/978-3-319-24106-7.
Y. Lin and A. K. M. Hadi, "Evaluation of information quality in business intelligence as a key success factor for using decision support system,” p. 95, 2011.
R. Y. Wang and D. M. Strong, "Beyond accuracy: what data quality means to data consumers,” Journal of Management Information Systems, vol. 12, no. 4, pp. 5–33, 1996.
L. Marshall and R. De la Harpe, "Decision making in the context of business intelligence and data quality,” S. Afr. j. inf. manag., vol. 11, no. 2, 2009, doi: 10.4102/sajim.v11i2.404.
D. M. Strong, Y. W. Lee, and R. Y. Wang, "Data quality in context,” Commun. ACM, vol. 40, no. 5, pp. 103–110, 1997, doi: 10.1145/253769.253804.
H. Watson, T. Ariyachandra, and R. J. Matyska, "Data warehousing stages of growth,” Information Systems Management, vol. 18, no. 3, pp. 42–50, 2001, doi: 10.1201/1078/43196.18.3.20010601/31289.6.
G. Lahrmann, F. Marx, R. Winter, and F. Wortmann, "Business intelligence maturity: development and evaluation of a theoretical model,” th Hawaii International Conference on System Sciences, p. 11, 2011.
S. Williams and N. Williams, The Profit Impact of Business Intelligence, Updated and rev.[New ed.]. in The Morgan Kaufmann series in interactive technologies. Amsterdam ; Boston: Elsevier/Morgan Kaufmann Publishers, 2008.
M. Alsqour, M. Owoc, and K. Matouk, "A survey of data warehouse architectures-preliminary results,” in Federated Conference on Computer Science and Information Systems (FedCSIS), Poland, 2012.
Piccoli and Ives, "Review: IT-dependent strategic initiatives and sustained competitive advantage: A Review and Synthesis of the Literature,” MIS Quarterly, vol. 29, no. 4, p. 747, 2005, doi: 10.2307/25148708.
Chen, Chiang, and Storey, "Business intelligence and analytics: from big data to big impact,” MIS Quarterly, vol. 36, no. 4, p. 1165, 2012, doi: 10.2307/41703503.
A. Bharadwaj, V. Sambamurthy, and R. Zmud, "IT capabilities: Theoretical perspectives and empirical operationalization,” in Proceedings of the 19th International Conference on Information Systems, Helsinki, Finland, 1998, pp. 378–385. doi: 10.1145/352925.352962.
N. Elgendy and A. Elragal, "Big data analytics in support of the decision making process,” Procedia Computer Science, vol. 100, pp. 1071–1084, 2016, doi: 10.1016/j.procs.2016.09.251.
H. J. Watson and B. H. Wixom, "The current state of business intelligence,” Computer, vol. 40, no. 9, pp. 96–99, 2007, doi: 10.1109/MC.2007.331.
B. Wixom and H. Watson, "The BI-Based organization,” International Journal of Business Intelligence Research, vol. 1, no. 1, pp. 13–28, Jan. 2010, doi: 10.4018/jbir.2010071702.
A. McAfee and E. Brynjolfsson, "Big data: the management revolution,” Harvard Business Review, no. October 2012, Oct. 01, 2012. Accessed: Jun. 20, 2019. [Online]. Available: https://hbr.org/2012/10/big-data-the-management-revolution
J. Pfeffer and R. I. Sutton, "Evidence-based management,” harvard business review, 2006.
R. Cosic, G. Shanks, and S. Maynard, "Towards a business analytics capability maturity model,” p. 11, 2012.
A. Thamir and B. Theodoulidis, "Business intelligence maturity models: information management perspective,” in Information and Software Technologies, T. Skersys, R. Butleris, and R. Butkiene, Eds., in Communications in Computer and Information Science, vol. 403. Berlin, Heidelberg: Springer Berlin Heidelberg, 2013, pp. 198–221. doi: 10.1007/978-3-642-41947-8_18.
T. GrubljeÅ¡iÄ and J. JakliÄ, "Conceptualization of the business intelligence extended use model,” Journal of Computer Information Systems, vol. 55, no. 3, pp. 72–82, 2015, doi: 10.1080/08874417.2015.11645774.
A. PopoviÄ, "If we implement it, will they come? User resistance in post-acceptance usage behaviour within a business intelligence systems context,” Economic Research-Ekonomska Istraživanja, vol. 30, no. 1, pp. 911–921, 2017, doi: 10.1080/1331677X.2017.1311232.
U. Kulkarni, J. Robles-Flores, Universidad ESAN, A. PopoviÄ, and University of Ljubljana, "Business Intelligence Capability: The Effect of Top Management and the Mediating Roles of User Participation and Analytical Decision Making Orientation,” Journal of the Association for Information Systems, vol. 18, no. 7, Art. no. 7, 2017, doi: 10.17705/1jais.00462.
S. Lavalle, E. Lesser, R. Shockley, M. S. Hopkins, and N. Kruschwitz, "How the smartest organizations are embedding analytics to transform information into insight and then action. Findings and recommendations from the first annual New Intelligent Enterprise Global Executive study.,” MIT Sloan Management Review, vol. 52, no. 2, Art. no. 2, 2011.
M. Hannula and V. Pirttimaki, "Business intelligence empirical study on the top 50 Finnish companies,” Journal of American Academy of Business, vol. 2, no. 2, p. 7, 2003.
S. Williams and N. Williams, "Assessing BI Readiness: The Key to BI ROI,” p. 12, 2004.
B. H. Wixom and H. J. Watson, "An Empirical Investigation of the Factors Affecting Data Warehousing Success,” MIS Quarterly, vol. 25, no. 1, p. 17, 2001, doi: 10.2307/3250957.
M. Gupta and J. F. George, "Toward the development of a big data analytics capability,” Information & Management, vol. 53, no. 8, Art. no. 8, 2016, doi: 10.1016/j.im.2016.07.004.
P. Mikalef, M. Boura, G. Lekakos, and J. Krogstie, "Big data analytics and firm performance: findings from a mixed-method approach,” Journal of Business Research, vol. 98, pp. 261–276, 2019, doi: 10.1016/j.jbusres.2019.01.044.
R. BILLOT, C. BOTHOREL, and P. LENCA, "Introduction to big data and its applications in insurance,” in Big data for insurance companies, Hoboken, NJ: ISTE Ltd/John Wiley and Sons Inc, 2017, pp. 1–25.
J. F. Hair, G. T. Hult, C. M. Ringle, and M. Sarstedt, A primer on partial least squares structural equation modeling (PLS-SEM), Second edition. California,USA: SAGE Publications, Inc., 2017.
J. F. Hair, J. J. Risher, M. Sarstedt, and C. M. Ringle, "When to use and how to report the results of PLS-SEM,” EBR, vol. 31, no. 1, pp. 2–24, 2019, doi: 10.1108/EBR-11-2018-0203.
J. F. Hair, W. C. Black, B. J. Babin, and R. E. Anderson, Multivariate data analysis, 7th ed. New Jersey USA: Prentice Hall PTR, 2009.
C. Fornell and D. F. Larcker, "Evaluating structural equation models with unobservable variables and measurement error,” Journal of Marketing Research, vol. 18, no. 1, p. 39, 1981, doi: 10.2307/3151312.
M. Sarstedt, J. F. Hair, J.-H. Cheah, J.-M. Becker, and C. M. Ringle, "How to specify, estimate, and validate higher-order constructs in PLS-SEM,” Australasian Marketing Journal, vol. 27, no. 3, pp. 197–211, 2019, doi: 10.1016/j.ausmj.2019.05.003.
J. Henseler, C. M. Ringle, and R. R. Sinkovics, "The use of partial least squares path modeling in international marketing,” in Advances in International Marketing, R. R. Sinkovics and P. N. Ghauri, Eds., Emerald Group Publishing Limited, 2009, pp. 277–319. doi: 10.1108/S1474-7979(2009)0000020014.
W. Yeoh and A. Koronios, "Critical success factors for business intelligence systems,” Journal of Computer Information Systems, p. 12, 2010.
H. Watson, C. Fuller, and T. Ariyachandra, "Data warehouse governance: best practices at blue cross and blue shield of North Carolina,” Decision Support Systems, vol. 38, pp. 435–450, 2004, doi: 10.1016/j.dss.2003.06.001.
T. Davenport, "The right way to use business analytics,” CIO, Oct. 01, 2005. https://www.cio.com/article/2448414/the-right-way-to-use-business-analytics.html (accessed Aug. 15, 2021).
T. H. Davenport and R. Bean, "Big companies are embracing analytics, but most still don't have a data-driven culture,” p. 4, 2018.
R. Cosic, G. Shanks, and S. B. Maynard, "A business analytics capability framework,” AJIS, vol. 19, 2015, doi: 10.3127/ajis.v19i0.1150.
C.-C. Shen, R.-E. Chang, C. J. Hsu, and I.-C. Chang, "How business intelligence maturity enabling hospital agility,” Telematics and Informatics, vol. 34, no. 1, pp. 450–456, 2017, doi: 10.1016/j.tele.2016.06.009.
Copyright (c) 2023 The Authors. Published by Universitas Airlangga.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
All accepted papers will be published under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. Authors retain copyright and grant the journal right of first publication. CC-BY Licenced means lets others to Share (copy and redistribute the material in any medium or format) and Adapt (remix, transform, and build upon the material for any purpose, even commercially).
