IT Maturity Model Design and Evaluation for Sustainable Smart Cities Assessment
Downloads
Background: The Economic Vision for sustainable smart cities (SSC) necessitates a continuous monitoring tool that assesses the long-term planning progress of the Economic maturity level (ML) which is dependent on the Maturity Models (MM) of the Enabling Technology/ICT capabilities as its analyzes, measures the maturity levels (ML) of Smart Cities (SCs), and assesses the Economic ML of the SSCs. Recent MM have several shortcomings such that they are: 1) undedicated and overlapping the SC domains, 2) missing details of SC cases, 3) applying indicators from ambiguous databases, 4) unable to identify SC baseline, 5) lacking easiness, usefulness, decision support, comprehensiveness, timeliness, and usage intention, and/or 6) not targeting the Economic dimension of SSC.
Objective: Aiming at monitoring the long-term planning progress of the SSC’s Economic maturity level (ML), this study developed and evaluated an Enterprise Architectural (EA) MM tool (BSSC-ML) that is capable to continuously assess the SC’s transition from AS-IS (SC) to TO-BE (SSC’s Economic MLs) by analyzing the Enabling Technology/ICT capabilities, 2) measuring the MLs of Enabling Technology/ICT capabilities based on 20 formulated indicators, and 3) assessing the MLs of Economic SSC based on 30 formulated KPIs.
Methods: The Design Science Research methodology (DSRM) orchestrated the development of BSSC-ML at which design, implementation, data collection & analysis, validation, and evaluation were performed by utilizing semi-structured interviews were conducted with 7 officials of the Information & eGovernment Authority (iGA), while the web content analysis and Delphi methods respectively were employed to analyze the official portals while preserving the validation quality and to evaluate the model.
Results: The findings revealed 50.3% ML score w.r.t 116 Business services and 3 sets of 260 Technology/ICT capabilities, 3rd ML score w.r.t Economic SSC, and 88.123% w.r.t evaluation’s acceptance rate.
Conclusion: The study described the development process of BSSC-ML for SSC’ Economic MLs assessment at which the evaluation scores proved its effectiveness as a monitoring too for local and global SCs.
Keywords: Technology/ICT Maturity Model, Smart City, Enterprise Architecture, Design and Evaluation, Economic Sustainability
D. Schraven, S. Joss, and M. de Jong, “Past, present, future: Engagement with sustainable urban development through 35 city labels in the scientific literature 1990–2019,” Journal of Cleaner Production, vol. 292, p. 125924, Apr. 2021, doi: https://doi.org/10.1016/j.jclepro.2021.125924.
Tsbmail, “Y.4904: Smart sustainable cities maturity model,” Itu.int, 2020. https://www.itu.int/rec/T-REC-Y.4904/en (accessed April. 24, 2023).
A. Durán-Sánchez, M. de la Cruz del Río-Rama, A. Sereno-Ramírez, and K. Bredies, “Sustainability and Quality of Life in Smart Cities: Analysis of Scientific Production,” Innovation, Technology, and Knowledge Management, pp. 159–181, Oct. 2016, doi: https://doi.org/10.1007/978-3-319-40895-8_12.
W. Nieto Bernal and K. L. García Espitaleta, “Framework for Developing an Information Technology Maturity Model for Smart City Services in Emerging Economies: (FSCE2),” Applied Sciences, vol. 11, no. 22, p. 10712, Nov. 2021, doi: https://doi.org/10.3390/app112210712.
A. Kramers, Mattias Höjer, N. Lövehagen, and Josefin Wangel, “ICT for Sustainable Cities : How ICT can support an environmentally sustainable development in cities,” International Conference on Information and Communication Technologies, pp. 183–189, Jan. 2013.
S. E. Bibri, A. Alexandre, A. Sharifi, and J. Krogstie, “Environmentally sustainable smart cities and their converging AI, IoT, and big data technologies and solutions: an integrated approach to an extensive literature review,” Energy Informatics, vol. 6, no. 1, Apr. 2023, doi: https://doi.org/10.1186/s42162-023-00259-2.
E. P. Trindade, M. P. F. Hinnig, E. M. da Costa, J. S. Marques, R. C. Bastos, and T. Yigitcanlar, “Sustainable development of smart cities: a systematic review of the literature,” Journal of Open Innovation: Technology, Market, and Complexity, vol. 3, no. 1, Aug. 2017, doi: https://doi.org/10.1186/s40852-017-0063-2.
T. Nam and T. A. Pardo, “Conceptualizing smart city with dimensions of technology, people, and institutions,” Proceedings of the 12th Annual International Digital Government Research Conference on Digital Government Innovation in Challenging Times - dg.o ’11, 2011, doi: https://doi.org/10.1145/2037556.2037602.
R. Giffinger and H. Gudrun, “Smart Cities ranking: an Effective Instrument for the Positioning of the cities?,” ACE: Architecture, City and Environment, vol. 4, no. 12, Feb. 2010, doi: https://doi.org/10.5821/ace.v4i12.2483.
A. Vaquero-García, José Álvarez-García, and M. Peris-Ortiz, “Urban Models of Sustainable Development from the Economic Perspective: Smart Cities,” pp. 15–29, Oct. 2016, doi: https://doi.org/10.1007/978-3-319-40895-8_2.
J. Hoon, K. Sharma, J. Costa, S. Sicato, and J. Park, “Emerging Technologies for Sustainable Smart City Network Security: Issues, Challenges, and Countermeasures,” doi: https://doi.org/10.3745/JIPS.03.0124.
M. A. Ahad, S. Paiva, G. Tripathi, and N. Feroz, “Enabling technologies and sustainable smart cities,” Sustainable Cities and Society, vol. 61, p. 102301, Oct. 2020, doi: https://doi.org/10.1016/j.scs.2020.102301.
S. A. Asongu and S. Le Roux, “Enhancing ICT for inclusive human development in Sub-Saharan Africa,” Technological Forecasting and Social Change, vol. 118, pp. 44–54, May 2017, doi: https://doi.org/10.1016/j.techfore.2017.01.026.
T. Hassmann and M. Westner, “Conceptualizing sustainability in the context of ICT. A literature review analysis.,” Annals of Computer Science and Information Systems, vol. 37, pp. 121–129, Oct. 2023, doi: https://doi.org/10.15439/2023f5720.
T. Santarius and J. Wagner, “Digitalization and sustainability: A systematic literature analysis of ICT for Sustainability research,” GAIA - Ecological Perspectives for Science and Society, vol. 32, no. 1, pp. 21–32, Mar. 2023, doi: https://doi.org/10.14512/gaia.32.s1.5.
J. B. S. dos Santos-Neto and A. P. C. S. Costa, “Enterprise maturity models: a systematic literature review,” Enterprise Information Systems, vol. 13, no. 5, pp. 719–769, Feb. 2019, doi: https://doi.org/10.1080/17517575.2019.1575986.
“IDC White Paper - Smart Cities and the Internet of Things - URENIO | Intelligent Cities – Smart Cities – Innovation Ecosystems,” Urenio.org, Nov. 04, 2013. https://urenio.org/2013/11/04/idc-white-paper-smart-cities-internet-things/ (accessed Nov. 07, 2024).
R. Wendler, “The maturity of maturity model research: A systematic mapping study,” Information and Software Technology, vol. 54, no. 12, pp. 1317–1339, Dec. 2012, doi: https://doi.org/10.1016/j.infsof.2012.07.007.
T. Aljowder, M. Ali, and S. Kurnia, “Development of a Maturity Model for Assessing Smart Cities: A Focus Area Maturity Model,” Smart Cities, vol. 6, no. 4, pp. 2150–2175, Aug. 2023, doi: https://doi.org/10.3390/smartcities6040099.
E. G. Lima et al., “Smart and Sustainable Cities: The Main Guidelines of City Statute for Increasing the Intelligence of Brazilian Cities,” Sustainability, vol. 12, no. 3, p. 1025, Jan. 2020, doi: https://doi.org/10.3390/su12031025.
F. V. Aragão et al., “Smart Cities Maturity Model—A Multicriteria Approach,” Sustainability, vol. 15, no. 8, p. 6695, Jan. 2023, doi: https://doi.org/10.3390/su15086695.
M. A. Ali, K. Alam, B. Taylor, and S. Rafiq, “Does ICT maturity catalyse economic development? Evidence from a panel data estimation approach in OECD countries,” Economic Analysis and Policy, vol. 68, pp. 163–174, Dec. 2020, doi: https://doi.org/10.1016/j.eap.2020.09.003.
W. Castelnovo, G. Misuraca, and A. Savoldelli, “Smart Cities Governance,” Social Science Computer Review, vol. 34, no. 6, pp. 724–739, Aug. 2016, doi: https://doi.org/10.1177/0894439315611103.
A. Sharifi, “A critical review of selected smart city assessment tools and indicator sets,” Journal of Cleaner Production, vol. 233, pp. 1269–1283, Oct. 2019, doi: https://doi.org/10.1016/j.jclepro.2019.06.172.
C. Patrão, P. Moura, and A. T. de Almeida, “Review of Smart City Assessment Tools,” Smart Cities, vol. 3, no. 4, pp. 1117–1132, Sep. 2020, doi: https://doi.org/10.3390/smartcities3040055.
E. A. Adwan, “Towards A Technological Reference Model of Bahraini Smart City,” Jan. 2018, doi: https://doi.org/10.1049/cp.2018.1414.
E. J. Adwan, “Towards A Cloud oriented Technological Reference Model of Bahrain,” 2nd Smart Cities Symposium (SCS 2019), 2019, doi: https://doi.org/10.1049/cp.2019.0228.
Suhono Harso Supangkat, F. Hidayat, Iqbal Ahmad Dahlan, and Faqih Hamami, “The Implementation of Traffic Analytics Using Deep Learning and Big Data Technology with Garuda Smart City Framework,” Oct. 2019, doi: https://doi.org/10.1109/gcce46687.2019.9015300.
Ehab Adwan, “An Enterprise Reference Architectural method for the business RM of the Construction sector- Development and Evaluation,” International Journal of Business and Administrative Studies, vol. 9, no. 1, Jan. 2023, doi: https://doi.org/10.20469/ijbas.9.10002-1.
E. J. Adwan and A. Al-Soufi, “Enterprise architecture-based ISA model development for ICT benchmarking in construction-case study,” International Journal of Informatics and Communication Technology (IJ-ICT), vol. 11, no. 2, p. 160, Aug. 2022, doi: https://doi.org/10.11591/ijict.v11i2.pp160-176.
K. Hinkelmann, A. Gerber, D. Karagiannis, B. Thoenssen, A. van der Merwe, and R. Woitsch, “A new paradigm for the continuous alignment of business and IT: Combining enterprise architecture modelling and enterprise ontology,” Computers in Industry, vol. 79, pp. 77–86, Jun. 2016, doi: https://doi.org/10.1016/j.compind.2015.07.009.
K. Peffers, T. Tuunanen, M. A. Rothenberger, and S. Chatterjee, “A Design Science Research Methodology for Information Systems Research,” Journal of Management Information Systems, vol. 24, no. 3, pp. 45–77, Dec. 2007, doi: https://doi.org/10.2753/mis0742-1222240302.
A. R. Hevner, S. T. March, J.-S. Park, and S. Ram, “Design science in information systems research,” Management Information Systems Quarterly, vol. 28, no. 1, pp. 75–105, Mar. 2004, doi: https://doi.org/10.5555/2017212.2017217.
J. vom Brocke, A. Hevner, and A. Maedche, “Introduction to Design Science Research,” Progress in IS, pp. 1–13, 2020, doi: https://doi.org/10.1007/978-3-030-46781-4_1.
M. Keil, H. K. Lee, and T. Deng, “Understanding the most critical skills for managing IT projects: A Delphi study of IT project managers,” Information & Management, vol. 50, no. 7, pp. 398–414, Nov. 2013, doi: https://doi.org/10.1016/j.im.2013.05.005.
A. Strasser, “Delphi Method Variants in Information Systems Research: Taxonomy Development and Application,” The Electronic Journal of Business Research Methods, vol. 15, no. 2, pp. 120–132, Oct. 2017, doi: https://doi.org/10.25968/opus-1164.
C. Okoli and S. D. Pawlowski, “The Delphi method as a research tool: an example, design considerations and applications,” Information & Management, vol. 42, no. 1, pp. 15–29, Dec. 2004, doi: https://doi.org/10.1016/j.im.2003.11.002.
Y. Levy and T. J. Ellis, “A Systems Approach to Conduct an Effective Literature Review in Support of Information Systems Research,” Informing Science: The International Journal of an Emerging Transdiscipline, vol. 9, no. 1, pp. 181–212, 2006, doi: https://doi.org/10.28945/479.
R. W. S. Ruhlandt, “The governance of smart cities: A systematic literature review,” Cities, vol. 81, pp. 1–23, Nov. 2018, doi: https://doi.org/10.1016/j.cities.2018.02.014.
L. M. Hilty and B. Aebischer, “ICT for Sustainability: An Emerging Research Field,” Advances in Intelligent Systems and Computing, pp. 3–36, Aug. 2014, doi: https://doi.org/10.1007/978-3-319-09228-7_1.
“Information & eGovernment Authority | Sustainable Development Goals,” Iga.gov.bh, 2023. https://www.iga.gov.bh/en/category/sustainable-development-goals (Accessed: 11 April 2023).
Rendra Sandhi Firmanyah, Suhono Harso Supangkat, Arry Akhmad Arman, and Yuti Ariani, “Identifying component for building smart city maturity model through document-based weighting and city problem in Indonesia,” Nov. 2017, doi: https://doi.org/10.1109/iceei.2017.8312464.
A. Ishaq, M. Mukhtar, M. Wahyudi, K. Indriani, A. Elham, A.H.M.A.D. Kayed, S.A. Babakir, D.Y. Minkin, Y.I. Sineshchuk, Y.I. and S.N. Terekhin, “Information technology governance using cobit 4.0 domain delivery support and monitoring evaluation,” Journal of Theoretical and Applied Information Technology, vol. 95(20), pp.5304-5315, 2017.
P. K. Sharma and J. H. Park, “Blockchain based hybrid network architecture for the smart city,” Future Generation Computer Systems, vol. 86, pp. 650–655, Sep. 2018, doi: https://doi.org/10.1016/j.future.2018.04.060.
C. Harrison et al., “Foundations for Smarter Cities,” IBM Journal of Research and Development, vol. 54, no. 4, pp. 1–16, Jul. 2010, doi: https://doi.org/10.1147/jrd.2010.2048257.
R. A. Afonso, S. Brito, H. do, Vinicius Cardoso Garcia, and A. Alvaro, “Brazilian smart cities,” May 2015, doi: https://doi.org/10.1145/2757401.2757426.
S. Toniolo, Chiara Pieretto, and D. Camana, “Improving sustainability in communities: Linking the local scale to the concept of sustainable development,” Environmental Impact Assessment Review, vol. 101, pp. 107126–107126, Jul. 2023, doi: https://doi.org/10.1016/j.eiar.2023.107126.
J. Liu et al., “Towards sustainable smart cities: Maturity assessment and development pattern recognition in China,” Journal of Cleaner Production, vol. 370, p. 133248, Oct. 2022, doi: https://doi.org/10.1016/j.jclepro.2022.133248.
M. Cachia and L. Millward, “The telephone medium and semi‐structured interviews: a complementary fit,” Qualitative Research in Organizations and Management: An International Journal, vol. 6, no. 3, pp. 265–277, Nov. 2011, doi: https://doi.org/10.1108/17465641111188420.
M. B. Farooq and C. de Villiers, “Telephonic qualitative research interviews: when to consider them and how to do them,” Meditari Accountancy Research, vol. 25, no. 2, pp. 291–316, Jun. 2017, doi: https://doi.org/10.1108/medar-10-2016-0083.
A. Irvine, “Duration, Dominance and Depth in Telephone and Face-to-Face Interviews: a Comparative Exploration,” International Journal of Qualitative Methods, vol. 10, no. 3, pp. 202–220, Sep. 2011, doi: https://doi.org/10.1177/160940691101000302.
I. Kim and J. Kuljis, “Applying Content Analysis to Web-based Content,” Journal of Computing and Information Technology, vol. 18, no. 4, p. 369, 2010, doi: https://doi.org/10.2498/cit.1001924.
R. K. Yin, “Validity and generalization in future case study evaluations,” Evaluation, vol. 19, no. 3, pp. 321–332, Jul. 2013, doi: https://doi.org/10.1177/1356389013497081.
S. R. Brady, “Utilizing and Adapting the Delphi Method for Use in Qualitative Research,” International Journal of Qualitative Methods, vol. 14, no. 5, p. 160940691562138, Dec. 2015, doi: https://doi.org/10.1177/1609406915621381.
R. El-Gazzar, E. Hustad, and D. H. Olsen, “Understanding cloud computing adoption issues: A Delphi study approach,” Journal of Systems and Software, vol. 118, pp. 64–84, Aug. 2016, doi: https://doi.org/10.1016/j.jss.2016.04.061.
L. Van Dyk, “A Review of Telehealth Service Implementation Frameworks,” International Journal of Environmental Research and Public Health, vol. 11, no. 2, pp. 1279–1298, Jan. 2014, doi: https://doi.org/10.3390/ijerph110201279.
Copyright (c) 2025 The Authors. Published by Universitas Airlangga.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
All accepted papers will be published under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. Authors retain copyright and grant the journal right of first publication. CC-BY Licenced means lets others to Share (copy and redistribute the material in any medium or format) and Adapt (remix, transform, and build upon the material for any purpose, even commercially).
