Evaluation of Success and Failure Factors for Maternal and Child Health in Integrated Healthcare Center Information Systems (IHCIS) Using the HOT-Fit Method
Downloads
Background: Maternal and child health in Integrated Healthcare Center Information Systems (IHCIS) has been implemented in several community health centers. Some have been implemented successfully, but others have failed. Many factors influence the success and failure of IHCIS implementation. Thus, knowing these factors can be used to assist the decision-making process in implementing IHCIS.
Objective: This research aims to determine the factors affecting the success and failure of IHCIS for maternal and child health using the HOT-Fit (Human, Organization, Technology, and Fit) model.
Methods: This research begins with preliminary research to identify the problem, determine research variables, and collect data. It uses quantitative and qualitative approaches. A quantitative approach is conducted at locations that have successfully implemented IHCIS. The data collection instrument uses a questionnaire. A qualitative approach was conducted in locations that were still experiencing failure in implementing IHCIS. Data collection techniques through direct interviews.
Results: Organizational factors do not fully determine the success or failure of the information system. Factors supporting the success of IHCIS are human (user satisfaction and system use) and technological factors (quality of information and the quality of service). However, technology (system quality and information quality) is the main factor in the failure of IHCIS implementation. Problems with system quality include the system login, limited access to the internet, and an information system that is not in accordance with requirements. The perceived information obstacle is that the system is not yet integrated, and the information produced is incomplete.
Conclusion: To satisfy requirements, the information and system qualities must be enhanced. Implementing IHCIS requires an appropriate strategy according to local circumstances and conditions. This approach involves human, organizational, and technological factors.
Keywords: Community Health Workers, Evaluation, HOT-Fit, Integrated Healthcare Center Information Systems, Success Factors
Ö. Sebetci, "Enhancing end-user satisfaction through technology compatibility: An assessment on health information system,” Health Policy Technol, vol. 7, no. 3, pp. 265–274, Sep. 2018, doi: 10.1016/j.hlpt.2018.06.001.
Y. K. Alotaibi and F. Federico, "The impact of health information technology on patient safety,” Saudi Med J, vol. 38, no. 12, pp. 1173–1180, Dec. 2017, doi: 10.15537/smj.2017.12.20631.
A. Deharja, A. Hargono, M. W. Santi, N. Nandini, and N. A. Damayanti, "Evaluating the Usability of Hospital Information System (HIS) Through Human Organization Technology-Fit (Hot-Fit) Model,” International Proceedings the 2nd International Scientific Meeting on Health Information Management (ISMoHIM) 2020, vol. 5, no. 1171, pp. 380–389, 2020.
WHO, "Framework and standards for country health information systems, 2nd ed,” https://iris.who.int/handle/10665/43872.
M. G. Nkanata, E. O. Makori, and G. Irura, "Comparative analysis of hospital information management systems among healthcare workers in two selected hospitals in Kenya,” Library Philosophy and Practice, no. December 2018, pp. 1–19, 2018.
D. K. RI, Pedoman Umum Pengelolaan Posyandu. 2011.
N. D. Saputro, R. R. Waliyansyah, M. Novita, and V. A. Putri, "Information System Management of Posyandu Activities Based on Web-Based Integrated Line Messenger at Posyandu Anggrek II, Purwosari Village,” in Proceedings of the 2nd International Conference on Education and Technology (ICETECH 2021), 2022, pp. 253–260. doi: 10.2991/assehr.k.220103.037.
R. Dijaya, C. Cholifah, D. Djauharoh, U. Nisak, and S. Syahminan, "Visual cohort baby recording based on internet of things for maternal and child health service,” J Phys Conf Ser, vol. 1402, no. 7, p. 077038, Dec. 2019, doi: 10.1088/1742-6596/1402/7/077038.
S. Ismail, M. Alshmari, K. Latif, and H. F. Ahmad, "A Granular Ontology Model for Maternal and Child Health Information System,” J Healthc Eng, vol. 2017, pp. 1–9, 2017, doi: 10.1155/2017/9519321.
Q. Chen, "Toward realizing self-protecting healthcare information systems: Design and security challenges,” in Advances in Computers, vol. 114, Elsevier, 2019, pp. 113–149. doi: 10.1016/bs.adcom.2019.02.003.
E. E. Sala and A. P. Subriadi, "Hot-Fit Model to Measure the Effectiveness and Efficiency of Information System in Public Sector,” The Winners, vol. 23, no. 2, pp. 131–141, May 2023, doi: 10.21512/tw.v23i2.7423.
W. P. Hapsari, U. A. Labib, H. Haryanto, and D. W. Safitri, "A Literature Review of Human, Organization, Technology (HOT) – Fit Evaluation Model,” in Proceedings of the 6th International Seminar on Science Education (ISSE 2020), 2021, pp. 876–883. doi: 10.2991/assehr.k.210326.126.
M. M. Yusof, R. J. Paul, and L. K. Stergioulas, "Towards a framework for Health Information System Evaluation, School of Information System.,” Proceedings of The 39th Hawaii International Conference on System Sciences, vol. 00, no. C, pp. 1–10, 2006.
R. Kurniawan, S. Kusumadewi, and R. Yuantari, "Implementation of the Posyandu Information System in Tirtorahayu Village Kapanewon Galur Kulon Progo Regency,” KACANEGARA Jurnal Pengabdian pada Masyarakat, vol. 6, no. 1, Jan. 2023, doi: 10.28989/kacanegara.v6i1.1271.
S. Kusumadewi, R. Kurniawan, and H. Wahyuningsih, "Implementasi Sistem Informasi Posyandu Berbasis Web Dan Android Di Desa Bimomartani Implementation of Web-Based and Android-Based Posyandu Information Systems in Bimomartani Village 1),” vol. 3, no. 2, pp. 2549–8347, 2019.
M. Mohd. Yusof, R. J. Paul, and L. K. Stergioulas, "Towards a Framework for Health Information Systems Evaluation,” in Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06), IEEE, 2006, pp. 95a–95a. doi: 10.1109/HICSS.2006.491.
Tawar, A. F. Santoso, and Y. S. Salma, "Model HOT FIT dalam Manajemen Sistem Informasi,” Bincang Sains dan Teknologi, vol. 1, no. 02, pp. 76–82, Dec. 2022, doi: 10.56741/bst.v1i02.144.
P. D. Abda'u, W. W. Winarno, and H. Henderi, "Evaluasi Penerapan SIMRS Menggunakan Metode HOT-Fit di RSUD dr. Soedirman Kebumen,” INTENSIF: Jurnal Ilmiah Penelitian dan Penerapan Teknologi Sistem Informasi, vol. 2, no. 1, p. 46, Feb. 2018, doi: 10.29407/intensif.v2i1.11817.
T. Suwarno, "Implementasi E-learning di Pendidikan Kedokteran: Permasalahan pada Aspek Manusia, Organisasi, dan Teknologi,” JATISI (Jurnal Teknik Informatika dan Sistem Informasi), vol. 9, no. 2, pp. 1596–1607, Jun. 2022, doi: 10.35957/jatisi.v9i2.1997.
B. Hardiyana and I. Suendi, "SISTEM INFORMASI PENDATAAN BAYI (Studi Kasus : Posyandu Dahlia RW/RT 12/05 Kec. Baleendah, Kel. Baleendah, Kab. Bandung) ,” Jurnal Teknologi dan Informasi (JATI) , vol. 3, no. 2, 2013.
W. Delone and E. McLean, "The DeLone and McLean Model of Information Systems Success: A Ten-Year Update,” Journal of Management Information Systems, vol. 19, no. 4, pp. 9–30, Apr. 2003, doi: 10.1080/07421222.2003.11045748.
D. Gustino, "Delone & McLean IS Success Model,” https://sis.binus.ac.id/2019/04/11/delone-mclean-is-success-model/.
Venkatesh, Morris, Davis, and Davis, "User Acceptance of Information Technology: Toward a Unified View,” MIS Quarterly, vol. 27, no. 3, p. 425, 2003, doi: 10.2307/30036540.
J. J. Po-An Hsieh and W. Wang, "Explaining employees' Extended Use of complex information systems,” European Journal of Information Systems, vol. 16, no. 3, pp. 216–227, Jul. 2007, doi: 10.1057/palgrave.ejis.3000663.
T. McGill, V. Hobbs, and J. Klobas, "User Developed Applications and Information Systems Success,” Information Resources Management Journal, vol. 16, no. 1, pp. 24–45, Jan. 2003, doi: 10.4018/irmj.2003010103.
B. Kositanurit, O. Ngwenyama, and K.-M. Osei-Bryson, "An exploration of factors that impact individual performance in an ERP environment: an analysis using multiple analytical techniques,” European Journal of Information Systems, vol. 15, no. 6, pp. 556–568, Dec. 2006, doi: 10.1057/palgrave.ejis.3000654.
J. Iivari, "An empirical test of the DeLone-McLean model of information system success,” ACM SIGMIS Database: the DATABASE for Advances in Information Systems, vol. 36, no. 2, pp. 8–27, Jun. 2005, doi: 10.1145/1066149.1066152.
U. R. Kulkarni, S. Ravindran, and R. Freeze, "A Knowledge Management Success Model: Theoretical Development and Empirical Validation,” Journal of Management Information Systems, vol. 23, no. 3, pp. 309–347, Dec. 2006, doi: 10.2753/MIS0742-1222230311.
L. A. Halawi, R. V McCarthy, and J. E. Aronson, "An empirical investigation of knowledge-management systems' success,” The Journal of Computer Information Systems, vol. 48, no. 2, pp. 121–135, 2007.
P. Seddon and M.-Y. Kiew, "A Partial Test and Development of Delone and Mclean's Model of IS Success,” Australasian Journal of Information Systems, vol. 4, no. 1, Nov. 1996, doi: 10.3127/ajis.v4i1.379.
C. Chiu, C. Chiu, and H. Chang, "Examining the integrated influence of fairness and quality on learners' satisfaction and Web"based learning continuance intention,” Information Systems Journal, vol. 17, no. 3, pp. 271–287, Jul. 2007, doi: 10.1111/j.1365-2575.2007.00238.x.
S. Petter, W. DeLone, and E. McLean, "Measuring information systems success: models, dimensions, measures, and interrelationships,” European Journal of Information Systems, vol. 17, no. 3, pp. 236–263, Jun. 2008, doi: 10.1057/ejis.2008.15.
A. Leclercq, "The perceptual evaluation of information systems using the construct of user satisfaction,” ACM SIGMIS Database: the DATABASE for Advances in Information Systems, vol. 38, no. 2, pp. 27–60, May 2007, doi: 10.1145/1240616.1240621.
Y.-C. Chen, L.-T. Hu, K.-C. Tseng, W.-J. Juang, and C.-K. Chang, "Cross-boundary e-government systems: Determinants of performance,” Gov Inf Q, vol. 36, no. 3, pp. 449–459, Jul. 2019, doi: 10.1016/j.giq.2019.02.001.
H. Gangwar, H. Date, and R. Ramaswamy, "Understanding determinants of cloud computing adoption using an integrated TAM-TOE model,” Journal of Enterprise Information Management, vol. 28, no. 1, pp. 107–130, Feb. 2015, doi: 10.1108/JEIM-08-2013-0065.
S. F. Bayastura, B. Warsito, and D. M. K. Nugraheni, "Integration of UTAUT 2 and Delone & McLean to Evaluate Acceptance of Video Conference Application,” INTENSIF: Jurnal Ilmiah Penelitian dan Penerapan Teknologi Sistem Informasi, vol. 6, no. 2, pp. 198–217, Aug. 2022, doi: 10.29407/intensif.v6i2.17897.
W. A. S. Nuraini, H. Mardhiana, and A. Kusumawati, "Analysis of E-Government Health Application Features Acceptance on Partner Applications During COVID-19,” INTENSIF: Jurnal Ilmiah Penelitian dan Penerapan Teknologi Sistem Informasi, vol. 7, no. 1, pp. 33–53, 2023, doi: 10.29407/intensif.v7i1.18538.
J. Henseler, C. M. Ringle, and R. R. Sinkovics, "The use of partial least squares path modeling in international marketing,” in Advances in International Marketing, vol. 20, no. 2009, 2009, pp. 277–319. doi: 10.1108/S1474-7979(2009)0000020014.
J. F. Hair, G. T. M. Hult, C. M. Ringle, M. Sarstedt, N. P. Danks, and S. Ray, "Evaluation of the Structural Model,” in Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R, Springer, 2021, pp. 115–138. Accessed: Jan. 11, 2024. [Online]. Available: https://link.springer.com/chapter/10.1007/978-3-030-80519-7_6
W. Setyowati, R. Widayanti, and D. Supriyanti, "Implementation Of E-Business Information System In Indonesia : Prospects And Challenges,” International Journal of Cyber and IT Service Management, vol. 1, no. 2, pp. 180–188, 2021.
S. Goldfinch, "Pessimism, Computer Failure, and Information Systems Development in the Public Sector,” Public Adm Rev, vol. 67, no. 5, pp. 917–929, Sep. 2007, doi: 10.1111/j.1540-6210.2007.00778.x.
H. M. E. Abdelsalam, H. A. ElKadi, and S. Gamal, "Setback and remedy of local e-government projects,” in Proceedings of the 4th International Conference on Theory and Practice of Electronic Governance, New York, NY, USA: ACM, Oct. 2010, pp. 66–72. doi: 10.1145/1930321.1930336.
E. Daryanto, "The Influence of Information System Quality, Information Quality and Perceived Usefulness on User Satisfaction of Personnel Information Systems (Study at The Indonesian Army Crypto and Cyber Centre),” Journal of Positive School Psychology, vol. 2022, no. 3, pp. 9814–9830, 2022.
A. Mahmud, D. Prayogo, N. Susilowati, B. D. Handayani, and M. Mardi, "Analyzing the Effects of System Quality on the Net Benefits of the Village Financial System (Siskeudes): Information Quality and User Satisfaction as Mediating Variables,” Management and Accounting Review, vol. 22, no. 1, pp. 105–127, 2023.
I. Maita and I. D. Ayu Riski, "Human Organization and Technology-Fit Model to Evaluate Implementation of Library Information System,” KnE Social Sciences, vol. 2020, pp. 228–238, Nov. 2020, doi: 10.18502/kss.v4i14.7880.
C. Tam and T. Oliveira, "Understanding mobile banking individual performance,” Internet Research, vol. 27, no. 3, pp. 538–562, Jun. 2017, doi: 10.1108/IntR-05-2016-0117.
P. Keikhosrokiani, N. Mustaffa, N. Zakaria, and R. Abdullah, "Assessment of a medical information system: the mediating role of use and user satisfaction on the success of human interaction with the mobile healthcare system (iHeart),” Cognition, Technology & Work, vol. 22, no. 2, pp. 281–305, May 2020, doi: 10.1007/s10111-019-00565-4.
T. S. Patma, N. Fienaningsih, K. S. Rahayu, and I. G. L. S. Artatanaya, "Impact of Information Quality on Customer Perceived Value, Experience Quality, and Customer Satisfaction from Using GoFood Aplication,” Journal of Indonesian Economy and Business, vol. 36, no. 1, p. 51, Jan. 2021, doi: 10.22146/jieb.59810.
H. N. Isnaeningsih, A. Fitriati, P. Pujiharto, and H. J. Astuti, "The influence Quality of information, Sistem Quality and Service Quality on Satisfaction and User Performace,” Jurnal Manajemen Bisnis, vol. 12, no. 2, p. Layouting, Sep. 2021, doi: 10.18196/mb.v12i2.11185.
A. Ameen, K. Alfalasi, N. A. Gazem, and O. Isaac, "Impact of System Quality, Information Quality, and Service Quality on Actual Usage of Smart Government,” in 2019 First International Conference of Intelligent Computing and Engineering (ICOICE), IEEE, Dec. 2019, pp. 1–6. doi: 10.1109/ICOICE48418.2019.9035144.
P. Y. Lenny and S. Kridanto, "Analysis of user acceptance, service quality, and customer satisfaction of hospital management information system,” J Phys Conf Ser, vol. 1193, no. 1, p. 012001, Apr. 2019, doi: 10.1088/1742-6596/1193/1/012001.
S. W. Nasution and C. Chairunnisa, "Hospital Management Information System Implementation Assessment Using HOT-FIT Model in Langsa General Hospital Aceh, Indonesia,” Majalah Kedokteran Bandung, vol. 55, no. 1, pp. 13–20, 2023, doi: 10.15395/mkb.v55n1.280.
C.-S. Kuo and C.-C. Hsu, "Continuance Intention to Use and Perceived Net Benefits as Perceived by Streaming Platform Users: An Application of the Updated IS Success Model,” Behavioral Sciences, vol. 12, no. 5, p. 124, Apr. 2022, doi: 10.3390/bs12050124.
L. Indrayati, N. B. Noor, F. Rivai, and L. M. Saleh, "Factors Affecting User Satisfaction and Benefits of SIMRS at the Regional General Hospital Beriman,” Turkish Journal of Computer and Mathematics Education, vol. 12, no. 13, pp. 1565–1572, 2021.
D. T. Abdurrahaman, A. Owusu, and A. S. Bakare, "Evaluating Factors Affecting User Satisfaction in University Enterprise Content Management (ECM) Systems,” Electronic Journal of Information Systems Evaluation, vol. 23, no. 1, pp. 1–16, Feb. 2020, doi: 10.34190/EJISE.20.23.1.001.
A. Bashiri, M. Shirdeli, F. Niknam, S. Naderi, and S. Zare, "Evaluating the success of Iran Electronic Health Record System (SEPAS) based on the DeLone and McLean model: a cross-sectional descriptive study,” BMC Med Inform Decis Mak, vol. 23, no. 1, p. 10, Jan. 2023, doi: 10.1186/s12911-023-02100-y.
Copyright (c) 2024 The Authors. Published by Universitas Airlangga.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
All accepted papers will be published under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. Authors retain copyright and grant the journal right of first publication. CC-BY Licenced means lets others to Share (copy and redistribute the material in any medium or format) and Adapt (remix, transform, and build upon the material for any purpose, even commercially).
