Usability Evaluation of Hospital Information System According to Heuristic Evaluation

Ahmad Azizi, Mahmood Maniati, Hadis Ghanbari-Adivi, Zeinab Aghajari, Sedigheh Hashemi, Bahareh Hajipoor, Asma Rabiee Qolami, Maryam Qolami, Amirabbas Azizi



Introduction: There are various applications and health information systems which have been developed to promote the effective retrieval of patient information, statistics, research, and education. Therefore, there is a need to design them in consistency with scientific principles of usability. To this end, the usability of hospital information sub-systems employed at the hospitals of Ahvaz were compared using heuristic evaluation method. The objective of the study was to assess the usability of hospital information system according to heuristic evaluation.

Material and Methods: Six trained evaluators, independently determined the ADT subsystem, HIM subsystem, and NIS according to Nielsen’s 10 Heuristic Principles. Since more than half of the hospitals (about 54%) employed Sib application, no specific sampling method was used. After combining the usability problems, the average severity ratings of the problems were calculated, and then the subsystems were compared.

Results: The number of the usability problems of the ADT information subsystem, HIM subsystem, and NIS were 40, 39, and 37, respectively. After merging the problems, the features of “user control and freedom” with 20 cases and “flexibility and efficiency of use” with six cases had the highest and the lowest inconsistencies with usability principles. The average severity ratings of the problems also varied between 1.7 and 3.

Conclusion: Heuristic evaluation method is regarded as one of the approaches appropriate to identify usability problems in health information systems. Thus, it is advisable to utilize this method to modify the design of the systems and to improve their efficiency before their implementation in order to increase user satisfaction.


Menachemi N, Collum TH. Benefits and drawbacks of electronic health record systems. Risk Manag Healthc Policy. 2011; 4: 47-55. PMID: 22312227 DOI: 10.2147/RMHP.S12985

Yucel G, Cebi S, Hoege B, Ozok AF. A fuzzy risk assessment model for hospital information system implementation. Expert Systems with Applications. 2012; 39(1): 1211-8.

Saghaeiannejad IS, Saeedbakhsh S, Jahanbakhsh M, Habibi M. Assessment and comparison of hospital information systems in isfahan hospitals based on the adjusted delone and mclean model. Health Information Management. 2011; 8(5): 609‐20.

Bates DW, Cohen M, Leape LL, Overhage JM, Shabot MM, Sheridan T. Reducing the frequency of errors in medicine using information technology. J Am Med Inform Assoc. 2001; 8(4): 299-308. PMID: 11418536 DOI: 10.1136/jamia.2001.0080299

Azizi A, Pirnejad H. Using health information technology to improve workflow in the emergency department. Mashhad University of Medical Sciences: Graduate Students Research Festival; 2013.

Kushniruk AW, Triola MM, Borycki EM, Stein B, Kannry JL. Technology induced error and usability: the relationship between usability problems and prescription errors when using a handheld application. Int J Med Inform. 2005; 74(7-8): 519-26. PMID: 16043081 DOI: 10.1016/j.ijmedinf.2005.01.003

International Organization for Standardization. ISO 9241-11 ergonomic requirement for office work with visual display terminals (VDTs) _ Part 11: Guidance on usability. Geneva:ISO; 1998.

Nielsen J. Usability engineering. Academic Press; 1993.

Thyvalikakath TP, Monaco V, Thambuganipalle H, Schleyer T. Comparative study of heuristic evaluation and usability testing methods. Stud Health Technol Inform. 2009; 143: 322-7. PMID: 19380955 PMCID: PMC2736678

Yen PY, Bakken S. A comparison of usability evaluation methods: heuristic evaluation versus end-user think-aloud protocol: An example from a web-based communication tool for nurse scheduling. AMIA Annu Symp Proc. 2009; 2009: 714-8. PMID: 20351946 PMCID: PMC2815403

Poll R. Evaluating the library website: Statistics and quality measures. World Library and Information Congress: 73rd IFLA General Conference and Council. IFLA; 2007.

Scholtz J. Usability evaluation: National institute of standards and technology [Internet]. 2004 [cited: 1 Dec 2020]. Available from:

Chan AJ, Islam MK, Rosewall T, Jaffray DA, Easty AC, Cafazzo JA. Applying usability heuristics to radiotherapy systems. Radiother Oncol. 2012; 102(1): 142-7. PMID: 21733590 DOI: 10.1016/j.radonc.2011.05.077

Choi J, Bakken S. Web-based education for low-literate parents in neonatal intensive care unit: Development of a website and heuristic evaluation and usability testing. Int J Med Inform. 2010; 79(8): 565-75. PMID: 20617546 DOI: 10.1016/j.ijmedinf.2010.05.001

Graham MJ, Kubose TK, Jordan D, Zhang J, Johnson TR, Patel VL. Heuristic evaluation of infusion pumps: Implications for patient safety in intensive care units. Int J Med Inform. 2004; 73(11-12): 771-9. PMID: 15491928 DOI: 10.1016/j.ijmedinf.2004.08.002

Joshi A, Arora M, Dai L, Price K, Vizer L, Sears A. Usability of a patient education and motivation tool using heuristic evaluation. J Med Internet Res. 2009; 11(4): e47. PMID: 19897458 DOI: 10.2196/jmir.1244

Zhang J, Johnson TR, Patel VL, Paige DL, Kubose T. Using usability heuristics to evaluate patient safety of medical devices. J Biomed Inform. 2003; 36(1-2): 23-30. PMID: 14552844 DOI: 10.1016/s1532-0464(03)00060-1

Beuscart-Zephir MC, Watbled L, Carpentier AM, Degroisse M, Alao O. A rapid usability assessment methodology to support the choice of clinical information systems: A case study. Proc AMIA Symp; 2002; 1: 46-50. PMID: 12463784 PMCID: PMC2244284

Joshi A, Lichenstein R, King J, Arora M, Khan S. Evaluation of a computer-based patient education and motivation tool on knowledge, attitudes and practice towards influenza vaccination. International Electronic Journal of Health Education. 2009; 12: 1-15.

Khajouei R, Azizi A, Atashi A. Usability evaluation of an emergency information system: A heuristic evaluation. Journal of Health Administration. 2013; 16(52): 61-72.

Nabovati E, Vakili-Arki H, Eslami S, Khajouei R. Usability evaluation of laboratory and radiology information systems integrated into a hospital information system. J Med Syst. 2014; 38(4): 35. PMID: 24682671 DOI: 10.1007/s10916-014-0035-z

Atashi A, Khajouei R, Azizi A, Dadashi A. User interface problems of a nationwide inpatient information system: A heuristic evaluation. Appl Clin Inform. 2016; 7(1): 89-100. PMID: 27081409 DOI: 10.4338/ACI-2015-07-RA-0086

Khajouei R, de Jongh D, Jaspers MW. Usability evaluation of a computerized physician order entry for medication ordering. Stud Health Technol Inform. 2009; 150: 532-6. PMID: 19745368

Khajouei R, Jaspers MW. The impact of CPOE medication systems' design aspects on usability, workflow and medication orders: A systematic review. Methods Inf Med. 2010; 49(1): 3-19. PMID: 19582333 DOI: 10.3414/ME0630

Agharezaei Z, Khajouei R, Ahmadian L, Agharezaei L. Usability evaluation of a laboratory information system. Health Information Management. 2013; 10(2): 213-24.



  • There are currently no refbacks.