Heuristic evaluation of infusion pumps: Implications for patient safety in Intensive Care Units

Mark J. Graham, Tate K. Kubose, Desmond Jordan, Jiajie Zhang, Todd R. Johnson, Vimla Patel

Research output: Contribution to journalArticle

68 Citations (Scopus)

Abstract

The goal of this research was to use a heuristic evaluation methodology to uncover design and interface deficiencies of infusion pumps that are currently in use in Intensive Care Units (ICUs). Because these infusion systems cannot be readily replaced due to lease agreements and large-scale institutional purchasing procedures, we argue that it is essential to systematically identify the existing usability problems so that the possible causes of errors can be better understood, passed on to the end-users (e.g., critical care nurses), and used to make policy recommendations. Four raters conducted the heuristic evaluation of the three-channel infusion pump interface. Three raters had a cognitive science background as well as experience with the heuristic evaluation methodology. The fourth rater was a veteran critical care nurse who had extensive experience operating the pumps. The usability experts and the domain expert independently evaluated the user interface and physical design of the infusion pump and generated a list of heuristic violations based upon a set of 14 heuristics developed in previous research. The lists were compiled and then rated on the severity of the violation. From 14 usability heuristics considered in this evaluation of the Infusion Pump, there were 231 violations. Two heuristics, "Consistency" and "Language", were found to have the most violations. The one with fewest violations was "Document". While some heuristic evaluation categories had more violations than others, the most severe ones were not confined to one type. The Primary interface location (e.g., where loading the pump, changing doses, and confirming drug settings takes place) had the most occurrences of heuristic violations. We believe that the Heuristic Evaluation methodology provides a simple and cost-effective approach to discovering medical device deficiencies that affect a patient's general well being. While this methodology provides information for the infusion pump designs of the future, it also identifies important insights concerning equipment that is currently in use in critical care environments.

Original languageEnglish (US)
Pages (from-to)771-779
Number of pages9
JournalInternational Journal of Medical Informatics
Volume73
Issue number11-12
DOIs
StatePublished - Nov 1 2004
Externally publishedYes

Fingerprint

Infusion Pumps
Patient Safety
Intensive Care Units
Critical Care
Nurses
Heuristics
Cognitive Science
Equipment and Supplies
Veterans
Research
Language
Costs and Cost Analysis

Keywords

  • Heuristic evaluation
  • IV pumps
  • Medical device errors
  • Patient safety

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Heuristic evaluation of infusion pumps : Implications for patient safety in Intensive Care Units. / Graham, Mark J.; Kubose, Tate K.; Jordan, Desmond; Zhang, Jiajie; Johnson, Todd R.; Patel, Vimla.

In: International Journal of Medical Informatics, Vol. 73, No. 11-12, 01.11.2004, p. 771-779.

Research output: Contribution to journalArticle

Graham, Mark J. ; Kubose, Tate K. ; Jordan, Desmond ; Zhang, Jiajie ; Johnson, Todd R. ; Patel, Vimla. / Heuristic evaluation of infusion pumps : Implications for patient safety in Intensive Care Units. In: International Journal of Medical Informatics. 2004 ; Vol. 73, No. 11-12. pp. 771-779.
@article{7579b5b52986486084cc7d14193ebea0,
title = "Heuristic evaluation of infusion pumps: Implications for patient safety in Intensive Care Units",
abstract = "The goal of this research was to use a heuristic evaluation methodology to uncover design and interface deficiencies of infusion pumps that are currently in use in Intensive Care Units (ICUs). Because these infusion systems cannot be readily replaced due to lease agreements and large-scale institutional purchasing procedures, we argue that it is essential to systematically identify the existing usability problems so that the possible causes of errors can be better understood, passed on to the end-users (e.g., critical care nurses), and used to make policy recommendations. Four raters conducted the heuristic evaluation of the three-channel infusion pump interface. Three raters had a cognitive science background as well as experience with the heuristic evaluation methodology. The fourth rater was a veteran critical care nurse who had extensive experience operating the pumps. The usability experts and the domain expert independently evaluated the user interface and physical design of the infusion pump and generated a list of heuristic violations based upon a set of 14 heuristics developed in previous research. The lists were compiled and then rated on the severity of the violation. From 14 usability heuristics considered in this evaluation of the Infusion Pump, there were 231 violations. Two heuristics, {"}Consistency{"} and {"}Language{"}, were found to have the most violations. The one with fewest violations was {"}Document{"}. While some heuristic evaluation categories had more violations than others, the most severe ones were not confined to one type. The Primary interface location (e.g., where loading the pump, changing doses, and confirming drug settings takes place) had the most occurrences of heuristic violations. We believe that the Heuristic Evaluation methodology provides a simple and cost-effective approach to discovering medical device deficiencies that affect a patient's general well being. While this methodology provides information for the infusion pump designs of the future, it also identifies important insights concerning equipment that is currently in use in critical care environments.",
keywords = "Heuristic evaluation, IV pumps, Medical device errors, Patient safety",
author = "Graham, {Mark J.} and Kubose, {Tate K.} and Desmond Jordan and Jiajie Zhang and Johnson, {Todd R.} and Vimla Patel",
year = "2004",
month = "11",
day = "1",
doi = "10.1016/j.ijmedinf.2004.08.002",
language = "English (US)",
volume = "73",
pages = "771--779",
journal = "International Journal of Medical Informatics",
issn = "1386-5056",
publisher = "Elsevier Ireland Ltd",
number = "11-12",

}

TY - JOUR

T1 - Heuristic evaluation of infusion pumps

T2 - Implications for patient safety in Intensive Care Units

AU - Graham, Mark J.

AU - Kubose, Tate K.

AU - Jordan, Desmond

AU - Zhang, Jiajie

AU - Johnson, Todd R.

AU - Patel, Vimla

PY - 2004/11/1

Y1 - 2004/11/1

N2 - The goal of this research was to use a heuristic evaluation methodology to uncover design and interface deficiencies of infusion pumps that are currently in use in Intensive Care Units (ICUs). Because these infusion systems cannot be readily replaced due to lease agreements and large-scale institutional purchasing procedures, we argue that it is essential to systematically identify the existing usability problems so that the possible causes of errors can be better understood, passed on to the end-users (e.g., critical care nurses), and used to make policy recommendations. Four raters conducted the heuristic evaluation of the three-channel infusion pump interface. Three raters had a cognitive science background as well as experience with the heuristic evaluation methodology. The fourth rater was a veteran critical care nurse who had extensive experience operating the pumps. The usability experts and the domain expert independently evaluated the user interface and physical design of the infusion pump and generated a list of heuristic violations based upon a set of 14 heuristics developed in previous research. The lists were compiled and then rated on the severity of the violation. From 14 usability heuristics considered in this evaluation of the Infusion Pump, there were 231 violations. Two heuristics, "Consistency" and "Language", were found to have the most violations. The one with fewest violations was "Document". While some heuristic evaluation categories had more violations than others, the most severe ones were not confined to one type. The Primary interface location (e.g., where loading the pump, changing doses, and confirming drug settings takes place) had the most occurrences of heuristic violations. We believe that the Heuristic Evaluation methodology provides a simple and cost-effective approach to discovering medical device deficiencies that affect a patient's general well being. While this methodology provides information for the infusion pump designs of the future, it also identifies important insights concerning equipment that is currently in use in critical care environments.

AB - The goal of this research was to use a heuristic evaluation methodology to uncover design and interface deficiencies of infusion pumps that are currently in use in Intensive Care Units (ICUs). Because these infusion systems cannot be readily replaced due to lease agreements and large-scale institutional purchasing procedures, we argue that it is essential to systematically identify the existing usability problems so that the possible causes of errors can be better understood, passed on to the end-users (e.g., critical care nurses), and used to make policy recommendations. Four raters conducted the heuristic evaluation of the three-channel infusion pump interface. Three raters had a cognitive science background as well as experience with the heuristic evaluation methodology. The fourth rater was a veteran critical care nurse who had extensive experience operating the pumps. The usability experts and the domain expert independently evaluated the user interface and physical design of the infusion pump and generated a list of heuristic violations based upon a set of 14 heuristics developed in previous research. The lists were compiled and then rated on the severity of the violation. From 14 usability heuristics considered in this evaluation of the Infusion Pump, there were 231 violations. Two heuristics, "Consistency" and "Language", were found to have the most violations. The one with fewest violations was "Document". While some heuristic evaluation categories had more violations than others, the most severe ones were not confined to one type. The Primary interface location (e.g., where loading the pump, changing doses, and confirming drug settings takes place) had the most occurrences of heuristic violations. We believe that the Heuristic Evaluation methodology provides a simple and cost-effective approach to discovering medical device deficiencies that affect a patient's general well being. While this methodology provides information for the infusion pump designs of the future, it also identifies important insights concerning equipment that is currently in use in critical care environments.

KW - Heuristic evaluation

KW - IV pumps

KW - Medical device errors

KW - Patient safety

UR - http://www.scopus.com/inward/record.url?scp=7444255413&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=7444255413&partnerID=8YFLogxK

U2 - 10.1016/j.ijmedinf.2004.08.002

DO - 10.1016/j.ijmedinf.2004.08.002

M3 - Article

C2 - 15491928

AN - SCOPUS:7444255413

VL - 73

SP - 771

EP - 779

JO - International Journal of Medical Informatics

JF - International Journal of Medical Informatics

SN - 1386-5056

IS - 11-12

ER -