Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation.

Alissa L. Russ, Alan J. Zillich, Brittany L. Melton, Scott A. Russell, Siying Chen, Jeffrey R. Spina, Michael Weiner, Elizabette G. Johnson, Joanne K. Daggy, M. Sue McManus, Jason M. Hawsey, Anthony G. Puleo, Bradley Doebbeling, Jason J. Saleem

Research output: Contribution to journalArticle

61 Citations (Scopus)

Abstract

To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Original languageEnglish (US)
JournalJournal of the American Medical Informatics Association : JAMIA
Volume21
Issue numbere2
DOIs
StatePublished - 2014
Externally publishedYes

Fingerprint

Workload
Licensure
Efficiency
Drug Hypersensitivity
Human Engineering
Veterans
Drug Interactions
Pharmaceutical Preparations
Cross-Over Studies

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation. / Russ, Alissa L.; Zillich, Alan J.; Melton, Brittany L.; Russell, Scott A.; Chen, Siying; Spina, Jeffrey R.; Weiner, Michael; Johnson, Elizabette G.; Daggy, Joanne K.; McManus, M. Sue; Hawsey, Jason M.; Puleo, Anthony G.; Doebbeling, Bradley; Saleem, Jason J.

In: Journal of the American Medical Informatics Association : JAMIA, Vol. 21, No. e2, 2014.

Research output: Contribution to journalArticle

Russ, AL, Zillich, AJ, Melton, BL, Russell, SA, Chen, S, Spina, JR, Weiner, M, Johnson, EG, Daggy, JK, McManus, MS, Hawsey, JM, Puleo, AG, Doebbeling, B & Saleem, JJ 2014, 'Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation.', Journal of the American Medical Informatics Association : JAMIA, vol. 21, no. e2. https://doi.org/10.1136/amiajnl-2013-002045
Russ, Alissa L. ; Zillich, Alan J. ; Melton, Brittany L. ; Russell, Scott A. ; Chen, Siying ; Spina, Jeffrey R. ; Weiner, Michael ; Johnson, Elizabette G. ; Daggy, Joanne K. ; McManus, M. Sue ; Hawsey, Jason M. ; Puleo, Anthony G. ; Doebbeling, Bradley ; Saleem, Jason J. / Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation. In: Journal of the American Medical Informatics Association : JAMIA. 2014 ; Vol. 21, No. e2.
@article{e475194cacb040d597c755c89e2e8ba5,
title = "Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation.",
abstract = "To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.",
author = "Russ, {Alissa L.} and Zillich, {Alan J.} and Melton, {Brittany L.} and Russell, {Scott A.} and Siying Chen and Spina, {Jeffrey R.} and Michael Weiner and Johnson, {Elizabette G.} and Daggy, {Joanne K.} and McManus, {M. Sue} and Hawsey, {Jason M.} and Puleo, {Anthony G.} and Bradley Doebbeling and Saleem, {Jason J.}",
year = "2014",
doi = "10.1136/amiajnl-2013-002045",
language = "English (US)",
volume = "21",
journal = "Journal of the American Medical Informatics Association : JAMIA",
issn = "1067-5027",
publisher = "Oxford University Press",
number = "e2",

}

TY - JOUR

T1 - Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation.

AU - Russ, Alissa L.

AU - Zillich, Alan J.

AU - Melton, Brittany L.

AU - Russell, Scott A.

AU - Chen, Siying

AU - Spina, Jeffrey R.

AU - Weiner, Michael

AU - Johnson, Elizabette G.

AU - Daggy, Joanne K.

AU - McManus, M. Sue

AU - Hawsey, Jason M.

AU - Puleo, Anthony G.

AU - Doebbeling, Bradley

AU - Saleem, Jason J.

PY - 2014

Y1 - 2014

N2 - To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

AB - To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

UR - http://www.scopus.com/inward/record.url?scp=84908143660&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84908143660&partnerID=8YFLogxK

U2 - 10.1136/amiajnl-2013-002045

DO - 10.1136/amiajnl-2013-002045

M3 - Article

C2 - 24668841

AN - SCOPUS:84908143660

VL - 21

JO - Journal of the American Medical Informatics Association : JAMIA

JF - Journal of the American Medical Informatics Association : JAMIA

SN - 1067-5027

IS - e2

ER -