Detection and characterization of usability problems in structured data entry interfaces in dentistry

Muhammad F. Walji, Elsbeth Kalenderian, Duong Tran, Krishna K. Kookal, Vickie Nguyen, Oluwabunmi Tokede, Joel M. White, Ram Vaderhobli, Rachel Ramoni, Paul C. Stark, Nicole S. Kimmes, Meta E. Schoonheim-Klein, Vimla Patel

Research output: Contribution to journalArticle

35 Citations (Scopus)

Abstract

Background: Poor usability is one of the major barriers for optimally using electronic health records (EHRs). Dentists are increasingly adopting EHRs, and are using structured data entry interfaces to enter data such that the data can be easily retrieved and exchanged. Until recently, dentists have lacked a standardized terminology to consistently represent oral health diagnoses. Objectives: In this study we evaluated the usability of a widely used EHR interface that allow the entry of diagnostic terms, using multi-faceted methods to identify problems and work with the vendor to correct them using an iterative design method. Methods: Fieldwork was undertaken at two clinical sites, and dental providers as subjects participated in user testing (n=32), interviews (n=36) and observations (n=24). Results: User testing revealed that only 22-41% of users were able to successfully complete a simple task of entering one diagnosis, while no user was able to complete a more complex task. We identified and characterized 24 high-level usability problems reducing efficiency and causing user errors. Interface-related problems included unexpected approaches for displaying diagnosis, lack of visibility, and inconsistent use of UI widgets. Terminology related issues included missing and mis-categorized concepts. Work domain issues involved both absent and superfluous functions. In collaboration with the vendor, each usability problem was prioritized and a timeline set to resolve the concerns. Discussion: Mixed methods evaluations identified a number of critical usability issues relating to the user interface, underlying terminology of the work domain. The usability challenges were found to prevent most users from successfully completing the tasks. Our further work we will determine if changes to the interface, terminology and work domain do result in improved usability.

Original languageEnglish (US)
Pages (from-to)128-138
Number of pages11
JournalInternational Journal of Medical Informatics
Volume82
Issue number2
DOIs
StatePublished - Feb 1 2013
Externally publishedYes

Fingerprint

Dentistry
Terminology
Electronic Health Records
Dentists
Oral Diagnosis
Oral Health
Tooth
Interviews

Keywords

  • Dental
  • Diagnosis
  • Electronic health record
  • Interface
  • Structured data entry
  • Terminology
  • Usability

ASJC Scopus subject areas

  • Health Informatics

Cite this

Detection and characterization of usability problems in structured data entry interfaces in dentistry. / Walji, Muhammad F.; Kalenderian, Elsbeth; Tran, Duong; Kookal, Krishna K.; Nguyen, Vickie; Tokede, Oluwabunmi; White, Joel M.; Vaderhobli, Ram; Ramoni, Rachel; Stark, Paul C.; Kimmes, Nicole S.; Schoonheim-Klein, Meta E.; Patel, Vimla.

In: International Journal of Medical Informatics, Vol. 82, No. 2, 01.02.2013, p. 128-138.

Research output: Contribution to journalArticle

Walji, MF, Kalenderian, E, Tran, D, Kookal, KK, Nguyen, V, Tokede, O, White, JM, Vaderhobli, R, Ramoni, R, Stark, PC, Kimmes, NS, Schoonheim-Klein, ME & Patel, V 2013, 'Detection and characterization of usability problems in structured data entry interfaces in dentistry', International Journal of Medical Informatics, vol. 82, no. 2, pp. 128-138. https://doi.org/10.1016/j.ijmedinf.2012.05.018
Walji, Muhammad F. ; Kalenderian, Elsbeth ; Tran, Duong ; Kookal, Krishna K. ; Nguyen, Vickie ; Tokede, Oluwabunmi ; White, Joel M. ; Vaderhobli, Ram ; Ramoni, Rachel ; Stark, Paul C. ; Kimmes, Nicole S. ; Schoonheim-Klein, Meta E. ; Patel, Vimla. / Detection and characterization of usability problems in structured data entry interfaces in dentistry. In: International Journal of Medical Informatics. 2013 ; Vol. 82, No. 2. pp. 128-138.
@article{4000124c24434a899fc987a7a4b8302b,
title = "Detection and characterization of usability problems in structured data entry interfaces in dentistry",
abstract = "Background: Poor usability is one of the major barriers for optimally using electronic health records (EHRs). Dentists are increasingly adopting EHRs, and are using structured data entry interfaces to enter data such that the data can be easily retrieved and exchanged. Until recently, dentists have lacked a standardized terminology to consistently represent oral health diagnoses. Objectives: In this study we evaluated the usability of a widely used EHR interface that allow the entry of diagnostic terms, using multi-faceted methods to identify problems and work with the vendor to correct them using an iterative design method. Methods: Fieldwork was undertaken at two clinical sites, and dental providers as subjects participated in user testing (n=32), interviews (n=36) and observations (n=24). Results: User testing revealed that only 22-41{\%} of users were able to successfully complete a simple task of entering one diagnosis, while no user was able to complete a more complex task. We identified and characterized 24 high-level usability problems reducing efficiency and causing user errors. Interface-related problems included unexpected approaches for displaying diagnosis, lack of visibility, and inconsistent use of UI widgets. Terminology related issues included missing and mis-categorized concepts. Work domain issues involved both absent and superfluous functions. In collaboration with the vendor, each usability problem was prioritized and a timeline set to resolve the concerns. Discussion: Mixed methods evaluations identified a number of critical usability issues relating to the user interface, underlying terminology of the work domain. The usability challenges were found to prevent most users from successfully completing the tasks. Our further work we will determine if changes to the interface, terminology and work domain do result in improved usability.",
keywords = "Dental, Diagnosis, Electronic health record, Interface, Structured data entry, Terminology, Usability",
author = "Walji, {Muhammad F.} and Elsbeth Kalenderian and Duong Tran and Kookal, {Krishna K.} and Vickie Nguyen and Oluwabunmi Tokede and White, {Joel M.} and Ram Vaderhobli and Rachel Ramoni and Stark, {Paul C.} and Kimmes, {Nicole S.} and Schoonheim-Klein, {Meta E.} and Vimla Patel",
year = "2013",
month = "2",
day = "1",
doi = "10.1016/j.ijmedinf.2012.05.018",
language = "English (US)",
volume = "82",
pages = "128--138",
journal = "International Journal of Medical Informatics",
issn = "1386-5056",
publisher = "Elsevier Ireland Ltd",
number = "2",

}

TY - JOUR

T1 - Detection and characterization of usability problems in structured data entry interfaces in dentistry

AU - Walji, Muhammad F.

AU - Kalenderian, Elsbeth

AU - Tran, Duong

AU - Kookal, Krishna K.

AU - Nguyen, Vickie

AU - Tokede, Oluwabunmi

AU - White, Joel M.

AU - Vaderhobli, Ram

AU - Ramoni, Rachel

AU - Stark, Paul C.

AU - Kimmes, Nicole S.

AU - Schoonheim-Klein, Meta E.

AU - Patel, Vimla

PY - 2013/2/1

Y1 - 2013/2/1

N2 - Background: Poor usability is one of the major barriers for optimally using electronic health records (EHRs). Dentists are increasingly adopting EHRs, and are using structured data entry interfaces to enter data such that the data can be easily retrieved and exchanged. Until recently, dentists have lacked a standardized terminology to consistently represent oral health diagnoses. Objectives: In this study we evaluated the usability of a widely used EHR interface that allow the entry of diagnostic terms, using multi-faceted methods to identify problems and work with the vendor to correct them using an iterative design method. Methods: Fieldwork was undertaken at two clinical sites, and dental providers as subjects participated in user testing (n=32), interviews (n=36) and observations (n=24). Results: User testing revealed that only 22-41% of users were able to successfully complete a simple task of entering one diagnosis, while no user was able to complete a more complex task. We identified and characterized 24 high-level usability problems reducing efficiency and causing user errors. Interface-related problems included unexpected approaches for displaying diagnosis, lack of visibility, and inconsistent use of UI widgets. Terminology related issues included missing and mis-categorized concepts. Work domain issues involved both absent and superfluous functions. In collaboration with the vendor, each usability problem was prioritized and a timeline set to resolve the concerns. Discussion: Mixed methods evaluations identified a number of critical usability issues relating to the user interface, underlying terminology of the work domain. The usability challenges were found to prevent most users from successfully completing the tasks. Our further work we will determine if changes to the interface, terminology and work domain do result in improved usability.

AB - Background: Poor usability is one of the major barriers for optimally using electronic health records (EHRs). Dentists are increasingly adopting EHRs, and are using structured data entry interfaces to enter data such that the data can be easily retrieved and exchanged. Until recently, dentists have lacked a standardized terminology to consistently represent oral health diagnoses. Objectives: In this study we evaluated the usability of a widely used EHR interface that allow the entry of diagnostic terms, using multi-faceted methods to identify problems and work with the vendor to correct them using an iterative design method. Methods: Fieldwork was undertaken at two clinical sites, and dental providers as subjects participated in user testing (n=32), interviews (n=36) and observations (n=24). Results: User testing revealed that only 22-41% of users were able to successfully complete a simple task of entering one diagnosis, while no user was able to complete a more complex task. We identified and characterized 24 high-level usability problems reducing efficiency and causing user errors. Interface-related problems included unexpected approaches for displaying diagnosis, lack of visibility, and inconsistent use of UI widgets. Terminology related issues included missing and mis-categorized concepts. Work domain issues involved both absent and superfluous functions. In collaboration with the vendor, each usability problem was prioritized and a timeline set to resolve the concerns. Discussion: Mixed methods evaluations identified a number of critical usability issues relating to the user interface, underlying terminology of the work domain. The usability challenges were found to prevent most users from successfully completing the tasks. Our further work we will determine if changes to the interface, terminology and work domain do result in improved usability.

KW - Dental

KW - Diagnosis

KW - Electronic health record

KW - Interface

KW - Structured data entry

KW - Terminology

KW - Usability

UR - http://www.scopus.com/inward/record.url?scp=84873056885&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84873056885&partnerID=8YFLogxK

U2 - 10.1016/j.ijmedinf.2012.05.018

DO - 10.1016/j.ijmedinf.2012.05.018

M3 - Article

VL - 82

SP - 128

EP - 138

JO - International Journal of Medical Informatics

JF - International Journal of Medical Informatics

SN - 1386-5056

IS - 2

ER -