Studying the human-computer-terminology interface

J. J. Cimino, Vimla Patel, A. W. Kushniruk

Research output: Contribution to journalArticle

54 Citations (Scopus)

Abstract

Objective: To explore the use of an observational, cognitive-based approach for differentiating between successful, suboptimal, and failed entry of coded data by clinicians in actual practice, and to detect whether causes for unsuccessful attempts to capture true intended meaning were due to terminology content, terminology representation, or user interface problems. Design: Observational study with videotaping and subsequent coding of data entry events in an outpatient clinic at New York Presbyterian Hospital. Participants: Eight attending physicians, 18 resident physicians, and 1 nurse practitioner, using the Medical Entities Dictionary (MED) to record patient problems, medications, and adverse reactions in an outpatient medical record system. Measurements: Classification of data entry events as successful, suboptimal, or failed, and estimation of cause; recording of system response time and total event time. Results: Two hundred thirty-eight data entry, events were analyzed; 71.0 percent were successful, 6.3 percent suboptimal, and 22.7 percent failed; unsuccessful entries were due to problems with content in 13.0 percent of events, representation problems in 10.1 percent of events, and usability problems in 5.9 percent of events. Response time averaged 0.74 sec, and total event time averaged 40.4 sec. Of an additional 209 tasks related to drug dose and frequency terms, 94 percent were successful, 0.5 percent were suboptimal, and 6 percent failed, for an overall success rate of 82 percent. Conclusions: Data entry, by clinicians using the outpatient system and the MED was generally successful and efficient. The cognitive-based observational approach permitted detection of false-positive (suboptimal) and false-negative (failed due to user interface) data entry.

Original languageEnglish (US)
Pages (from-to)163-173
Number of pages11
JournalJournal of the American Medical Informatics Association
Volume8
Issue number2
DOIs
StatePublished - Jan 1 2001
Externally publishedYes

Fingerprint

Medical Dictionaries
Terminology
Reaction Time
Outpatients
Physicians
Nurse Practitioners
Ambulatory Care Facilities
Medical Records
Observational Studies
Pharmaceutical Preparations

ASJC Scopus subject areas

  • Health Informatics

Cite this

Studying the human-computer-terminology interface. / Cimino, J. J.; Patel, Vimla; Kushniruk, A. W.

In: Journal of the American Medical Informatics Association, Vol. 8, No. 2, 01.01.2001, p. 163-173.

Research output: Contribution to journalArticle

Cimino, J. J. ; Patel, Vimla ; Kushniruk, A. W. / Studying the human-computer-terminology interface. In: Journal of the American Medical Informatics Association. 2001 ; Vol. 8, No. 2. pp. 163-173.
@article{74e4586606904a98bbe42c1af3351fbf,
title = "Studying the human-computer-terminology interface",
abstract = "Objective: To explore the use of an observational, cognitive-based approach for differentiating between successful, suboptimal, and failed entry of coded data by clinicians in actual practice, and to detect whether causes for unsuccessful attempts to capture true intended meaning were due to terminology content, terminology representation, or user interface problems. Design: Observational study with videotaping and subsequent coding of data entry events in an outpatient clinic at New York Presbyterian Hospital. Participants: Eight attending physicians, 18 resident physicians, and 1 nurse practitioner, using the Medical Entities Dictionary (MED) to record patient problems, medications, and adverse reactions in an outpatient medical record system. Measurements: Classification of data entry events as successful, suboptimal, or failed, and estimation of cause; recording of system response time and total event time. Results: Two hundred thirty-eight data entry, events were analyzed; 71.0 percent were successful, 6.3 percent suboptimal, and 22.7 percent failed; unsuccessful entries were due to problems with content in 13.0 percent of events, representation problems in 10.1 percent of events, and usability problems in 5.9 percent of events. Response time averaged 0.74 sec, and total event time averaged 40.4 sec. Of an additional 209 tasks related to drug dose and frequency terms, 94 percent were successful, 0.5 percent were suboptimal, and 6 percent failed, for an overall success rate of 82 percent. Conclusions: Data entry, by clinicians using the outpatient system and the MED was generally successful and efficient. The cognitive-based observational approach permitted detection of false-positive (suboptimal) and false-negative (failed due to user interface) data entry.",
author = "Cimino, {J. J.} and Vimla Patel and Kushniruk, {A. W.}",
year = "2001",
month = "1",
day = "1",
doi = "10.1136/jamia.2001.0080163",
language = "English (US)",
volume = "8",
pages = "163--173",
journal = "Journal of the American Medical Informatics Association : JAMIA",
issn = "1067-5027",
publisher = "Oxford University Press",
number = "2",

}

TY - JOUR

T1 - Studying the human-computer-terminology interface

AU - Cimino, J. J.

AU - Patel, Vimla

AU - Kushniruk, A. W.

PY - 2001/1/1

Y1 - 2001/1/1

N2 - Objective: To explore the use of an observational, cognitive-based approach for differentiating between successful, suboptimal, and failed entry of coded data by clinicians in actual practice, and to detect whether causes for unsuccessful attempts to capture true intended meaning were due to terminology content, terminology representation, or user interface problems. Design: Observational study with videotaping and subsequent coding of data entry events in an outpatient clinic at New York Presbyterian Hospital. Participants: Eight attending physicians, 18 resident physicians, and 1 nurse practitioner, using the Medical Entities Dictionary (MED) to record patient problems, medications, and adverse reactions in an outpatient medical record system. Measurements: Classification of data entry events as successful, suboptimal, or failed, and estimation of cause; recording of system response time and total event time. Results: Two hundred thirty-eight data entry, events were analyzed; 71.0 percent were successful, 6.3 percent suboptimal, and 22.7 percent failed; unsuccessful entries were due to problems with content in 13.0 percent of events, representation problems in 10.1 percent of events, and usability problems in 5.9 percent of events. Response time averaged 0.74 sec, and total event time averaged 40.4 sec. Of an additional 209 tasks related to drug dose and frequency terms, 94 percent were successful, 0.5 percent were suboptimal, and 6 percent failed, for an overall success rate of 82 percent. Conclusions: Data entry, by clinicians using the outpatient system and the MED was generally successful and efficient. The cognitive-based observational approach permitted detection of false-positive (suboptimal) and false-negative (failed due to user interface) data entry.

AB - Objective: To explore the use of an observational, cognitive-based approach for differentiating between successful, suboptimal, and failed entry of coded data by clinicians in actual practice, and to detect whether causes for unsuccessful attempts to capture true intended meaning were due to terminology content, terminology representation, or user interface problems. Design: Observational study with videotaping and subsequent coding of data entry events in an outpatient clinic at New York Presbyterian Hospital. Participants: Eight attending physicians, 18 resident physicians, and 1 nurse practitioner, using the Medical Entities Dictionary (MED) to record patient problems, medications, and adverse reactions in an outpatient medical record system. Measurements: Classification of data entry events as successful, suboptimal, or failed, and estimation of cause; recording of system response time and total event time. Results: Two hundred thirty-eight data entry, events were analyzed; 71.0 percent were successful, 6.3 percent suboptimal, and 22.7 percent failed; unsuccessful entries were due to problems with content in 13.0 percent of events, representation problems in 10.1 percent of events, and usability problems in 5.9 percent of events. Response time averaged 0.74 sec, and total event time averaged 40.4 sec. Of an additional 209 tasks related to drug dose and frequency terms, 94 percent were successful, 0.5 percent were suboptimal, and 6 percent failed, for an overall success rate of 82 percent. Conclusions: Data entry, by clinicians using the outpatient system and the MED was generally successful and efficient. The cognitive-based observational approach permitted detection of false-positive (suboptimal) and false-negative (failed due to user interface) data entry.

UR - http://www.scopus.com/inward/record.url?scp=0035099406&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0035099406&partnerID=8YFLogxK

U2 - 10.1136/jamia.2001.0080163

DO - 10.1136/jamia.2001.0080163

M3 - Article

C2 - 11230384

AN - SCOPUS:0035099406

VL - 8

SP - 163

EP - 173

JO - Journal of the American Medical Informatics Association : JAMIA

JF - Journal of the American Medical Informatics Association : JAMIA

SN - 1067-5027

IS - 2

ER -