Usability in the real world

Assessing medical information technologies in patients' homes

David Kaufman, Vimla Patel, Charlyn Hilliman, Philip C. Morin, Jenia Pevzner, Ruth S. Weinstock, Robin Goland, Steven Shea, Justin Starren

Research output: Contribution to journalArticle

142 Citations (Scopus)

Abstract

Objective: This paper presents an approach to usability evaluation of computer-based health care systems designed for patient use in their homes. Although such devices are becoming more prevalent, there is very little known about their usability. Design: The theoretical foundations for the methods are discussed. The approach incorporates a cognitive walkthrough usability evaluation and new methods for usability testing that can be conducted in patient's homes. The method was applied to the IDEATel intervention, a multi-institution randomized controlled trial of the feasibility, acceptability, and clinical utility of a home-based telemedicine system for diabetic Medicare population. The usability study was designed to assess barriers to optimal use of the system. The focus was both on dimensions of the interface and on dimensions of patient skills and competency. The usability field research involved testing 25 patients in their homes using the system. The analysis included a range of video-analytic methods of varying levels of granularity. Results: The usability evaluation revealed aspects of the interface that were sub-optimal and impeded the performance of certain tasks. It also found a range of patient-related factors such as numeracy and psychomotor skills that constituted barriers to productive use. Conclusions: A multifaceted usability approach provided important insight regarding use of technology by an elderly chronic-care patient population and more generally, for understanding how home health initiatives can more effectively use such technology.

Original languageEnglish (US)
Pages (from-to)45-60
Number of pages16
JournalJournal of Biomedical Informatics
Volume36
Issue number1-2
DOIs
StatePublished - Feb 2003
Externally publishedYes

Fingerprint

Information technology
Technology
Telemedicine
Testing
Health care
Health
Task Performance and Analysis
Medicare
Population
Patient Care
Randomized Controlled Trials
Delivery of Health Care
Equipment and Supplies
Research

Keywords

  • Chronic illness
  • Cognitive methods
  • Diabetes
  • Field usability testing
  • Telemedicine
  • Usability evaluation

ASJC Scopus subject areas

  • Computer Science Applications
  • Health Informatics

Cite this

Kaufman, D., Patel, V., Hilliman, C., Morin, P. C., Pevzner, J., Weinstock, R. S., ... Starren, J. (2003). Usability in the real world: Assessing medical information technologies in patients' homes. Journal of Biomedical Informatics, 36(1-2), 45-60. https://doi.org/10.1016/S1532-0464(03)00056-X

Usability in the real world : Assessing medical information technologies in patients' homes. / Kaufman, David; Patel, Vimla; Hilliman, Charlyn; Morin, Philip C.; Pevzner, Jenia; Weinstock, Ruth S.; Goland, Robin; Shea, Steven; Starren, Justin.

In: Journal of Biomedical Informatics, Vol. 36, No. 1-2, 02.2003, p. 45-60.

Research output: Contribution to journalArticle

Kaufman, D, Patel, V, Hilliman, C, Morin, PC, Pevzner, J, Weinstock, RS, Goland, R, Shea, S & Starren, J 2003, 'Usability in the real world: Assessing medical information technologies in patients' homes', Journal of Biomedical Informatics, vol. 36, no. 1-2, pp. 45-60. https://doi.org/10.1016/S1532-0464(03)00056-X
Kaufman, David ; Patel, Vimla ; Hilliman, Charlyn ; Morin, Philip C. ; Pevzner, Jenia ; Weinstock, Ruth S. ; Goland, Robin ; Shea, Steven ; Starren, Justin. / Usability in the real world : Assessing medical information technologies in patients' homes. In: Journal of Biomedical Informatics. 2003 ; Vol. 36, No. 1-2. pp. 45-60.
@article{104cc5b086354941b8c3a10c86f69793,
title = "Usability in the real world: Assessing medical information technologies in patients' homes",
abstract = "Objective: This paper presents an approach to usability evaluation of computer-based health care systems designed for patient use in their homes. Although such devices are becoming more prevalent, there is very little known about their usability. Design: The theoretical foundations for the methods are discussed. The approach incorporates a cognitive walkthrough usability evaluation and new methods for usability testing that can be conducted in patient's homes. The method was applied to the IDEATel intervention, a multi-institution randomized controlled trial of the feasibility, acceptability, and clinical utility of a home-based telemedicine system for diabetic Medicare population. The usability study was designed to assess barriers to optimal use of the system. The focus was both on dimensions of the interface and on dimensions of patient skills and competency. The usability field research involved testing 25 patients in their homes using the system. The analysis included a range of video-analytic methods of varying levels of granularity. Results: The usability evaluation revealed aspects of the interface that were sub-optimal and impeded the performance of certain tasks. It also found a range of patient-related factors such as numeracy and psychomotor skills that constituted barriers to productive use. Conclusions: A multifaceted usability approach provided important insight regarding use of technology by an elderly chronic-care patient population and more generally, for understanding how home health initiatives can more effectively use such technology.",
keywords = "Chronic illness, Cognitive methods, Diabetes, Field usability testing, Telemedicine, Usability evaluation",
author = "David Kaufman and Vimla Patel and Charlyn Hilliman and Morin, {Philip C.} and Jenia Pevzner and Weinstock, {Ruth S.} and Robin Goland and Steven Shea and Justin Starren",
year = "2003",
month = "2",
doi = "10.1016/S1532-0464(03)00056-X",
language = "English (US)",
volume = "36",
pages = "45--60",
journal = "Journal of Biomedical Informatics",
issn = "1532-0464",
publisher = "Academic Press Inc.",
number = "1-2",

}

TY - JOUR

T1 - Usability in the real world

T2 - Assessing medical information technologies in patients' homes

AU - Kaufman, David

AU - Patel, Vimla

AU - Hilliman, Charlyn

AU - Morin, Philip C.

AU - Pevzner, Jenia

AU - Weinstock, Ruth S.

AU - Goland, Robin

AU - Shea, Steven

AU - Starren, Justin

PY - 2003/2

Y1 - 2003/2

N2 - Objective: This paper presents an approach to usability evaluation of computer-based health care systems designed for patient use in their homes. Although such devices are becoming more prevalent, there is very little known about their usability. Design: The theoretical foundations for the methods are discussed. The approach incorporates a cognitive walkthrough usability evaluation and new methods for usability testing that can be conducted in patient's homes. The method was applied to the IDEATel intervention, a multi-institution randomized controlled trial of the feasibility, acceptability, and clinical utility of a home-based telemedicine system for diabetic Medicare population. The usability study was designed to assess barriers to optimal use of the system. The focus was both on dimensions of the interface and on dimensions of patient skills and competency. The usability field research involved testing 25 patients in their homes using the system. The analysis included a range of video-analytic methods of varying levels of granularity. Results: The usability evaluation revealed aspects of the interface that were sub-optimal and impeded the performance of certain tasks. It also found a range of patient-related factors such as numeracy and psychomotor skills that constituted barriers to productive use. Conclusions: A multifaceted usability approach provided important insight regarding use of technology by an elderly chronic-care patient population and more generally, for understanding how home health initiatives can more effectively use such technology.

AB - Objective: This paper presents an approach to usability evaluation of computer-based health care systems designed for patient use in their homes. Although such devices are becoming more prevalent, there is very little known about their usability. Design: The theoretical foundations for the methods are discussed. The approach incorporates a cognitive walkthrough usability evaluation and new methods for usability testing that can be conducted in patient's homes. The method was applied to the IDEATel intervention, a multi-institution randomized controlled trial of the feasibility, acceptability, and clinical utility of a home-based telemedicine system for diabetic Medicare population. The usability study was designed to assess barriers to optimal use of the system. The focus was both on dimensions of the interface and on dimensions of patient skills and competency. The usability field research involved testing 25 patients in their homes using the system. The analysis included a range of video-analytic methods of varying levels of granularity. Results: The usability evaluation revealed aspects of the interface that were sub-optimal and impeded the performance of certain tasks. It also found a range of patient-related factors such as numeracy and psychomotor skills that constituted barriers to productive use. Conclusions: A multifaceted usability approach provided important insight regarding use of technology by an elderly chronic-care patient population and more generally, for understanding how home health initiatives can more effectively use such technology.

KW - Chronic illness

KW - Cognitive methods

KW - Diabetes

KW - Field usability testing

KW - Telemedicine

KW - Usability evaluation

UR - http://www.scopus.com/inward/record.url?scp=0141571128&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0141571128&partnerID=8YFLogxK

U2 - 10.1016/S1532-0464(03)00056-X

DO - 10.1016/S1532-0464(03)00056-X

M3 - Article

VL - 36

SP - 45

EP - 60

JO - Journal of Biomedical Informatics

JF - Journal of Biomedical Informatics

SN - 1532-0464

IS - 1-2

ER -