Cognitive evaluation of decision making processes and assessment of information technology in medicine

Andre W. Kushniruk, Vimla Patel

Research output: Contribution to journalReview article

51 Citations (Scopus)

Abstract

This paper describes cognitive methods for analyzing medical decision making and evaluating medical information systems. The overall approach focuses on understanding the processes involved in the decision making and reasoning of health care workers, both with and without the use of information technologies. The issue of developing appropriate evaluation tools, for use in the design and analysis of medical information systems is considered to be of great importance. However, conventional methods are limited in their ability to identify and characterize the effects of information technology on the cognitive processes involved in decision making and reasoning. In this paper a range of methods are described involving video recording for collecting data on the use of information systems. The techniques described allow for the collection of an integrated data set consisting of transcripts of health care workers as they 'think aloud' in interacting with a medical system, along with complete video records of user-computer interaction. In addition, the methods can be extended to allow for the collection of process data from video recording of systems in actual clinical and emergency situations. The use of a variety of approaches, borrowing from research in cognitive science, is discussed. The development and application of these evaluation methods within the Canadian Centres of Excellence network HEALNet is subsequently described. Finally, implications for the development and evaluation of medical information systems are considered.

Original languageEnglish (US)
Pages (from-to)83-90
Number of pages8
JournalInternational Journal of Medical Informatics
Volume51
Issue number2-3
DOIs
StatePublished - Aug 1 1998
Externally publishedYes

Fingerprint

Process Assessment (Health Care)
Decision Making
Information Systems
Medicine
Technology
Video Recording
Cognitive Science
Delivery of Health Care
Aptitude
Emergencies
Research

Keywords

  • Cognitive science
  • Decision making
  • Evaluation
  • Medical informatics
  • Medical information systems
  • Technology assessment

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Cognitive evaluation of decision making processes and assessment of information technology in medicine. / Kushniruk, Andre W.; Patel, Vimla.

In: International Journal of Medical Informatics, Vol. 51, No. 2-3, 01.08.1998, p. 83-90.

Research output: Contribution to journalReview article

@article{4ff44bc84c1c4dd3861b3282b4c463e2,
title = "Cognitive evaluation of decision making processes and assessment of information technology in medicine",
abstract = "This paper describes cognitive methods for analyzing medical decision making and evaluating medical information systems. The overall approach focuses on understanding the processes involved in the decision making and reasoning of health care workers, both with and without the use of information technologies. The issue of developing appropriate evaluation tools, for use in the design and analysis of medical information systems is considered to be of great importance. However, conventional methods are limited in their ability to identify and characterize the effects of information technology on the cognitive processes involved in decision making and reasoning. In this paper a range of methods are described involving video recording for collecting data on the use of information systems. The techniques described allow for the collection of an integrated data set consisting of transcripts of health care workers as they 'think aloud' in interacting with a medical system, along with complete video records of user-computer interaction. In addition, the methods can be extended to allow for the collection of process data from video recording of systems in actual clinical and emergency situations. The use of a variety of approaches, borrowing from research in cognitive science, is discussed. The development and application of these evaluation methods within the Canadian Centres of Excellence network HEALNet is subsequently described. Finally, implications for the development and evaluation of medical information systems are considered.",
keywords = "Cognitive science, Decision making, Evaluation, Medical informatics, Medical information systems, Technology assessment",
author = "Kushniruk, {Andre W.} and Vimla Patel",
year = "1998",
month = "8",
day = "1",
doi = "10.1016/S1386-5056(98)00106-3",
language = "English (US)",
volume = "51",
pages = "83--90",
journal = "International Journal of Medical Informatics",
issn = "1386-5056",
publisher = "Elsevier Ireland Ltd",
number = "2-3",

}

TY - JOUR

T1 - Cognitive evaluation of decision making processes and assessment of information technology in medicine

AU - Kushniruk, Andre W.

AU - Patel, Vimla

PY - 1998/8/1

Y1 - 1998/8/1

N2 - This paper describes cognitive methods for analyzing medical decision making and evaluating medical information systems. The overall approach focuses on understanding the processes involved in the decision making and reasoning of health care workers, both with and without the use of information technologies. The issue of developing appropriate evaluation tools, for use in the design and analysis of medical information systems is considered to be of great importance. However, conventional methods are limited in their ability to identify and characterize the effects of information technology on the cognitive processes involved in decision making and reasoning. In this paper a range of methods are described involving video recording for collecting data on the use of information systems. The techniques described allow for the collection of an integrated data set consisting of transcripts of health care workers as they 'think aloud' in interacting with a medical system, along with complete video records of user-computer interaction. In addition, the methods can be extended to allow for the collection of process data from video recording of systems in actual clinical and emergency situations. The use of a variety of approaches, borrowing from research in cognitive science, is discussed. The development and application of these evaluation methods within the Canadian Centres of Excellence network HEALNet is subsequently described. Finally, implications for the development and evaluation of medical information systems are considered.

AB - This paper describes cognitive methods for analyzing medical decision making and evaluating medical information systems. The overall approach focuses on understanding the processes involved in the decision making and reasoning of health care workers, both with and without the use of information technologies. The issue of developing appropriate evaluation tools, for use in the design and analysis of medical information systems is considered to be of great importance. However, conventional methods are limited in their ability to identify and characterize the effects of information technology on the cognitive processes involved in decision making and reasoning. In this paper a range of methods are described involving video recording for collecting data on the use of information systems. The techniques described allow for the collection of an integrated data set consisting of transcripts of health care workers as they 'think aloud' in interacting with a medical system, along with complete video records of user-computer interaction. In addition, the methods can be extended to allow for the collection of process data from video recording of systems in actual clinical and emergency situations. The use of a variety of approaches, borrowing from research in cognitive science, is discussed. The development and application of these evaluation methods within the Canadian Centres of Excellence network HEALNet is subsequently described. Finally, implications for the development and evaluation of medical information systems are considered.

KW - Cognitive science

KW - Decision making

KW - Evaluation

KW - Medical informatics

KW - Medical information systems

KW - Technology assessment

UR - http://www.scopus.com/inward/record.url?scp=0032143433&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032143433&partnerID=8YFLogxK

U2 - 10.1016/S1386-5056(98)00106-3

DO - 10.1016/S1386-5056(98)00106-3

M3 - Review article

C2 - 9794325

AN - SCOPUS:0032143433

VL - 51

SP - 83

EP - 90

JO - International Journal of Medical Informatics

JF - International Journal of Medical Informatics

SN - 1386-5056

IS - 2-3

ER -