Usability evaluation of an experimental text summarization system and three search engines

implications for the reengineering of health care interfaces.

Andre W. Kushniruk, Min Yem Kan, Kathleen McKeown, Judith Klavans, Desmond Jordan, Mark LaFlamme, Vimla Patel

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

This paper describes the comparative evaluation of an experimental automated text summarization system, Centrifuser and three conventional search engines - Google, Yahoo and About.com. Centrifuser provides information to patients and families relevant to their questions about specific health conditions. It then produces a multidocument summary of articles retrieved by a standard search engine, tailored to the user's question. Subjects, consisting of friends or family of hospitalized patients, were asked to "think aloud" as they interacted with the four systems. The evaluation involved audio- and video recording of subject interactions with the interfaces in situ at a hospital. Results of the evaluation show that subjects found Centrifuser's summarization capability useful and easy to understand. In comparing Centrifuser to the three search engines, subjects' ratings varied; however, specific interface features were deemed useful across interfaces. We conclude with a discussion of the implications for engineering Web-based retrieval systems.

Original languageEnglish (US)
Pages (from-to)420-424
Number of pages5
JournalProceedings / AMIA ... Annual Symposium. AMIA Symposium
StatePublished - Jan 1 2002
Externally publishedYes

Fingerprint

Search Engine
Delivery of Health Care
Video Recording
Health

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Usability evaluation of an experimental text summarization system and three search engines : implications for the reengineering of health care interfaces. / Kushniruk, Andre W.; Kan, Min Yem; McKeown, Kathleen; Klavans, Judith; Jordan, Desmond; LaFlamme, Mark; Patel, Vimla.

In: Proceedings / AMIA ... Annual Symposium. AMIA Symposium, 01.01.2002, p. 420-424.

Research output: Contribution to journalArticle

Kushniruk, Andre W. ; Kan, Min Yem ; McKeown, Kathleen ; Klavans, Judith ; Jordan, Desmond ; LaFlamme, Mark ; Patel, Vimla. / Usability evaluation of an experimental text summarization system and three search engines : implications for the reengineering of health care interfaces. In: Proceedings / AMIA ... Annual Symposium. AMIA Symposium. 2002 ; pp. 420-424.
@article{498f09bdab1b4643b9a6b0a065d0ece6,
title = "Usability evaluation of an experimental text summarization system and three search engines: implications for the reengineering of health care interfaces.",
abstract = "This paper describes the comparative evaluation of an experimental automated text summarization system, Centrifuser and three conventional search engines - Google, Yahoo and About.com. Centrifuser provides information to patients and families relevant to their questions about specific health conditions. It then produces a multidocument summary of articles retrieved by a standard search engine, tailored to the user's question. Subjects, consisting of friends or family of hospitalized patients, were asked to {"}think aloud{"} as they interacted with the four systems. The evaluation involved audio- and video recording of subject interactions with the interfaces in situ at a hospital. Results of the evaluation show that subjects found Centrifuser's summarization capability useful and easy to understand. In comparing Centrifuser to the three search engines, subjects' ratings varied; however, specific interface features were deemed useful across interfaces. We conclude with a discussion of the implications for engineering Web-based retrieval systems.",
author = "Kushniruk, {Andre W.} and Kan, {Min Yem} and Kathleen McKeown and Judith Klavans and Desmond Jordan and Mark LaFlamme and Vimla Patel",
year = "2002",
month = "1",
day = "1",
language = "English (US)",
pages = "420--424",
journal = "Proceedings / AMIA . Annual Symposium. AMIA Symposium",
issn = "1531-605X",
publisher = "Hanley & Belfus",

}

TY - JOUR

T1 - Usability evaluation of an experimental text summarization system and three search engines

T2 - implications for the reengineering of health care interfaces.

AU - Kushniruk, Andre W.

AU - Kan, Min Yem

AU - McKeown, Kathleen

AU - Klavans, Judith

AU - Jordan, Desmond

AU - LaFlamme, Mark

AU - Patel, Vimla

PY - 2002/1/1

Y1 - 2002/1/1

N2 - This paper describes the comparative evaluation of an experimental automated text summarization system, Centrifuser and three conventional search engines - Google, Yahoo and About.com. Centrifuser provides information to patients and families relevant to their questions about specific health conditions. It then produces a multidocument summary of articles retrieved by a standard search engine, tailored to the user's question. Subjects, consisting of friends or family of hospitalized patients, were asked to "think aloud" as they interacted with the four systems. The evaluation involved audio- and video recording of subject interactions with the interfaces in situ at a hospital. Results of the evaluation show that subjects found Centrifuser's summarization capability useful and easy to understand. In comparing Centrifuser to the three search engines, subjects' ratings varied; however, specific interface features were deemed useful across interfaces. We conclude with a discussion of the implications for engineering Web-based retrieval systems.

AB - This paper describes the comparative evaluation of an experimental automated text summarization system, Centrifuser and three conventional search engines - Google, Yahoo and About.com. Centrifuser provides information to patients and families relevant to their questions about specific health conditions. It then produces a multidocument summary of articles retrieved by a standard search engine, tailored to the user's question. Subjects, consisting of friends or family of hospitalized patients, were asked to "think aloud" as they interacted with the four systems. The evaluation involved audio- and video recording of subject interactions with the interfaces in situ at a hospital. Results of the evaluation show that subjects found Centrifuser's summarization capability useful and easy to understand. In comparing Centrifuser to the three search engines, subjects' ratings varied; however, specific interface features were deemed useful across interfaces. We conclude with a discussion of the implications for engineering Web-based retrieval systems.

UR - http://www.scopus.com/inward/record.url?scp=0036363277&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036363277&partnerID=8YFLogxK

M3 - Article

SP - 420

EP - 424

JO - Proceedings / AMIA . Annual Symposium. AMIA Symposium

JF - Proceedings / AMIA . Annual Symposium. AMIA Symposium

SN - 1531-605X

ER -