Making usability data more usable

Douglas J. Gillan, Nancy Cooke

Research output: Chapter in Book/Report/Conference proceedingChapter

2 Citations (Scopus)

Abstract

Usability tests often include recording of users' behaviors as they interact with a computer; unfortunately, these data are often underused for design due to their complexity and the difficulty in interpreting them. In recent years, a variety of methods have been proposed for analyzing user behavioral sequences. In this paper we propose five criteria for evaluating the quality and effectiveness of any such method - (1) standardization and repeatability of the method; (2) simplification of the data; (3) validity; (4) interpretable visual representation of the data that suggests design implications; and (5) output that is amenable to additional analyses. We describe how the PRONET method - an analytical method that uses the Pathfinder algorithm to produce network representations of behavioral sequences - successfully addresses these five criteria. Finally, we argue that test design should be conceived of in a framework of usability engineering, thereby leading to the creation of more usable test methods.

Original languageEnglish (US)
Title of host publicationProceedings of the Human Factors and Ergonomics Society
PublisherHuman Factors and Ergonomics Society, Inc.
Pages300-304
Number of pages5
Volume1
StatePublished - 1998
Externally publishedYes
EventProceedings of the 1998 42nd Annual Meeting 'Human Factors and Ergonomics Society' - Chicago, IL, USA
Duration: Oct 5 1998Oct 9 1998

Other

OtherProceedings of the 1998 42nd Annual Meeting 'Human Factors and Ergonomics Society'
CityChicago, IL, USA
Period10/5/9810/9/98

Fingerprint

Usability engineering
Standardization

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering

Cite this

Gillan, D. J., & Cooke, N. (1998). Making usability data more usable. In Proceedings of the Human Factors and Ergonomics Society (Vol. 1, pp. 300-304). Human Factors and Ergonomics Society, Inc..

Making usability data more usable. / Gillan, Douglas J.; Cooke, Nancy.

Proceedings of the Human Factors and Ergonomics Society. Vol. 1 Human Factors and Ergonomics Society, Inc., 1998. p. 300-304.

Research output: Chapter in Book/Report/Conference proceedingChapter

Gillan, DJ & Cooke, N 1998, Making usability data more usable. in Proceedings of the Human Factors and Ergonomics Society. vol. 1, Human Factors and Ergonomics Society, Inc., pp. 300-304, Proceedings of the 1998 42nd Annual Meeting 'Human Factors and Ergonomics Society', Chicago, IL, USA, 10/5/98.
Gillan DJ, Cooke N. Making usability data more usable. In Proceedings of the Human Factors and Ergonomics Society. Vol. 1. Human Factors and Ergonomics Society, Inc. 1998. p. 300-304
Gillan, Douglas J. ; Cooke, Nancy. / Making usability data more usable. Proceedings of the Human Factors and Ergonomics Society. Vol. 1 Human Factors and Ergonomics Society, Inc., 1998. pp. 300-304
@inbook{1711e51fc79741c79a681abbb25c3b84,
title = "Making usability data more usable",
abstract = "Usability tests often include recording of users' behaviors as they interact with a computer; unfortunately, these data are often underused for design due to their complexity and the difficulty in interpreting them. In recent years, a variety of methods have been proposed for analyzing user behavioral sequences. In this paper we propose five criteria for evaluating the quality and effectiveness of any such method - (1) standardization and repeatability of the method; (2) simplification of the data; (3) validity; (4) interpretable visual representation of the data that suggests design implications; and (5) output that is amenable to additional analyses. We describe how the PRONET method - an analytical method that uses the Pathfinder algorithm to produce network representations of behavioral sequences - successfully addresses these five criteria. Finally, we argue that test design should be conceived of in a framework of usability engineering, thereby leading to the creation of more usable test methods.",
author = "Gillan, {Douglas J.} and Nancy Cooke",
year = "1998",
language = "English (US)",
volume = "1",
pages = "300--304",
booktitle = "Proceedings of the Human Factors and Ergonomics Society",
publisher = "Human Factors and Ergonomics Society, Inc.",

}

TY - CHAP

T1 - Making usability data more usable

AU - Gillan, Douglas J.

AU - Cooke, Nancy

PY - 1998

Y1 - 1998

N2 - Usability tests often include recording of users' behaviors as they interact with a computer; unfortunately, these data are often underused for design due to their complexity and the difficulty in interpreting them. In recent years, a variety of methods have been proposed for analyzing user behavioral sequences. In this paper we propose five criteria for evaluating the quality and effectiveness of any such method - (1) standardization and repeatability of the method; (2) simplification of the data; (3) validity; (4) interpretable visual representation of the data that suggests design implications; and (5) output that is amenable to additional analyses. We describe how the PRONET method - an analytical method that uses the Pathfinder algorithm to produce network representations of behavioral sequences - successfully addresses these five criteria. Finally, we argue that test design should be conceived of in a framework of usability engineering, thereby leading to the creation of more usable test methods.

AB - Usability tests often include recording of users' behaviors as they interact with a computer; unfortunately, these data are often underused for design due to their complexity and the difficulty in interpreting them. In recent years, a variety of methods have been proposed for analyzing user behavioral sequences. In this paper we propose five criteria for evaluating the quality and effectiveness of any such method - (1) standardization and repeatability of the method; (2) simplification of the data; (3) validity; (4) interpretable visual representation of the data that suggests design implications; and (5) output that is amenable to additional analyses. We describe how the PRONET method - an analytical method that uses the Pathfinder algorithm to produce network representations of behavioral sequences - successfully addresses these five criteria. Finally, we argue that test design should be conceived of in a framework of usability engineering, thereby leading to the creation of more usable test methods.

UR - http://www.scopus.com/inward/record.url?scp=0032269360&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032269360&partnerID=8YFLogxK

M3 - Chapter

AN - SCOPUS:0032269360

VL - 1

SP - 300

EP - 304

BT - Proceedings of the Human Factors and Ergonomics Society

PB - Human Factors and Ergonomics Society, Inc.

ER -