Evaluating mental model elicitation methods

Nancy Cooke, Anna L. Rowe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Researchers have developed and applied a number of methods for measuring mental models. Unfortunately not only is the mental model construct ill-defined, but the basic research associated with it offers little guidance concerning the selection of a method for a particular application. In this paper a program of research is presented that is designed address this shortcoming. Specifically, the research involves a comparative evaluation of methods to measure mental models on the basis of the relationship between the method's output (i.e., the mental model) and the criterion of primary importance to the problem (e.g., task performance, user acceptance). It is assumed that a method should be selected on the basis of its ability to generate output that is predictive of the criterion of interest. It is likely that because the methods tap different aspects of a mental model, they will predict performance well on some tasks and criteria, but not others. As an example of this approach, data are presented that help to select the best method for measuring technicians' mental models of an electronics troubleshooting task.

Original languageEnglish (US)
Title of host publicationProceedings of the Human Factors and Ergonomics Society
PublisherHuman Factors and Ergonomics Society, Inc.
Pages261-265
Number of pages5
Volume1
StatePublished - 1994
Externally publishedYes
EventProceedings of the 38th Annual Meeting of the Human Factors and Ergonomics Society. Part 2 (of 2) - Nashville, TN, USA
Duration: Oct 24 1994Oct 28 1994

Other

OtherProceedings of the 38th Annual Meeting of the Human Factors and Ergonomics Society. Part 2 (of 2)
CityNashville, TN, USA
Period10/24/9410/28/94

Fingerprint

Electronic equipment

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering

Cite this

Cooke, N., & Rowe, A. L. (1994). Evaluating mental model elicitation methods. In Proceedings of the Human Factors and Ergonomics Society (Vol. 1, pp. 261-265). Human Factors and Ergonomics Society, Inc..

Evaluating mental model elicitation methods. / Cooke, Nancy; Rowe, Anna L.

Proceedings of the Human Factors and Ergonomics Society. Vol. 1 Human Factors and Ergonomics Society, Inc., 1994. p. 261-265.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Cooke, N & Rowe, AL 1994, Evaluating mental model elicitation methods. in Proceedings of the Human Factors and Ergonomics Society. vol. 1, Human Factors and Ergonomics Society, Inc., pp. 261-265, Proceedings of the 38th Annual Meeting of the Human Factors and Ergonomics Society. Part 2 (of 2), Nashville, TN, USA, 10/24/94.
Cooke N, Rowe AL. Evaluating mental model elicitation methods. In Proceedings of the Human Factors and Ergonomics Society. Vol. 1. Human Factors and Ergonomics Society, Inc. 1994. p. 261-265
Cooke, Nancy ; Rowe, Anna L. / Evaluating mental model elicitation methods. Proceedings of the Human Factors and Ergonomics Society. Vol. 1 Human Factors and Ergonomics Society, Inc., 1994. pp. 261-265
@inproceedings{d52dbd78ec654cf78b17418f1d2d9e1d,
title = "Evaluating mental model elicitation methods",
abstract = "Researchers have developed and applied a number of methods for measuring mental models. Unfortunately not only is the mental model construct ill-defined, but the basic research associated with it offers little guidance concerning the selection of a method for a particular application. In this paper a program of research is presented that is designed address this shortcoming. Specifically, the research involves a comparative evaluation of methods to measure mental models on the basis of the relationship between the method's output (i.e., the mental model) and the criterion of primary importance to the problem (e.g., task performance, user acceptance). It is assumed that a method should be selected on the basis of its ability to generate output that is predictive of the criterion of interest. It is likely that because the methods tap different aspects of a mental model, they will predict performance well on some tasks and criteria, but not others. As an example of this approach, data are presented that help to select the best method for measuring technicians' mental models of an electronics troubleshooting task.",
author = "Nancy Cooke and Rowe, {Anna L.}",
year = "1994",
language = "English (US)",
volume = "1",
pages = "261--265",
booktitle = "Proceedings of the Human Factors and Ergonomics Society",
publisher = "Human Factors and Ergonomics Society, Inc.",

}

TY - GEN

T1 - Evaluating mental model elicitation methods

AU - Cooke, Nancy

AU - Rowe, Anna L.

PY - 1994

Y1 - 1994

N2 - Researchers have developed and applied a number of methods for measuring mental models. Unfortunately not only is the mental model construct ill-defined, but the basic research associated with it offers little guidance concerning the selection of a method for a particular application. In this paper a program of research is presented that is designed address this shortcoming. Specifically, the research involves a comparative evaluation of methods to measure mental models on the basis of the relationship between the method's output (i.e., the mental model) and the criterion of primary importance to the problem (e.g., task performance, user acceptance). It is assumed that a method should be selected on the basis of its ability to generate output that is predictive of the criterion of interest. It is likely that because the methods tap different aspects of a mental model, they will predict performance well on some tasks and criteria, but not others. As an example of this approach, data are presented that help to select the best method for measuring technicians' mental models of an electronics troubleshooting task.

AB - Researchers have developed and applied a number of methods for measuring mental models. Unfortunately not only is the mental model construct ill-defined, but the basic research associated with it offers little guidance concerning the selection of a method for a particular application. In this paper a program of research is presented that is designed address this shortcoming. Specifically, the research involves a comparative evaluation of methods to measure mental models on the basis of the relationship between the method's output (i.e., the mental model) and the criterion of primary importance to the problem (e.g., task performance, user acceptance). It is assumed that a method should be selected on the basis of its ability to generate output that is predictive of the criterion of interest. It is likely that because the methods tap different aspects of a mental model, they will predict performance well on some tasks and criteria, but not others. As an example of this approach, data are presented that help to select the best method for measuring technicians' mental models of an electronics troubleshooting task.

UR - http://www.scopus.com/inward/record.url?scp=0028754767&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0028754767&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:0028754767

VL - 1

SP - 261

EP - 265

BT - Proceedings of the Human Factors and Ergonomics Society

PB - Human Factors and Ergonomics Society, Inc.

ER -