Mental models of metal models: a comparison of mental model measurement techniques

Anna L. Rowe, Nancy Cooke, Kelly J. Neville, Chris W. Schacherer

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Although use of the mental model construct has proliferated in recent research, the construct lacks a clear definition and an agreed upon method of measurement. Furthermore, the reliability and validity of the different measurement techniques in use have not been established, thereby making generalizations across studies of mental models difficult. The purpose of the current project was to assess several methods of measuring mental models in terms of their reliability/stability over time. Subjects' mental models of the automobile engine system were elicited on two occasions separated by one week, using seven different knowledge elicitation techniques. Subjects' level of experience was also measured to allow comparisons between experts and novices. The results indicate that each of the measurement techniques tended to be reliable for both experts and novices. However, reliability tended to be greater for experts than novices. Additionally, experts tended to agree with each other more than did the novices. Some evidence also indicated that the results from the similarity ratings and subsequent Pathfinder analysis converged with those from the structured interviews.

Original languageEnglish (US)
Title of host publicationProceedings of the Human Factors Society
PublisherPubl by Human Factors Soc Inc
Pages1195-1199
Number of pages5
Volume2
StatePublished - 1992
Externally publishedYes
EventProceedings of the Human Factors Society 36th Annual Meeting. Part 2 (f 2) - Atlanta, GA, USA
Duration: Oct 12 1992Oct 16 1992

Other

OtherProceedings of the Human Factors Society 36th Annual Meeting. Part 2 (f 2)
CityAtlanta, GA, USA
Period10/12/9210/16/92

Fingerprint

Metals
Automobile engines
Knowledge acquisition

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Rowe, A. L., Cooke, N., Neville, K. J., & Schacherer, C. W. (1992). Mental models of metal models: a comparison of mental model measurement techniques. In Proceedings of the Human Factors Society (Vol. 2, pp. 1195-1199). Publ by Human Factors Soc Inc.

Mental models of metal models : a comparison of mental model measurement techniques. / Rowe, Anna L.; Cooke, Nancy; Neville, Kelly J.; Schacherer, Chris W.

Proceedings of the Human Factors Society. Vol. 2 Publ by Human Factors Soc Inc, 1992. p. 1195-1199.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Rowe, AL, Cooke, N, Neville, KJ & Schacherer, CW 1992, Mental models of metal models: a comparison of mental model measurement techniques. in Proceedings of the Human Factors Society. vol. 2, Publ by Human Factors Soc Inc, pp. 1195-1199, Proceedings of the Human Factors Society 36th Annual Meeting. Part 2 (f 2), Atlanta, GA, USA, 10/12/92.
Rowe AL, Cooke N, Neville KJ, Schacherer CW. Mental models of metal models: a comparison of mental model measurement techniques. In Proceedings of the Human Factors Society. Vol. 2. Publ by Human Factors Soc Inc. 1992. p. 1195-1199
Rowe, Anna L. ; Cooke, Nancy ; Neville, Kelly J. ; Schacherer, Chris W. / Mental models of metal models : a comparison of mental model measurement techniques. Proceedings of the Human Factors Society. Vol. 2 Publ by Human Factors Soc Inc, 1992. pp. 1195-1199
@inproceedings{f359b25ce2a34df69b17af03110138d9,
title = "Mental models of metal models: a comparison of mental model measurement techniques",
abstract = "Although use of the mental model construct has proliferated in recent research, the construct lacks a clear definition and an agreed upon method of measurement. Furthermore, the reliability and validity of the different measurement techniques in use have not been established, thereby making generalizations across studies of mental models difficult. The purpose of the current project was to assess several methods of measuring mental models in terms of their reliability/stability over time. Subjects' mental models of the automobile engine system were elicited on two occasions separated by one week, using seven different knowledge elicitation techniques. Subjects' level of experience was also measured to allow comparisons between experts and novices. The results indicate that each of the measurement techniques tended to be reliable for both experts and novices. However, reliability tended to be greater for experts than novices. Additionally, experts tended to agree with each other more than did the novices. Some evidence also indicated that the results from the similarity ratings and subsequent Pathfinder analysis converged with those from the structured interviews.",
author = "Rowe, {Anna L.} and Nancy Cooke and Neville, {Kelly J.} and Schacherer, {Chris W.}",
year = "1992",
language = "English (US)",
volume = "2",
pages = "1195--1199",
booktitle = "Proceedings of the Human Factors Society",
publisher = "Publ by Human Factors Soc Inc",

}

TY - GEN

T1 - Mental models of metal models

T2 - a comparison of mental model measurement techniques

AU - Rowe, Anna L.

AU - Cooke, Nancy

AU - Neville, Kelly J.

AU - Schacherer, Chris W.

PY - 1992

Y1 - 1992

N2 - Although use of the mental model construct has proliferated in recent research, the construct lacks a clear definition and an agreed upon method of measurement. Furthermore, the reliability and validity of the different measurement techniques in use have not been established, thereby making generalizations across studies of mental models difficult. The purpose of the current project was to assess several methods of measuring mental models in terms of their reliability/stability over time. Subjects' mental models of the automobile engine system were elicited on two occasions separated by one week, using seven different knowledge elicitation techniques. Subjects' level of experience was also measured to allow comparisons between experts and novices. The results indicate that each of the measurement techniques tended to be reliable for both experts and novices. However, reliability tended to be greater for experts than novices. Additionally, experts tended to agree with each other more than did the novices. Some evidence also indicated that the results from the similarity ratings and subsequent Pathfinder analysis converged with those from the structured interviews.

AB - Although use of the mental model construct has proliferated in recent research, the construct lacks a clear definition and an agreed upon method of measurement. Furthermore, the reliability and validity of the different measurement techniques in use have not been established, thereby making generalizations across studies of mental models difficult. The purpose of the current project was to assess several methods of measuring mental models in terms of their reliability/stability over time. Subjects' mental models of the automobile engine system were elicited on two occasions separated by one week, using seven different knowledge elicitation techniques. Subjects' level of experience was also measured to allow comparisons between experts and novices. The results indicate that each of the measurement techniques tended to be reliable for both experts and novices. However, reliability tended to be greater for experts than novices. Additionally, experts tended to agree with each other more than did the novices. Some evidence also indicated that the results from the similarity ratings and subsequent Pathfinder analysis converged with those from the structured interviews.

UR - http://www.scopus.com/inward/record.url?scp=0027037011&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0027037011&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:0027037011

VL - 2

SP - 1195

EP - 1199

BT - Proceedings of the Human Factors Society

PB - Publ by Human Factors Soc Inc

ER -