Toward an On-Line Knowledge Assessment Methodology: Building on the Relationship between Knowing and Doing

Anna L. Rowe, Ellen P. Hall, Nancy Cooke, Tracy L. Halgren

Research output: Contribution to journalArticle

42 Citations (Scopus)

Abstract

The researchers describe steps taken toward the development of an on-line knowledge assessment methodology in the airborne electronics troubleshooting domain. On-line assessment in this complex, ill-defined domain requires an empirical investigation of expert or ideal knowledge and a means to infer knowledge patterns from action patterns. In Study 1, actions taken while troubleshooting were examined to develop a means for identifying meaningful action patterns. Pathfinder analyses of action sequences meaningfully distinguished high and low performers and identified intervention targets. In Study 2, methods for measuring students' knowledge were examined in terms of their respective abilities to predict troubleshooting performance. Three of the evaluated measures resulted in knowledge representations that were predictive of performance. Our findings have implications for capturing conceptual models and assessing knowledge in complex domains.

Original languageEnglish (US)
Pages (from-to)31-47
Number of pages17
JournalJournal of Experimental Psychology: Applied
Volume2
Issue number1
StatePublished - Mar 1996
Externally publishedYes

Fingerprint

Sequence Analysis
Research Personnel
Students

ASJC Scopus subject areas

  • Applied Psychology
  • Experimental and Cognitive Psychology

Cite this

Toward an On-Line Knowledge Assessment Methodology : Building on the Relationship between Knowing and Doing. / Rowe, Anna L.; Hall, Ellen P.; Cooke, Nancy; Halgren, Tracy L.

In: Journal of Experimental Psychology: Applied, Vol. 2, No. 1, 03.1996, p. 31-47.

Research output: Contribution to journalArticle

@article{fe7beb0aa4fa481e8a885eab3c05a2f6,
title = "Toward an On-Line Knowledge Assessment Methodology: Building on the Relationship between Knowing and Doing",
abstract = "The researchers describe steps taken toward the development of an on-line knowledge assessment methodology in the airborne electronics troubleshooting domain. On-line assessment in this complex, ill-defined domain requires an empirical investigation of expert or ideal knowledge and a means to infer knowledge patterns from action patterns. In Study 1, actions taken while troubleshooting were examined to develop a means for identifying meaningful action patterns. Pathfinder analyses of action sequences meaningfully distinguished high and low performers and identified intervention targets. In Study 2, methods for measuring students' knowledge were examined in terms of their respective abilities to predict troubleshooting performance. Three of the evaluated measures resulted in knowledge representations that were predictive of performance. Our findings have implications for capturing conceptual models and assessing knowledge in complex domains.",
author = "Rowe, {Anna L.} and Hall, {Ellen P.} and Nancy Cooke and Halgren, {Tracy L.}",
year = "1996",
month = "3",
language = "English (US)",
volume = "2",
pages = "31--47",
journal = "Journal of Experimental Psychology: Applied",
issn = "1076-898X",
publisher = "American Psychological Association Inc.",
number = "1",

}

TY - JOUR

T1 - Toward an On-Line Knowledge Assessment Methodology

T2 - Building on the Relationship between Knowing and Doing

AU - Rowe, Anna L.

AU - Hall, Ellen P.

AU - Cooke, Nancy

AU - Halgren, Tracy L.

PY - 1996/3

Y1 - 1996/3

N2 - The researchers describe steps taken toward the development of an on-line knowledge assessment methodology in the airborne electronics troubleshooting domain. On-line assessment in this complex, ill-defined domain requires an empirical investigation of expert or ideal knowledge and a means to infer knowledge patterns from action patterns. In Study 1, actions taken while troubleshooting were examined to develop a means for identifying meaningful action patterns. Pathfinder analyses of action sequences meaningfully distinguished high and low performers and identified intervention targets. In Study 2, methods for measuring students' knowledge were examined in terms of their respective abilities to predict troubleshooting performance. Three of the evaluated measures resulted in knowledge representations that were predictive of performance. Our findings have implications for capturing conceptual models and assessing knowledge in complex domains.

AB - The researchers describe steps taken toward the development of an on-line knowledge assessment methodology in the airborne electronics troubleshooting domain. On-line assessment in this complex, ill-defined domain requires an empirical investigation of expert or ideal knowledge and a means to infer knowledge patterns from action patterns. In Study 1, actions taken while troubleshooting were examined to develop a means for identifying meaningful action patterns. Pathfinder analyses of action sequences meaningfully distinguished high and low performers and identified intervention targets. In Study 2, methods for measuring students' knowledge were examined in terms of their respective abilities to predict troubleshooting performance. Three of the evaluated measures resulted in knowledge representations that were predictive of performance. Our findings have implications for capturing conceptual models and assessing knowledge in complex domains.

UR - http://www.scopus.com/inward/record.url?scp=0003030567&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0003030567&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:0003030567

VL - 2

SP - 31

EP - 47

JO - Journal of Experimental Psychology: Applied

JF - Journal of Experimental Psychology: Applied

SN - 1076-898X

IS - 1

ER -