Applied tests of engineering design skills

Visual thinking characterization, test development and validation

Jami J. Shah, Jay Woodward, S. M. Smith

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

A number of cognitive skills relevant to conceptual design have been previously identified: Divergent Thinking, Visual Thinking, Spatial Reasoning, Qualitative Reasoning and Problem Formulation. A battery of standardized test has been developed for these skills. We have already reported on the contents and rationale for divergent thinking test, as well as, on data collection and statistical analysis for it. This paper focuses similarly on the efforts related to the visual thinking and spatial reasoning in engineering context. It is designed to evaluate six measures: visual comprehension including perceptual speed, visual memory, visual synthesis mental image manipulation/ transformation, spatial reasoning and graphical expression/elaboration. We discuss the theoretical basis of a comprehensive test for engineers, test composition, trial runs and computation of reliability measures. The alpha version was given to a small set of subjects to determine clarity of the questions and gauge difficulty level. The beta version was used for norming and test validation from over 300 samples, engineering students and a smaller number of practicing engineers. The test is shown to be reliable (Cronbach alpha less than .05 and only 2 eigenvalues greater than 1).

Original languageEnglish (US)
Title of host publicationICED 11 - 18th International Conference on Engineering Design - Impacting Society Through Engineering Design
Pages127-139
Number of pages13
Volume7
StatePublished - 2011
Event18th International Conference on Engineering Design, ICED 11 - Copenhagen, Denmark
Duration: Aug 15 2011Aug 18 2011

Other

Other18th International Conference on Engineering Design, ICED 11
CountryDenmark
CityCopenhagen
Period8/15/118/18/11

Fingerprint

Engineers
Conceptual design
Gages
Statistical methods
Students
Data storage equipment
Chemical analysis

Keywords

  • Design cognition
  • Engineering design skills
  • Ideation
  • Standardized tests
  • Visual thinking

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering

Cite this

Shah, J. J., Woodward, J., & Smith, S. M. (2011). Applied tests of engineering design skills: Visual thinking characterization, test development and validation. In ICED 11 - 18th International Conference on Engineering Design - Impacting Society Through Engineering Design (Vol. 7, pp. 127-139)

Applied tests of engineering design skills : Visual thinking characterization, test development and validation. / Shah, Jami J.; Woodward, Jay; Smith, S. M.

ICED 11 - 18th International Conference on Engineering Design - Impacting Society Through Engineering Design. Vol. 7 2011. p. 127-139.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Shah, JJ, Woodward, J & Smith, SM 2011, Applied tests of engineering design skills: Visual thinking characterization, test development and validation. in ICED 11 - 18th International Conference on Engineering Design - Impacting Society Through Engineering Design. vol. 7, pp. 127-139, 18th International Conference on Engineering Design, ICED 11, Copenhagen, Denmark, 8/15/11.
Shah JJ, Woodward J, Smith SM. Applied tests of engineering design skills: Visual thinking characterization, test development and validation. In ICED 11 - 18th International Conference on Engineering Design - Impacting Society Through Engineering Design. Vol. 7. 2011. p. 127-139
Shah, Jami J. ; Woodward, Jay ; Smith, S. M. / Applied tests of engineering design skills : Visual thinking characterization, test development and validation. ICED 11 - 18th International Conference on Engineering Design - Impacting Society Through Engineering Design. Vol. 7 2011. pp. 127-139
@inproceedings{2aa07a57c7c6412680bd82686789a7b3,
title = "Applied tests of engineering design skills: Visual thinking characterization, test development and validation",
abstract = "A number of cognitive skills relevant to conceptual design have been previously identified: Divergent Thinking, Visual Thinking, Spatial Reasoning, Qualitative Reasoning and Problem Formulation. A battery of standardized test has been developed for these skills. We have already reported on the contents and rationale for divergent thinking test, as well as, on data collection and statistical analysis for it. This paper focuses similarly on the efforts related to the visual thinking and spatial reasoning in engineering context. It is designed to evaluate six measures: visual comprehension including perceptual speed, visual memory, visual synthesis mental image manipulation/ transformation, spatial reasoning and graphical expression/elaboration. We discuss the theoretical basis of a comprehensive test for engineers, test composition, trial runs and computation of reliability measures. The alpha version was given to a small set of subjects to determine clarity of the questions and gauge difficulty level. The beta version was used for norming and test validation from over 300 samples, engineering students and a smaller number of practicing engineers. The test is shown to be reliable (Cronbach alpha less than .05 and only 2 eigenvalues greater than 1).",
keywords = "Design cognition, Engineering design skills, Ideation, Standardized tests, Visual thinking",
author = "Shah, {Jami J.} and Jay Woodward and Smith, {S. M.}",
year = "2011",
language = "English (US)",
isbn = "9781904670278",
volume = "7",
pages = "127--139",
booktitle = "ICED 11 - 18th International Conference on Engineering Design - Impacting Society Through Engineering Design",

}

TY - GEN

T1 - Applied tests of engineering design skills

T2 - Visual thinking characterization, test development and validation

AU - Shah, Jami J.

AU - Woodward, Jay

AU - Smith, S. M.

PY - 2011

Y1 - 2011

N2 - A number of cognitive skills relevant to conceptual design have been previously identified: Divergent Thinking, Visual Thinking, Spatial Reasoning, Qualitative Reasoning and Problem Formulation. A battery of standardized test has been developed for these skills. We have already reported on the contents and rationale for divergent thinking test, as well as, on data collection and statistical analysis for it. This paper focuses similarly on the efforts related to the visual thinking and spatial reasoning in engineering context. It is designed to evaluate six measures: visual comprehension including perceptual speed, visual memory, visual synthesis mental image manipulation/ transformation, spatial reasoning and graphical expression/elaboration. We discuss the theoretical basis of a comprehensive test for engineers, test composition, trial runs and computation of reliability measures. The alpha version was given to a small set of subjects to determine clarity of the questions and gauge difficulty level. The beta version was used for norming and test validation from over 300 samples, engineering students and a smaller number of practicing engineers. The test is shown to be reliable (Cronbach alpha less than .05 and only 2 eigenvalues greater than 1).

AB - A number of cognitive skills relevant to conceptual design have been previously identified: Divergent Thinking, Visual Thinking, Spatial Reasoning, Qualitative Reasoning and Problem Formulation. A battery of standardized test has been developed for these skills. We have already reported on the contents and rationale for divergent thinking test, as well as, on data collection and statistical analysis for it. This paper focuses similarly on the efforts related to the visual thinking and spatial reasoning in engineering context. It is designed to evaluate six measures: visual comprehension including perceptual speed, visual memory, visual synthesis mental image manipulation/ transformation, spatial reasoning and graphical expression/elaboration. We discuss the theoretical basis of a comprehensive test for engineers, test composition, trial runs and computation of reliability measures. The alpha version was given to a small set of subjects to determine clarity of the questions and gauge difficulty level. The beta version was used for norming and test validation from over 300 samples, engineering students and a smaller number of practicing engineers. The test is shown to be reliable (Cronbach alpha less than .05 and only 2 eigenvalues greater than 1).

KW - Design cognition

KW - Engineering design skills

KW - Ideation

KW - Standardized tests

KW - Visual thinking

UR - http://www.scopus.com/inward/record.url?scp=84863346574&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84863346574&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9781904670278

VL - 7

SP - 127

EP - 139

BT - ICED 11 - 18th International Conference on Engineering Design - Impacting Society Through Engineering Design

ER -