Development of standardized tests for design skills

Jami J. Shah, S. M. Smith, Jay Woodward

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Citations (Scopus)

Abstract

A number of cognitive skills relevant to design have been identified. Formal methods for evaluating these skills in engineering students are needed. Towards that goal we are developing a battery of standardized tests for the most critical of these skills. These tests are based on research in design thinking, human problem solving, cognitive psychology and psychometrics. Tests for Divergent Thinking, Visual Thinking, Spatial Reasoning, Qualitative Reasoning and Problem Formulation are in various stages of development. This paper describes the procedure and rationale for test development. Tt involves characterization of design skills in terms of measurable indicators; devising skill measurement instruments (problems, metrics, scales); conducting trials to collect data and evaluation of tests for criterion and construct validity. Beta trials are in progress involving undergraduate and graduate students at multiple universities and engineers in industry. Possible applications of these tests include evaluating students in design classes, forming of balanced design teams that posses skills necessary for a given project and evaluating the effectiveness of design courses and curricula.

Original languageEnglish (US)
Title of host publicationDS 58-10: Proceedings of ICED 09, the 17th International Conference on Engineering Design
Pages269-280
Number of pages12
Volume10
StatePublished - 2009
Event17th International Conference on Engineering Design, ICED 09 - Palo Alto, CA, United States
Duration: Aug 24 2009Aug 27 2009

Other

Other17th International Conference on Engineering Design, ICED 09
CountryUnited States
CityPalo Alto, CA
Period8/24/098/27/09

Fingerprint

Students
Construct Validity
Qualitative Reasoning
Spatial Reasoning
Balanced Design
Formal methods
Psychometrics
Formal Methods
Battery
Curricula
Design
Skills
Industry
Engineering
Engineers
Metric
Necessary
Formulation
Evaluation
Class

Keywords

  • Design education
  • Design thinking
  • Psychometrics
  • Skill evaluation
  • Teamology

ASJC Scopus subject areas

  • Engineering (miscellaneous)
  • Modeling and Simulation

Cite this

Shah, J. J., Smith, S. M., & Woodward, J. (2009). Development of standardized tests for design skills. In DS 58-10: Proceedings of ICED 09, the 17th International Conference on Engineering Design (Vol. 10, pp. 269-280)

Development of standardized tests for design skills. / Shah, Jami J.; Smith, S. M.; Woodward, Jay.

DS 58-10: Proceedings of ICED 09, the 17th International Conference on Engineering Design. Vol. 10 2009. p. 269-280.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Shah, JJ, Smith, SM & Woodward, J 2009, Development of standardized tests for design skills. in DS 58-10: Proceedings of ICED 09, the 17th International Conference on Engineering Design. vol. 10, pp. 269-280, 17th International Conference on Engineering Design, ICED 09, Palo Alto, CA, United States, 8/24/09.
Shah JJ, Smith SM, Woodward J. Development of standardized tests for design skills. In DS 58-10: Proceedings of ICED 09, the 17th International Conference on Engineering Design. Vol. 10. 2009. p. 269-280
Shah, Jami J. ; Smith, S. M. ; Woodward, Jay. / Development of standardized tests for design skills. DS 58-10: Proceedings of ICED 09, the 17th International Conference on Engineering Design. Vol. 10 2009. pp. 269-280
@inproceedings{ea6038e865cb429182cb490c0d8b9954,
title = "Development of standardized tests for design skills",
abstract = "A number of cognitive skills relevant to design have been identified. Formal methods for evaluating these skills in engineering students are needed. Towards that goal we are developing a battery of standardized tests for the most critical of these skills. These tests are based on research in design thinking, human problem solving, cognitive psychology and psychometrics. Tests for Divergent Thinking, Visual Thinking, Spatial Reasoning, Qualitative Reasoning and Problem Formulation are in various stages of development. This paper describes the procedure and rationale for test development. Tt involves characterization of design skills in terms of measurable indicators; devising skill measurement instruments (problems, metrics, scales); conducting trials to collect data and evaluation of tests for criterion and construct validity. Beta trials are in progress involving undergraduate and graduate students at multiple universities and engineers in industry. Possible applications of these tests include evaluating students in design classes, forming of balanced design teams that posses skills necessary for a given project and evaluating the effectiveness of design courses and curricula.",
keywords = "Design education, Design thinking, Psychometrics, Skill evaluation, Teamology",
author = "Shah, {Jami J.} and Smith, {S. M.} and Jay Woodward",
year = "2009",
language = "English (US)",
isbn = "9781904670148",
volume = "10",
pages = "269--280",
booktitle = "DS 58-10: Proceedings of ICED 09, the 17th International Conference on Engineering Design",

}

TY - GEN

T1 - Development of standardized tests for design skills

AU - Shah, Jami J.

AU - Smith, S. M.

AU - Woodward, Jay

PY - 2009

Y1 - 2009

N2 - A number of cognitive skills relevant to design have been identified. Formal methods for evaluating these skills in engineering students are needed. Towards that goal we are developing a battery of standardized tests for the most critical of these skills. These tests are based on research in design thinking, human problem solving, cognitive psychology and psychometrics. Tests for Divergent Thinking, Visual Thinking, Spatial Reasoning, Qualitative Reasoning and Problem Formulation are in various stages of development. This paper describes the procedure and rationale for test development. Tt involves characterization of design skills in terms of measurable indicators; devising skill measurement instruments (problems, metrics, scales); conducting trials to collect data and evaluation of tests for criterion and construct validity. Beta trials are in progress involving undergraduate and graduate students at multiple universities and engineers in industry. Possible applications of these tests include evaluating students in design classes, forming of balanced design teams that posses skills necessary for a given project and evaluating the effectiveness of design courses and curricula.

AB - A number of cognitive skills relevant to design have been identified. Formal methods for evaluating these skills in engineering students are needed. Towards that goal we are developing a battery of standardized tests for the most critical of these skills. These tests are based on research in design thinking, human problem solving, cognitive psychology and psychometrics. Tests for Divergent Thinking, Visual Thinking, Spatial Reasoning, Qualitative Reasoning and Problem Formulation are in various stages of development. This paper describes the procedure and rationale for test development. Tt involves characterization of design skills in terms of measurable indicators; devising skill measurement instruments (problems, metrics, scales); conducting trials to collect data and evaluation of tests for criterion and construct validity. Beta trials are in progress involving undergraduate and graduate students at multiple universities and engineers in industry. Possible applications of these tests include evaluating students in design classes, forming of balanced design teams that posses skills necessary for a given project and evaluating the effectiveness of design courses and curricula.

KW - Design education

KW - Design thinking

KW - Psychometrics

KW - Skill evaluation

KW - Teamology

UR - http://www.scopus.com/inward/record.url?scp=84859241298&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84859241298&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9781904670148

VL - 10

SP - 269

EP - 280

BT - DS 58-10: Proceedings of ICED 09, the 17th International Conference on Engineering Design

ER -