Rethinking the comprehensive test on qualitative reasoning for designers

Maryam Khorshidi, Jami J. Shah, Jay Woodward

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

A battery of tests assessing the cognitive skills needed for the conceptual design is being developed. Tests on Divergent thinking and visual thinking are fully developed and validated. The first version of the qualitative reasoning test has also been developed; this paper focuses on the lessons learned from testing of the first version of the test (alpha version) and the improvements made to it since then. A number of problems were developed for each indicator of the qualitative reasoning skill (deductive reasoning, inductive reasoning, analogical reasoning, and abductive reasoning). Later, a protocol study was done with the problems to make sure that the problems assess the desired skills. The problems were also given to a randomly chosen population of undergraduate senior-level or graduate-level engineering students. Data was collected from the test results on the possible correlations between the problems (e.g. technical and non-technical problems); feedback on clarity, time allocation, and difficulty for each problem was also collected. Based on all of the observed correlations, the average performance of the test takers, and test parameters such as validity, reliability, etc. the beta version of the test is constructed.

Original languageEnglish (US)
Title of host publicationProceedings of the ASME Design Engineering Technical Conference
PublisherAmerican Society of Mechanical Engineers
Volume5
ISBN (Print)9780791855928
DOIs
StatePublished - 2013
EventASME 2013 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2013 - Portland, OR, United States
Duration: Aug 4 2013Aug 7 2013

Other

OtherASME 2013 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2013
CountryUnited States
CityPortland, OR
Period8/4/138/7/13

Fingerprint

Qualitative Reasoning
Conceptual design
Students
Feedback
Testing
Reasoning
Conceptual Design
Battery
Engineering

ASJC Scopus subject areas

  • Mechanical Engineering
  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Modeling and Simulation

Cite this

Khorshidi, M., Shah, J. J., & Woodward, J. (2013). Rethinking the comprehensive test on qualitative reasoning for designers. In Proceedings of the ASME Design Engineering Technical Conference (Vol. 5). [V005T06A027] American Society of Mechanical Engineers. https://doi.org/10.1115/DETC2013-12403

Rethinking the comprehensive test on qualitative reasoning for designers. / Khorshidi, Maryam; Shah, Jami J.; Woodward, Jay.

Proceedings of the ASME Design Engineering Technical Conference. Vol. 5 American Society of Mechanical Engineers, 2013. V005T06A027.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Khorshidi, M, Shah, JJ & Woodward, J 2013, Rethinking the comprehensive test on qualitative reasoning for designers. in Proceedings of the ASME Design Engineering Technical Conference. vol. 5, V005T06A027, American Society of Mechanical Engineers, ASME 2013 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2013, Portland, OR, United States, 8/4/13. https://doi.org/10.1115/DETC2013-12403
Khorshidi M, Shah JJ, Woodward J. Rethinking the comprehensive test on qualitative reasoning for designers. In Proceedings of the ASME Design Engineering Technical Conference. Vol. 5. American Society of Mechanical Engineers. 2013. V005T06A027 https://doi.org/10.1115/DETC2013-12403
Khorshidi, Maryam ; Shah, Jami J. ; Woodward, Jay. / Rethinking the comprehensive test on qualitative reasoning for designers. Proceedings of the ASME Design Engineering Technical Conference. Vol. 5 American Society of Mechanical Engineers, 2013.
@inproceedings{60f6db3c85d640bd8694c2d283568992,
title = "Rethinking the comprehensive test on qualitative reasoning for designers",
abstract = "A battery of tests assessing the cognitive skills needed for the conceptual design is being developed. Tests on Divergent thinking and visual thinking are fully developed and validated. The first version of the qualitative reasoning test has also been developed; this paper focuses on the lessons learned from testing of the first version of the test (alpha version) and the improvements made to it since then. A number of problems were developed for each indicator of the qualitative reasoning skill (deductive reasoning, inductive reasoning, analogical reasoning, and abductive reasoning). Later, a protocol study was done with the problems to make sure that the problems assess the desired skills. The problems were also given to a randomly chosen population of undergraduate senior-level or graduate-level engineering students. Data was collected from the test results on the possible correlations between the problems (e.g. technical and non-technical problems); feedback on clarity, time allocation, and difficulty for each problem was also collected. Based on all of the observed correlations, the average performance of the test takers, and test parameters such as validity, reliability, etc. the beta version of the test is constructed.",
author = "Maryam Khorshidi and Shah, {Jami J.} and Jay Woodward",
year = "2013",
doi = "10.1115/DETC2013-12403",
language = "English (US)",
isbn = "9780791855928",
volume = "5",
booktitle = "Proceedings of the ASME Design Engineering Technical Conference",
publisher = "American Society of Mechanical Engineers",

}

TY - GEN

T1 - Rethinking the comprehensive test on qualitative reasoning for designers

AU - Khorshidi, Maryam

AU - Shah, Jami J.

AU - Woodward, Jay

PY - 2013

Y1 - 2013

N2 - A battery of tests assessing the cognitive skills needed for the conceptual design is being developed. Tests on Divergent thinking and visual thinking are fully developed and validated. The first version of the qualitative reasoning test has also been developed; this paper focuses on the lessons learned from testing of the first version of the test (alpha version) and the improvements made to it since then. A number of problems were developed for each indicator of the qualitative reasoning skill (deductive reasoning, inductive reasoning, analogical reasoning, and abductive reasoning). Later, a protocol study was done with the problems to make sure that the problems assess the desired skills. The problems were also given to a randomly chosen population of undergraduate senior-level or graduate-level engineering students. Data was collected from the test results on the possible correlations between the problems (e.g. technical and non-technical problems); feedback on clarity, time allocation, and difficulty for each problem was also collected. Based on all of the observed correlations, the average performance of the test takers, and test parameters such as validity, reliability, etc. the beta version of the test is constructed.

AB - A battery of tests assessing the cognitive skills needed for the conceptual design is being developed. Tests on Divergent thinking and visual thinking are fully developed and validated. The first version of the qualitative reasoning test has also been developed; this paper focuses on the lessons learned from testing of the first version of the test (alpha version) and the improvements made to it since then. A number of problems were developed for each indicator of the qualitative reasoning skill (deductive reasoning, inductive reasoning, analogical reasoning, and abductive reasoning). Later, a protocol study was done with the problems to make sure that the problems assess the desired skills. The problems were also given to a randomly chosen population of undergraduate senior-level or graduate-level engineering students. Data was collected from the test results on the possible correlations between the problems (e.g. technical and non-technical problems); feedback on clarity, time allocation, and difficulty for each problem was also collected. Based on all of the observed correlations, the average performance of the test takers, and test parameters such as validity, reliability, etc. the beta version of the test is constructed.

UR - http://www.scopus.com/inward/record.url?scp=84897011588&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84897011588&partnerID=8YFLogxK

U2 - 10.1115/DETC2013-12403

DO - 10.1115/DETC2013-12403

M3 - Conference contribution

AN - SCOPUS:84897011588

SN - 9780791855928

VL - 5

BT - Proceedings of the ASME Design Engineering Technical Conference

PB - American Society of Mechanical Engineers

ER -