Developing a method to measure the metacognitive effects of a course on design, engineering and technology over time

Dale Baker, Senay Yasar, Sharon Kurpius, Stephen Krause, Chell Roberts

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Measuring and tracking how individuals become aware of their own understanding (metacognition) cannot easily be measured by traditional tests or assessments. Consequently, this paper presents the development and application of a rubric to examine qualitative data that illustrates how graduate students in science education, who were enrolled in a Design, Engineering and Technology. (DET) course, became aware of the changes in their understanding of DET. Weekly reflection papers, weekly written pre and post tests and lesson plans were used as data sources. A rubric linking the course outcomes with six major categories (engineering as a design process, gender and diversity, societal relevance of engineering, technical self-efficacy, tinkering self-efficacy and transfer to classroom teaching) was developed to code text. Several passes through the data led to the refinements for the six categories that allowed the coding of almost all of the text. We specifically looked for shifts in understanding over a 15-week period and an awareness that these shifts were taking place (e.g. "It's not that I had a bad attitude about technology to begin with, rather this class as a whole and our group project has forced me to think about its appropriate applications at the K-12 level." and "Both technology education papers addressed the difference between technology education and educational technology - two different concepts I had not thought of before"). Our technique allowed us to capture the subtleties of understanding and the progression of metacognition. The rubric demonstrated that the DET course had a strong impact on students thinking about and applying DET to teaching.

Original languageEnglish (US)
Title of host publicationASEE Annual Conference Proceedings
Pages3117-3128
Number of pages12
StatePublished - 2004
EventASEE 2004 Annual Conference and Exposition, "Engineering Researchs New Heights" - Salt Lake City, UT, United States
Duration: Jun 20 2004Jun 23 2004

Other

OtherASEE 2004 Annual Conference and Exposition, "Engineering Researchs New Heights"
CountryUnited States
CitySalt Lake City, UT
Period6/20/046/23/04

Fingerprint

Education
Teaching
Students
Educational technology

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Baker, D., Yasar, S., Kurpius, S., Krause, S., & Roberts, C. (2004). Developing a method to measure the metacognitive effects of a course on design, engineering and technology over time. In ASEE Annual Conference Proceedings (pp. 3117-3128)

Developing a method to measure the metacognitive effects of a course on design, engineering and technology over time. / Baker, Dale; Yasar, Senay; Kurpius, Sharon; Krause, Stephen; Roberts, Chell.

ASEE Annual Conference Proceedings. 2004. p. 3117-3128.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Baker, D, Yasar, S, Kurpius, S, Krause, S & Roberts, C 2004, Developing a method to measure the metacognitive effects of a course on design, engineering and technology over time. in ASEE Annual Conference Proceedings. pp. 3117-3128, ASEE 2004 Annual Conference and Exposition, "Engineering Researchs New Heights", Salt Lake City, UT, United States, 6/20/04.
Baker, Dale ; Yasar, Senay ; Kurpius, Sharon ; Krause, Stephen ; Roberts, Chell. / Developing a method to measure the metacognitive effects of a course on design, engineering and technology over time. ASEE Annual Conference Proceedings. 2004. pp. 3117-3128
@inproceedings{a8221ed82ae14eba8b3acaa6c690f01e,
title = "Developing a method to measure the metacognitive effects of a course on design, engineering and technology over time",
abstract = "Measuring and tracking how individuals become aware of their own understanding (metacognition) cannot easily be measured by traditional tests or assessments. Consequently, this paper presents the development and application of a rubric to examine qualitative data that illustrates how graduate students in science education, who were enrolled in a Design, Engineering and Technology. (DET) course, became aware of the changes in their understanding of DET. Weekly reflection papers, weekly written pre and post tests and lesson plans were used as data sources. A rubric linking the course outcomes with six major categories (engineering as a design process, gender and diversity, societal relevance of engineering, technical self-efficacy, tinkering self-efficacy and transfer to classroom teaching) was developed to code text. Several passes through the data led to the refinements for the six categories that allowed the coding of almost all of the text. We specifically looked for shifts in understanding over a 15-week period and an awareness that these shifts were taking place (e.g. {"}It's not that I had a bad attitude about technology to begin with, rather this class as a whole and our group project has forced me to think about its appropriate applications at the K-12 level.{"} and {"}Both technology education papers addressed the difference between technology education and educational technology - two different concepts I had not thought of before{"}). Our technique allowed us to capture the subtleties of understanding and the progression of metacognition. The rubric demonstrated that the DET course had a strong impact on students thinking about and applying DET to teaching.",
author = "Dale Baker and Senay Yasar and Sharon Kurpius and Stephen Krause and Chell Roberts",
year = "2004",
language = "English (US)",
pages = "3117--3128",
booktitle = "ASEE Annual Conference Proceedings",

}

TY - GEN

T1 - Developing a method to measure the metacognitive effects of a course on design, engineering and technology over time

AU - Baker, Dale

AU - Yasar, Senay

AU - Kurpius, Sharon

AU - Krause, Stephen

AU - Roberts, Chell

PY - 2004

Y1 - 2004

N2 - Measuring and tracking how individuals become aware of their own understanding (metacognition) cannot easily be measured by traditional tests or assessments. Consequently, this paper presents the development and application of a rubric to examine qualitative data that illustrates how graduate students in science education, who were enrolled in a Design, Engineering and Technology. (DET) course, became aware of the changes in their understanding of DET. Weekly reflection papers, weekly written pre and post tests and lesson plans were used as data sources. A rubric linking the course outcomes with six major categories (engineering as a design process, gender and diversity, societal relevance of engineering, technical self-efficacy, tinkering self-efficacy and transfer to classroom teaching) was developed to code text. Several passes through the data led to the refinements for the six categories that allowed the coding of almost all of the text. We specifically looked for shifts in understanding over a 15-week period and an awareness that these shifts were taking place (e.g. "It's not that I had a bad attitude about technology to begin with, rather this class as a whole and our group project has forced me to think about its appropriate applications at the K-12 level." and "Both technology education papers addressed the difference between technology education and educational technology - two different concepts I had not thought of before"). Our technique allowed us to capture the subtleties of understanding and the progression of metacognition. The rubric demonstrated that the DET course had a strong impact on students thinking about and applying DET to teaching.

AB - Measuring and tracking how individuals become aware of their own understanding (metacognition) cannot easily be measured by traditional tests or assessments. Consequently, this paper presents the development and application of a rubric to examine qualitative data that illustrates how graduate students in science education, who were enrolled in a Design, Engineering and Technology. (DET) course, became aware of the changes in their understanding of DET. Weekly reflection papers, weekly written pre and post tests and lesson plans were used as data sources. A rubric linking the course outcomes with six major categories (engineering as a design process, gender and diversity, societal relevance of engineering, technical self-efficacy, tinkering self-efficacy and transfer to classroom teaching) was developed to code text. Several passes through the data led to the refinements for the six categories that allowed the coding of almost all of the text. We specifically looked for shifts in understanding over a 15-week period and an awareness that these shifts were taking place (e.g. "It's not that I had a bad attitude about technology to begin with, rather this class as a whole and our group project has forced me to think about its appropriate applications at the K-12 level." and "Both technology education papers addressed the difference between technology education and educational technology - two different concepts I had not thought of before"). Our technique allowed us to capture the subtleties of understanding and the progression of metacognition. The rubric demonstrated that the DET course had a strong impact on students thinking about and applying DET to teaching.

UR - http://www.scopus.com/inward/record.url?scp=5444242772&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=5444242772&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:5444242772

SP - 3117

EP - 3128

BT - ASEE Annual Conference Proceedings

ER -