Dynamic Measurement in Health Professions Education: Rationale, Application, and Possibilities

Denis Dumas, Daniel McNeish, Deanna Schreiber-Gregory, Steven J. Durning, Dario M. Torre

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Dynamic measurement modeling (DMM) is a psychometric paradigm that uses longitudinal data to estimate individual students' growth in measured skills over the course of an educational program (i.e., growth scores). DMM represents a more formal way of assessing learning progress across the health professions education continuum. In this article, the authors provide justification for this approach in health professions education and demonstrate its proof-of-concept use with three time points of United States Medical Licensing Examination Step exams to generate growth scores for 454 current and recent medical learners. The authors demonstrate that learners vary substantially on their growth scores, and those growth scores exhibit psychometric reliability. In addition, growth scores significantly and positively correlated with indicators of medical learner readiness (e.g., undergraduate grade point average and Medical College Admission Test scores). These growth scores were also capable of significantly and positively correlating with future ratings of clinical competencies during internship as assessed through a survey sent to their program directors at the end of the first postgraduate year (e.g., patient care, interpersonal skills). These preliminary findings of reliability and validity for DMM growth scores provide initial evidence for further investigation into the suitability of a dynamic measurement paradigm in health professions education.

Original languageEnglish (US)
Pages (from-to)1323-1328
Number of pages6
JournalAcademic medicine : journal of the Association of American Medical Colleges
Volume94
Issue number9
DOIs
StatePublished - Sep 1 2019

Fingerprint

profession
health
education
psychometrics
paradigm
learning success
internship
educational program
patient care
director
rating
examination
evidence
student

ASJC Scopus subject areas

  • Education

Cite this

Dynamic Measurement in Health Professions Education : Rationale, Application, and Possibilities. / Dumas, Denis; McNeish, Daniel; Schreiber-Gregory, Deanna; Durning, Steven J.; Torre, Dario M.

In: Academic medicine : journal of the Association of American Medical Colleges, Vol. 94, No. 9, 01.09.2019, p. 1323-1328.

Research output: Contribution to journalArticle

Dumas, Denis ; McNeish, Daniel ; Schreiber-Gregory, Deanna ; Durning, Steven J. ; Torre, Dario M. / Dynamic Measurement in Health Professions Education : Rationale, Application, and Possibilities. In: Academic medicine : journal of the Association of American Medical Colleges. 2019 ; Vol. 94, No. 9. pp. 1323-1328.
@article{6d8b6e6ba3734c2487d4ea9a58226640,
title = "Dynamic Measurement in Health Professions Education: Rationale, Application, and Possibilities",
abstract = "Dynamic measurement modeling (DMM) is a psychometric paradigm that uses longitudinal data to estimate individual students' growth in measured skills over the course of an educational program (i.e., growth scores). DMM represents a more formal way of assessing learning progress across the health professions education continuum. In this article, the authors provide justification for this approach in health professions education and demonstrate its proof-of-concept use with three time points of United States Medical Licensing Examination Step exams to generate growth scores for 454 current and recent medical learners. The authors demonstrate that learners vary substantially on their growth scores, and those growth scores exhibit psychometric reliability. In addition, growth scores significantly and positively correlated with indicators of medical learner readiness (e.g., undergraduate grade point average and Medical College Admission Test scores). These growth scores were also capable of significantly and positively correlating with future ratings of clinical competencies during internship as assessed through a survey sent to their program directors at the end of the first postgraduate year (e.g., patient care, interpersonal skills). These preliminary findings of reliability and validity for DMM growth scores provide initial evidence for further investigation into the suitability of a dynamic measurement paradigm in health professions education.",
author = "Denis Dumas and Daniel McNeish and Deanna Schreiber-Gregory and Durning, {Steven J.} and Torre, {Dario M.}",
year = "2019",
month = "9",
day = "1",
doi = "10.1097/ACM.0000000000002729",
language = "English (US)",
volume = "94",
pages = "1323--1328",
journal = "Academic Medicine",
issn = "1040-2446",
publisher = "Lippincott Williams and Wilkins",
number = "9",

}

TY - JOUR

T1 - Dynamic Measurement in Health Professions Education

T2 - Rationale, Application, and Possibilities

AU - Dumas, Denis

AU - McNeish, Daniel

AU - Schreiber-Gregory, Deanna

AU - Durning, Steven J.

AU - Torre, Dario M.

PY - 2019/9/1

Y1 - 2019/9/1

N2 - Dynamic measurement modeling (DMM) is a psychometric paradigm that uses longitudinal data to estimate individual students' growth in measured skills over the course of an educational program (i.e., growth scores). DMM represents a more formal way of assessing learning progress across the health professions education continuum. In this article, the authors provide justification for this approach in health professions education and demonstrate its proof-of-concept use with three time points of United States Medical Licensing Examination Step exams to generate growth scores for 454 current and recent medical learners. The authors demonstrate that learners vary substantially on their growth scores, and those growth scores exhibit psychometric reliability. In addition, growth scores significantly and positively correlated with indicators of medical learner readiness (e.g., undergraduate grade point average and Medical College Admission Test scores). These growth scores were also capable of significantly and positively correlating with future ratings of clinical competencies during internship as assessed through a survey sent to their program directors at the end of the first postgraduate year (e.g., patient care, interpersonal skills). These preliminary findings of reliability and validity for DMM growth scores provide initial evidence for further investigation into the suitability of a dynamic measurement paradigm in health professions education.

AB - Dynamic measurement modeling (DMM) is a psychometric paradigm that uses longitudinal data to estimate individual students' growth in measured skills over the course of an educational program (i.e., growth scores). DMM represents a more formal way of assessing learning progress across the health professions education continuum. In this article, the authors provide justification for this approach in health professions education and demonstrate its proof-of-concept use with three time points of United States Medical Licensing Examination Step exams to generate growth scores for 454 current and recent medical learners. The authors demonstrate that learners vary substantially on their growth scores, and those growth scores exhibit psychometric reliability. In addition, growth scores significantly and positively correlated with indicators of medical learner readiness (e.g., undergraduate grade point average and Medical College Admission Test scores). These growth scores were also capable of significantly and positively correlating with future ratings of clinical competencies during internship as assessed through a survey sent to their program directors at the end of the first postgraduate year (e.g., patient care, interpersonal skills). These preliminary findings of reliability and validity for DMM growth scores provide initial evidence for further investigation into the suitability of a dynamic measurement paradigm in health professions education.

UR - http://www.scopus.com/inward/record.url?scp=85071608711&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85071608711&partnerID=8YFLogxK

U2 - 10.1097/ACM.0000000000002729

DO - 10.1097/ACM.0000000000002729

M3 - Article

C2 - 31460924

AN - SCOPUS:85071608711

VL - 94

SP - 1323

EP - 1328

JO - Academic Medicine

JF - Academic Medicine

SN - 1040-2446

IS - 9

ER -