Considerations for Fitting Dynamic Bayesian Networks With Latent Variables: A Monte Carlo Study

Ray E. Reichenberg, Roy Levy, Adam Clark

Research output: Contribution to journalArticlepeer-review

Abstract

Dynamic Bayesian networks (DBNs; Reye, 2004) are a promising tool for modeling student proficiency under rich measurement scenarios (Reichenberg, 2018). These scenarios often present assessment conditions far more complex than what is seen with more traditional assessments and require assessment arguments and psychometric models capable of integrating those complexities. Unfortunately, DBNs remain understudied and their psychometric properties relatively unknown. The current work aimed at exploring the properties of DBNs under a variety of realistic psychometric conditions. A Monte Carlo simulation study was conducted in order to evaluate parameter recovery for DBNs using maximum likelihood estimation. Manipulated factors included sample size, measurement quality, test length, the number of measurement occasions. Results suggested that measurement quality has the most prominent impact on estimation quality with more distinct performance categories yielding better estimation. From a practical perspective, parameter recovery appeared to be sufficient with samples as low as N = 400 as long as measurement quality was not poor and at least three items were present at each measurement occasion. Tests consisting of only a single item required exceptional measurement quality in order to adequately recover model parameters.

Original languageEnglish (US)
Pages (from-to)116-135
Number of pages20
JournalApplied Psychological Measurement
Volume46
Issue number2
DOIs
StatePublished - Mar 2022
Externally publishedYes

Keywords

  • Bayesian networks
  • diagnostic assessment
  • psychometric

ASJC Scopus subject areas

  • Social Sciences (miscellaneous)
  • Psychology (miscellaneous)

Fingerprint

Dive into the research topics of 'Considerations for Fitting Dynamic Bayesian Networks With Latent Variables: A Monte Carlo Study'. Together they form a unique fingerprint.

Cite this