Skip to main content icon/video/no-internet

Diagnostic Classification Models

Diagnostic classification models (DCMs) are psychometric models for classifying respondents or test takers according to their status on a set of discrete latent attributes, inferred from their observed performance or response on assessment items or tasks. DCMs, with their modeling of categorical, often fine-grained latent attributes, are well-suited for making classification-based inferences about attribute mastery. This contrasts with more conventional psychometric models containing continuous latent variables to be more suitable for the measurement of aggregated achievement. DCMs are, minimally, models about the item response process. They can also be understood as restricted latent class models for discrete multivariate data.

This entry begins with a comprehensive overview of the conceptual foundations of DCMs, followed by details of the DCM modeling process, and concludes with discussions about estimation and model evaluation. For consistency, the following terminology is used: items refer to questions or tasks in educational or psychological assessment tools; attributes are the categorical latent variables measured by the items; and attribute profiles include all possible combinations of attribute status. In line with the convention in the DCM literature, mastery is used to mean possession, attainment, or presence of the attribute in question.

Motivations for DCMs

Diagnostic paradigms have gained increasing prominence in educational and psychological measurement research. Existing approaches such as classical test theory and item response theory (IRT) are helpful for locating and ranking examinees on one or more continuous latent dimensions thought to represent the primary constructs to be measured. Thus, they are more appropriate for broad, summative assessments and, when used without further anchoring, lead naturally to norm-referenced interpretations for selection and prediction. However, actionable information for diagnostic decision making or to gain insight into underlying cognitive processes are not readily available from these more traditional approaches. For example, educators may want to know the strengths and weaknesses of students to improve classroom instruction and learning outcomes, and clinical psychologists require evidence to aid diagnosis and treatment. In such instances, classifying individuals based on attribute profiles are more meaningful than an overall score.

The advantages of DCMs over conventional methods for classification purposes are that DCMs eliminate the need for a two-stage procedure of first scaling examinees and then setting cut-scores, thus reducing multiple sources of classification error. In addition, DCMs present a natural mechanism to incorporate base rate (the proportion of individuals who attained mastery of an attribute) information into classification decisions. In addition, item models for DCMs can be formulated according to cognitive theories to provide empirical evidence regarding the theories via model fit evaluation. Also, DCMs provide information about the diagnostic quality of items in terms of item difficulty and discrimination. Furthermore, as an empirical advantage, DCMs can often provide reliable diagnostic information on multiple latent variables with fewer items than models with continuous latent variables.

Characteristics of DCMs

The defining characteristics of DCMs become apparent when comparing them with other latent variable models. Traditional IRT models and DCMs have in common that the manifest variables or items are categorical (i.e., dichotomous and polytomous response data). Also, all DCMs and IRT models are probabilistic models in that they express the probability of a categorial response with respect to latent traits representing constructs of interest. As for the number of latent traits, DCMs are similar to multidimensional IRT or factor analysis (FA) models as they consist of multiple latent dimensions as opposed to a single ability in unidimensional IRT models.

...

  • Loading...
locked icon

Sign in to access this content

Get a 30 day FREE TRIAL

  • Watch videos from a variety of sources bringing classroom topics to life
  • Read modern, diverse business cases
  • Explore hundreds of books and reference titles

Sage Recommends

We found other relevant content for you on other Sage platforms.

Loading