A brief introduction to evidence‐centered design
RJ Mislevy, RG Almond… - ETS Research Report …, 2003 - Wiley Online Library
RJ Mislevy, RG Almond, JF Lukas
ETS Research Report Series, 2003•Wiley Online LibraryEvidence‐centered assessment design (ECD) is an approach to constructing educational
assessments in terms of evidentiary arguments. This paper provides an introduction to the
basic ideas of ECD, as well as some of the terminology and models that have been
developed to implement the approach. In particular, it presents the high‐level models of the
Conceptual Assessment Framework (CAF) and the Four‐process Delivery Architecture for
assessment delivery systems. Special attention is given to the role of probability‐based …
assessments in terms of evidentiary arguments. This paper provides an introduction to the
basic ideas of ECD, as well as some of the terminology and models that have been
developed to implement the approach. In particular, it presents the high‐level models of the
Conceptual Assessment Framework (CAF) and the Four‐process Delivery Architecture for
assessment delivery systems. Special attention is given to the role of probability‐based …
Abstract
Evidence‐centered assessment design (ECD) is an approach to constructing educational assessments in terms of evidentiary arguments. This paper provides an introduction to the basic ideas of ECD, as well as some of the terminology and models that have been developed to implement the approach. In particular, it presents the high‐level models of the Conceptual Assessment Framework (CAF) and the Four‐process Delivery Architecture for assessment delivery systems. Special attention is given to the role of probability‐based reasoning in accumulating evidence across task performances, in terms of belief about unobservable variables that characterize the knowledge, skills, and/or abilities of students. This is the role traditionally associated with psychometric models, such as those of item response theory (IRT) and latent class models. To unify the ideas and to provide a foundation for extending probability‐based reasoning in assessment applications more broadly, however, a more general expression in terms of graphical models is indicated. This brief overview of evidence‐centered design provides the reader with a feel for where and how graphical models fit into the larger enterprise of educational and psychological assessment. A simple example based on familiar large‐scale standardized tests such as the Graduate Record Examinations® (GRE®) is used to fix ideas.
Wiley Online Library