- Subject index
Measurement Theory in Action: Case Studies and Exercises comprises twenty modules, each corresponding to entire chapters in typical measurement theory texts. The modules begin with introductory concepts and a review of statistics; progress through conceptions of content, criterion-related, and construct validation, validity generalization and test-bias; and conclude with more advanced topics such as multiple regression and item response theory (IRT). Each module is composed of an overview, case studies, exercises, Internet references, and suggested further readings. An extensive glossary of key terms is also provided for quick reference. An Instructor's Resources CD containing exercises and assignments is also available.
Module 9: Validity Generalization and Meta-Analysis
Schmidt and Hunter (2001) discussed the myth of the “perfect study.” That is, if we could somehow get a large enough sample with perfectly reliable and valid measures we could definitively answer the key and nagging questions plaguing the social and behavioral sciences. Although some large-scale studies have been conducted with thousands of participants, most individual empirical studies, particularly in psychology, tend to average in the hundreds (or less) of participants, not thousands. As a result, sampling error is a major source of error in estimating population relationships and parameters within any given empirical investigation. In addition, a variety of factors (i.e., methodological artifacts), such as unreliable measures, restriction of range, and artificial dichotomization of continuous variables, are ...