Skip to main content icon/video/no-internet

External Validity

External validity refers to the ability to generalize the findings of an experiment to other settings, populations, and times. For educational psychology, this ability is a vital one, because it indicates the extent to which various programs shown to improve learning in one (perhaps artificial) setting can be confidently expected to show similar improvements in other (real) classroom settings. Without high external validity, the program may not have its intended or presumed effect in the various populations of interest. This entry will describe external validity in detail, offer suggestions for increasing it, describe threats to it, and discuss the trade-off between external validity and internal validity.

When a new educational technique or program is being evaluated in an experimental trial, of necessity the evaluation involves, for example, a specific school or district or set of classrooms. In addition, it takes place with specific children, teachers, materials, and at a particular time. However, researchers and educators clearly do not wish to restrict their conclusions to those particular schools, teachers, children, and so on; they prefer to generalize, that is, assume that their conclusions about the program extends to other (or even any) schools, teachers, children, and the like. The issue of external validity concerns whether such a generalization is defensible and true.

Logically, such a generalization is hardly ever completely justifiable. Even if the experiment is later replicated in many classrooms or schools, and the same result is found, it remains logically possible that the next school will find different results. Although such an outcome always remains a logical possibility, its plausibility is related to the external validity features of the experiment.

Increasing External Validity

One approach to increasing a study's external validity is to ensure that it is conducted under conditions that are both realistic and similar to those in which the program will later be used. A more demanding approach is to use several exemplars (e.g., schools, districts) that differ in numerous ways in the initial or subsequent studies and observe whether the results replicate. The most demanding approach to achieving high external validity is to randomly select a relatively large number of exemplars from among those to which the results are hoped to eventually generalize. Under such a circumstance, schools or districts might be included as a random factor in the statistical analysis, which allows a statistical basis for generalizing.

External validity information is also often available after the study has concluded and the results have been analyzed. Subgroup analyses may indicate, for instance, that only girls' learning was increased by a specific mode of teaching and that the teaching mode had no impact on boys' learning. Consequently, the effects of the teaching mode on learning cannot be generalized across gender, because the effect is only present for girls and not boys. Many experiments are specifically designed to probe external validity by examining a previously evaluated treatment program with a new population, to establish if the program is effective with that new population and thus determine the limits of generality of the treatment effect.

...

  • Loading...
locked icon

Sign in to access this content

Get a 30 day FREE TRIAL

  • Watch videos from a variety of sources bringing classroom topics to life
  • Read modern, diverse business cases
  • Explore hundreds of books and reference titles

Sage Recommends

We found other relevant content for you on other Sage platforms.

Loading