Skip to main content icon/video/no-internet

A scientific experiment is a controlled set of observations aimed at testing whether two or more variables are causally related. William Shadish, Thomas Cook, and Donald Campbell describe two broad types of experiments: (a) randomized experiments, in which study units are randomly assigned to observational conditions; and (b) quasi-experiments, in which study units are not randomly assigned to observational conditions because of ethical or practical constraints. Although it is more difficult to draw causal inferences from quasi-experiments than from randomized experiments, careful planning of quasi-experiments can lead to designs that allow for strong causal inferences.

In order to infer a relationship between cause and effect, three requirements must be met: Cause must precede effect; cause must be related to effect; and, aside from the cause, no alternative explanation for the effect must be plausible. Randomized and quasi-experiments do not differ with respect to the first two requirements. However, with respect to the third requirement, randomized experiments have an advantage over quasi-experiments. Because study units are randomly assigned to conditions in randomized experiments, alternative explanations (e.g., confounding variables) are equally likely across these conditions and can be ruled out. But because quasi-experiments lack random assignment between conditions, alternative explanations are difficult to rule out. This entry focuses on the validity of, common designs of, and inferences drawn from quasi-experiments.

Validity

Inferences based on an experiment are only as good as the evidence that supports them. The term validity is used to refer to the relation between the conclusion of an inference and its supporting evidence. In experimentation, inferences (i.e., conclusions) are valid if they are plausible.

A number of conditions must be met in order to draw a valid inference based on an experiment. These conditions fall into four categories. First, the internal validity of an inference refers to whether the covariation between the experimental manipulation and the experimental outcome does indeed reflect a causal relationship between the manipulation and outcome. Second, external validity refers to the generalizability of an inference (i.e., do the results of the experiment apply outside of the experimental setting?). Third, statistical conclusion validity refers to the validity of inferences about the covariation between manipulation and outcome. Fourth, construct validity refers to the validity of inferences about the higher order construct(s) that the experimental manipulation operationalizes.

Threats to Internal Validity

Factors that influence the nature and strength of inferences are referred to as threats to validity. Of particular relevance to quasi-experimental designs are threats to internal validity as they increase the likelihood that a plausible alternative explanation for the experimental outcome exists. Shadish and colleagues identify the following threats to internal validity:

Ambiguous temporal precedence: Lack of clarity about which variable occurred first may yield confusion about which variable is the cause and which is the effect.

Selection: Systematic differences over conditions in respondent characteristics that could also cause the observed effect.

History: Events occurring concurrently with treatment could cause the observed effect.

Maturation: Naturally occurring changes over time could be confused with a treatment effect.

Regression: When units are selected for their extreme scores, they will often have less extreme scores on other variables, an occurrence that can be confused with a treatment effect.

...

  • Loading...
locked icon

Sign in to access this content

Get a 30 day FREE TRIAL

  • Watch videos from a variety of sources bringing classroom topics to life
  • Read modern, diverse business cases
  • Explore hundreds of books and reference titles

Sage Recommends

We found other relevant content for you on other Sage platforms.

Loading