Skip to main content icon/video/no-internet

Meta-analysis, a tool developed to summarize the findings from randomized clinical trials (RCTs), can be used by many scientific fields, including health services research, to statistically combine data from many individual studies. A meta-analysis adds up the results for each participant in the experimental group and in the control group of all the relevant studies and presents an easily understood summary; it also provides a visual depiction of the outcome, a forest diagram, in which the results of each study are shown, making it obvious if all the studies agree or not. For example, if some studies find that an intervention or experimental group is worse than the control group, and other studies find it better, the disagreement can be seen at a glance.

The term meta-analysis was coined by the American statistician Gene V. Glass while he was a faculty member at the University of Colorado at Boulder in 1976. However, the practice actually originated before 1976 as many meta-analyses were published earlier. The use of meta-analysis in clinical medicine was systematically developed in the United Kingdom by the Cochrane Collaboration, an international group of thousands of volunteers founded in 1993 and named after the British epidemiologist Archibald “Archie” L. Cochrane (1909–1988). The Cochrane Collaboration is an international, not-for-profit organization that produces and maintains systematic reviews of healthcare interventions, doing their meta-analysis in a standard way. These meta-analyses are published electronically in the Cochrane Database of Systematic Reviews, which are published many times a year and can be easily updated.

Meta-analysis consists of (a) a systematic search of the literature, identifying studies by predefined criteria; (b) extracting numerical results from each study for the experimental and control subjects, on various outcomes and their difference; plus (c) the calculation of parameters reflecting their statistical confidence (e.g., standard deviation and sample size).

The Meta-Analytic Method

To conduct a meta-analysis, a researcher conducts a literature search to find all the studies that meet certain predefined qualitative and quantitative inclusion or exclusion criteria. This is often computer based, with each search term and database used listed. As computer searches often miss important articles and reports, hand searches are also necessary, including searching the bibliography in each journal article to identify other applicable studies. If possible, the translations of the relevant foreign-language articles should be acquired.

It is vital that all studies in the meta-analysis meet reasonable criteria; otherwise there is the potential for bias. Meta-analysis is no better than the studies that go into it. If there is bias in even a few studies, it will translate into bias in the meta-analytic summary. Sometimes, one will see a meta-analysis with rather exacting criteria for the selection of studies. This may defeat the purpose of a meta-analysis because having very exhaustive inclusion criteria excludes studies that do not fit with the researcher's preconceptions. For this reason, the Cochrane Collaboration always includes a list of excluded studies. The criteria for study inclusion should be simple and straightforward and capture all the well-controlled studies in a field. One can then examine some of the minor methodological differences across studies by sensitivity analysis and meta-regression to see if they do make a difference.

...

  • Loading...
locked icon

Sign in to access this content

Get a 30 day FREE TRIAL

  • Watch videos from a variety of sources bringing classroom topics to life
  • Read modern, diverse business cases
  • Explore hundreds of books and reference titles

Sage Recommends

We found other relevant content for you on other Sage platforms.

Loading