Skip to main content icon/video/no-internet

A study's response rate is an important gauge for the quality of data collection. The response rate, in its most basic form, refers to the proportion of people eligible for a study who actually enroll and participate. In fact, despite the name, the response rate is a proportion rather than a rate.

Although the concept is simple, the computation of response rates can be complex, and the use of multiple formulas diminishes the ability to compare studies by degree of nonresponse. Any comparison of response rates between studies requires knowledge of the study designs, sampling frames, modes of study recruitment, and formulas for computing response rates.

The American Association for Public Opinion Research (AAPOR) has attempted to standardize response rates for surveys conducted by mail or random-digit dialing by offering guidance on different computation methods. For example, calculating response rates for cases in a case-control study are reasonably straightforward because a list of cases is likely available (e.g., incident cases of a specific cancer received by a cancer registry). Thus, a simple proportion of the individuals with incident disease who agree to participate in the study can be computed. For controls selected from the general population, response rates need to combine information about who could be contacted, and among who could be contacted, who agrees to participate. The response rate for controls can be computed using one of the AAPOR standard formulas. Cohort studies and randomized trials tend to sample from defined subpopulations with a complete list of eligible participants or clinical settings with methods that allow for straightforward response rate computation.

It is widely recognized that response rates for all study types have decreased. This decrease may correlate with the increase in (and dislike of) telemarketing, overscheduled lifestyles, and lack of trust in government, academia, and medicine to use time efficiently and effectively. The Behavioral Risk Factor Surveillance System is a national random-digitdial (RDD) telephone survey that collects information about health behaviors and health care access and is administered by the Centers for Disease Control and Prevention in conjunction with the states. This survey provides an example of the decrease in response rates over the past two decades. The BRFSS response rate declined from 71% in 1993 to 51% in 2005.

Response Rates for Telephone Surveys with Random Samples

Telephone surveys have their own set of issues regarding response rates. Not all telephone numbers belong to households; some belong to businesses. Because many people use technology to screen phone calls, it may not be possible to separate those who refuse to participate from those who are simply unavailable (for instance, not at home). Those who answer may not provide information to determine if an eligible person for the study resides at home, and some eligible people refuse to participate. The computation of a response rate for RDD telephone surveys requires multiple levels of information. The RDD response rate typically comprises two elements: the contact rate and the cooperation rate, both of which are really proportions (not rates). The contact rate is the proportion of nonbusiness numbers dialed resulting in households reached. The cooperation rate (sometimes called the participation rate) is the proportion of contacted eligible units resulting in completed interviews. While it may seem simple to construct numerators and denominators for these proportions, the myriad formulas take into account the almost 20 ways a phone call may or may not result in an eligible household or person being contacted. When comparing response rates in an assessment of data collection quality, it is clearly important to take into account the formulas used.

...

  • Loading...
locked icon

Sign in to access this content

Get a 30 day FREE TRIAL

  • Watch videos from a variety of sources bringing classroom topics to life
  • Read modern, diverse business cases
  • Explore hundreds of books and reference titles

Sage Recommends

We found other relevant content for you on other Sage platforms.

Loading