Skip to main content icon/video/no-internet

During the past decade, nonresponse error—which occurs when those units that are sampled but from which data are not gathered differ to a nonignorable extent from those sampled units that do provide data—has become an extremely important topic to survey researchers. The increasing attention given to this part of the total survey error is related to the observation that survey participation is decreasing in all Western societies. Thus, more efforts (and cost expenditures) are needed to obtain acceptably high response rates.

In general, the response rate can be defined as the proportion of eligible sample units for which an interview (or other form of data collection) was completed. The calculation of the standard response rate is straightforward: the number of achieved interviews divided by the number of sample units for which an interview could have been completed. These are eligible sample units: completed interviews, partial interviews, noncontacted but known eligible units, refusals, and other noninterviewed eligible units.

Simple Model

Although the nonresponse rate is important information used to evaluate the nonresponse error, that rate is only one component of the nonresponse error. The biasing effect of nonresponse error is also related to the difference between respondents and nonrespon-dents. A simple model for a sample mean can be used to illustrate this point.

Given a sample with n units, r of these n units participated in the survey and nr units did not: n = r + nr. Y is a metric characteristic, and Noner = mean estimated for the r respondents, Nonen = mean estimated for all n sample units, and Nonenr = mean estimated for the nr nonrespondents. The estimated mean for all the units in the sample (Nonen) equals to a weighted sum of the estimated mean for the respondents (Noner) and the estimated mean for the nonrespondents (Nonenr). The latter is weighted by the nonresponse rate (nr/n), the former by the response rate (r/n). This results in the following formal specification:

None

This expression makes it clear that the estimated mean for the respondents is equal to the estimated mean for all units in the sample plus a factor that expresses the biasing effect of the nonresponse error. When there is no nonresponse, then (nr = o→ r = n):Noner =Nonen. In this situation, the estimated mean for the r respondents is equal to the mean estimated for all n sample units. This signifies that there is no non-response error. This is also the case when the estimated mean of the respondents and the nonrespondents are equal:Noner =Nonenr. In this case, the decision to participate is uncorrelated with Y, and as far as Y is concerned, there is no difference between the group of respondents and the group of nonrespondents.

Although this nonresponse model for a sample mean is simple, it shows that the reduction of nonresponse error operationally is not straightforward. For example, with an incentive one can increase the response rate, but it is possible that some persons are more susceptible to the incentive than others. When the susceptibility to incentives is related to a substantive relevant characteristic, the use of the incentive will increase the difference between respondents and nonrespondents with respect to that characteristic, thus increasing nonresponse error. In this situation, a higher response rate due to the incentive does not result in a smaller nonresponse error; instead, just the opposite occurs.

...

  • Loading...
locked icon

Sign in to access this content

Get a 30 day FREE TRIAL

  • Watch videos from a variety of sources bringing classroom topics to life
  • Read modern, diverse business cases
  • Explore hundreds of books and reference titles

Sage Recommends

We found other relevant content for you on other Sage platforms.

Loading