Skip to main content icon/video/no-internet

Unit Nonresponse

Unit nonresponse in a survey occurs when an eligible sample member fails to respond at all or does not provide enough information for the response to be deemed usable (not even as a “partial completion”). Unit nonresponse can be contrasted to item nonresponse (missing data) wherein the sample member responds but does not provide a usable response to a particular item or items. Unit nonresponse can be a source of bias in survey estimates, and reducing unit nonresponse is an important objective of good survey practice.

Reasons for unit Nonresponse

Despite the best efforts of the survey practitioner, there are reasons why unit nonresponse will still occur.

  • Refusal: The sample member may refuse to participate in the survey. Often refusals are divided into hard refusals and soft refusals, depending on the intensity with which the sample member refuses to participate.
  • Sample member cannot be found: The sample member (whether a person, a household, or an establishment) may have moved or otherwise cannot be located. In the case of a telephone survey, the telephone may ring repeatedly with no answer or be picked up by an answering machine with an uninformative message.
  • Sample member may be temporarily away: The sample member may be known to be travelling and unavailable during the data collection period.
  • Communication difficulty: The sample member may speak a language that none of the interviewers speaks or into which the survey instrument has not been translated. In other instances, the sample member may have a physical or mental disability that interferes with communication.
  • Sample member provides inadequate data: The sample member provides some data, but after editing, the data are deemed inadequate to constitute a valid response.
  • Other: There are other reasons for unit nonresponse, such as quarantines, which although unlikely, do occur. (Detailed discussion of these other instances is available at http://www.aapor.org.)

It is important to distinguish sample members that are unit nonrespondents from those that are ineligible (out of scope). In the case of sample members that cannot be contacted, it may not be possible to know for certain if a particular sample member is a nonre-spondent or ineligible, but the proportion of nonrespondents among the “noncontacts” can be estimated. An example is a random-digit dial telephone survey of households in which a selected telephone number is called repeatedly with no answer. The telephone number may belong to a household or an establishment, or it may not be an assigned number. Only in the first case is the sample member a unit nonrespondent.

Reducing Unit Nonresponse

Steps that may be taken to reduce unit nonresponse include the following:

  • Keep the survey instrument (questionnaire, Web form, or interviewer protocol) short and relatively easy to complete. It helps if the items are interesting and salient.
  • Use only thoroughly trained interviewers.
  • Provide an advance letter or telephone call or other message. This helps the sample member to distinguish serious surveys from marketing and promotions. Including endorsements from respected organizations can also be beneficial.
  • Provide a cash or other type of incentive.
  • Allow proxy respondents. If the intended sample member is unavailable or uncooperative, someone else (e.g., a family member) may be able to respond for the person.
  • Provide the sample member a choice of modes with which to respond. For example, the sample member may prefer to respond on the Web or by telephone rather than by mail in a paper questionnaire. Telephone follow-up to mail questionnaires is a frequently employed technique, to allow the respondent to be interviewed at that time.
  • Assure the sample member of the confidentiality of the responses.
  • If the sample member initially refuses to respond, make use of advanced refusal conversion techniques.
  • Employ intense and well-designed follow-up techniques. For example, in telephone surveys, a large number of callbacks may be needed at varied times of the day and days of the week.
  • In longitudinal surveys, make use of sophisticated tracking techniques to track sample members who may have moved between rounds of the survey.

Efforts to reduce unit nonresponse can have drawbacks. Incentives and follow-up activities are costly. If the follow-up is too intense, survey members may provide low-quality responses so as not to be bothered further. Proxy respondents may not be able to provide data as accurate as the intended respondent. In some cases, the disadvantages may even override the benefits of the reduced unit nonresponse, in part because not all unit nonresponse leads to unit nonresponse error.

...

  • Loading...
locked icon

Sign in to access this content

Get a 30 day FREE TRIAL

  • Watch videos from a variety of sources bringing classroom topics to life
  • Read modern, diverse business cases
  • Explore hundreds of books and reference titles

Sage Recommends

We found other relevant content for you on other Sage platforms.

Loading