Skip to main content icon/video/no-internet

Questionnaire design is the process of designing the format and questions in the survey instrument that will be used to collect data about a particular phenomenon. In designing a questionnaire, all the various stages of survey design and implementation should be considered. These include the following nine elements: (1) determination of goals, objectives, and research questions; (2) definition of key concepts; (3) generation of hypotheses and proposed relationships; (4) choice of survey mode (mail, telephone, face-to-face, Internet); (5) question construction; (6) sampling; (7) questionnaire administration and data collection; (8) data summarization and analysis; (9) conclusions and communication of results.

One goal of the questionnaire design process is to reduce the total amount of measurement error in a questionnaire. Survey measurement error results from two sources: variance and bias. Question wording (including response alternatives), ordering, formatting, or all three, may introduce variance and bias into measurement, which affects the reliability and validity of the data and conclusions reached. Increased variance involves random increases in distance between the reported survey value from the “true” survey value (e.g. attitude, behavior, factual knowledge). Increased bias involves a systematic (directional) difference from the “true” survey value. Questionnaire-related error may be introduced by four different sources: the interviewer, the item wording/format/ordering, the respondent, and the mode of data collection. Careful questionnaire design can reduce the likelihood of error from each of these sources.

Coals, Objectives, and Hypotheses

The process of designing a questionnaire begins with a definition of the goals and objectives of the study. A clearly defined purpose acts as an anchor that sets the stage for questionnaire format and question construction or ordering. In what concepts and phenomena is the researcher interested? What does he or she want to learn? To what population are the results to generalize? These are all questions that should be asked during the initial phase of questionnaire design. Each item included in the questionnaire should meet the criteria that it will provide useful information related to the goals and research questions of the survey; parsimony is a virtue in questionnaire design. To properly define goals and research questions, key concepts of interest need to be detailed. A list of concepts of interest and how they relate to one another aids in selecting specific questions to include. These concepts are transformed into (i.e. operationalize as) survey questions that measure the concept in some way, proceeding from abstract concepts to specifie measurements. Once the goals and objectives of the survey have been established, it is possible to generate specifie research questions and, possibly, directional hypotheses based on theory and previous findings. The items used in the questionnaire should produce data that are appropriate to the desired analyses.

Questionnaire Format

The layout of a questionnaire, no matter what type, should reduce the cognitive burden of respondents (and interviewers) and contain an intuitive and logical flow. For example, in most cases, questions on related topics should be grouped together and questions should maintain the chronology of events. Questionnaire format should be as easy as possible to understand and use for the interviewer or the respondent depending on the mode of administration. Questions should be numbered individually, clearly spaced, and visually distinct from one another. It is especially important that self-administered questionnaires provide clear and concise instructions and have a simple layout (e.g. common question format, visual instructions for skipping questions). For interviewer-administered questionnaires, instructions that are to be read aloud to respondents should be visually distinct from instructions that are for only the interviewer; for example, set off by italics, CAPS, bold type, or parentheses ( ). Ideally, important questions should appear early in a questionnaire to avoid the possible negative effects of respondent fatigue on motivation, recall, and item nonresponse.

...

  • Loading...
locked icon

Sign in to access this content

Get a 30 day FREE TRIAL

  • Watch videos from a variety of sources bringing classroom topics to life
  • Read modern, diverse business cases
  • Explore hundreds of books and reference titles

Sage Recommends

We found other relevant content for you on other Sage platforms.

Loading