How to Conduct Organizational Surveys: A Step-by-Step Guide
Publication Year: 1997
Organizations are increasingly turning to surveys to solve many business-related problems. This book provides those who want to plan organizational surveys with a step-by-step, ‘how-to’ guide. The authors describe the issues that must be addressed at each step in the process, the advantages and disadvantages that result from many of the choices that must be made, and practical lessons learned from their years of experience in designing and conducting surveys.
- Front Matter
- Back Matter
- Subject Index
- Chapter 1: Organizational Surveys: An Overview
- Uses of Surveys in Organizations
- Gathering Information
- Improving Communication
- Monitoring and Evaluating the Effects of Organizational Change
- Factors to Consider before Initiating the Survey Process
- Is a Survey within the Organization's Budget?
- Are Personnel with Survey Expertise Available?
- Are There other Ways to Answer the Question?
- Are Organizational Personnel Being Oversurveyed?
- Setting the Table: Presurvey Issues
- The Survey Team
- Using Internal versus External Personnel to Conduct the Survey
- Writing a Statement of Purpose
- Conducting Organizational Surveys: A Look Ahead
- Chapter 2: Identifying Survey Content
- Methods for Identifying Survey Content
- Developmental Interviews and Focus Groups
- Past Surveys in the Same Organization
- Published Scales
- Archival Sources
- Theory and Academic Findings
- Other Sources of Survey Content
- Chapter 3: Creating the Survey, Part I: Writing Survey Items
- Item Formats: Closed- and Open-Ended Questions
- Closed-Ended Questions
- Open-Ended Questions
- Should the Survey Team Use Closed- or Open-Ended Questions?
- Item Content: Demographic, Factual, and Attitudinal Questions
- Demographic Items
- Factual Items
- Attitudinal Items
- Writing “Good” Items: Some Basic Rules
- Ask What You Want to Know
- Keep Items Simple and Short
- Ask about Only One Topic per Item
- Avoid Ambiguous or Vague Questions
- Use Appropriate Language
- Be Specific
- Double Negatives: Not!
- Avoid Biased Items
- Take Care with Sensitive Items
- Chapter 4: Creating the Survey, Part II: Response Alternatives, Item Order, Survey Length, and Response Biases
- Getting Good Answers: Choosing Closed-Ended Response Formats
- Multiple-Choice Response Format
- Yes-No and True-False Response Formats
- Likert Rating Scales
- Thurstone Scaling
- Semantic Differential Scaling
- Response Biases: The Downside of Using Closed-Ended Items
- Response Order Effects
- Yea-Saying or Nay-Saying
- Socially Desirable Responding
- How Many Survey Items?
- What are the Goals of the Survey?
- How Much is the Company Willing to Pay?
- Who Will Complete the Questionnaire?
- Are the Items Open or Closed Ended?
- What is the Administration Method?
- How Fast are Data Needed?
- Are Fatigue Effects an Issue?
- What is the Bottom Line on Survey Length?
- Ordering the Items, or Putting it all Together
- Clustering versus Scattering the Items for a Single Dimension
- Item Order Effects
- Some Practical Advice
- Chapter 5: Selecting Survey Respondents
- Identifying the Target Population
- Should the Population or a Sample Be Used in Data Collection?
- Probability Sampling
- Simple Random Sampling
- Stratified Sampling
- Nonprobability Sampling
- Convenience Sample
- Quota Sampling
- Sampling Error and Sample Size
- Sampling Error
- Sample Size
- Chapter 6: Organizational Survey Administration
- Self- versus Group-Administered Surveys
- Modes of Survey Administration
- Paper Surveys
- Computer-Administered Surveys
- Face-to-Face Interview Surveys
- Telephone Interview Surveys
- Chapter 7: Fielding the Survey
- Adding the Finishing Touches to the Survey Instrument
- Survey Introduction
- Survey Instructions
- Pretesting the Survey
- Obtaining Organizational Approval
- Top Management
- Institutional Review Boards
- Preparing, Assembling, and Distributing the Survey Packet
- Preparing the Contents of the Survey Packet
- Distributing the Survey Through the Mail
- Chapter 8: Monitoring and Maximizing Response Rates
- Monitoring Response Rates
- Calculating Response Rates
- What is an Acceptable Response Rate?
- Nonresponse Bias
- Dealing with Nonresponse Bias
- Ways to Maximize Response Rates
- Prenotification: The Survey is Coming! The Survey is Coming!
- Follow-up until You Drop
- If They Won't Respond, Bribe Them
- Make the Survey Meaningful
- It's as Easy as TDM
- What Works: A Summary
- Practical Suggestions for Increasing Response Rates
- Chapter 9: Data Processing
- Preparing for Data Entry: Data Coding for Closed-Ended Questions
- Naming and Labeling Variables
- Assigning Values to Responses
- Designating Code(s) for Missing Values
- Entering Data
- Data File Organization
- Data Entry for Computerized and Scannable Surveys
- Manual Data Entry
- Cleaning the Data File
- Types of Data File Cleaning
- Missing Data
- Reasons for Missing Data
- Assessing the Missing Data Problem
- Handling Missing Data
- Categorizing and Coding Open-Ended Answers
- Creating Categories
- Content Coding
- Chapter 10: Analyzing Data and Interpreting Results
- Planning the Analyses
- Analyzing the Data
- A Review of the Sample and a Description of the Data
- Describing the Respondents
- Frequencies and Percentages
- Means and Standard Deviations
- Analyzing Subgroup Differences
- Other Data Analysis Procedures
- Poststratification Weighting
- Interpreting the Results: What Do all the Findings Tell the Organization?
- Comparing Findings with other Findings from the Same Survey
- Using Norms: Comparing Survey Findings to other Standards
- Chapter 11: Presentation of Survey Findings
- Oral and Written Presentations of the Survey Process
- Organizing the Presentation
- Introduction: Why Was the Survey Done?
- Method: What Was Done and with Whom?
- Results and Discussion: What Did the Survey Reveal?
- Conclusions and Recommendations: What are the Next Steps?
- A Hodgepodge of other Advice
- Visual Aids
- Handling Questions
- How to Handle Negative News
- Handling a Hostile Audience
- Linking Survey Results to Action
Copyright © 1997 by Sage Publications, Inc.
The opinions expressed in this book are those of the authors, are not official, and do not necessarily reflect the views of the Department of Defense or the Navy Department.
All rights reserved. No part of this book may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage and retrieval system, without permission in writing from the publisher.
For information address:
SAGE Publications, Inc.
2455 Teller Road
Thousand Oaks, California 91320
SAGE Publications Ltd.
6 Bonhill Street
London EC2A 4PU
SAGE Publications India Pvt. Ltd.
Greater Kailash I
New Delhi 110 048 India
Printed in the United States of America
Library of Congress Cataloging-in-Publication Data
Main entry under title:
How to conduct organizational surveys : a step-by-step guide / authors, Jack E. Edwards … [et al.].
Includes bibliographical references and index.
ISBN 0-8039-5512-X (cloth : acid-free paper). — ISBN 0-8039-5513-8 (pbk.: acid-free paper)
1. Employee attitude surveys—Methodology. I. Edwards, Jack E.
This book is printed on acid-free paper.
00 01 10 9 8 7 6 5
Acquiring Editor: Harry Briggs
Editorial Assistant: Frances Borghi
Production Editor: Sherrise Purdum
Production Assistant: Karen Wiley
Typesetter/Designer: Christina Hill
Cover Designer: Lesa Valdez
Print Buyer: Anna Chin
A manufacturing company is downsizing and wants to know the effect of the downsizing on employee morale. A computer corporation is considering moving its headquarters and needs to determine how many employees it would need to relocate. A multinational consulting firm has had a rash of sexual harassment complaints and seeks to determine the extent of the problem. An automobile company is planning to redesign its line of sports cars and wishes to see how its loyal customers will react to the changes.
To answer these and many other business-related questions, organizations are increasingly turning to surveys. Developing expertise in the organizational survey process is by no means an easy task. It is a process that can reap great benefits if the steps are correctly executed, but it can cause harm if done improperly.
Although conducting an organizational survey can be a difficult, expensive, and labor-intensive effort, it also has its rewards. Survey designers have the satisfaction of seeing a need for information turn into items; these items elicit data that, in turn, provide answers to the original questions (Rosenfeld, Edwards, & Thomas, 1993). For management, surveys can suggest ways to increase productivity, improve morale, and reduce costs. Through organizational surveys, employees can communicate their concerns and questions to management. Surveys can also provide a vehicle for employees to participate in the company's decision-making process and involve them in solving problems rather than simply griping or suffering in silence (Carney, 1994; Salemme, 1995).
We have written this book as a resource for conducting surveys within organizational settings. It is designed to provide those who desire to conduct organizational surveys with step-by-step, how-to instructions. In the chapters that follow, we describe the issues that must be addressed at each step in the survey process, the advantages and disadvantages that result from many of the choices that must be made, and practical lessons that we have learned (often, the hard way). This book should be a useful and practical tool even for people with little or no experience with the survey process. Moreover, we have attempted to identify sound survey [Page x]practices in other professions (e.g., marketing and public opinion research) that generalize to organizational surveys.
We intend this book to be an easy-to-understand guide to the technical and practical considerations that arise when conducting surveys in real-world organizational settings. In particular, our book is written for the manager who has little experience conducting an in-house survey or contracting external survey consultants. Similarly, our book should be a useful introduction to graduate students (e.g., in business and industrial-organizational psychology) who must make the transition from theory to practice. Toward this end, we address most common survey issues with both references to the survey research literature and real-life examples. Although a book this size cannot address every issue in depth, we provide citations to survey literature that we have found helpful.
We are indebted to a number of people for their professional and personal support. At Sage, we will always be grateful to Harry Briggs for his faith in our abilities and his patience with the pace of our productivity. Comments from two anonymous reviewers helped us focus an earlier draft of the book and identify areas of improvement. Some of the comments were so articulate that we included them with little modification.
We also benefited greatly from the continued support of many current and former colleagues and friends. Thanks to David Alderton, Dan Landis, Nambury Raju, Larry Waters, Paul Crawford, Catherine Riordan, Bob Giacalone, Zannette Perry, Steve Knouce, Amy Culbertson, John Sheposh, Mike White, Aileen Conroy, John Kantor, Patricia Thomas, Edmund Thomas, Carol Newell, Kristin David, Sharon Le, Richard Sorenson, George Edward Seymour, Tim Elig, Anita Lancaster, and, of course, Walt Peterson. On a personal level, we would like to thank Deborah McCormick, Mary Edwards, Harold Edwards, Susie Hoke, Patti Groves, Jerry Larson, Edward Thomas, Fred Thomas, Barbara Rooney, Abraham and Judes Rosenfeld, the Shanskes, Mary Sellen, Brian Kewley, Andrew Kewley, Norman and Joyce Booth, and Donna Booth for their continued love, support, and encouragement.
References[Page 147]1980). Understanding attitudes and predicting social behavior. Englewood Cliffs, NJ: Prentice Hall., & (1985). The survey research handbook. Homewood, IL: Richard D. Irwin., & (American Psychological Association. (1994). Publication manual of the American Psychological Association (4th ed.). Washington, DC: Author.1983). Measurement: Theory and techniques. In P. H.Rossi, J. D.Wright, & A. B.Anderson (Eds.), Handbook of survey research (pp. 231–287). San Diego, CA: Academic., , & (1987). Return mail in postage surveys: A meta-analysis. Public Opinion Quarterly, 51, 233–248. http://dx.doi.org/10.1086/269031, & (1994). Statistics for psychology. Englewood Cliffs, NJ: Prentice Hall., & (1990). Response effects in mail surveys. Public Opinion Quarterly, 54, 229–247. http://dx.doi.org/10.1086/269200, & (1973). Survey research methods. Belmont, CA: Wadsworth.(1993, May). Employee attitude surveys: More substance than style. Across the Board, pp. 43–45.(1990). Behavior in organizations: Understanding and managing the human side of work (, & (3rd ed.). Boston: Allyn & Bacon.1986). Questionnaires: Design and use. Metuchen, NJ: Scarecrow., , & (1992). Impression management, social desirability, and computer administration of attitude questionnaires: Does the computer make a difference?Journal of Applied Psychology, 77, 562–566. http://dx.doi.org/10.1037/0021-9010.77.4.562, , & (1993). Computer-administered surveys in organizational settings: Alternatives, advantages, and applications. In P.Rosenfeld, J. E.Edwards, & M. D.Thomas (Eds.), Improving organizational surveys: New directions, methods, and applications (pp. 73–101). Newbury Park, CA: Sage., , & (1992). Processing data: The survey example. Newbury Park, CA: Sage., & (1988). Polls and surveys: Understanding what they tell us. San Francisco: Jossey-Bass., & ([Page 148]1991). The current status of questionnaire research. In P. B.Groves, L. E.Lyberg, N. A.Mathiowetz, & S.Sudman (Eds.), Measurement errors in surveys (pp. 29–40). New York: John Wiley & Sons., & (1995, January). Are you listening?Quality Progress, pp. 59–62.(British Telecom. (1984a). Survey item bank: Volume I—Measures of satisfaction. Bradford, UK: MCB University Press.British Telecom. (1984b). Survey item bank: Volume II—Measures of organization. Bradford, UK: MCB University Press.1994, June). Surveys of substance: Communications. Inc., p. 112.(1984). Social science research methods. Englewood Cliffs, NJ: Prentice Hall., , & (1975). Measures for psychological assessment: A guide to 3,000 original sources and their applications. Ann Arbor: University of Michigan, Institute for Social Research, Survey Research Center., , & , Jr. (1993). Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opinion Quarterly, 57, 62–79. http://dx.doi.org/10.1086/269355(Coffey, J. (Ed.). (1993). Resource manual for customer surveys. Washington, DC: Office of Management and Budget, Statistical Policy Office.1986). Survey questions: Handcrafting the standardized questionnaire. Beverly Hills, CA: Sage., & (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334. http://dx.doi.org/10.1007/BF02310555(1989). Automated psychological testing: Method of administration, need for approval, and measures of anxiety. Educational and Psychological Testing, 49, 311–320., & (1995, July 17). Anti-union, but not anti-unity. U.S. News & World Report, p. 47.(1991). Scale development: Theory and applications. Newbury Park, CA: Sage.(1992). Fax surveys? Study finds the time may be right for business research. Marketing Research: A Magazine of Management & Applications, 4 (3), 26–30., & (1978). Mail and telephone surveys: The total design method. New York: John Wiley.(1985). Mail and other self-administered questionnaires. In P. H.Rossi, J. D.Wright, & A. B.Anderson (Eds.), Handbook of survey research (pp. 359–377). San Diego, CA: Academic.(1986). Effects of an automated survey system upon responses. In O.Brown, Jr., & H. W.Hendrick (Eds.), Human factors in organizational design management—II (pp. 157–161). North Holland: Elsevier., & (1982). The relativeness of procedures commonly used in multiple regression analysis for dealing with missing values. American Statistician, 36, 378–381.(1993). New methods and technologies in the organizational survey process. In P.Rosenfeld, J. E.Edwards, & M. D.Thomas (Eds.), Improving organizational surveys: New directions, methods, and applications (pp. 102–121). Newbury Park, CA: Sage.([Page 149]1996). Methodological issues on Navy surveys. Military Psychology, 8, 309–324. http://dx.doi.org/10.1207/s15327876mp0804_4, , , & (1993). The organizational survey process: General steps and practical considerations. In P.Rosenfeld, J. E.Edwards, & M. D.Thomas (Eds.), Improving organizational surveys: New directions, methods, and applications (pp. 3–28). Newbury Park, CA: Sage., & (1983). The reliability of a computer interview for drug use/abuse information. Behavior Research Methods and Instrumentation, 15, 66–68. http://dx.doi.org/10.3758/BF03203440, , & (1985). How to conduct surveys: A step-by-step guide. Beverly Hills, CA: Sage., & (1988). Survey research methods (, Jr. (1st ed.). Newbury Park, CA: Sage.1993). Survey research methods (, Jr. (2nd ed.). Newbury Park, CA: Sage.1995). Improving survey questions: Design and evaluation. Thousand Oaks, CA: Sage., Jr. (1990). Standardized survey interviewing: Minimizing interviewer-related error. Newbury Park, CA: Sage., Jr., & (1988). Mail survey response rate: A meta-analysis of selected techniques for inducing response. Public Opinion Quarterly, 52, 467–491. http://dx.doi.org/10.1086/269125, , & (1989). Survey research by telephone ((2nd ed.). Newbury Park, CA: Sage.1993). The group interview in social research. In D. L.Morgan (Ed.). Successful focus groups: Advancing the state of the art (pp. 20–34). Newbury Park, CA: Sage., & (1994, April). Ten reasons why surveys fail. Quality Progress, pp. 65–69.(1988, August). Employee research: From nice to know to need to know. Personnel Journal, pp. 42–43.(General Accounting Office. (1989). Content analysis: A methodology for structuring and analyzing written material (GAO/PEMD-10.1.3). Washington, DC: Author.General Accounting Office. (1992). Using statistical sampling (GAO/PEMD-10.1.6). Washington, DC: Author.General Accounting Office. (1993). Developing and using questionnaires (GAO/PEMD-10.1.7). Washington, DC: Author.1993). Identifying security risks in organizations: Development and use of a security exit survey instrument. In P.Rosenfeld, J. E.Edwards, & M. D.Thomas (Eds.), Improving organizational surveys: New directions, methods, and applications (pp. 240–256). Newbury Park, CA: Sage., & (1987). Justifications and procedures for implementing institutional review boards in business organizations. Journal of Business Ethics, 6, 5–17., & (1979). Surveys by telephone: A national comparison with personal interviews. New York: Academic., & ([Page 150]1978). Factors affecting response rates of mailed questionnaires: A quantitative analysis of the published literature. American Sociological Review, 43, 446–462. http://dx.doi.org/10.2307/2094771, & (1990). Practical sampling. Newbury Park, CA: Sage.(1992). Using graphical displays to empower evaluation audiences. In A.Vaux, M. S.Stockdale, & M. J.Schwerin (Eds.), Independent consulting for evaluators (pp. 141–160). Newbury Park, CA: Sage.(1995). Graphing data: Techniques for display and analysis. Thousand Oaks, CA: Sage.(1991). Survey data as a catalyst for employee empowerment and organizational effectiveness. In R. J.Niehaus & K. F.Price (Eds.), Bottom line results from strategic human resource planning (pp. 301–308). New York: Plenum.(1991). Customer survey research: Extending the partnership. In J. W.Jones, B. D.Steffy, & D. W.Bray (Eds.), Applying psychology in business: The handbook for managers and human resource professionals (pp. 640–652). Lexington, MA: Lexington., & (1990). The effects of monetary incentives and follow-up mailings on the response rate and response quality in mail surveys. Public Opinion Quarterly, 54, 346–361. http://dx.doi.org/10.1086/269211, & (1993, July). Training 101: Another look at employee surveys. Training & Development, pp. 15–18.(1992, August 9). Numbers are no problem for pollsters: Words are. New York Times, p. E-5., & (1983). Introduction to survey sampling. Beverly Hills, CA: Sage.(1988). Survey sampling. In S.Kotz, N. L.Johnson, & C. B.Read (Eds.), Encyclopedia of statistical sciences (Vol. 9, pp. 111–119). New York: John Wiley.(1983). Computers in survey research. In P. H.Rossi, J. D.Wright, & A. B.Anderson (Eds.), Handbook of survey research (pp. 379–414). San Diego, CA: Academic., & (1992, August 30). Test-marketing a president. New York Times Magazine, pp. 18–21, 60, 68, 72.(Kraut, A. I. (1996). (Ed.). Organizational surveys: Tool for assessment and change. San Francisco, CA: Jossey-Bass.1996). Applying alternative survey methods. In A. I.Kraut (Ed.), Organizational surveys: Tools for assessment and change (pp. 233–254). San Francisco, CA: Jossey-Bass., & (1947). Frontiers in group dynamics. Human Relations, 1, 5–41. http://dx.doi.org/10.1177/001872674700100103(1992). Memory and mismemory for health events. In J. M.Tanur (Ed.), Questions about questions: Inquiries into the cognitive bases of surveys (pp. 102–137). New York: Russell Sage Foundation., , , & (1985). Comparing computerized versus traditional psychological assessment. Computers in Human Behavior, 1, 49–58. http://dx.doi.org/10.1016/0747-5632%2885%2990006-8, , , & ([Page 151]Management Decisions Systems, Inc. (1993, Fall). Does survey feedback make a difference? Decisions Decisions (newsletter).1995). Mail surveys. Thousand Oaks, CA: Sage.(1989). Some effects of computerized interviewing on job applicant responses. Journal of Applied Psychology, 74, 72–80. http://dx.doi.org/10.1037/0021-9010.74.1.72, & (1988). The impact of computer-mediated communication on self-awareness. Computers in Human Behavior, 4, 221–233. http://dx.doi.org/10.1016/0747-5632%2888%2990015-5, & (1987). Measuring health: A guide to rating scales and questionnaires. New York: Oxford University Press., & (Merit Systems Protection Board. (1988). Sexual harassment in the federal government: An update. Washington, DC: Government Printing Office.Merit Systems Protection Board. (1989). Who is leaving the federal government? An analysis of employee turnover. Washington, DC: Government Printing Office.Merit Systems Protection Board. (1990). Working for America: A federal employee survey. Washington, DC: Government Printing Office.1982). The effects of branching on item nonresponse. Public Opinion Quarterly, 46, 270–277. http://dx.doi.org/10.1086/268718, & (1994). Qualitative data analysis: An expanded sourcebook. Thousand Oaks, CA: Sage., & (1991). Handbook for research design and social measurement ((5th ed.). Newbury Park, CA: Sage.1995, May-June). A field study of the feasibility of computer-assisted occupational surveys: Implications for MPT research and development. Paper presented at the Ninth Interactional Occupational Analyst Workshop, San Antonio, TX., , , , , & (Morgan, D. L. (1993). (Ed.). Successful focus groups: Advancing the state of the art. Newbury Park, CA: Sage.1993). Consortium surveys. In P.Rosenfeld, J. E.Edwards, & M. D.Thomas (Eds.), Improving organizational surveys: New directions, methods, and applications (pp. 122–142). Newbury Park, CA: Sage., & (1991). Psychological testing: Principles and applications (, & (2nd ed.). Englewood Cliffs, NJ: Prentice Hall.1989). Organizational development interventions: A meta-analysis of their effects on satisfaction and other attitudes. Personnel Psychology, 42, 461–489. http://dx.doi.org/10.1111/j.1744-6570.1989.tb00665.x, , & (1967). Psychometric theory. New York: McGraw-Hill.(1993). Improving survey questionnaires through focus groups. In D. L.Morgan (Ed.). Successful focus groups: Advancing the state of the art (pp. 105–117). Newbury Park, CA: Sage.(1991). Attitudes and opinions ((2nd ed.). Englewood Cliffs, NJ: Prentice Hall.1992, July). Collecting data the e-mail way. Training & Development, pp. 52–54.(1993, September 28). Money talks. USA Today, p. B-8.([Page 152]1995, January). Everything you always wanted to know about employee surveys. Training & Development, pp. 45–49., & (1991). Measurement and control of response bias. In J. P.Robinson, P. R.Shaver, & L. S.Wrightsman (Eds.), Measures of personality and social psychological attitudes (pp. 17–59). San Diego, CA: Academic.(1951). The art of asking questions. Princeton, NJ: Princeton University Press.(1990). Data analysis for the helping professionals: A practical guide. Newbury Park, CA: Sage.(1992). Designing and conducting survey research: A comprehensive guide. San Francisco: Jossey-Bass., & (1976). Handbook of scales and indices of health behavior. Pacific Palisades, CA: Goodyear., , & (1992). Preparing reports and presentations that strengthen the link between research and action. In A.Vaux, M. S.Stockdale, & M. J.Schwerin (Eds.), Independent consulting for evaluators (pp. 161–179). Newbury Park, CA: Sage.(1969). Measures of occupational attitudes and occupational characteristics. Ann Arbor, MI: University of Michigan, Institute for Social Research., , & (Robinson, J. P., , & Wrightsman, L. S. (Eds.). (1991). Measures of personality and social psychological attitudes. San Diego, CA: Academic.1994, Spring). Turning employee survey results into high-impact business improvements. Employment Relations Today, 21, 35–44. http://dx.doi.org/10.1002/ert.3910210105(1996). Responses on computer surveys: Impression management, social desirability, and the big brother syndrome. Computers in Human Behavior, 12, 263–274. http://dx.doi.org/10.1016/0747-5632%2896%2900006-4, , , & (1989). Attitude assessment in organizations: Testing three microcomputer-based survey systems. Journal of General Psychology, 116, 145–154. http://dx.doi.org/10.1080/00221309.1989.9711119, , , , & (1993). Introduction. In P.Rosenfeld, J. E.Edwards, & M. D.Thomas (Eds.), Improving organizational surveys: New directions, methods, and applications (pp. ix—xiv). Newbury Park, CA: Sage., , & (1995). Surveys (pp. 548–549). In N.Nicholson (Ed.), Blackwell encyclopedic dictionary of organizational behavior. Cambridge, MA: Basil Blackwell Publishers., , & (1992, August). Computer assisted telephone interviewing technology: Advantages over traditional survey methods for intraorganizational research and policy development. Paper presented at the annual meeting of the American Psychological Association, Washington, DC.(1983). Sample surveys: History, current practice, and future prospects. In P. H.Rossi, J. D.Wright, & A. B.Anderson (Eds.), Handbook of survey research (pp. 1–20). Orlando, FL: Academic., , & (1994). Missing data: A conceptual review for applied psychologists. Personnel Psychology, 47, 537–560. http://dx.doi.org/10.1111/j.1744-6570.1994.tb01736.x(1986). Paper-and-pencil versus computer-administered MMPIs: A comparison of patients' attitudes. Computers in Human Behavior, 2, 111–116. http://dx.doi.org/10.1016/0747-5632%2886%2990027-0, , , , & ([Page 153]1991). Fundamentals of behavioral statistics (, & (7th ed.). New York: McGraw-Hill.1988). Industrial/organizational psychology: Science and practice. Pacific Grove, CA: Brooks/Cole., & (1990, May). Develop company-specific employee attitude surveys. Personnel Journal, pp. 46–48, 50, 51.(1995, Jan). Look before you leap! HR Focus, p. 7.(1991). Computer-assisted interviewing. Newbury Park, CA: Sage.(Sawtooth Software. (1994). Ci3 user manual: Version 1.1. Evanston, IL: Author.1991). Some issues to consider when surveying employee opinions. In J. W.Jones, B. D.Steffy, & D. W.Bray (Eds.), Applying psychology in business: The handbook for managers and human resource professionals (pp. 611–622). Lexington, MA: Lexington Books., & (1991). Using employee surveys to increase organizational effectiveness. In J. W.Jones, B. D.Steffy, & D. W.Bray (Eds.), Applying psychology in business: The handbook for managers and human resource professionals (pp. 623–639). Lexington, MA: Lexington Books.(1981). Questions and answers in attitude surveys: Experiments on question form, wording, and context. New York: Academic., & (1991). Response alternatives: The impact of their choice and presentation order. In P. B.Biemer, R. M.Groves, L. E.Lyberg, N. A.Mathiowetz, & S.Sudman (Eds.), Measurement errors in surveys (pp. 41–56). New York: John Wiley., & (1967). Scales for the measurement of attitudes. New York: McGraw-Hill., & (1983). Questionnaire construction and item writing. In P. H.Rossi, J. D.Wright, & A. B.Anderson (Eds.), Handbook of survey research (pp. 195–230). San Diego, CA: Academic.(1992). Planning ethically responsible research: A guide for students and internal review boards. Newbury Park, CA: Sage.(1983). Does the computer make a difference? Computerized versus face-to-face versus self-report assessment of alcohol, drug and tobacco use. Journal of Consulting and Clinical Psychology, 51, 267–275. http://dx.doi.org/10.1037/0022-006X.51.2.267, & (1969). The measurement of satisfaction in work and retirement. Chicago: Rand-McNally., , & (1992). Summated rating scale construction: An introduction. Newbury Park, CA: Sage.(SPSS Inc. (1988). SPSS-X user's guide (3rd ed.). Chicago: Author.1989). Reporting what we think: The pollsters. Occupational Outlook Quarterly, 33, 12–19.(1990). Focus groups: Theory and practice. Newbury Park, CA: Sage., & (Tanur, J. M. (Ed.). (1992). Questions about questions: Inquiries into the cognitive bases of surveys. New York: Russell Sage Foundation.1985). Introduction to social psychology. St. Paul, MN: West., , & ([Page 154]1991). The answering machine poses many questions for telephone researchers. Public Opinion Quarterly, 55, 200–217. http://dx.doi.org/10.1086/269252, & (1994, Spring). Fax attracts. Marketing Research: A Magazine of Management and Applications, 6, 18–25., & (1986). Can learning disabled students effectively use separate answer sheets?Perceptual and Motor Skills, 63, 155–160. http://dx.doi.org/10.2466/pms.19188.8.131.52, & (1988, August). How to develop an employee attitude survey. Training & Management Journal, pp. 72–76.(1977). An introduction to survey research and data analysis. San Francisco: Freeman., & (1995). Computer programs for qualitative data analysis: A software sourcebook. Thousand Oaks, CA: Sage., & (White House. (1993, September 11). Setting customer service standards (Executive Order 12862). Washington, DC: Author.1990, May). How to run a reality check. Training, 66–72., & (1987). Introduction and training of students to use separate answer sheets: Effects on standardized test scores. Psychology in the Schools, 24, 285–288. http://dx.doi.org/10.1002/1520-6807%28198707%2924:3%3C285::AID-PITS2310240314%3E3.0.CO;2-P, , , & (1971). Development of the Survey of Work Values. Journal of Applied Psychology, 55, 331–338. http://dx.doi.org/10.1037/h0031531, , , & (1991). Understanding mail survey response behavior: A meta-analysis. Public Opinion Quarterly, 55, 613–639. http://dx.doi.org/10.1086/269284, , & (
About the Authors[Page 163]
Jack E. Edwards is Chief of the Personnel Survey Branch at the Defense Manpower Data Center in Arlington, VA. His prior positions include Personnel Research Psychologist at the Navy Personnel Research and Development Center and Associate Professor of Industrial/Organizational Psychology at the Illinois Institute of Technology. He has examined theoretical and practical concerns in survey methods, personnel selection, performance evaluation, and utility analysis. He also coedited Improving Organizational Surveys: New Directions, Methods, and Applications (Sage, 1993). He received a Ph.D. from Ohio University.
Marie D. Thomas is Assistant Professor of Psychology at California State University at San Marcos. Previously she was Research Psychologist with the Navy Personnel Research and Development Center and Associate Professor at the College of Mount St. Vincent in New York City. Her research interests include gender and ethnicity issues and the role of women in the military. She has authored and coauthored numerous publications and coedited Improving Organizational Surveys: New Directions, Methods, and Applications (Sage, 1993). She received a Ph.D. from Fordham University.
Paul Rosenfeld is Personnel Research Psychologist at the Navy Personnel Research and Development Center in San Diego and an Adjunct Professor of Psychology at the California School of Professional Psychology. He coauthored two books: Impression Management in Organizations (Rout-ledge, 1995) and Introduction to Social Psychology (West, 1985) and coedited four other books. He received a Ph.D. from the State University of New York at Albany.
Stephanie Booth-Kewley is Research Psychologist at the Naval Health Research Center in San Diego. Her research interests include personality, [Page 164]survey methodology, and health psychology. She has published articles in Psychological Bulletin, American Psychologist, and the Journal of Applied Psychology. She received a Ph.D. from the University of California, Riverside.