Entry
Reader's guide
Entries A-Z
Subject index
Reliability
Reliability can be defined as the extent to which scores of a measure are free from the effect of measurement error. Measurement error is reflected in random deviations of the scores observed on a measure from respondents' true scores, which are the expected values of respondents' scores if they completed the measure an infinite number of times. Mathematically, reliability is quantified as the ratio of true score variance to observed score variance or, equivalently, the square of the correlation between true scores and observed scores. Based on these indexes, reliability can range from zero (no true score variance) to one (no measurement error).
Reliability is important for both practical and theoretical purposes. Practically, it enables estimation of the standard error of measurement, an index of accuracy of a person's test score. Theoretically, reliability contributes to theory development by allowing researchers to correct for the biasing effect of measurement error on observed correlations between measures of psychological constructs and by providing researchers with an assessment of whether their measurement process needs to be improved (e.g., if reliability is low).
Sources of Measurement Error
Multiple sources of measurement error can influence a person's observed score. The following sources are common in psychological measures.
Random Response Error
Random response error is caused by momentary variations in attention, mental efficiency, or distractions within a given occasion. It is specific to a moment when a person responds to an item on a measure. For example, a person might provide different answers to the same item appearing in different places on a measure.
Transient Error
Whereas random response error occurs within an occasion, transient error occurs across occasions. Transient errors are produced by temporal variations in respondents' mood and feelings across occasions. For example, any given respondent might score differently on a measure administered on two occasions. Theoretically, such temporal differences are random, and thus not part of a person's true score, because they do not correlate with scores from the measure completed on other occasions (i.e., they are occasion specific).
Specific Factor Error
Specific factor error reflects idiosyncratic responses to some element of the measurement situation. For example, when responding to test items, respondents might interpret item wording differently. Theoretically, specific factors are not part of a person's true score because they do not correlate with scores on other elements (e.g., items) of the measure.
Rater Error
Rater error arises only when a person's observed score (rating) is obtained from another person or set of persons (raters). Rater error arises from the rater's idiosyncratic perceptions of a ratee's standing on the construct of interest. Theoretically, idiosyncratic rater factors are not part of a person's true score because they do not correlate with ratings provided by other raters (i.e., they are rater specific).
Types of Reliability Coefficients
Reliability is indexed with a reliability coefficient. There are several types of reliability coefficients, and they differ with regard to the sources of observed score variance that they treat as true score and error variance. Sources of variance that are treated as error variance in one type of coefficient may be treated as true score variance in other types.
...
- Foundations: History
- Army Alpha/Army Beta
- Hawthorne Studies/Hawthorne Effect
- History of Industrial/Organizational Psychology in Europe and the United Kingdom
- History of Industrial/Organizational Psychology in North America
- History of Industrial/Organizational Psychology in Other Parts of the World
- Human Relations Movement
- Project A
- Scientific Management
- Scientist-Practitioner Model
- Unions
- Foundations: Ethical and Legal Issues
- Adverse Impact/Disparate Treatment/Discrimination at Work
- Affirmative Action
- Age Discrimination in Employment Act
- Americans with Disabilities Act
- Bona Fide Occupational Qualifications
- Civil Rights Act of 1964, Civil Rights Act of 1991
- Comparable Worth
- Corporate Ethics
- Corporate Social Responsibility
- Employment at Will
- Equal Pay Act of 1963
- Ethics in Industrial/Organizational Practice
- Ethics in Industrial/Organizational Research
- Family and Medical Leave Act
- Glass Ceiling
- Labor Law
- National Institute for Occupational Safety and Health/Occupational Safety and Health Administration
- Race Norming
- Sexual Discrimination
- Sexual Harassment at Work
- Stereotyping
- Test Security
- Uniform Guidelines on Employee Selection Procedures
- Workplace Accommodations for the Disabled
- Foundations: Research Methods
- Benchmarking
- Case Study Method
- Competency Modeling
- Content Coding
- Critical Incident Technique
- Cross-Cultural Research Methods and Theory
- Experimental Designs
- Focus Groups
- Lens Model
- Linkage Research and Analyses
- Longitudinal Research/Experience Sampling Technique
- Meta-Analysis
- Naturalistic Observation
- Nonexperimental Designs
- Organizational Surveys
- Policy Capturing
- Program Evaluation
- Qualitative Research Approach
- Quantitative Research Approach
- Quasi-experimental Designs
- Sampling Techniques
- Simulation, Computer Approach
- Survey Approach
- Verbal Protocol Analysis
- Foundations: Measurement Theory and Statistics
- Classical Test Theory
- Confidence Intervals/Hypothesis Testing/Effect Sizes
- Construct
- Criterion Theory
- Descriptive Statistics
- Differential Item Functioning
- Factor Analysis
- Generalizability Theory
- Incremental Validity
- Inferential Statistics
- Item Response Theory
- Measurement Scales
- Measures of Association/Correlation Coefficient
- Moderator and Mediator Variables
- Multilevel Modeling
- Multilevel Modeling Techniques
- Multitrait–Multimethod Matrix
- Nomological Networks
- Normative versus Ipsative Measurement
- Reliability
- Statistical Power
- Structural Equation Modeling
- Utility Analysis
- Validation Strategies
- Validity
- Industrial Psychology: Understanding and Assessing Individual Differences
- Affective Traits
- Big Five Taxonomy of Personality
- Biographical Data
- Cognitive Abilities
- Cognitive Ability Tests
- Computer Assessment
- Core Self-Evaluations
- Emotional Intelligence
- Employment Interview
- Genetics and Industrial/Organizational Psychology
- Graphology
- Gravitational Hypothesis
- Hardiness
- Impression Management
- Individual Assessment
- Individual Differences
- Integrity Testing
- Job Knowledge Testing
- Letters of Recommendation
- Locus of Control
- Machiavellianism
- Motivational Traits
- Need for Achievement, Power, and Affiliation
- Optimism and Pessimism
- Personality
- Personality Assessment
- Physical Performance Assessment
- Practical Intelligence
- Protestant Work Ethic
- Self-Esteem
- Situational Judgment Tests
- Standardized Testing
- Stereotype Threat
- Trainability and Adaptability
- Type A and Type B Personalities
- Work Samples
- Work Values
- Industrial Psychology: Employment, Staffing, and Career Issues
- Dictionary of Occupational Titles
- Applicant/Test-Taker Reactions
- Banding
- Career Development
- Careers
- Compensation
- Credentialing
- Dirty Work
- Drug and Alcohol Testing
- Electronic Human Resources Management
- Employee Selection
- Executive Selection
- Exit Survey (Exit Interview)
- Expatriates
- Gainsharing and Profit Sharing
- Gay, Lesbian, and Bisexual Issues at Work
- Human Resources Strategy
- Job Advertisements
- Job Analysis
- Job Analysis Methods
- Job Choice
- Job Description
- Job Evaluation
- Job Search
- Job Typologies
- Occupational Information Network (O*NET)
- Older Worker Issues
- Person–Environment Fit
- Person–Job Fit
- Person–Organization Fit
- Person–Vocation Fit
- Placement and Classification
- Prescreening Assessment Methods for Personnel Selection
- Realistic Job Preview
- Recruitment
- Recruitment Sources
- Retirement
- Selection Strategies
- Selection: Occupational Tailoring
- Succession Planning
- Underemployment
- Industrial Psychology: Developing, Training, and Evaluating Employees
- 360-Degree Feedback
- Assessment Center
- Assessment Center Methods
- Distance Learning
- Diversity Training
- Electronic Performance Monitoring
- Employee Assistance Program
- Executive Coaching
- Feedback Seeking
- Frame-of-Reference Training
- Leadership Development
- Mentoring
- Organizational Socialization
- Organizational Socialization Tactics
- Performance Appraisal
- Performance Appraisal, Objective Indexes
- Performance Appraisal, Subjective Indexes
- Performance Feedback
- Rating Errors and Perceptual Biases
- Self-Fulfilling Prophecy: Pygmalion Effect
- Socialization: Employee Proactive Behaviors
- Training
- Training Evaluation
- Training Methods
- Training Needs Assessment and Analysis
- Transfer of Training
- Industrial Psychology: Productive and Counterproductive Employee Behavior
- Contextual Performance/Prosocial Behavior/Organizational Citizenship Behavior
- Counterproductive Work Behaviors
- Counterproductive Work Behaviors, Interpersonal Deviance
- Counterproductive Work Behaviors, Organizational Deviance
- Creativity at Work
- Customer Satisfaction with Services
- Cyberloafing at Work
- Innovation
- Integrity at Work
- Job Performance Models
- Organizational Retaliatory Behavior
- Theft at Work
- Time Management
- Violence at Work
- Whistle-Blowers
- Withdrawal Behaviors, Absenteeism
- Withdrawal Behaviors, Lateness
- Withdrawal Behaviors, Turnover
- Workplace Incivility
- Industrial Psychology: Motivation and Job Design
- Action Theory
- Control Theory
- Empowerment
- Expectancy Theory of Work Motivation
- Goal-Setting Theory
- Human–Computer Interaction
- Incentives
- Intrinsic and Extrinsic Work Motivation
- Job Characteristics Theory
- Job Design
- Job Involvement
- Job Rotation
- Job Sharing
- Need Theories of Work Motivation
- Path–Goal Theory
- Positive Psychology Applied to Work
- Self-Concept Theory of Work Motivation
- Self-Efficacy
- Self-Regulation Theory
- Social Cognitive Theory
- Telecommuting
- Theory of Work Adjustment
- Two-Factor Theory
- Work Motivation
- Workaholism
- Industrial Psychology: Leadership and Management
- Abusive Supervision
- Behavioral Approach to Leadership
- Charismatic Leadership Theory
- Employee Grievance Systems
- Global Leadership and Organizational Behavior Effectiveness Project
- Implicit Theory of Leadership
- Judgment and Decision-Making Process
- Judgment and Decision-Making Process: Advice Giving and Taking
- Judgment and Decision-Making Process: Heuristics, Cognitive Biases, and Contextual Influences
- Leader–Member Exchange Theory
- Leadership and Supervision
- Least Preferred Coworker Theory
- Life-cycle Model of Leadership
- Normative Models of Decision Making and Leadership
- Reinforcement Theory of Work Motivation
- Situational Approach to Leadership
- Spirituality and Leadership at Work
- Trait Approach to Leadership
- Transformational and Transactional Leadership
- Trust
- Industrial Psychology: Groups, Teams, and Working with Others
- Conflict at Work
- Conflict Management
- Diversity in the Workplace
- Group Cohesiveness
- Group Decision-Making Quality and Performance
- Group Decision-Making Techniques
- Group Development
- Group Dynamics and Processes
- Groups
- Groupthink
- Input–Process–Output Model of Team Effectiveness
- Intergroup Relations
- Interpersonal Communication
- Interpersonal Communication Styles
- Justice in Teams
- Meetings at Work
- Negotiation, Mediation, and Arbitration
- Networking
- Social Exchange Theory
- Social Loafing
- Social Norms and Conformity
- Social Support
- Team Building
- Team Mental Model
- Team-Based Rewards
- Virtual Teams
- Workplace Romance
- Industrial Psychology: Employee Well-Being and Attitudes
- Affective Events Theory
- Attitudes and Beliefs
- Boredom at Work
- Emotional Burnout
- Emotional Labor
- Emotions
- Eustress
- Job Satisfaction
- Job Satisfaction Measurement
- Job Security/Insecurity
- Mood
- Morale
- Organizational Commitment
- Organizational Cynicism
- Organizational Justice
- Psychological Contract
- Quality of Work Life
- Role Ambiguity
- Role Conflict
- Role Overload and Underload
- Stress, Consequences
- Stress, Coping and Management
- Stress, Models and Theories
- Theory of Reasoned Action/Theory of Planned Behavior
- Union Commitment
- Work–Life Balance
- Industrial Psychology: Organizational Structure, Design, and Change
- Attraction–Selection–Attrition Model
- Automation/Advanced Manufacturing Technology/Computer-Based Integrated Technology
- Balanced Scorecard
- Compressed Workweek
- Downsizing
- Entrepreneurship
- Flexible Work Schedules
- Globalization
- High-Performance Organization Model
- Learning Organizations
- Mergers, Acquisitions, and Strategic Alliances
- Organizational Behavior
- Organizational Behavior Management
- Organizational Change
- Organizational Change, Resistance to
- Organizational Climate
- Organizational Communication, Formal
- Organizational Communication, Informal
- Organizational Culture
- Organizational Development
- Organizational Image
- Organizational Politics
- Organizational Sensemaking
- Organizational Structure
- Outsourcing
- Shiftwork
- Sociotechnical Approach
- Strategic Planning
- Survivor Syndrome
- Terrorism and Work
- Theory of Action
- Total Quality Management
- Virtual Organizations
- Workplace Injuries
- Workplace Safety
- Professional Organizations and Related Fields
- Loading...
Get a 30 day FREE TRIAL
-
Watch videos from a variety of sources bringing classroom topics to life
-
Read modern, diverse business cases
-
Explore hundreds of books and reference titles
Sage Recommends
We found other relevant content for you on other Sage platforms.
Have you created a personal profile? Login or create a profile so that you can save clips, playlists and searches