Week 8 Final
Organization Development & Change 11 edition Thomas G. Cummings • Christopher G. Worley
CHAPTER
9
Evaluating and Reinforcing Organization Development Interventions
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Learning Objectives
Illustrate the research design and measurement issues associated with evaluating OD interventions.
Explain the key elements in the process of reinforcing OD interventions.
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
‹#›
Issues in Evaluating OD Interventions
Implementation and Evaluation Feedback
Measurement
Select the right variables to measure
Design good measurements
Operational
Reliable
Valid
Research Design
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Implementation and Evaluation Feedback (1)
Implementation
Feedback
Feedback aimed at guiding implementation efforts
Milestones, intermediate targets
Measures of the intervention’s progress
Evaluation
Feedback
Feedback aimed at determining impact of intervention
Goals, outcomes, performance
Measures of the intervention’s effect
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Implementation and Evaluation Feedback (2)
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Measurement
Selecting Appropriate Variables
Designing Good Measures
Rigorous Operational Definition
Provide precise guidelines for measurement: How high does a team have to score on a five-point scale to say that it is effective?
Reliability
Validity
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Sources of Reliability
Rigorous Operational Definition of the variables
Provide precise guidelines for measurement: How high does a team have to score on a five-point scale to say that it is effective?
Multiple methods to measure a particular variable
Surveys, interviews, observations and unobtrusive measures
Multiple items to measure the same variable on a questionnaire
Standardized Instruments
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Validity
Face Validity or Content Validity
Does the measure “appear” to reflect the variable of interest?
Criterion or Convergent Validity
Do measures of “similar” variables correlate?
Discriminant Validity
Do measures of “non-similar” variables show no association?
Predictive Validity
Does the variable of interest accurately forecast another variable over time?
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Research Designs in OD Interventions
Features of Strong Research Designs
Longitudinal Measurement
Change is measured over time
Comparison Units
Appropriate use of “control” groups
Statistical Analysis
Alternative sources of variation have been controlled
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Evaluating Different Types of Change
Alpha Change
Movement along a stable dimension
Beta Change
Recalibration of units of measure in a stable dimension
Gamma Change
Fundamental redefinition of dimension
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Reinforcing Organizational Changes
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Organization Characteristics
Congruence
Extent to which an intervention supports or aligns with the current environment, strategic orientation, or other changes taking place
Stability of Environment and Technology
Unionization
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Intervention Characteristics
Goal Specificity
Programmability
Level of Change Target
Internal Support
Sponsorship
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Reinforcing the Processes
Socialization
Commitment
Reward Allocation
Diffusion
Sensing and Calibration
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Indicators of Reinforcement
Knowledge
Performance
Preferences
Normative Consensus
Value Consensus
‹#›
©2019 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.