one
Threats to validity
Week 3
Threats to validity
Validity refers to how well a study is designed so that we can be fairly certain that the effect (dependent variable) was impacted by an intervention.
A threat to validity is any aspect of a study that raises questions about whether we can safely attribute the effect to the intervention.
External validity
External validity refers to our ability to generalize the findings to other populations.
Internal validity
Compensatory rivalry: Practitioners or clients in the treatment-as-usual control group compete with their counterparts in the experimental treatment group.
Resentful demoralization: Clients or practitioners assigned to the treatment as usual control group have reduced motivation or confidence in the services after being excluded from the experimental treatment
Attrition or experimental mortality: Participants drop out of an experiment before it is completed.
Social desirability bias or reactivity: Study participants report improved outcomes in order to please, or not to disappoint, the experimenter or themselves.
Internal validity refers to our ability to trust the accuracy of the study findings.
Internal validity
Treatment diffusion: Practitioners in the treatment-as-usual control group learn about and incorporate aspects of the experimental treatment.
Practitioner equivalence refers to the degree to which practitioners delivering the experimental treatment and those delivering the treatment as usual are really equivalent
Fidelity: Refers to how closely practitioners follow designated protocols to ensure that treatment was administered the same.
History: Refers to an event that occurs that might alter the results of the study.
Maturation: Refers to participants changing through natural processes and the passage of time.