week_3_threats_to_validity.pptx

Threats to validity

Week 3

Threats to validity

Validity refers to how well a study is designed so that we can be fairly certain that the effect (dependent variable) was impacted by an intervention.

A threat to validity is any aspect of a study that raises questions about whether we can safely attribute the effect to the intervention.

External validity

External validity refers to our ability to generalize the findings to other populations.

Internal validity

Compensatory rivalry: Practitioners or clients in the treatment-as-usual control group compete with their counterparts in the experimental treatment group.

Resentful demoralization: Clients or practitioners assigned to the treatment as usual control group have reduced motivation or confidence in the services after being excluded from the experimental treatment

Attrition or experimental mortality: Participants drop out of an experiment before it is completed.

Social desirability bias or reactivity: Study participants report improved outcomes in order to please, or not to disappoint, the experimenter or themselves.

Internal validity refers to our ability to trust the accuracy of the study findings.

Internal validity

Treatment diffusion: Practitioners in the treatment-as-usual control group learn about and incorporate aspects of the experimental treatment.

Practitioner equivalence refers to the degree to which practitioners delivering the experimental treatment and those delivering the treatment as usual are really equivalent

Fidelity: Refers to how closely practitioners follow designated protocols to ensure that treatment was administered the same.

History: Refers to an event that occurs that might alter the results of the study.

Maturation: Refers to participants changing through natural processes and the passage of time.