Order #403985 Topic: #3

profiletutorthammy
Chapter_4.pptx

An Applied Reference Guide to Research Designs Quantitative, Qualitative, and Mixed Methods

A Visual System for Research Designs in

Education and the Social & Behavioral Sciences

© 2012 SAGE Publications

All Rights Reserved

Edmonds, W. A., & Kennedy , T. D. (2012). An applied reference guide to research designs: Quantitative, qualitative, and mixed methods. Thousand Oaks, CA: Sage.

Ch. 4

Within-Subjects Approach

Sage Publications

Within-subjects Approach

Good alternative to between-subjects when:

Access to participants is limited

Random assignment is not possible

The primary goal with this approach is that each subject or group is exposed to each of the treatment conditions

More threats to internal validity are associated with this approach:

Maturation

History

Sequencing Effects

© 2012 SAGE Publications

All Rights Reserved

Within-subjects Approach

Also referred to as repeated-measures approach

Allows for the collection of multiple data points over time

Most basic design is the one-group pre and posttest design

Interrupted Time-series Design

Crossover Design (k-factor design for repeated measures)

© 2012 SAGE Publications

All Rights Reserved

Experimental Research for the repeated measures approach

These designs can be designated as experimental research (cause-effect) so long the following can be ensured:

Covariation?

Temporal Precedence?

No Plausible Alternative Explanation?

Major Threat to internal validity

Sequencing Effects

Sequencing Effects is addressed through counterbalancing

© 2012 SAGE Publications

All Rights Reserved

Repeated-measures plus between-subjects

Some designs within the repeated-measures approach include between-subjects components

Switching replications design

2-group pre- and posttest design (with multiple posttests)

The emphasis can be on both the within- and between-subjects variances

This is determined theoretically

© 2012 SAGE Publications

All Rights Reserved

Common variants

Crossover Design

Minimum 2 factors

Can include individuals or groups

Interrupted Time-series Design

Should include at least 10 observation points but many times should be more (theoretically determined)

Latin-square design

Complex one-factor design

Rarely applied in social sciences

© 2012 SAGE Publications

All Rights Reserved

Subject Treatment Midtest Treatment Midtest Treatment Posttest
1 XA O1 XB O2 XC O3
2 XB O1 XC O2 XA O3
3 XC O1 XA O2 XB O3
4 XC O1 XB O2 XA O3
5 XA O1 XC O2 XB O3
6 XB O1 XA O2 XC O3
Time ►

Most common threats

Most common threats to internal validity related, but not limited, to these designs:

Experimental. History, Maturation, Testing, Instrumentation, Attrition, and Sequencing Effects.

Quasi-experimental. History, Maturation, Testing, Instrumentation, Statistical Regression, Selection Bias, Attrition, and Sequencing Effects.

© 2012 SAGE Publications

All Rights Reserved

Pretest and Multiple-posttest Design

© 2012 SAGE Publications

All Rights Reserved

Research Question Example Here: Fill in the blanks

Formulate a RQ which would necessitate the use of this type of design

Assignment Group Pretest Treatment Posttest Posttest (2-week delay)  
 
1  
Time ►
Group Pretest Treatment Posttest1 Posttest2
1 O1 X O2 O3
2 O1 - O2 O3
Time ►  

Pretest and Multiple-posttest Design

What are the general weaknesses (in terms of internal validity) of this design?

How can group equivalency be tested?

How much time should elapse between posttests?

Should the emphasis be on the within- or between-subject variances?

© 2012 SAGE Publications

All Rights Reserved

Switching-replications Design

© 2012 SAGE Publications

All Rights Reserved

Research Question Example Here: Fill in the blanks

Assignment Group Pretest (Baseline) Treatment Midtest (3 months) Treatment Posttest (6 months)
-
-
Time ►
Group Pretest Treatment Midtest Treatment Posttest
1 O1 XA O2 - O3
2 O1 - O2 XA O3
Time ►

Switching-replications Design

What are the general weaknesses (in terms of internal validity) of this design?

How can group equivalency be tested?

Should there be a certain amount of time that should elapse before the next groups receives the intervention? Why or why not?

© 2012 SAGE Publications

All Rights Reserved

Crossover Design

© 2012 SAGE Publications

All Rights Reserved

Research Question Example Here: Fill in the blanks

Assignment Group Pretest Treatment Midtest Treatment Posttest
Time ►
Group Pretest Treatment Midtest Treatment Posttest
1 O1 XA O2 XB O3
2 O1 XB O2 XA O3
Time ►

Sage Publications

Crossover Design

What are the general weaknesses (in terms of internal validity) of this design?

How can group equivalency be tested?

How could sequencing effects affect the outcome?

Should the emphasis be on the within- or between-subject variances?

© 2012 SAGE Publications

All Rights Reserved

Interrupted time-series design

© 2012 SAGE Publications

All Rights Reserved

Research Question Example Here: Fill in the blanks

Group Pretests Treatment Posttests
1 O1…O6 X O7…O11
2 O1…O6 O7…O11
Time ►
Assignment Group Observations Treatment Observations
Time ►

Interrupted time-series design

What are the general weaknesses (in terms of internal validity) related to this design?

What are the strengths (in terms of internal validity) of this design because of the removal of the pretest?

Is it advisable to utilize non-random assignment with this design? Why or Why not?

How many observations should be taken prior to and after the intervention (or major event)?

© 2012 SAGE Publications

All Rights Reserved

Access companion website to further explore specific references of interest

http://www.sagepub.com/edmonds/

Be cautious of internet resources on research design and methodology.

Be aware that many books use different types of terminology to explain the same thing.

© 2012 SAGE Publications

All Rights Reserved

Group 1

O1

X

O2

Group 2

O1

-

O2

Group 1

O1

X

O2

Group 2

O1

-

O2