Order #408782 Topic: A#4
The Literature Review
Alternative Models for Quantitative and Qualitative Data
© 2007 Thomson, a part of the Thomson Corporation. Thomson, the Star logo, and Atomic Dog are trademarks used herein under license. All rights reserved.
Background
- “Old model” (pre-1980)
Subjective review by one or small group of authors
Search procedures not typically described
Quality of prior research judged by apparent comprehensiveness and writing
No way to evaluate threats to validity
Differences resolved by argument, persuasion
“New Model”: Research Synthesis
Literature review as a research study
Systematic
Replicable
Hypothesis driven
Meta-analysis
Smith & Glass (1977) Psychotherapy
Cooper (1989) Homework
Qualitative meta-analysis
Case synthesis (Jensen & Rodgers, 2001)
Cross case analysis (Stake, 2006)
Cooper’s Five Step Model
Problem Formulation
Data Collection
Data Evaluation
Analysis & Interpretation
Public Presentation
Skills Needed to Utilize Cooper’s Model
Search
Critique
Analysis
Management
Reporting
Key Issues
The review as science
Be sure to report your procedures!
Search strategies
Basic
Relevant electronic databases
PsychInfo, Medline & Eric
Digital dissertations
Citation analysis
Journal perusal
Key Issues
Advanced Search
Complementary searches
Govt docs (e.g., IOM reports)
Experts
Computers & lit searches
Databases
Ref managers
Which Studies to Include?
- It is critical to have an explicit inclusion and exclusion criteria
The broader the research domain, the more detailed they tend to become
Refine criteria as you interact with the literature
Components of a detailed criteria
research respondents
key variables
research methods
cultural and linguistic range
time frame
publication types
Methodological Quality Dilemma
- Include or exclude low quality studies?
The findings of all studies are potentially in error (methodological quality is a continuum, not a dichotomy)
Being too restrictive may restrict ability to generalize
Being too inclusive may weaken the confidence that can be placed in the findings
Methodological quality is often in the “eye-of-the-beholder”
You must strike a balance that is appropriate to your research question
Critique
- Critical thinking about research
Identification of strengths & limitations
How do we know?
Expertise about subject matter
Expertise about methodology
Use of objective criteria
Critique outline
Complications
- What About Conflicting Findings?
Validity Issues
External
Sampling
Construct
Degree of abstractness
Internal
Control of alternative explanations
Conclusion
Reliability
Instrument differences & sample-instrument interactions
Level of analysis