Order #408782 Topic: A#4

profiletutorthammy
Literature_Search.ppt

The Literature Review

Alternative Models for Quantitative and Qualitative Data

© 2007 Thomson, a part of the Thomson Corporation. Thomson, the Star logo, and Atomic Dog are trademarks used herein under license.  All rights reserved.

Background

  • “Old model” (pre-1980)

Subjective review by one or small group of authors

Search procedures not typically described

Quality of prior research judged by apparent comprehensiveness and writing

No way to evaluate threats to validity

Differences resolved by argument, persuasion

“New Model”: Research Synthesis

Literature review as a research study

Systematic

Replicable

Hypothesis driven

Meta-analysis

Smith & Glass (1977) Psychotherapy

Cooper (1989) Homework

Qualitative meta-analysis

Case synthesis (Jensen & Rodgers, 2001)

Cross case analysis (Stake, 2006)

Cooper’s Five Step Model

Problem Formulation

Data Collection

Data Evaluation

Analysis & Interpretation

Public Presentation

Skills Needed to Utilize Cooper’s Model

Search

Critique

Analysis

Management

Reporting

Key Issues

The review as science

Be sure to report your procedures!

Search strategies

Basic

Relevant electronic databases

PsychInfo, Medline & Eric

Digital dissertations

Citation analysis

Journal perusal

Key Issues

Advanced Search

Complementary searches

Govt docs (e.g., IOM reports)

Experts

Computers & lit searches

Databases

Ref managers

Which Studies to Include?

  • It is critical to have an explicit inclusion and exclusion criteria

The broader the research domain, the more detailed they tend to become

Refine criteria as you interact with the literature

Components of a detailed criteria

research respondents

key variables

research methods

cultural and linguistic range

time frame

publication types

Methodological Quality Dilemma

  • Include or exclude low quality studies?

The findings of all studies are potentially in error (methodological quality is a continuum, not a dichotomy)

Being too restrictive may restrict ability to generalize

Being too inclusive may weaken the confidence that can be placed in the findings

Methodological quality is often in the “eye-of-the-beholder”

You must strike a balance that is appropriate to your research question

Critique

  • Critical thinking about research

Identification of strengths & limitations

How do we know?

Expertise about subject matter

Expertise about methodology

Use of objective criteria

Critique outline

Complications

  • What About Conflicting Findings?

Validity Issues

External

Sampling

Construct

Degree of abstractness

Internal

Control of alternative explanations

Conclusion

Reliability

Instrument differences & sample-instrument interactions

Level of analysis