COMPARE AND CONTRAST QUANTITATIVE AND QUALITATIVE RESEARCH

profileSc hool10
NRSE_4550_M2_LA_Introduction_to_Quantitative_Researchmodule2third.ppt

Chapter 8

Introduction to Quantitative Research

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Research Design

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Purpose of Research Design

Provides the plan or blueprint

Is the vehicle for systematically testing research questions and hypotheses

Provides the structure for maintaining the control in the study

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Control

Achieved with steps taken by the researcher to hold the conditions of the study uniform and avoid or decrease the effect of intervening, extraneous, or mediating variables on the dependent variable or outcome

Avoids bias or threats to the internal validity of the study

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Considerations in Quantitative Research

Objectivity in conceptualization of the research question

Type of design chosen

Accuracy

Feasibility

Control and intervention fidelity

Validity: internal and external

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Objectivity in Conceptualization of the Research Question

Objectivity can be achieved from a thorough review of the literature and the development of a theoretical framework.

The literature review should be presented so that the reader can judge the objectivity of the research question.

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Accuracy

Accomplished through the theoretical framework and literature review

All aspects of the study systematically and logically follow from the research question.

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Feasibility

Time

Is there enough time for completion of the study?

Subject availability

Are a sufficient number of eligible subjects available?

Facility and equipment availability

Are the necessary equipment and facilities available?

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Feasibility

Expense

Is money available for the projected cost?

Experience

Is the study based on the researcher’s experience and interest?

Ethics

Could subjects be harmed?

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Control and Intervention Fidelity

Intervention fidelity

Ensures that every subject receiving the intervention or treatment receives the identical intervention or treatment

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Intervening, Extraneous, or Mediating Variables

Variables that occur during the study that interfere with or influence the relationship between the independent and dependent variables

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Intervening, Extraneous, or Mediating Variables

Intervening and mediating variables are processes that occur during the study.

Extraneous variables are subject, researcher, or environmental characteristics that might influence the dependent variable.

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Controlling Extraneous Variables
Homogenous Sample

Using a homogeneous sample—similarity with respect to the extraneous variables relevant to the particular study

Using consistent data collection procedures—constancy

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Controlling Extraneous Variables

Training and supervising individuals delivering interventions and collecting data—constancy and intervention fidelity

Manipulating the independent variable

Randomization

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Homogeneity

Participants in the study are homogeneous or have similar extraneous variables that might affect the dependent variable

Homogeneity of the sample limits generalizability or the potential to apply the results of a study to other populations

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Constancy in Data Collection

Design

Training

Delivery

Receipt

Enactment

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Independent Variable (X)

The independent variable is:

The variable that the researcher hypothesizes will have an effect on the dependent variable

Usually manipulated (experimental study) but sometimes cannot be manipulated (nonexperimental)

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Independent Variable (X)

The independent variable is:

Manipulated by means of a program, treatment, or intervention done to only one group in the study (experimental group)

The control group gets the standard treatment or no treatment

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Dependent Variable (Y)

The dependent variable is:

A factor, trait, or condition that can exist in differing amounts or types

Not manipulated and presumed to vary with changes in the independent variable

The variable the researcher is interested in explaining

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Randomization

Each subject in the study has an equal chance of being assigned to the control group or the experimental group.

Randomization assumes that any important intervening, extraneous, or mediating variable will be equally distributed between the groups, minimizing variance and decreasing selection bias.

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Internal Validity

Asks whether the independent variable really made the difference or the change in the dependent variable

Established by ruling out other factors or threats as rival explanations

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Threats to Internal Validity

History

An event, other than the intervention, that might have an effect on the dependent variable; the event could be either inside or outside the experimental setting

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Threats to Internal Validity

Maturation

Developmental, biological, or psychological processes that operate within an individual over time. These processes are outside the experimental setting

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Threats to Internal Validity

Testing

Taking the same test more than once can influence the participant’s responses the next time the test is taken

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Threats to Internal Validity

Instrumentation

Changes in equipment used to make measurements or changes in observational techniques may cause measurements to vary between participants related to treatment fidelity

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Threats to Internal Validity

Mortality

The loss of study subjects

Selection bias

A partiality in choosing the participants in a study

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

External Validity

Questions the conditions under which the findings are generalized

Deals with the ability to generalize the findings outside the study to other populations and environments

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Threats to External Validity

Selection effects

What method was used to select the sample? How were subjects assigned to groups?

Reactive effects

Subjects’ responses to being studied

Hawthorne effect

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Threats to External Validity

Measurement effects

A pretest may act like an intervention and influence or change the subjects’ responses

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Critiquing Criteria for Quantitative Studies

Is the type of design used appropriate?

Does the researcher use the various concepts of control that are consistent with the type of design chosen?

Does the design used seem to reflect the issues of economy?

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Critiquing Criteria for Quantitative Studies

Does the design used seem to flow from the proposed research question, theoretical framework, literature review, and hypothesis?

What are the threats to internal validity?

What are the controls for the threats to internal validity?

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Critiquing Criteria for Quantitative Studies

What are the threats to external validity?

What are the controls for the threats to external validity?

Is the design appropriately linked to the evidence hierarchy?

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Which component creates the research design in a tobacco cessation study?

College males, ages 18-23

Online, 1:1, or class sessions

Maslow’s hierarchy of needs theory

Which type of education leads to sustained cessation?

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

ANSWER: C

RATIONALE: Maslow’s Hierarchy of Needs theory. The research process does not need to be a sterile procedure, but rather one where the researcher develops a masterful work within the limits of a research question and the related theoretical basis. The framework that the researcher creates is the design.

*

To increase accuracy in the previous example, which might the new researcher consider first?

A thorough literature review

Compare only online and 1:1 sessions

Complete a pilot study with a very small sample first

Remove external variables

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

ANSWER: B

RATIONALE: Compare only online and 1:1 sessions. To increase accuracy, a beginning researcher may answer a question involving a few variables that will not require the use of sophisticated designs. The simplicity of a research project does not render it useless or of a lesser value for practice. A helps objectivity in conceptualization of the research question, C helps feasibility control, and D, intervention fidelity. All external variables cannot be removed, only controlled.

*

Which internal validity threat is suspected in the following scenario?

A college health center identifies lack of testicular self-examination among students and implements an intense summer wellness program focusing on the benefits of testicular self-examination. Afterward, a count indicates an increased number of students who do not complete testicular self-examinations

History

Maturation

Testing

Mortality

Selection bias

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

ANSWER: D

RATIONALE: Mortality, the loss of study subjects from the first data collection point (pretest) to the second data-collection point (posttest). If the subjects who remain in the study are not similar to those who dropped out, the results could be affected. The college community has a high rate of turnover during the summer.

*

Which type of research design should be used in the following scenario?

A nurse researcher is investigating the effects of yoga and blood pressure. One group of subjects is participating in a yoga class and the other group is not.

Qualitative

Correlational

Meta-analysis

Experimental

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

*

Copyright © 2014, 2010, 2006, 2002, 1998, 1994, 1990, 1986 by Mosby, an imprint of Elsevier Inc.

ANSWER: D

RATIONALE: Experimental designs are used to compare treatment group with control group. Qualitative designs are used when there is little or no research or literature available for the area being investigated. Correlational studies look at the relationship between or among variables. Meta-analysis involves results of multiple studies.

*