Nursing Research DQ 13

dailycubita
ReasearchMixmethod3.ppt

Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins

Chapter 28

Feasibility Assessments and Pilot Tests of Interventions Using Mixed Methods

*

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Question

Tell whether the following statement is true or false:

The terms pilot study and feasibility study are interchangeable.

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Answer

False

Often, the terms pilot study and feasibility study are used interchangeably. Recently, however, some experts are drawing a distinction between the two.

A feasibility study is research completed prior to a main intervention study to test specific and discrete aspects of an emerging intervention or the anticipated trial.

A pilot study is an investigation designed to test the feasibility of, and to support refinements of, the protocols, methods, and procedures to be used in a larger scale trial of an intervention.

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Feasibility and Pilot Studies

Feasibility study

  • Tests specific and discrete aspects of an emerging intervention
  • Using a fairly simple design

Pilot study

  • A small-scale version of a full trial
  • Assesses an entire set of procedures for implementing
  • Evaluates an intervention
  • Ideally involves a randomized design 

*

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Feasibility Study

  • Completed prior to a main intervention study
  • Tests specific and discrete aspects of an emerging intervention or the anticipated trial
  • Do not focus on the outcome of interest
  • Typically do not use a randomized design

*

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Pilot Study

  • Goal is to avoid a costly full study failure.
  • Questionable as to whether it should be used to test a hypothesis
  • Sample size is too small.
  • Typically 30-40 subjects

*

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Question

Tell whether the following statement is true or false:

An external pilot is a stand-alone study, whereas an internal pilot is an early phase of a larger trial.

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Answer

True

An external pilot is a stand-alone study, the findings from which inform the design and implementation of a full randomized control trial. An internal pilot is an early phase of a large trial, the findings from which are typically used to make adjustments to sample size projections.

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Pilot Study Objectives

  • Stated at the onset of study
  • Focus on the:
  • Process
  • Resources
  • Management issues
  • Scientific issues

*

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Scientific Objectives

  • Focuses on the substantive aspects of the intervention
  • Safety and tolerability
  • Clinical significance
  • Preliminary evidence of efficacy
  • Focuses on the methodologic aspects of a trial

Randomization

Sample size

Fidelity

Instruments

*

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Preliminary Effect Size Estimates

  • Often computed with confidence intervals (CIs)
  • CIs need not be as stringent as in full study results.

*

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Resulting Decisions

Pilot study results are meant to inform the decision about whether to:

  • Move forward with a full trial
  • Make revisions that require an additional pilot
  • Abandon the project altogether

*

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Mixed Method Designs

  • Especially well suited for a pilot study
  • Quantitative data can be used to assess whether feasibility criteria were met.
  • Qualitative data can elucidate why they were not met.
  • How the intervention of study protocols could be improved

*

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Lessons Learned

  • Major product provides:
  • Information from which protocols for a full trial can be created
  • If interventions have been found to be feasible, acceptable, and promising
  • List of proposed outcomes
  • The findings will be published so that others can benefit from learning about both the successes and the failures.

*

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Critiquing Feasibility and Pilot Studies

  • Provides descriptions of sample characteristics, design elements, instruments
  • Intervention theory and development of the intervention
  • References should be provided to any previously published papers on intervention development.
  • Researchers’ description of the pilot objectives, the criteria used to make decisions about feasibility, and the methods associated with feasibility assessments

*

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Question

What term is used to identify practical information about the real-life application of a pilot study?

Responder analysis

Exit interview

Lessons learned

Statement of purpose

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

Answer

C

A major product from pilot work is a description of “lessons learned” that inform the final protocols for a full trial as well as providing information about the usefulness and achievability of the proposed intervention(s) in the “real world.”