Thesis Proposal

Chapter 10: Mixed Methods Procedures

This chapter presents information on designing a mixed methods procedures section for a research proposal. Previous chapters have discussed the collection of quantitative and qualitative data but not the process for combining the two forms of data in the study. The blending of the two types of data can help to develop a stronger understanding of the research question or process.

Chapter 10 begins with a discussion of the components of a mixed methods procedure and discusses how to design the procedures for a mixed methods study. Recommendations for conveying the nature of mixed methods research and what is are discussed. Conveying the nature of mixed methods and its characteristics is essential to a good mixed methods procedure.

Components of Mixed Methods Procedures

Mixed Methods Research

It is useful to convey a basic definition and description of the approach in a method section of a proposal. This may include:

· Defining mixed methods research

· It involves the collection of both qualitative and quantitative data in response to research questions or hypotheses

· The procedures for both qualitative and quantitative data collection and analysis will be conducted rigorously

· The two forms of data are integrated in the design analysis

· These procedures are incorporated into a distinct mixed methods design that also includes the timing of the data collection as well as the emphasis

· These procedures can also be informed by a philosophy (worldview) or a theory

· Discuss the many different terms used for mixed methods

· Educate the reader about the background of mixed methods by reviewing the history of this approach to research

· Discuss the reasons for choosing mixed methods; it is a useful strategy to have a more complete understanding of research problems

· Comparing different perspectives drawn from quantitative and qualitative data

· Explaining quantitative results with a qualitative follow-up data collection and analysis

· Developing better contextualized measurement instruments by first collecting and analyzing qualitative data and then administering the instruments to a sample

· Developing cases or documenting cases for comparison

· Augmenting experiments or trials by including perspectives of individuals

· Developing a more complete understanding of changes needed for a marginalized group with a combination of qualitative and quantitative data

· Having a better understanding of the need for or impact of an intervention program

· Indicate the type of mixed methods design that will be used in the study and the rationale for choosing it

· Note the challenges this former research poses for the researcher

Types of Mixed Methods Designs

Convergent Mixed Methods Design

· Description of the design

· The researcher collects both quantitative and qualitative data in a single phase

· Analyzes them separately

· Compares the results to see if the findings confirm or disconfirm each other

· Data collection

· The qualitative data can assume any of the forms previously discussed (interviews, observations, documents, etc.)

· The intent of this type of data collection is to locate and obtain information from a small sample but to gather extensive information from the sample

· Data analysis and integration

· The two databases are analyzed separately and then brought together; this can be done through:

· Side-by-side comparison

· Changing qualitative codes for themes into quantitative variables (this is called data transformation)

· Merging the two forms of data into a table or graph

· Interpretation

· Typically written into the discussion section of the study

· The discussion section includes a report comparing results from the two databases noting whether there is convergence or divergence between the two sources

· Validity

· Should be based on both quantitative and qualitative validity

Explanatory Sequential Mixed Methods Design

· Description of the design

· The researcher collects quantitative data in the first phase

· Analyzes the results and uses them to plan phase 2

· The quantitative phase informs the types of participants to be purposefully selected for the qualitative things in the types of questions that will be asked

· Data collection

· The data collection proceeds into distinct phases:

· Phase 1 consists of rigorous quantitative sampling

· Phase 2 consists of purposeful sampling.

· Intent is to follow up quantitative data with more in depth information

· Data analysis and integration

· The two databases are analyzed separately

· Quantitative results used to plan the qualitative follow-up

· Qualitative data analysis follows

· Interpretation

· Typically written into the discussion section of the study

· Quantitative is reported first; then second-phase results are reported

· The third form of interpretation asks a question “How do the qualitative findings help explain the quantitative results?”

· Validity

· Establish validity of scores from the quantitative measures

· Discuss the validity of qualitative findings

Exploratory Sequential Mixed Methods Design

· Description of the design

· The researcher collects qualitative data in the first phase

· Analyzes the results and uses them to plan phase 2

· The qualitative phase informs the quantitative phase

· Data collection

· The qualitative data collected and is used in the second phase to:

· Create an instrument

· Develop new variables

· The intent of this type is to develop better instruments and to see if data from a few individuals can be generalized to a larger sample

· Data analysis and integration

· The two databases are analyzed separately

· The researcher uses the results of phase 1 to build into quantitative measures

· Interpretation

· Typically written into the discussion section of the study

· Qualitative results are reported first and then quantitative

· Validity

· Should be based on both quantitative and qualitative validity

· A concern might be whether the research uses the appropriate steps to develop the instrument

Several Complex Mixed Methods Designs

· Framework for considering complex applications:

· Intersecting a secondary method (mixed methods) within a primary quantitative or qualitative design (e.g., an intervention)

· Intersecting mixed methods within another methodology (e.g., evaluation)

· Intersecting mixed methods within a theoretical framework (e.g., social justice)

· Complex mixed methods designs

· Mixed methods experimental (intervention) design – quantitative and qualitative data within an experiment or trial

· Mixed methods case study design – mixed methods within a single or multiple case study

· Mixed methods participatory social justice design – core mixed methods design within a larger framework

· Mixed methods evaluation design – one or more core designs in an evaluation

A Procedure for Embedding Core Designs into Complex Designs

· Identify quantitative and qualitative data collection in the study

· Draw a diagram of steps in the procedure

· Look into the steps for opportunities to collect quantitative and qualitative data

· In the steps where you collect both forms of data, ask how the databases are being connected

· Discuss procedures of using core designs

· Mixed methods notation provides shorthand labels and symbols that can be important aspects of mixed methods research

· QUAL and QUAN (capitalized) indicates an emphasis on priority on the quantitative or qualitative data, analysis, and interpretation in the study

· Quan and Qual stand for quantitative and qualitative, respectively

· A plus sign indicates a convergent or merging integration of data collection

· An arrow indicates a sequential form of data collection

· Parentheses – indicate that one form of data collection is embedded within another or embedded within a larger design

· Double arrows mean that the flow of activities can go both ways

Factors Important in Choosing a Mixed Methods Design

· Choice based on outcomes expected; this requires a researcher to determine the outcome anticipated and then to link it to the types

· Choice based on integrating the data will be used together; the researcher needs to consider whether mixed methods integration of the two databases will be through merging, explaining, building, or embedding

· Choice based on the timing of the data collection; this considers whether the two databases are collected concurrently or sequentially

· Choice based on the emphasis placed on each database; a mixed methods study can use an equal emphasis on both databases or an unequal emphasis

· Choice based on type of design most suited for a field; for quantitatively oriented fields, the explanatory sequential approach seems to work well

· Choice based on a single researcher or team; if the investigator is a single researcher, the sequential strategies are best because the investigation can be broken into two tasks

Examples of Mixed Methods Procedures

· See Examples 10.1–10.4 that illustrate mixed methods procedures.