writing
Quantitative Design
- Designing quantitative methods for a research proposal
- Survey and experimental designs
- Careful measurement, parsimonious variables, theory-guided
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
*
Defining Surveys and Experiments
- Survey design
Quantitative description of trends, attitudes, or opinions of a population
Testing association
Studying a sample of that population
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Defining Surveys and Experiments
- Experimental design
Systematic manipulation of one or more variables to evaluate an outcome
Holds other variables constant to isolate effects
Generalize to a broader population
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
- The survey design
- The population and sample
- Instrumentation
- Variables in the study
- Data analysis and interpretation
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Components of a Survey Method Plan
Creswell, Research Design 5e SAGE Publishing, 2018
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Components of a Survey Method Plan
Creswell, Research Design 5e SAGE Publishing, 2018
Components of a Survey Method Plan
The survey design:
- Provide a purpose for using survey research
- Indicate why the survey method is preferred
- Indicate the type of survey design
Cross-sectional (data collected at one point in time)
Longitudinal (data collected over time)
- Specify the form of data collection – telephone, mail, Internet personal/group interviews) and rationale
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Components of a Survey Method Plan
The population and sample:
- Identify the population including size and sampling frames
- Specify the sampling design
Single-stage
Multi-stage (clustering)
- Type of sampling
Probability
Nonprobability
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Components of a Survey Method Plan
The population and sample:
- Indicate if the study involves stratification – ensuring specific population characteristics (e.g. gender) are represented
- Indicate number in the sample and procedure to determine
- Use a power analysis if you plan to detect significant associations
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Components of a Survey Method Plan
The population and sample:
- Power analysis involves
Estimating the size of correlation
An alpha value (type I error rate)
A beta value (type II error rate)
Conducting the power analysis (e.g., G*Power)
- Conduct power analysis during planning
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Components of a Survey Method Plan
Instrumentation:
- Name the survey instrument used to collect data
- Indicate how instrument was developed
- Describe the established validity scores from past use
Content validity
Predictive or concurrent validity
Construct validity
- Describe reliability of scores from past use
Internal consistency
Test-retest
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Components of a Survey Method Plan
Instrumentation:
- When modifying or combining instruments, the original validity and reliability may not hold
- Include sample items from the instrument
- Indicate major content sections in the instrument
Cover letter
Items – demographics, attitude items, behavior items, factual items
Closing instructions
Type of scale for responses
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Components of a Survey Method Plan
Instrumentation:
- Discuss pilot testing or field-testing
Rationale for plans
Content validity and reliability
Improve question
- Steps for administering for a mailed survey
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Components of a Survey Method Plan
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Components of a Survey Method Plan
Data analysis:
- Computer programs used for analysis
- Data analysis steps
Step 1. Number who did and did not respond
Step 2. Method to determine response bias
Step 3. Plan to provide descriptive analyses
Step 4. Calculate total scale scores
Step 5. Statistics and program for inferential statistical analyses
Step 6. Present results in figures or tables and interpret
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Interpreting results and writing a discussion section:
- Report how the results answered the research question or hypothesis
- Practical evidence in terms of effect size and confidence interval
- Discuss implications
- Consistent with, refute, extent previous studies
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Components of a Survey Method Plan
Creswell, Research Design 5e SAGE Publishing, 2018
Qualitative Designs
- Specific approaches in conducting qualitative research
- Include procedures for data collection, analysis, and writing
- Designs include
Narrative
Phenomenology
Ethnography
Case study
Grounded theory
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Collection Procedures
- Types of qualitative data collection
Qualitative observations
Qualitative interviews
Qualitative documents
Qualitative audio-visual materials
(see Table 9.2)
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Collection Procedures
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Collection Procedures
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Collection Procedures
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Collection Procedures
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Collection Procedures
- Be specific about types
- Include data collection types beyond typical observations and interviews
- These unusual forms create reader interest and can capture useful information .
(see Table 9.3)
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Collection Procedures
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Recording Procedures
- Observational protocol – record information while observing
Record descriptive notes
Reflexive notes
Demographic information
Setting
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Recording Procedures
- Interview protocol for asking questions and recording answers
Information about interview, introduction, questions and probes, closing instructions
Perhaps 5 to 10 questions
Prepare in advance
Memorize questions
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Analysis Procedures
- Segment and take apart the data and put back together
- Data analysis will proceed hand-in-hand with data collection and the write-up of findings
- Winnowing the data because it is dense
- Aggregate into five to seven themes
- Use a computer software program
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Analysis Procedures
Step 1 – Organize and prepare the data for analysis
- e.g., Transcribing interviews
Step 2 – Read or look at all the data
- Gain a general sense of the data
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Analysis Procedures
Step 3 – Start coding all of the data
- Coding – organize data by bracketing chunks
- Labeling with a term (code), often based on language of participants
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Data Analysis Procedures
Step 4 – Generate a description and themes
Step 5 – Represent the description and themes
- Narrative discussion, figures, tables, quotes
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Interpretation
- Interpretation in qualitative research
Summarize overall findings, compare to literature
Use a theoretical lens
Convey personal, research-based, and action meanings
Suggest limitations and future research
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Writing the Qualitative Report
- Plan for the narrative
Developing description and themes
Considering how sections will be presented
- Convey the following:
Use quotes
Dialogue that reflects culture
Varied narrative form
Use the first person
Use metaphors and analogies
Narrative reflects strategies
*
Creswell, Research Design 5e
SAGE Publishing, 2018
Creswell, Research Design 5e SAGE Publishing, 2018
Mixed Methods Procedures
*
Introduction
- Mixed methods procedures section
Combining qualitative and quantitative forms for more understanding
Nature of mixed methods
Reasons to use
The design
Ethical issues
Creswell, Research Design 5e
SAGE Publishing, 2018
*
Creswell, Research Design 5e SAGE Publishing, 2018
*
Components of Mixed Methods Procedures
Describe mixed methods research
- Indicate the type of mixed methods design and the rationale for choosing it
- Challenges to design
Creswell, Research Design 5e
SAGE Publishing, 2018
*
Creswell, Research Design 5e SAGE Publishing, 2018
Types of Mixed Methods Designs
Creswell, Research Design 5e
SAGE Publishing, 2018
*
Creswell, Research Design 5e SAGE Publishing, 2018
Several complex mixed methods designs:
- Mixed methods experimental (intervention) design – quantitative and qualitative data within an experiment or trial
- Mixed methods case study design – mixed methods within a single or multiple case study
Creswell, Research Design 5e
SAGE Publishing, 2018
*
Types of Mixed Methods Designs
Creswell, Research Design 5e SAGE Publishing, 2018
Several complex mixed methods designs:
- Mixed methods participatory social justice design – core mixed methods design within a larger framework
- Mixed methods evaluation design – one or more core designs in an evaluation
Creswell, Research Design 5e
SAGE Publishing, 2018
*
Types of Mixed Methods Designs
Creswell, Research Design 5e SAGE Publishing, 2018
A Procedure for Embedding Core Designs into Complex Designs
- Identify quantitative and qualitative data collection
- Draw a diagram of steps
- Look in steps for opportunities to collect quantitative and qualitative data
- How databases are connected
- Procedures of using core designs
Creswell, Research Design 5e
SAGE Publishing, 2018
*
Creswell, Research Design 5e SAGE Publishing, 2018
Factors Important in Choosing a Mixed Methods Design
Creswell, Research Design 5e
SAGE Publishing, 2018
*
Creswell, Research Design 5e SAGE Publishing, 2018