PART 2 OF THE RESEARCH

profilehapiness
QuantitativeMethods-.ppt
Home>Business & Finance homework help>Management homework help>PART 2 OF THE RESEARCH

Chapter 8

Quantitative Methods

*

Outline

  • Quantitative Research Methods

  • Components of a Survey Method Plan

  • Components of an Experimental Study Method Plan

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

*

Quantitative Methods

  • Quantitative approaches focus on carefully measuring (or experimentally manipulating) a set of variables to answer theory-guided research questions/hypothesis

  • Survey design: Quantitative description of trends, attitudes, or opinions of a population

  • Experimental design: Systematic manipulation of one or more variables to evaluate an outcome

Both designs help the researcher:

make inferences about relationships among variables,

how the sample results may generalize to a broader population of interest

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

*

  • The survey design

  • The population and sample

  • Instrumentation

  • Variables in the study

  • Data analysis and interpretation

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Components of
a Survey Method Plan

Creswell, Research Design 5e SAGE Publishing, 2018

Components of a Survey Method Plan

The survey design:

  • Identify the purpose of survey research
  • the primary purpose is to answer a question about variables

  • Indicate why the survey method is preferred
  • E.g. cost, rapid turnaround in data collection

  • Indicate the type of survey design
  • Cross-sectional or Longitudinal

  • Specify the form of data collection
  • telephone, mail, Internet personal/group interviews) and rationale

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of a Survey Method Plan

The population and sample:

  • Identify the population, including size and sampling frames

  • Specify the sampling design

Single-stage

Multi-stage (clustering): when impractical to compile a list of the elements- identify clusters first

  • Type of sampling

Probability (random & systematic)

Nonprobability (conveniecy and availability)

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

*

It is important to define research population clearly

Sampling

Saunders et al. (2016). Research methods for business students, 7th Ed.

Sampling Techniques

Saunders et al. (2016). Research methods for business students, 7th Ed.

Components of a Survey Method Plan

The population and sample:

  • Stratification: Indicate if the study involves stratification – ensuring specific population characteristics (e.g. gender, income, education) are represented

  • Sample size: Indicate number in the sample and procedure to determine (fraction of the population-e.g. 10%, as past studies, analysis plan)

  • Power analysis: use a power analysis (target sample size estimators) if you plan to detect significant associations

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of a Survey Method Plan

The population and sample:

  • Power analysis requires:

Estimating the size of correlation - r (previous studies)

An alpha value (type I error rate)- false positive.

Saying “there is significant r/p” (alpha=0.5 or 5%)

A beta value (type II error rate) – false negative.

Saying “ there is no significant r/p” (beta=0.2)

Conducting the power analysis (e.g., G*Power) –online recourses

  • Conduct power analysis during planning

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of a Survey Method Plan

Instrumentation:

  • Name the survey instrument used to collect data, if any
  • e.g. scale to measure stress

  • Indicate how instrument was developed

  • Describe the established validity scores from past use (to use the existing instruments)

  • Describe reliability of scores from past use

Internal consistency

Test-retest

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of a Survey Method Plan

Instrumentation:

  • Pilot testing: Discuss pilot testing or field-testing

Rationale for plans

Content validity and reliability

Improve question

  • Administering the survey: identify steps for administering and for following up for a mailed survey

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of a Survey Method Plan

Variables in the study:

  • useful to relate the variables, the research questions or hypotheses, and sample items on the survey instrument

  • reader can easily determine how the data collection connects to the variables and questions/hypotheses

  • plan to include a table and a discussion that cross-reference the variables, the questions or hypotheses, and specific survey items.

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of a Survey Method Plan- Variables

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of a Survey Method Plan

Data analysis:

  • Computer programs used for analysis

  • Data analysis steps

Step 1. Number who did and did not respond

Step 2. Method to determine response bias: the effect of nonresponses on survey estimates

Step 3. Plan to provide descriptive analyses: missing data handling

Step 4. Calculate total scale scores

Step 5. Statistics and program for inferential statistical analyses

Step 6. Present results in figures or tables and interpret

*

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Components of a Survey Method Plan

Creswell, Research Design 5e SAGE Publishing, 2018

Interpreting results and writing a discussion section:

  • Report how the results answered the research question or hypothesis
  • based on statistical significance testing
  • summarized as “the analysis of variance revealed a statistically significant/not significant diff. or r/p….”

  • Practical evidence in terms of:
  • effect size: strength of the conclusions
  • confidence interval- level of uncertainty

  • Discuss implications
  • Consistent with, refute, extended previous studies

*

Components of a Survey Method Plan

Components of
an Experimental Study Method Plan

Participants

Variables

Instrumentation and materials

Experimental procedures

Threats to validity

Data analysis

Interpreting results and writing a discussion

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of an Experimental Study Method Plan

Participants:

  • Describe procedures for recruiting participants

  • Describe the selection of participants as either:

Random (distinguishing feature of experiment)

Nonrandom (convenience)

E.g . “The experiment consisted of a one-way two-groups design comparing burnout symptoms between full-time and part-time nurses”

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Components of an Experimental Study Method Plan

Creswell, Research Design 5e SAGE Publishing, 2018

Components of an Experimental Study Method Plan

Variables:

  • Specify the variables and describe in detail

Identify the independent variables

Include a manipulation check measure

Identify dependent variable

Identify other variables measured

  • Participant demographics
  • Measure variables that contribute noise
  • time of day vs Self-esteem
  • Potential confounding variables (e.g. deep thought)

*

Components of an Experimental Study Method Plan

Instrumentation and materials:

  • Describe the instrument(s) participants complete in the experiment

Development, items, and scales

Reliability and validity reports of past uses

  • Thoroughly discuss materials used for the treatment

  • Cover story to explain procedures if deception is used

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of an Experimental Study Method Plan

Experimental procedures:

  • Identify the type of experiment

Pre-experimental (no ctrl group), true experiment, quasi-experiment, single subject design (observing the behavior of a single individual over time).

  • Identify the type of comparisons – within-group or between-subject

Provide a visual model to illustrate the research design used

  • X = treatment
  • O = observation
  • R = random assignment

See Examples 8.2–8.5

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of an Experimental Study Method Plan

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of an Experimental Study Method Plan

Threats to validity:

  • Internal validity
  • procedures, treatments, or experiences of the participants that threaten inferences in experiments

  • External validity
  • drawing incorrect inferences from sample data to other persons, settings, situations

  • Statistical conclusion validity
  • because of inadequate statistical power or violation of statistical assumptions

  • Construct validity
  • When inadequate definitions and measures of variable

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of an Experimental Study Method Plan

The procedure:

  • Administer measures of the dependent variable or a variable closely correlated
  • Assign participants to matched pairs
  • Randomly assign one member of each pair to the control and experimental group
  • Expose experimental group to the treatment
  • Administer measures of dependent variables
  • Compare performance of the experimental and control groups

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of an Experimental Study Method Plan

Data analysis:

  • Report descriptive statistics (e.g., means, standard deviations, ranges)

  • Indicate inferential statistical tests (e.g., t test, ANOVA, ANCOVA, or MANOVA)

  • Report confidence intervals and effect sizes in addition to statistical tests

  • Use line graphs for single subject designs

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Components of an Experimental Study Method Plan

Interpreting results and writing a discussion section:

  • Interpret findings in light of hypotheses and research questions

  • Whether supported or refuted

  • Why results significant or not, literature

  • Indicate implications

  • Suggest future research

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018

Summary

  • The methodological approach to a survey or experiment

  • Surveys – purpose, population and sample, instruments, relationship, research questions, items, analysis

  • Experiments – identify participants, variables, instruments, type of experiment, validly, analysis

*

Creswell, Research Design 5e

SAGE Publishing, 2018

Creswell, Research Design 5e SAGE Publishing, 2018