FOR RAY WRITTER

Labala_la
PPTBasicQuantitativeResearchchapter3.ppt

Walden University
Academic Residencies:

Basic Quantitative Research

PhD Residency 3 & 4

*

Session Learning Objectives

  • Identify the components of a methodology chapter for quantitative research
  • Understand criteria for selecting and justifying the research design, research question/hypotheses, data collection, and data analysis methods for the student’s dissertation study
  • Evaluate how the components of quantitative design and methods are aligned for dissertation research

Daniel W. Salter (DWS) - "how quantitative research aligns with the parts of the dissertation methodology chapter"?

*

Session Agenda

  • Overview
  • From Concepts to Variables
  • From Research Question to Hypotheses
  • From Recruitment to Data Collection
  • Analysis Plan Example
  • Report Out
  • Wrap Up

*

*

Quantitative Checklist-Chapter 3

  • Introduction
  • Research Design and Rationale
  • Methodology
  • Population
  • Sampling and Sampling Procedures
  • Recruitment, Participation, Data Collection
  • Instrumentation
  • Data Analysis Plan
  • Threats to Validity
  • Ethical Procedures

*

*

Quantitative Checklist

*

*

Research Design and Rationale

  • Research design is the plan developed that best answers the research questions.
  • Two broad categories of research design:
  • Observational
  • Interventional
  • These categories identify the relationship between selected variables or the differences between groups.

*

*

Research Design and Rationale

  • Observational designs are non-experimental.
  • Cross sectional
  • Cohort
  • Case control
  • Interventional designs look at cause and effect relationships between variables.
  • Experimental studies
  • Quasi-experimental studies
  • Understanding which research design best answers the research questions provides the rationale for your design choice.

*

*

Research Design and Research Methodology

  • Research methodology describes the overall process of conducting research. Includes:
  • Research design
  • How the variables will be measured or operationalized
  • How the data will be collected
  • Sampling strategy
  • How the data will be analyzed
  • Each component of the research methodology needs to be fully discussed in Chapter 3.
  • Convenience is not a scholarly reason for the design.
  • It should not be the primary reason for your choice.

Daniel W. Salter (DWS [15]) - This slide seems out of order. Should be #6 in the deck.

Daniel W. Salter (DWS [16]) - I've never seen "convenience" used in this way. Its usually tied to sampling.

*

*

Instrumentation

  • Refers to the methods for collecting and measuring the variables in your study.
  • Preferable to use already published measures, as the reliability and validity have already been established.
  • Information needed about the measure includes the author, year published, what populations the measure has been used with, and the reliability and validity with each population.
  • Additional information includes whether permission is needed to utilize the measure.

*

*

Instrumentation: Reliability and Validity

  • Reliability refers to whether the instrument consistently measures what it was designed to measure.
  • Validity refers to the whether the instrument measures what it was designed to measure. There are different types of validity:

Face

Content

Construct

*

*

Finding the Right Instrument(s) for Your Study

  • How do you find the right instrument for your study?
  • Databases of instruments exist in some disciplines.
  • Don’t be afraid to look at databases outside your discipline, as many instruments can be cross-disciplinary.
  • Reviewing the literature to see what others have used is also a good source of information.
  • What information should you evaluate?
  • Year published, author, populations it’s been used with, length, reliability, and validity information.
  • If the measure contains subscales, knowing the number and names of these will be important.

*

*

Example Measure

  • Three-Dimensional Work Fatigue Inventory
  • 18 items, 6 each that measure:
  • Physical Fatigue
  • Mental Fatigue
  • Emotional Fatigue

PsycTESTS Citation:

Frone, M. R., & Tidwell, M. O. (2015). Three-dimensional work fatigue inventory [Database record]. Retrieved from http://dx.doi.org/10.1037/t43185-000

 

Source:

Frone, M. R., & Tidwell, M. O. (2015). The meaning and measurement of work fatigue: Development and evaluation of the Three-Dimensional Work Fatigue Inventory (3D-WFI). Journal of Occupational Health Psychology, 20(3), 273–288. doi:10.1037/a0038700

*

*

Activity #1: Finding Instrumentation

  • Demonstration: Log in to the Walden Library at http://academicguides.waldenu.edu/library.
  • Demonstration of PsycTESTS
  • Demonstration of Mental Measurements Yearbook
  • Work individually or in small groups.
  • Use a test-specific database (i.e., PsycTESTS) or the Mental Measurement Yearbook.

*

*

Activity: Finding Instrumentation

  • Locate an instrument related to your area of research interest. Review the following information:
  • Year published, including any revised forms
  • Author
  • Populations it’s been used with
  • Reliability and validity information
  • Scales and subscales used
  • Next in this session, you will write a research question and hypothesis that might utilize this instrument.

*

*

Research Question to Hypotheses—1

  • Suppose you were interested in studying work fatigue, and you had a theoretical or empirical reason to expect that managers, techies, and regular staff within an organization would differ on each of the three types of work fatigue.
  • What would the research question and accompanying hypotheses look like?
  • Research Question: To what extent do managers, techies, and regular staff differ on physical work fatigue, mental work fatigue, and emotional work fatigue?

*

*

Research Question to Hypotheses—2

  • Suppose you also had a measure of “intent to leave the organization” and had a theoretical or empirical reason to expect that the three types of fatigue predict intent to leave.
  • Research Question: To what extent do managers, techies, and regular staff differ on physical work fatigue, mental work fatigue, and emotional work fatigue?

*

*

Research Question to Hypotheses—2

  • Null Hypothesis 1: The combined effect (Multiple R) of physical work fatigue, mental work fatigue, and emotional work fatigue will not predict intent to leave the organization.
  • Alternative Hypothesis 1: The combined effect (Multiple R) of physical work fatigue, mental work fatigue, and emotional work fatigue will predict intent to leave the organization.

*

*

Research Question to Hypotheses—2

  • Null Hypothesis 2: The unique effects (i.e., partial correlations) of physical work fatigue, mental work fatigue, and emotional work fatigue will be equal in predicting intent to leave the organization (all pairwise z-tests of Fisher transformed part correlations will be nonsignificant, p > .05)
  • Alternative Hypothesis 2: The unique effects (i.e., part correlations) of physical work fatigue, mental work fatigue, and emotional work fatigue will not be equal in predicting intent to leave the organization (at least one pairwise z-test of Fisher transformed part correlations will be significant, p < .05)

*

*

Activity #2: Research Question and Hypothesis

  • Work individually or in small groups.
  • Draft a research question and hypothesis based on the instrument you found.

*

*

Population and Sampling

  • Sampling: The method used to select participants from the population.
  • Your choice of sampling method determines how valid it will be to infer that your findings are true for the entire population.

*

*

Population and Sampling

  • The most externally valid sampling technique is:
  • Free from bias (every individual has an equal chance of being selected); and
  • Reliable (you will get the same results each time you study the population)
  • Know the difference between:
  • Probability sampling (random); and
  • Non-probability sampling (convenience)

*

*

Sampling and Sample Size

  • Describe sampling time frame.
  • Describe inclusion and exclusion criteria. What criteria would allow one to participate?
  • Determine the number of participants needed to find a significant result or effect (i.e., sample size or power analysis).
  • Consider the anticipated response rate.
  • Be sure to justify the number of participants chosen.

*

*

Recruitment

  • Recruitment options
  • Participant pool
  • Online recruitment
  • Flyers and other forms of community advertising
  • Recruitment strategies
  • Tailor recruitment to population and type of study
  • Use community partners
  • Provide incentives/compensation
  • Address barriers including language, childcare, transportation

*

*

From Research Question to Population and Sampling

  • Research Question: To what extent do managers, techies, and regular staff differ on physical work fatigue, mental work fatigue, and emotional work fatigue?
  • What is the population?
  • How might you sample from the population?

*

*

Activity #3: Population, Sampling, Recruitment

In small groups, using your own research question:

  • Identify your population.
  • Identify your sampling strategy.
  • Identify how you will recruit your sample group.

*

*

Data Collection

  • In-person data collection
  • Advantages
  • Disadvantages
  • Online data collection
  • Advantages
  • Disadvantages
  • Archival data (data that have already been collected)
  • Advantages
  • Disadvantages

*

*

Internal Validity/External Validity

  • Internal Validity: Addresses how well the study was done, how confident you are that the results you found are the “truth.”
  • Control of confounders
  • Information bias (e.g., misclassification)
  • Presence of control group
  • Effects of time (e.g., history, maturation), etc.
  • External Validity: How generalizable are these results beyond the study population?
  • Selection biases

*

*

Ethical Considerations

  • In this section of the proposal, you will outline your plans for ensuring the autonomy, privacy, and confidentiality of participants and corresponding protections for their data (e.g., informed consent procedures, data security).
  • All student research at Walden must obtain Institutional Review Board (IRB) approval prior to data collection.
  • IRB review and approval ensures the protection of human participants and their data.

*

*

Data Analysis Plan

Include the following components:

  • Identify the software you are using for analysis.
  • Describe data screening procedures.
  • Describe plans for descriptive statistics, any planned recoding of variables.
  • Restate the research hypotheses and, after each hypothesis, describe how you plan to analyze the data.

*

*

Data Analysis Plan Example

  • Data will be exported from SurveyMonkey to SPSS 23.0 for data analysis.
  • Data will be screened for missing and outlier responses.
  • Descriptive statistics will be calculated for all variables.

*

*

Data Analysis Plan Example, continued

  • A mean composite score for physical work fatigue will be computed and analyzed for reliability, as indexed by Cronbach’s α.
  • Null Hypothesis 1: Managers, techies, and regular staff do not differ on physical work fatigue.
  • Alternative Hypothesis 1: Managers, techies, and regular staff do differ on physical work fatigue.

*

*

Data Analysis Plan Example, continued

  • ANOVA post hoc tests using a Tukey HSD alpha adjustment will be examined for differences on physical work fatigue scores between managers and techies; managers and regular staff; and techies and regular staff.

*

*

Report Out

Any volunteers to share:

  • Instrument found
  • Research questions
  • Research hypotheses
  • Population and sampling strategy
  • Analysis plan

*

*

Wrap Up and Questions

  • The purpose of this session was to describe the components of Chapter 3.
  • Use the quantitative checklist to organize your chapter and complete the other sections.
  • Quantitative Checklist can be found on the Center for Research Quality website.

*

Feedback Survey

  • Please take 2 minutes right now to complete feedback for this session in the Residency App.

*