Research method 3
Final Assessment
Choice of design
Qualitative or interviews,
Quantitative via survey or
Quantitative via instruments in the field ( Field experiment)
Quantitative via instrument in the lab. Laboratory experiment
Quantitative in the field but under quasi control: Quasi experiment
Validity & Reliability
Validity is the degree at which findings align with objectives
Have your findings, tools, techniques, methods, data been selected, used correctly to meet your research objectives?
If yes, then you achieve validity, if no then you lack validity and the whole research falls apart
We have 14 different types of validity
Validity is the degree at which findings show consistency across times, and contexts
will other researchers be able to reproduce your findings in other similar contexts? Times ?
If yes, then you achieve reliability, if no then you lack reliability and the whole research falls apart
We have 5 different types of validity
Final assessment
It links your problem statement, problematization and literature review to data collection, sampling and analysis to complete your proposal
Key is to have conceptual and methodological fit between your problem, data and choice of methods
Lack of internal fit means lack of validity and absence of reliability
Examples of internal fit….
To explore how following an organization's dress codes affects staffs’ networking abilities
Is it qual or quant?
If I ask please if they follow the dress code or not. Those who follow get 1 and those who don’t get 0
Then I ask please about the degree of their networking ability by a simple question: how you assess your networking ability on a scale of one to 5 one being poor, 5 being strong
Then send this simple 2-question survey to 100 employees, and correlate the data
Internal fit…
Exploratory problems require qualitative data and qualitative sampling and methods
Convenient sampling
Judgmental sampling
Interviews
Coding and thematic analysis
Examinatory problems require quantitative data and quantitative sampling and methods
Probability sampling
Survey or instruments
T-test, ANOVA, Correlation, frequency, regression, etc.
Final Assessment
Sample, Sampling & Data
How to select sample
How many samples are needed
Ddefinition of population of interest
Final Assessment
Instrument
If interviews, what are the interview questions and how they can be validated?
If survey, what are the survey questions and how they can be referenced and validate
If instrument, what does it do? What does it measure?
We don’t need technical notes and explanations about the mechanisms and methods and design of the instrument and tools.
We just need simple explanations about how a tool is used to measure what it needs to be measured for our research
Final Assessment
Analytic method
What method and technique is used to analyze the data? Is it simple content analysis or thematic analysis or correlation, regression, ANOVA, t-test, etc.?
Note that we will not collect actual data and will not perform any actual analysis and calculation but we should be able to choose a methodologically correct technique based on our research problem, research questions and type and nature of data
Final Assessment
Analytic method
Qualitative methods are flexible and not standardized.
Qualitative text is coded in different ways to make sense.
Quantitative methods are standardized
Quantitative methods are univariate, bivariate, multivariate
When only one variable is measured it is univariate
When two variables are measured simultaneously, it becomes bivariate
When multiple variables are measured simultaneously, it becomes multivariate