journal
FCS681
Types of Research Design:
Non Experimental
Hira Cho
*
Types of Designs
Treatment ?
control group?
yes
no
yes
no
true experiment
quasi-experiment
non-experiment
*
Random Assignment?
no
- Manipulation of IV
- High degree of control
- Random Assignment
- No random assignment
- Threat to Internal Validity
- Need more evidence
- No manipulation
- Little of no control
- New phenomena
- Description, observation, no causal
*
Experimental vs. Non Experimental
- Manipulation of IV
(Treatment or Intervention)
- Observation of the influence
Independent Variable -------------------Dependent Variable
- No manipulation
- No control group
- Just observation
VS.
Types of Research
- Experimental
- Quasi-Experimental
- Non Experimental
Non-Experimental Design
Non-Experimental Design is used to;
Construct a picture of a phenomenon
Explore events, people, or situations as they naturally occur
Test relationships and differences among variables
Types
Description
Frequency, percentages, averages, graphs, etc.
Comparison (t-test or one-way ANOVA)
Difference in two group of subjects (Ex. Math scores by gender)
Correlation (regression)
Ex. Math achievement and math attitudes
Prediction (regression)
Ex. Prediction of math achievement based on math attitudes
*
- Http://wps.ablongman.com/ab_mcmillan_edresearch_4/16/4151/1062662.cw/index.html
- Descriptive Designs
- Construct a picture of a phenomenon
- Explore events, people, or situations as they naturally occur
- Frequency, percentages, averages, graphs, etc.
- Criteria for evaluating descriptive studies
- 1.Conclusions about relationships should not be drawn
- 2.Subjects and instruments should be described completely
- Relationship designs
- Test relationships and differences among variables
- Comparative:
- Difference in two group of subjects
- Ex. Math scores by gender
- Correlational
- Simple correlation
- Ex.Math achievement and math attitudes
- Prediction
- Ex. Scores from a mathematical attitude scale are used to predict math achievement scores
- Causal-comparative designs
- Ex-post-facto
- When it is impossible or unethical to manipulate the independent variable
- Ex. what is the effect of pre-kindergarten (Pre-K) attendance on first grade achievement
- Correlational causal-comparative studies
- Use of correlational models to investigate possible cause and effect relationships
- Sophisticated statistical models: Path analysis & Structural equation modeling
- Example of comparative design
- If math scores for males are significantly higher than those for females, a relationship exists between gender and math achievement
- If the academic self-concept scores for ninth graders are significantly different than those for twelfth graders, a relationship exists between grade level and academic self-concept
- If the third grade achievement scores for whites are not significantly different that those for non-whites, no relationship exists between ethnicity and achievement
- Simple Correlation
- Math achievement and math attitudes
- Teacher effectiveness and teacher efficacy
*
Cross-section design
Bivariate: X O
Multivariate: X O
Y1
Y2
Longitudinal time series design
X | X | X | X | X | X | ---
O | O | O| O| O| O| ---
Panel Design?
Examples
Household production theory:
Families are both producers and consumers of goods.
In an effort to maximize utility, families attempt to efficiently allocate time, income, and the collection of goods and services they both use and produce.
Study of the household production, consumption and household time allocation.
Time spent in hhp = f(agewife)
http://simpleeconomist.com/household-production-theory/
Household production
Market production
Leisure
Basic Concepts, Relationships Between Concepts and Assumptions
The basic concepts that are consistent across several different definitions of household production theory are household production, consumption and time allocation. Household production relates to all the output that a household produces including production related to work. Household consumption includes all things that are consumed by a household including things like food, sleep, and leisure.
Consumption theory is often predicated on the idea of diminishing marginal utility. This idea implies that we will diversify our consumption because increased consumption of the same good will give us less utility after a certain point.
Finally, time allocation refers to the exact way we spend each minute of our day. Time allocation also introduces the basic concept of opportunity cost, explaining that every minute we allocate to one activity, by definition, can not be allocated to any other activity.
The main assumption of household production theory is that consumers act as rational actors. The overall theory’s goal is to explain the interactions and relationships between consumption, production and time.
*
Time spent in hhp = f(agewife)
A. In 1995, a researcher collected data on time allocation of house wives and their ages. The researcher analyzed the relationship between the two variables through a simple regression (wives’ household production time - their age).
What is the name of this design? Suggest one improvement you could make in this design.
Source: Godwin, D. (1992)
Time spent in hhp = f(agewife)
B. A researcher samples a group of 60-69 year old wives in 1995 and asks them to recollect different period of their lives and report on their time allocation at specific dates (e.g., in 1955, when the women were 20-29, again in 1965, when the women were aged 30-39, etc.)
What is the name of this design? What is its key weakness?
Source: Godwin, D. (1992)
Cross-sectional
*
Time spent in hhp = f(agewife)
C. The first data are collected from all age groups, aged 20-79, from a random sample of subjects in 1985. In 1995, another random sample of subject is taken and the same data, using the same instruments, are collected. Again in 2005, the same data are collected with the same instruments, from a third random sample of the population. She analyzes the time use of each age group across time.
What is the name of this design? What specific question in this research study does it answer best?
Source: Godwin, D. (1992)
Time spent in hhp = f(agewife)
D. The first data collection from a random sample of subjects aged 20-79 in 1985. In 1995, another random sample is taken and the same data, using the same instruments, are collected. Again in 2005, the same data are collected with the same instruments from a third random sample.
The researcher examines those in the 1985 sample who were in the same age groups as they would have aged over 10 years until 1995 and aged another 10 years by 2005. For example, she studies the 30-39 year olds in 1995 in comparison to the 1985 sample of 20-29 year olds and the 2005 sample of 40-49 year olds.
What is the name of this design? Discuss one of its key advantages.
Source: Godwin, D. (1992)
Time series
*
Time spent in hhp = f(agewife)
E. A researcher draws a sample in 1985 of a group of 20-59 year old wives, to survey their household production and age. In 1995, the researcher recontacted and reinterviewed the same sample and measures the same two variables in the same way. The researcher reinterviewed the same sample again in 2005, measuring the same variables with the same instruments.
What is the name of this design? Discuss its one most advantageous feature.
Source: Godwin, D. (1992)
Longditudinal-panel
*
Practice
Based on your group research proposal, develop a non experiment design (you can modify the current model for this practice).
State the alternative hypothesis
Specify the population
Diagram the design using the notations (R X Y O)
Explain the potential threats to the validity
Non Experimental Design
*
Discussion Leader
- Sampling
Group Discussion
- Possible theory/framework
- Possible methodology
- Group report (Mar. 14, by midnight)
A. Your theory
1) The visual image of the concept/model with the source
2) A brief introduction
3) How to apply the theory to your proposal
B. Your Research Design
Possible methods
Define the population
Possible threats
*In the heading, include the title/names/key words (as in your previous report)
*Use page numbers
Assignment for week 9
- Due: Mar 18, by noon, through Moodle
- Three part journal
- Individual Assignment: Preliminary paper outline
*Please bring the hard copy to the class (I will collect it)
- Due: Mar 18, In class
- Take Home Exercise 4: Download the exercise from the Moodle, work on it, and bring the hard copy to the class for week 8
- Due: Mar. 21 (Sat), by midnight, through Moodle
- Turn in an updated group report.
- Discussion Leader for Week 13 (Apr. 15) & 15 (Apr. 29)
- Week 13: Miriam & Mayra
- Week 15: Esme & Dania
Preliminary Paper outline
Individual assignment for week 9
- Organization of preliminary paper outline
- Title
- Your name
- Introduction
- Topic 1 (Heading & subheading)
- Topic 2 (Heading & subheading)
- Topic 3 (Heading & subheading)
- Methodology (not necessary in this stage)
*Use at least three topics for the headings. In each topic you will need multiple subheadings (refer to an journal article).
*For each of heading or subheading, you will provide the summary of the contents in a paragraph.
*Use page numbers!!