Non-Parametric Models
Running head: UNIT 6 1
UNIT 3 15
Unit 6: Non-Parametric Models
Student
Capella University
Quantitative Research Techniques
Dr. Brock Boudreau
May 1, 2018
Table of Contents
Cove Page ……………………………………………………………………………………………………………………………………………………………………………………………………………………......……...1
Table of Contents ……………………………………………………………………………………………………………………………………………………………………………………………………….….………..…2
Abstract ……………………………………….…………………………………………………………………………………………………………………………………………………………………….……...……….…3
Section A …………………….……………………………………………………………………………………………………………………………………………………………………………………………………......….4
Section B...………………………………..……………………………………………………………………………………………………………………………………………………………………..………………….....….5
Section C …..………………………………………………………………………………………………………………………………………………………………………………………………………………………….….6
Section D …..………………………………………………………………………………………………………………………………………………………………………………………………………………………....….7
Conclusion……………………………………………………………………………………………………………………………………………………………………..…………….……………………………………....…...8
References …………………………………………………………………………………………………………………………………………………………………………………………………………………….…….…...9
Abstract
Nonparametric methods are known as distribution-free tests because they assumptions are typically not required about population distribution (Field, 2013). Thus, nonparametric methods may be used when parametric ssumptions are not satisfied where ranks of observations are used instead of the measurements themselves. However, Cummings (2014) cautions that this method may cause somewhat loss of information. Nonparametric methods mainly test the pre-set hypothesis. For example, whether two data differ or not. As a result, nonparametric methods usually don't provide any useful parameter estimates. The subsequent document presents four sections of calculations using nonparametric testing and Offers dataset.
Keywords: nonparametric, sampling, methods, assuptions.
Unit 6 Assignment 1
The Mann-Whitney test, also called the Wilcoxon-Mann-Whitney test (Cumming, 2014; Field, 2013), is a nonparametric and rank-based test useful in determining the differences between two groups on a continuous or ordinal dependent variable. The subsequent document is structured in four main sections using the Oxoby (2008) Offers dataset. The first section, Section A, presents a research question appropriate for the Mann-Whitney test stating their null and alternative hypotheses along with the levels of measurement. The decision tree as well as the significance level for the test are also identified. The second section, Section B, presents any missing data, outliers and assumptions. The third section, Section C, presents the relevant graphs for visualization and analysis. The Mann-Whitney test results will also be reported and interpreted identifying the null hypothesis and make a decision whether to reject the hypothesis. Finally, in the fourth section, Section D, a justification for the decision and interpretation will be provided. The third section presents a G*Power computation and analysis with an interpretation of the results and a conclusion.
Section A
This section provides information about the study and the tests to be conducted specifically including:
1. The research question, the null and the alternative hypotheses;
2. The levels of measurement used and the significance level;
3. The selection process using the Decision Tree (Field, 2013).
For the Oxoby (2008) Offers dataset, the nominal variable is music (plotted on the x-axis), while offer is scale (plotted on the y-axis), with a Confidence Level =95% and Significance = .074, the following applies:
Research Question (RQ): Was there a significant difference between offers made in listening to Bon Scott compared to those listening to Brian Johnson?
Ho: The distribution of offers made in dollars is the same across categories of background music.
H1: The distribution of offers made in dollars is not the same across categories of background music.
Therefore, offers made by people listening to Bon Scott, with a median=30, were not significantly different from offers by people listening to Brian Johnson, with a median, U= 218.50, z = 1.85, p = .074, r = .31. These results were derived from Mann-Whitney tests Table 1a.
Table 1a
The Decision Tree
In using the Decision Tree (Field, 2013), analyzing the Oxoby dataset could begin by looking at the differences between sets of measurements, in contrary to looking for association. Next, the scores are ranked. Next, it was necessary to determine the number of samples to be tested and there were two; therefore, Mann-Whitney U test could be utilized (Cumming, 2014). The Mann-Whitney U test was selected for the purpose of the study in search of the differences between offers without any expected outcomes, without any correlations, without frequencies to consider and without any matched sets of variables or repeated measures to use. This particular study is not concerned about testing for or using those factors. For these reasons, the appropriate test to be conducted is the Mann-Whitney U test (Field, 2013).
Section B
When conducting a test, outliers must be identified and addressed by removing them (Cumming, 2014). Using the box plot to remove them is an accepted method of doing so for further analysis (Field, 2013). Thus, the variables could be removed by recoding them and replotting them without the outlying values. The test of normality and homogeneity of variance will provide the testing for assumptions in this section including:
1. Identifying missing data and outliers;
2. Tests of assumptions;
3. Graphs for visual analysis; and,
4. The results and conclusions.
The predictor, Brian Scott has three outliers, scores of 1, 5 and 5. While Brian Johnson predictor has one outlier, a score of 2. The lines outside the boxplots demonstrate the outliers (Figure 1). Finally, it is important to report that there were no missing values, N=0; this is substantiated by the Case Processing Summary of the SPSS output (Table 1). Finally, Figure 2 presents the boxplots after the outliers have been removed, as recommended by Field (2013) for further analysis.
Figure 1 Figure 2
|
Case Processing Summary |
|||||||
|
|
Offer Made ($) |
Cases |
|||||
|
|
|
Valid |
Missing |
Total |
|||
|
|
|
N |
Percent |
N |
Percent |
N |
Percent |
|
Background Music |
1 |
1 |
100.0% |
0 |
0.0% |
1 |
100.0% |
|
|
2 |
5 |
100.0% |
0 |
0.0% |
5 |
100.0% |
|
|
3 |
10 |
100.0% |
0 |
0.0% |
10 |
100.0% |
|
|
4 |
10 |
100.0% |
0 |
0.0% |
10 |
100.0% |
|
|
5 |
10 |
100.0% |
0 |
0.0% |
10 |
100.0% |
|
|
|
|
|
|
|
|
|
Table 1
Field (2013) explains that significance value of Sig. <0.05 indicates a deviation from normality. Therefore, based on the tables presented the distribution in question is significantly different from a normal distribution, it is non-normal. Therefore, Table 3 presents the Tests of Normality SPSS output while Table 3 presents the Test of Homogeneity of Variance before the outliers were removed. To report, the K-S Tests for Normality before the outliers were removed Group 2 Sig.=.001, Group 3 Sig.=.003, Group 4 Sig.=.003 and Group 5 Sig.=.000. Additionally, the Shapiro-Wilk Tests for Normality for all groups Sig.=.000. Finally, after the outliers were removed the K-S and Shapiro-Wilk Tests for Normality, Group 3 Sig.=.003, Group 4 Sig.=.000, Group 5 Sig.=.000, and all Shapiro-Wilk Tests for Normality for all groups Sig.=.000, clearly indicating that the distributions were still non-significant. Overall, before and after the outliers were removed, the K-S and Shapiro-Wilk Tests for Normality consistently indicated non-normal distribution. For these reasons, it must be noted that the SPSS output indicated that the data are not normally distributed for all groups because all of the significance values are less than .05. Therefore, we reject the null hypothesis and accept the alternate hypothesis that the data do not fit the normal distribution.
On the other hand, in conducting a Test of Homogeneity of Variance, the variance of the groups should not change as the test go through the levels (Field, 2013). This means the variance of the outcome variables (the offers made, in dollars) should be the same in each of the groups. Thus, the Levene’s Test of Homogeneity of Variance tests the null hypothesis that the variances in different groups are equal. To report, the Levene’s test is non-significant at Sig. =.089 before the outliers were removed and the value of Sig. =.963 after, also non-significant because both values Sig.>.05. Therefore, it can be concluded that the null hypothesis is correct and the variances are not significantly different. For this reason, the assumption of homogeneity has been met.
|
Test of Homogeneity of Variancea |
|||||
|
|
Levene Statistic |
df1 |
df2 |
Sig. |
|
|
Background Music |
Based on Mean |
2.375 |
3 |
31 |
.089 |
|
|
Based on Median |
1.782 |
3 |
31 |
.171 |
|
|
Based on Median and with adjusted df |
1.782 |
3 |
12.938 |
.200 |
|
|
Based on trimmed mean |
2.375 |
3 |
31 |
.089 |
|
a. Background Music is constant when Offer Made ($) = 1. It has been omitted. |
|
Tests of Normalitya |
|||||||
|
|
Offer Made ($) |
Kolmogorov-Smirnovb |
Shapiro-Wilk |
||||
|
|
|
Statistic |
df |
Sig. |
Statistic |
df |
Sig. |
|
Background Music |
2 |
.473 |
5 |
.001 |
.552 |
5 |
.000 |
|
|
3 |
.329 |
10 |
.003 |
.655 |
10 |
.000 |
|
|
4 |
.329 |
10 |
.003 |
.655 |
10 |
.000 |
|
|
5 |
.433 |
10 |
.000 |
.594 |
10 |
.000 |
|
a. Background Music is constant when Offer Made ($) = 1. It has been omitted. |
|||||||
|
b. Lilliefors Significance Correction |
Table 2 Table3
|
Tests of Normality |
|||||||
|
|
Offer Made ($) |
Kolmogorov-Smirnova |
Shapiro-Wilk |
||||
|
|
|
Statistic |
df |
Sig. |
Statistic |
df |
Sig. |
|
Background Music |
3 |
.329 |
10 |
.003 |
.655 |
10 |
.000 |
|
|
4 |
.353 |
11 |
.000 |
.649 |
11 |
.000 |
|
|
5 |
.350 |
15 |
.000 |
.643 |
15 |
.000 |
|
a. Lilliefors Significance Correction |
|
Test of Homogeneity of Variance |
|||||
|
|
Levene Statistic |
df1 |
df2 |
Sig. |
|
|
Background Music |
Based on Mean |
.038 |
2 |
33 |
.963 |
|
|
Based on Median |
.030 |
2 |
33 |
.971 |
|
|
Based on Median and with adjusted df |
.030 |
2 |
23.997 |
.971 |
|
|
Based on trimmed mean |
.038 |
2 |
33 |
.963 |
Table 4 Table 5
Finally, the following Q-Q plots, Figures 3 through 10, presents the graphs for illustrating how the dots deviated from the diagonal lines before and after the outliers were removed. Therefore, it can be concluded that there is deviation from normality.
Figure 3 Figure 4 Figure 5 Figure 6
Figure 7 Figure 8 Figure 9 Figure 10
Section C
According to Field (2013), nonparametric models require no assumptions about the data and may be used with scores that are not in any numerical sense. The Mann-Whitney Test (Field, 2013) is an example of a nonparametric testing that can show the median between 2 sets of data. This section includes:
1. Graphs for analysis;
2. Test of the null hypothesis and a report of the results;
3. An interpretation of the results; and,
4. A decision whether to reject the hypothesis or otherwise.
To report, using the Oxoby (2008) dataset, the distribution was significantly non-normal with a confidence interval= 95%, effect size= .308, U=218.5, Ws =30.54, N=36, Test Statistic=1.850, and p= .074, resulting in non-significant value>.05 between the number of listener offers made to Bon Scott with a mean rank= 15.36 than Brian Johnson, mean rank =21.64. Overall, the null hypothesis should be retained, stating that the distribution of the Offers is the same for both Bonn Scott and Brian Johnson as substantiated by the table below, Table 14:
Table 6
Section D
According to Cummings (2014), the power of a statistical test denotes the Type II Error or Beta Error probability of falsely retaining an incorrect H0. Further, statistical power depends on three classes of parameters (Saha & Jones, 2016) which are: (1) the significance level; (2) the size(s) of the sample(s); and (3) an effect size parameter defining H1 and thus indexing the degree of deviation from H0 in the underlying population. Simply, the G*Power is helpful in determining the sample size required to detect an effect of a given size, when confidence interval is known.
Overall, as the power level increases, so too did the sample sizes. The following G*Power analysis shows df= 152.69, T= 1.453, total sample size= 162 and a statistical power = .95 indicating that there is 95% probability of detecting an effect. As a result, with this statistical power, the calculated effect size=.371. According to Cummings (2014), studies should have no more than a 20% probability of making a Type II error. In other words, Cummings believed (2014) studies should have an 80% probability of detecting an effect when there is an effect there to be detected.
Figure 11
t tests - Means: Wilcoxon-Mann-Whitney test (two groups)
Options: A.R.E. method
Analysis: A priori: Compute required sample size
Input: Tail(s) = One
Parent distribution = Normal
Effect size d = 0.5
α err prob = 0.074
Power (1-β err prob) = 0.95
Allocation ratio N2/N1 = 1
Output: Noncentrality parameter δ = 3.1094473
Critical t = 1.4539949
Df = 152.6986
Sample size group 1 = 81
Sample size group 2 = 81
Total sample size = 162
Actual power = 0.9507452
Overall, the G*Power results indicate that there is a 95% probability that an effect will be detected if there is an effect and a sample size of 162 is necessary. The main limitation of the study is the relatively small current sample size of 36. However, with the homogeneity assumptions has been met with Levene’s value before outliers were removed Sig.=.089 and Sig. =.963 after the outliers were removed. On the other hand, the Q-Q plots and box plots indicated non-normality of distribution and the null hypothesis is retained:
Ho: The distribution of offers made in dollars is the same across categories of background music.
Therefore, offers made by people listening to Bon Scott, with a median=30, were not significantly different from offers by people listening to Brian Johnson and as substantiated by the G*Power value =95%, there is a 95% probability that an effect will be detected if there is an effect.
Conclusion
Thus far, the preceding discussion was structured into four sections and it presented the nonparametric and rank-based test, the Mann-Whitney test, the null and alternative hypotheses along with the levels of measurement, the decision tree as well as the significance level for the tests; the missing data, outliers and the assumptions. All the relevant graphs for visualization and analysis were also presented showing deviation from normality. Finally, the report and interpretation to retain the null hypothesis were also discussed. This was summed up by the supporting explanation of the G*Power value = .95 stating a 95% probability that an effect would be detected, if it is present
References
Cumming, G. (2014). The New Statistics: Why and How. Psychological Science, 25 1.
Faul, F., Erdfelder, E., Buchner, A., & Lang, A-G. (2009). Statistical Power Analyses Using G*Power 3.1: Tests for Correlation and Regression Analyses. Behavior Research Methods, 41(4), 1149–1160.
Field, A. (2013). Discovering Statistics Using IBM SPSS Statistics, 4th ed. SAGE Publications (UK).
0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95 0
20
40
60
80
100
120
140
160
To ta
l s am
pl e
si ze
= 0.5
Effect size d
t tests - Means: Wilcoxon-Mann-Whitney test (two groups) Tail(s) = One. Parent distribution = Normal. Allocation ratio N2/N1 = 1. α err prob = 0.074. Effect size d = 0.5
Power (1-β err prob)
0.60.650.70.750.80.850.90.95
0
20
40
60
80
100
120
140
160
T
o
t
a
l
s
a
m
p
l
e
s
i
z
e
= 0.5
Effect size d
t tests - Means: Wilcoxon-Mann-Whitney test (two groups)
Tail(s) = One. Parent distribution = Normal. Allocation ratio N2/N1 = 1. α err prob = 0.074. Effect
size d = 0.5
Power (1-β err prob)