Selecting A Statistical Test
Selecting A Statistical Test
There are two types of test data and consequently different types of analysis. As the table below shows, parametric data has an underlying
normal distribution which allows for more conclusions to be drawn as the shape can be mathematically described. Anything else is
non-parametric.
Parametric Non-parametric
Assumed distribution Normal Any
Assumed variance Homogeneous Any
Typical data Ratio or Interval Ordinal or Nominal
Data set relationships Independent Any
Usual central measure Mean Median
Simplicity; Less affected by
Benefits Can draw more conclusions
outliers
Tests
Choosing Choosing parametric test Choosing a non-parametric test
Correlation test Pearson Spearman
Independent measures, 2 groups Independent-measures t-test Mann-Whitney test
Independent measures, >2 One-way, independent-measures
Kruskal-Wallis test
groups ANOVA
Repeated measures, 2 conditions Matched-pair t-test Wilcoxon test
Repeated measures, >2 One-way, repeated measures
Friedman's test
conditions ANOVA
Choosing a non-parametric test
Choosing the test
How many separate samples?
How many scores for each subject?
How many measurement categories?
1 2 Binomial test
1 2+ Chi-square test for goodness of fit
Can difference scores be ranked?
2 Y Wilcoxon test
N Sign test
Matched samples? (N = independent)
Can difference scores be ranked?
Y Y Wilcoxon test
N Sign test
2
Can scores be ranked with few tied values? (independent samples only)
Y Median test
N
Y Mann-Whitney test
N Chi-square test for independence
Can scores be ranked with few tied values? (independent samples only)
Y Median test
>2
N Chi-square test for independence
N Krushkal-Wallas test