1.
Data Assumption & Preliminary Tests
Statistical Description Function Classification IV(s) DV(s) Design Groups Times DV Example
Tool Measured Application
Shapiro-Wilk Checks Validates Test of 0 1 — — — Checking if
Test normality assumption Normality IQ scores
for are normally
parametric distributed
tests
Kolmogorov- Compares Normality Test of 0 1 — — — Testing
Smirnov Test distribution check Normality normality of
to normal anxiety
scores
Levene’s Checks Homogeneity Test of 1 1 Between 2+ 1 Ensuring
Test equality of of variance Homogeneity equal
variances variances
before t-test
Box’s M Test Checks Multivariate Test of 1+ 2+ Between 2+ 1 Checking
equality of homogeneity Homogeneity MANOVA
covariance check assumptions
matrices
2. Parametric & Non-Parametric Inferential Tests
Statistical Description Function Classification IV(s) DV(s) Design Groups Times DV Example
Tool Measured Application
Independent Compares Tests group Parametric 1 1 Between 2 1 Depression
Samples means of 2 difference scores: male
t-test independent vs female
groups
Paired Compares Tests change Parametric 1 1 Within 1 2 Anxiety
Samples means in over time before vs
t-test same group after therapy
at 2 time
points
Mann-Whitn Non-parame Tests group Non-parametri 1 1 Between 2 1 Stress levels
ey U Test tric version difference c in two
of groups
independent (skewed
t-test data)
Wilcoxon Non-parame Tests Non-parametri 1 1 Within 1 2 Resilience
Signed-Ran tric paired within-subject c before vs
k Test test difference after
workshop
One-way Compares Tests group Parametric 1 1 Between 3+ 1 Self-esteem
ANOVA means of 3+ difference across grade
groups levels
Repeated Compares Tests change Parametric 1 1 Within 1 3+ Mood
Measures means at over time changes
ANOVA multiple time over therapy
points sessions
ANCOVA Compares Adjusts for Parametric 1+ 1 Between 2+ 1 Test
means confounders performance
controlling controlling
covariates for age
Kruskal-Wall Non-parame Tests group Non-parametri 1 1 Between 3+ 1 Satisfaction
is Test tric difference c across
alternative therapy
to One-way types
ANOVA
Friedman Non-parame Tests change Non-parametri 1 1 Within 1 3+ Emotional
Test tric over time c ratings
alternative across 3
to RM time points
ANOVA
3. Correlation & Regression Analyses
Statistical Description Function Classification IV(s) DV(s) Design Groups Times DV Example
Tool Measured Application
Pearson’s r Measures Tests Parametric — 2 — — 1 Correlating test
linear correlatio continuous anxiety &
relationship n variables performance
Spearman’s Measures Tests Non-parametric — 2 — — 1 Resilience & life
rho monotonic correlatio satisfaction
relationship n
Point-Biserial Correlation Tests Parametric — 2 — — 1 Gender &
Correlation between associatio empathy scores
binary & n
continuous
Phi Correlation Tests Non-parametric — 2 — — 1 Pass/fail &
Coefficient between associatio attendance
two binaries n
Simple Predicts DV Predictive Parametric 1 1 — — 1 Predicting GPA
Linear from one IV modeling from study hours
Regression
Multiple Predicts DV Predictive Parametric 2+ 1 — — 1 Predicting
Regression from modeling performance
multiple IVs from cognitive &
personality
scores
Logistic Predicts Predictive Non-parametric 1+ 1 binary — — 1 Predicting
Regression binary DV modeling dropout risk
4. Reliability & Validity Analyses
Statistical Description Function Classification IV(s) DV(s) Design Groups Times DV Example
Tool Measured Application
Cronbach’s Internal Reliability Internal — 1 scale — — 1 Self-esteem
Alpha consistency measure Consistency scale reliability
KR-20 Internal Reliability Internal — 1 scale — — 1 True/false test
consistency measure Consistency reliability
for
dichotomous
items
KR-21 Simplified Reliability Internal — 1 scale — — 1 Quick quiz
KR-20 measure Consistency reliability
Split-Half Splits test & Reliability Internal — 1 scale — — 1 Motivation scale
Reliability correlates measure Consistency reliability
halves
Test-Retest Correlates Reliability Stability Over — 1 — — 2+ Stability of IQ
Reliability scores over measure Time test scores
time
Krippendorff’s Inter-rater Validity/Reliability Inter-Rater — 1 — 2+ 1 Agreement on
Alpha agreement Reliability raters behavioral
coding
Fleiss’ Kappa Agreement Validity/Reliability Inter-Rater — 1 — 3+ 1 Agreement on
among 3+ Reliability raters diagnosis
raters
Cohen’s Agreement Validity/Reliability Inter-Rater — 1 — 2 raters 1 Agreement on
Kappa between 2 Reliability anxiety severity
raters
Content Expert rating Validity measure Content — 1 — Experts 1 Checking item
Validity Index of items Validity relevance
Factor Identifies Validity measure Construct — Multiple — — 1 Identifying
Analysis underlying Validity factors in
constructs personality tests
