The reasoning: the testing framework
- State H₀ (no difference/association) and H₁ (two‑sided unless strongly justified).
- Pre‑specify α (usually 0.05).
- Compute a test statistic (t, χ², Z) from the data.
- p‑value = probability, under H₀ and the model assumptions, of obtaining a statistic at least as extreme as observed.
- If p < α, reject H₀ ("statistically significant"); otherwise "fail to reject".