Mistake #5
“Fishing” for significant results. That is, performing several hypothesis tests on a data set, and reporting only those results that are significant.
If ? = P(Type I) = 0.05, and we perform 20 tests on the same data set, we can expect to make 1 Type I error. (0.05 ×20 = 1).