渥太华大学统计英文课件lecture 8.pptVIP

1999 Lecture 8: Multiple comparisons What are multiple comparisons? The problem of experiment-wise a error When do we do multiple comparisons? Statistical tests which control ae Estimating treatment effects What are multiple comparisons? Pair-wise comparisons of different treatments These comparisons may involve group means, medians, variances, etc. for means, done after ANOVA In all cases, H0 is that the groups in question do not differ. Types of comparisons planned (a priori): independent of ANOVA results; theory predicts which treatments should be different. unplanned (a posteriori): depend on ANOVA results; unclear which treatments should be different. Test of significance are very different between the two! Planned comparisons (a priori contrasts): catecholamine levels in stressed fish Comparisons of interest are determined by experimenter beforehand based on theory and do not depend on ANOVA results. Prediction from theory: catecholamine levels increase above basal levels only after threshold PAO2 = 30 torr is reached. So, compare only treatments above and below 30 torr (NT = 12). Unplanned comparisons (a posteriori contrasts): catecholamine levels in stressed fish Comparisons are determined by ANOVA results. Prediction from theory: catecholamine levels increase with increasing PAO2 . So, comparisons between any pairs of treatments may be warranted (NT = 21). The problem: controlling experiment-wise a error For k comparisons, the probability of accepting H0 (no difference) is (1 - a)k. For 4 treatments, (1 - a)k = (0.95)6 = .735, so experiment-wise a (ae) = 0.265. Thus we would expect to reject H0 for at least one paired comparison about 27% of the time, even if all four treatments are identical. Controlling experiment-wise a error at nominal a by adjusting by total number of comparisons To maintain ae at nominal a, we need to adjust a for each comparison by the total number of comparisons. In this manner, ae becomes independent of the number of treatment