Burt L的 Monro-Power Analysis for Traditional and Modern.pptVIP

Power Analysis for Traditional and Modern Hypothesis Tests Kevin R. Murphy Pennsylvania State University Power Analysis Helps you plan better studies Helps you make better sense of existing studies Is not limited to traditional null hypothesis tests Application of power analysis to minimum-effect tests will be discussed Errors in Null Hypothesis Tests Power Depends On Effect Size How large is the effect in the population? Sample Size (N) You are using a sample to make inferences about the population. How large is the sample? Decision Criteria - ? How do you define “significant” and why? Power Analysis and the F Distribution The power of most statistical tests in social sciences (e.g., ANOVA, regression, t-tests, other linear model statistics) can be evaluated via the familiar F distribution F is a ratio of observed effect to error F= MS treatments / MS error F = (True Effect + Error) / Error The larger the true treatment effect, the larger F you expect to find If the null hypothesis is correct, E(F) = 1.0 How Does Power Analysis Work? The Noncentral F Distribution A Larger Effect Power Functions Power Functions How to Increase Power Increase N Effects of adding more subjects are not identical to those of adding more observations Increase ES Choose a different research question Use stronger treatments or interventions Use better measures Use a more lenient alpha p.05 is driven by force of habit, not necessarily by substantive concerns Effects of Implementing Power Analysis Stronger studies Larger samples, better measures Fewer studies Adequate studies are harder to do than most people realize Less emphasis, in the long term, on null hypothesis testing Conducting a Power Analysis The classic text in this field is still one of the best sources Cohen, J. (1998). Statistical power analysis for the behavioral sciences (2nd Ed.). Erlbaum More current (and more accessible) sources include Lipsey, M. (1990). Design sensitivity. Sage Murphy, K.