Reliability validity信度效度.ppt

Reliability and Validity Designs Accurate and consistent measures are needed It is very important in research and clinical practice to be able to measure patient characteristics accurately and consistently Needed in clinical trials to effectively assess differences between groups Needed in practice to help make clinical decisions and to track patients’ progress Reliability The ability of a test to provide consistent results when repeated By the same examiner Or by more than one examiner testing the same attribute on the same group of subjects Specific research designs are utilized to determine the degree tests are reliable Validity The degree to which a test truly measures what it was intended it to measure Valid tests characteristic being measured changes changes occur in the test measurement Tests with reduced validity do not reflect patient changes very well Measurement error All measurements have some degree of error Observed score = True score + Error group of subjects, variation of true scores occurs because of Individual differences of the subjects Plus an error component This results in a distribution (hopefully normal) Random errors Errors that are attributable to the examiner, the subject, or the measuring instrument Have little effect on the group’s mean score because the errors are just as likely to be high as they are low For example, blood pressure which is variable depending on a number of factors Systematic errors Errors that cause scores to move in only one direction in response to a factor that has a constant effect on the measurement system Considered to be a form of bias For example, a sphygmomanometer that is out of calibration and always generates high BP readings Error components Estimating reliability The proportion of true score variance divided by the observed score variance True score variance Real differences between subjects’ scores due to biologically different people Observed score variance The portion of variability t