《心理测量》Ch5 Reliability可靠性.ppt

Figure 5.4 Hypothetical Illustration of different Examinees’ Distributions of Observed Scores Around Their True Score Computation Formula (5.12) Use to Estimate one Examinee’s True Score Create a confidence interval around the examinee’s observed score. Example Known that the standard deviation of an intelligence scale is 15, rtt is .95. If one examinee’s IQ is 120, then create confidence interval for his/her true score. Answer: Then, How to eliminate the effect of order of forms administered? Method: First, divide one group of examinees into two parallel groups; Second, group one receives formⅠ of the test, and group two receives formⅡ; Third, after a short interval, group one receives formⅠ, and group two receives formⅡ; Compute the correlation between all the examinees’ scores on two forms of the test. Sources of Error Whether the two forms of test are parallel or equivalent, such as the consistence on content sampling, item format, item quantity, item difficulty, SD and means of the two forms. Fluctuations in the individual examinee’s mind, in-cluding emotions, test motivation, health, etc.. Other unexpected disturbance. Coefficient of Stability and Equivalence the correlation between the two group observed scores, when the two alternate test forms are administered on two separate occasions to the same examinees. FORM Ⅰ FORMⅡ INTERVAL SAME EXAMINEES Coefficients of Internal Consistency When examinees perform consistently across items within a test, the test is said to have item homogeneity. Internal consistency coefficient is an index of both item content homogeneity and item quality. Quality: One administration of a single form of test Error sources: