《心理测量》Ch7 Item Analysis项目分析.ppt

Chapter 7 Item Analysis In constructing a new test (or shortening or lengthening an existing one), the final set of items is usually identified through a process known as item analysis. —Linda Croker Both the validity and the reliability of any test depend ultimately on the characteristics of its items. Two Approaches of Item Analysis Qualitative Analysis Quantitative Analysis Qualitative Analysis includes the consideration of content validity (content and form of items), as well as the evaluation of items in terms of effective item-writing procedures. Quantitative Analysis includes principally the measurement of item difficulty and item discrimination. §1 Item Difficulty 1. Definition The item difficulty for item i, pi , is defined as the proportion of examinees who get that item correct. Though the proportion of examinees passing an item traditionally has been called the item difficulty, this proportion logically should be called item easiness, because the proportion increase as the item becomes easier. 2. Estimation Methods Method for Dichotomously Scored Item Method for Polytomously Scored Item Grouping Method Method for Dichotomously Scored Items (7.1) p is the difficulty of a certain item. R is the number of examinees who get that item correct. N is the total number of examinees. Example 1 There are 80 high school students attending a science achievement test, and 61 students pass item 1, 32 students pass item 10. Please calculate the difficulty for item 1 and 10 separately. Method for Polytomously Scored Items (7.2) Example 2 The perfect scores of one open- ended item is 20 points, the average score of total examinees on this item is 11 points. What is the item difficulty?