语言测试基础PPT.pptVIP

Language Testing Basic principles What is Measurement Measurement in the social sciences is the process of quantifying the characteristics of persons according to explicit procedures and rules. Quantification: assign numbers Characteristics: physical and mental characteristics of persons (abilities/construct) Procedures and rules: replicable, for other observers, in other contexts and with other individuals. What is Test? Carroll (1968): a psychological or educational test is a procedure designed to elicit certain behavior from which one can make inferences about certain characteristics of an individual. Bachman (1990): a test is a measurement instrument designed to elicit a specific sample of an individual’s behavior. Characteristics that limit measurement (1/2) Limitations in specification Two levels of specification: Theoretical level Operational level Characteristics that limit measurement (2/2) Limitations in observation and quantification indirectness Incompleteness Imprecision (ordinal instead of interval) Subjectivity (test developers’ choice of items subjective scoring) Relativeness (no perfect norm of language use) Thus, a major of language test development is to minimize the effects of these limitations. Classifying different types of language test (1/3) Intended Use Selection Entrance Diagnostic Placement Achievement Research Classifying different types of language test (2/3) Content Proficiency test (theory-based) Achievement test (syllabus-based) Language aptitude test Classifying different types of language test (3/3) Frame of reference Norm-referenced test (test results are interpreted with reference to the performance of a given group.) Typical norms: mean, average score, standard deviation. Criterion test (syllabus-based) Difference: Discriminativeness Measure of variability Standard deviation and normal distribution Test qualities Reliability: consistency of measurement; minimize error variance Test qualities Construct validity