Common Contracts
1 similar Rater Agreement contracts
RATER AGREEMENT IN ENGLISH LANGUAGE ASSESSMENT IN THE SPANISH UNIVERSITY ACCESS EXAMINATION BATTERYRater Agreement • April 20th, 2008
The reliability of scores is of utmost importance in an examining context in which tenths of a point are often decisive in determining a student's course of study. In Spain, access to university studies is determined by passing a battery of examinations, one of which is in modern language, with English as the most widely chosen language. Two experiments using the English language test from the province of Valencia were carried out to test the hypothesis that enhanced assessment criteria would increase rater agreement, and thus the reliability of the scores. The criteria were focused holistic for the four constructed-response questions on the test, which represent 70% of the total grade. One experiment compared the scores on one hundred test papers given by four raters using the new criteria with the scores on the same one hundred papers given by four different raters following the criteria currently used. Results showed significantly higher agreement among the raters who used the enhan
