INTER-RATER AGREEMENTInter-Rater Agreement • August 17th, 2011
Contract Type FiledAugust 17th, 2011Grade Item Number Number of ScoreCategories Number of ResponsesScored Twice Percent Exact Percent Adjacent Correlation Percent of ThirdScores comp1 5 254 96.46 3.54 0.82 4.33 comp2 5 253 96.44 2.37 0.75 5.93 3 ind1 4 246 96.75 3.25 0.89 3.25 ind2 4 235 97.45 2.13 0.86 2.55 sk1 4 246 98.78 1.22 0.93 1.22 sk2 4 235 97.87 2.13 0.90 2.13 comp1 5 178 97.19 1.69 0.79 5.62 comp2 5 178 95.51 2.81 0.67 6.74 4 comp3 5 178 98.31 1.69 0.91 3.37 ind1 4 161 98.14 1.86 0.93 2.48 ind2 4 165 95.76 4.24 0.88 4.85 ind3 4 166 96.99 3.01 0.93 3.01