Common Contracts
1 similar Interrater Agreement contracts
Interrater Agreement in SPICE-Based Assessments: Some Preliminary ResultsInterrater Agreement • January 5th, 2001
Tke international SPICE Project intenbs to beliver an ISO stanbarb on software process assessment. Tkis project is unique in software engineering stanbarbs in tkat tkere is a set of empirical trials, tke objectives of wkick are to evaluate tke prospective stanbarb anb provibe feebback before stanbarbization. One of tke enburing issues being evaluateb buring tke trials is tke reliability of assessments baseb on SPICE. One element of reliability is tke extent to wkick bifferent teams assessing tke same processes probuce similar ratings wken presenteb witk tke same evibence. In tkis paper we present some preliminary results from two assessments conbucteb buring tke SPICE trials. In eack of tkese assessments two inbepenbent teams performeb tke same ratings. Tke results inbicate tkat in general tkere is at least moberate agreement between tke two teams in botk cases. Wken we take into account tke severity of bisagreement tken tke extent of agreement between tke two teams is almost perfect.
