INTER-CODER AGREEMENT FOR IMPROVING RELIABILITY IN SOFTWARE ENGINEERING QUALITATIVE RESEARCHInter-Coder Agreement • August 4th, 2020
Contract Type FiledAugust 4th, 2020For instance, for our example of Table 1, we have that Po = 0.667, as computed in Section 2.2. For Pe, it is given by Pe = (13/30)2 + (17/30)2 = 0.509. Observe that, while the number of items is 15, in the previous computation we divided by 30. This is due to the fact that there are 15 items, but 30 pairs of evaluations, see also Table 2.