You are viewing the site in preview mode

Skip to main content

Advertisement

Table 6 Results, kappa agreement among the evaluators for each of the 12 examples in the pilot study

From: Systems for grading the quality of evidence and the strength of recommendations II: Pilot study of a new system

Example No of outcomes P Kappa (SE)
1 3 0.436 0.149 0.031
2 3 0.769 0.075 0.053
3 6 0.643 0.441 0.024
4 3 0.926 0.823 0.050
5 2 0.608 -0.044 0.065
6 3 0.618 0.163 0.050
7 3 0.520 -0.028 0.044
8 3 0.451 0.146 0.036
9 4 0.441 -0.022 0.037
10 5 0.579 0.005 0.034
11 4 0.377 0.112 0.027
12 7 0.718 -0.083 0.043