Benchmarks for kappa (Landis & Koch, 1977)

Kappa

Strength of Association

0.00

Poor

0.01-0.20

Slight

0.21-0.40

Fair

0.41-0.60

Moderate

0.61-0.80

Substantial

0.81-1.00

Almost Perfect

References

Everitt, BS and Hay, DF (1992) Talking about statistics: a psychologist's guide to deisgn and analysis. Edward Arnold:London. Details concerning use and computation of kappa and mention of the above benchmarks.

Landis, JR and Koch, GC (1977) The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.