Wood, J. M. (2007, October 3). Understanding and Computing Cohens Kappa: A Tutorial. WebPsychEmpiricist. Retrieved October 3, 2007 from http://wpe.info/papers_table.html.
Cohens Kappa (Cohen, 1960) is an index of interrater reliability that is commonly used to measure the level of agreement between two sets of dichotomous ratings or scores. This tutorial explains the underlying logic of Kappa and shows why it is superior to simple percentage of agreement as a measure of interrater reliability. Examples demonstrate how to calculate Kappa both by hand and with SPSS.