Pitfalls in the use of kappa when interpreting agreement between multiple raters in reliability studies
Shaun O’Leary1,2, Marte Lund1,3, Tore Johan Ytre-Hauge1,4, Sigrid Reiersen Holm1,5, Kaja Naess1,6, Lars Nagelstad Dalland1,7, Steven M. McPhail8,9
1NHMRC Centre for Clinical Research Excellence in Spinal Pain, Injury and Health, University of Queensland, Brisbane, QLD 4072, Australia
2Physiotherapy Department, Royal Brisbane and Women's Hospital, Queensland Health, Herston, Brisbane, QLD 4029, Australia
3Norwegian Sports Medicine Clinic (NIMI), Oslo, Norway
4Medi 3 Clinic, Aalesund, Norway
5University Hospital of Northern Norway, Tromsø, Norway
6Hans & Olaf Physiotherapy Clinic, Oslo, Norway
7Eggedal Physiotherapy Clinic, Sigdal, Norway
8Centre for Functioning and Health Research, Queensland Health, Cnr of Ipswich Road and Cornwall Street, Brisbane, Australia
9School of Public Health and Institute of Health and Biomedical Innovation, Queensland University of Technology, Victoria Park Road, Brisbane, Australia