Assessing inter-rater reliability when the raters are fixed: two concepts and two estimates.

Details

Ressource 1Request a copy Under indefinite embargo.
UNIL restricted access
State: Public
Version: author
Serval ID
serval:BIB_D23EEF8E0DC2
Type
Article: article from journal or magazin.
Collection
Publications
Institution
Title
Assessing inter-rater reliability when the raters are fixed: two concepts and two estimates.
Journal
Biometrical Journal
Author(s)
Rousson Valentin
ISSN
0323-3847
1521-4036 (Electronic)
ISSN-L
0323-3847
Publication state
Published
Issued date
2011
Peer-reviewed
Oui
Volume
53
Number
3
Pages
477-490
Language
english
Abstract
Intraclass correlation (ICC) is an established tool to assess inter-rater reliability. In a seminal paper published in 1979, Shrout and Fleiss considered three statistical models for inter-rater reliability data with a balanced design. In their first two models, an infinite population of raters was considered, whereas in their third model, the raters in the sample were considered to be the whole population of raters. In the present paper, we show that the two distinct estimates of ICC developed for the first two models can both be applied to the third model and we discuss their different interpretations in this context.
Pubmed
Web of science
Create date
30/05/2011 15:53
Last modification date
20/08/2019 16:52
Usage data