Inter-rater reliability

Question

Namarta Kapil 2020-1-18

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/500906-inter-rater-reliability

回答： Star Strider 2020-1-18

Inter-Rater reliabilty.xlsx

Hi,

I am trying to find out inter-rater reliability between 3 readers. The data is nominal. There were two categories used to grade the samples: FID denoted with 1 and AFID denoted with 0. I am not sure how to go about writing a code to determine inter rater reliabilty between these readers for this data.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Star Strider 2020-1-18

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/500906-inter-rater-reliability#answer_410806

If I understand what your data are and what you want to do, The correct test for your data is Fleiss’s kappa statistic. As I remember, the statistic is normally distributed, so a normal distribution will define the confidence intervals for it. The Wikipedia article on Fleiss’ kappa will provide necessary background.