Affiliation:
1. Department of Statistics, University of Florida
Abstract
This article presents a survey of ways of statistically modelling patterns of observer agreement and disagreement. Main emphasis is placed on modelling inter-observer agreement for categorical responses, both for nominal and ordinal response scales. Models discussed include (1) simple cell-probability models based on Cohen's kappa that focus on beyond-chance agreement, (2) loglinear models for square tables, such as quasi-independence and quasi-symmetry models, (3) latent class models that express the joint distribution between ratings as a mixture of clusters for homogeneous subjects, each cluster having the same 'true' rating, and 4) Rasch models, which decompose subject-by-observer rating distributions using observer and subject main effects. Models can address two distinct components of agreement - strength of association between ratings, and similarity of marginal distributions of the ratings.
Subject
Health Information Management,Statistics and Probability,Epidemiology
Cited by
121 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献