Including omission mistakes in the calculation of Cohen's Kappa and an analysis of the coefficient's paradox features

Simon, Patricia (2006) Including omission mistakes in the calculation of Cohen's Kappa and an analysis of the coefficient's paradox features. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 66 (5). pp. 765-777. ISSN 0013-1644,

Full text not available from this repository. (Request a copy)

Abstract

The application range of Cohen's Kappa is extended to the field of sequential observation data, where omission mistakes of an observer may often occur. It is shown how the omission mistakes can be incorporated into the calculation of the Kappa coefficient without violating the statistic it is based on. The enhanced coefficient is termed Kappa Coefficient With Omission Calculation (kappa(woc)). In addition, the so-called paradox features of the Kappa coefficient, the base-rate problem, and the observer bias are discussed. It is shown that, in the case of observation data, these attributes are desirable features of the Kappa coefficient.

Item Type: Article
Uncontrolled Keywords: NOMINAL SCALES; HIGH AGREEMENT; sequential observation; omission mistakes; Kappa coefficient; base-rate problem; observer bias
Subjects: 100 Philosophy & psychology > 150 Psychology
Divisions: Human Sciences > Institut für Psychologie > Alumni or Retired Professors > Lehrstuhl für Psychologie VI (Pädagogische Psychologie und Medienpsychologie) - Prof. Dr. Helmut Lukesch
Depositing User: Dr. Gernot Deinzer
Date Deposited: 25 Jan 2021 07:13
Last Modified: 25 Jan 2021 07:13
URI: https://pred.uni-regensburg.de/id/eprint/33912

Actions (login required)

View Item View Item