American Journal of Epidemiology Vol. 135, No. 5: 571-578
Copyright © 1992 by The Johns Hopkins University School of Hygiene and Public Health
brief-report |
Acceptable Values of Kappa for Comparison of Two Groups
From the Biometry and Epidemiology Program, National Eye Institute, National Institutes of Health Bethesda, MD 20892
Reprint requests to Dr. Daniel G. Seigel, Building 31, Room 6A10, Biometry and Epidemiology Program, National Eye Institute, N1H, Bethesda, MD 20892
A model was developed for a simple clinical trial in which graders had defined probabilities of misclassifying pathologic material to disease present or absent. The authors compared Kappa between graders, and efficiency and bias in the clinical trial in the presence of misdassification. Though related to bias and efficiency, Kappa did not predict these two statistics well. These results pertain generally to evaluation of systems for encoding medical information, and the relevance of Kappa in determining whether such systems are ready for use in comparative studies. The authors conclude that, by itself, Kappa is not informative enough to evaluate the appropriateness of a grading scheme for comparative studies. Additional, and perhaps difficult, questions must be addressed for such evaluation.
bias; clinical trials; epidemiotogic methods; models, statistical; odds ratio; relative risk; statistics
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
L. Hartling, M. Ospina, Y. Liang, D. M Dryden, N. Hooton, J. Krebs Seida, and T. P Klassen Risk of bias versus quality assessment of randomised controlled trials: cross sectional study BMJ, October 19, 2009; 339(oct19_1): b4012 - b4012. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. E. Spencer Jr, W. R. Dunn, R. W. Wright, B. R. Wolf, K. P. Spindler, E. McCarty, C. B. Ma, G. Jones, M. Safran, G. B. Holloway, et al. Interobserver Agreement in the Classification of Rotator Cuff Tears Using Magnetic Resonance Imaging Am. J. Sports Med., January 1, 2008; 36(1): 99 - 103. [Abstract] [Full Text] [PDF] |
||||
![]() |
L Richiardi, D Mirabelli, R Calisti, A Ottino, A Ferrando, P Boffetta, and F Merletti Occupational exposure to diesel exhausts and risk for lung cancer in a population-based case-control study in Italy Ann. Onc., December 1, 2006; 17(12): 1842 - 1847. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Herold, M. Bachthaler, O. W. Hamer, R. Hente, S. Feuerbach, C. Fellner, M. Strotzer, M. Lenhart, and C. Paetzel Indirect MR Arthrography of the Shoulder: Use of Abduction and External Rotation to Detect Full- and Partial-Thickness Tears of the Supraspinatus Tendon Radiology, July 1, 2006; 240(1): 152 - 160. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Receveur, P. Lenoir, H. Desombre, S. Roux, C. Barthelemy, and J. Malvy Interaction and imitation deficits from infancy to 4 years of age in children with autism: A pilot study based on videotapes Autism, February 1, 2005; 9(1): 69 - 82. [Abstract] [PDF] |
||||
![]() |
S. DeVries, S. Nyante, J. Korkola, R. Segraves, K. Nakao, D. Moore, H. Bae, M. Wilhelm, S. Hwang, and F. Waldman Array-Based Comparative Genomic Hybridization from Formalin-Fixed, Paraffin-Embedded Breast Tumors J. Mol. Diagn., February 1, 2005; 7(1): 65 - 71. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. K. Tobacman, I. U. Scott, S. T. Cyphert, and M. B. Zimmerman Comparison of Appropriateness Ratings for Cataract Surgery between Convened and Mail-only Multidisciplinary Panels Med Decis Making, December 1, 2001; 21(6): 490 - 497. [Abstract] [PDF] |
||||
![]() |
A. M. McCarthy, L. C. Richman, R. P. Hoffman, and L. Rubenstein Psychological Screening of Children for Participation in Nontherapeutic Invasive Research Arch Pediatr Adolesc Med, November 1, 2001; 155(11): 1197 - 1203. [Abstract] [Full Text] [PDF] |
||||
![]() |
J.L. Anguenot, F. de Marval, P. Vassilakos, R. Auckenthaler, V. Ibecheole, and A. Campana Combined screening for Chlamydia trachomatis and squamous intra-epithelial lesions using a single liquid-based cervical sample Hum. Reprod., October 1, 2001; 16(10): 2206 - 2210. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. Feder, J. C. Nietfeld, J. Galland, T. Yeary, J. M. Sargeant, R. Oberst, M. L. Tamplin, and J. B. Luchansky Comparison of Cultivation and PCR-Hybridization for Detection of Salmonella in Porcine Fecal and Water Samples J. Clin. Microbiol., July 1, 2001; 39(7): 2477 - 2484. [Abstract] [Full Text] [PDF] |
||||
![]() |
D R Durbin, A R Localio, and E J MacKenzie Validation of the ICD/AIS MAP for pediatric use Inj. Prev., June 1, 2001; 7(2): 96 - 99. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. C. Grotta, D. Chiu, M. Lu, S. Patel, S. R. Levine, B. C. Tilley, T. G. Brott, E. C. Haley Jr, P. D. Lyden, R. Kothari, et al. Agreement and Variability in the Interpretation of Early CT Changes in Stroke Patients Qualifying for Intravenous rtPA Therapy Stroke, August 1, 1999; 30(8): 1528 - 1533. [Abstract] [Full Text] [PDF] |
||||











