American Journal of Epidemiology Advance Access originally published online on January 12, 2006
American Journal of Epidemiology 2006 163(7):670-675; doi:10.1093/aje/kwj063
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Original Contribution |
The Inconsistency of "Optimal" Cutpoints Obtained using Two Criteria based on the Receiver Operating Characteristic Curve
1 Division of Epidemiology, Statistics and Prevention Research, National Institute of Child Health and Human Development, Bethesda, MD
2 Department of Mathematics and Statistics, American University, Washington, DC
Correspondence to Dr. Enrique F. Schisterman, Division of Epidemiology, Statistics and Prevention Research, National Institute of Child Health and Human Development, 6100 Executive Blvd., Bethesda, MD 20852 (e-mail: schistee{at}mail.nih.gov).
The use of biomarkers is of ever-increasing importance in clinical diagnosis of disease. In practice, a cutpoint is required for dichotomizing naturally continuous biomarker levels to distinguish persons at risk of disease from those who are not. Two methods commonly used for establishing the "optimal" cutpoint are the point on the receiver operating characteristic curve closest to (0,1) and the Youden index, J. Both have sound intuitive interpretations—the point closest to perfect differentiation and the point farthest from none, respectively—and are generalizable to weighted sensitivity and specificity. Under the same weighting of sensitivity and specificity, these two methods identify the same cutpoint as "optimal" in certain situations but different cutpoints in others. In this paper, the authors examine situations in which the two criteria agree or disagree and show that J is the only "optimal" cutpoint for given weighting with respect to overall misclassification rates. A data-driven example is used to clarify and demonstrate the magnitude of the differences. The authors also demonstrate a slight alteration in the (0,1) criterion that retains its intuitive meaning while resulting in consistent agreement with J. In conclusion, the authors urge that great care be taken when establishing a biomarker cutpoint for clinical use.
area under curve; biological markers; cutpoints; data interpretation, statistical; epidemiologic methods; ROC curve; statistics; Youden index
Abbreviations: AUC, area under the curve; ROC, receiver operating characteristic
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  T. Blomquist, E. L. Crawford, D. Mullins, Y. Yoon, D.-A. Hernandez, S. Khuder, P. L. Ruppel, E. Peters, D. J. Oldfield, B. Austermiller, et al. Pattern of Antioxidant and DNA Repair Gene Expression in Normal Airway Epithelium Associated with Lung Cancer Diagnosis Cancer Res., November 15, 2009; 69(22): 8629 - 8635. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. D. Press, S. G. Willis, J. Laudadio, M. J. Mauro, and M. W. N. Deininger Determining the rise in BCR-ABL RNA that optimally predicts a kinase domain mutation in patients with chronic myeloid leukemia on imatinib Blood, September 24, 2009; 114(13): 2598 - 2605. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 Y. Ma, J. Peng, W. Liu, P. Zhang, L. Huang, B. Gao, T. Shen, Y. Zhou, H. Chen, Z. Chu, et al. Proteomics Identification of Desmin as a Potential Oncofetal Diagnostic and Prognostic Biomarker in Colorectal Cancer Mol. Cell. Proteomics, August 1, 2009; 8(8): 1878 - 1890. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. D. Ford, R. L. Trestman, V. H. Wiesbrock, and W. Zhang Validation of a Brief Screening Instrument for Identifying Psychiatric Disorders Among Newly Incarcerated Adults Psychiatr Serv, June 1, 2009; 60(6): 842 - 846. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 X. Zhou, F.-m. Ding, J.-t. Lin, and K.-s. Yin Validity of Asthma Control Test for Asthma Control Assessment in Chinese Primary Care Settings Chest, April 1, 2009; 135(4): 904 - 910. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. Gebker, C. Jahnke, R. Manka, A. Hamdan, B. Schnackenburg, E. Fleck, and I. Paetsch Additional Value of Myocardial Perfusion Imaging During Dobutamine Stress Magnetic Resonance for the Assessment of Coronary Artery Disease Circ Cardiovasc Imaging, September 1, 2008; 1(2): 122 - 130. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Weber, O. Bazzino, J. L. Navarro Estrada, J. J. Fuselli, F. Botto, D. Perez de Arenaza, H. Mollmann, H. N. Nef, A. Elsasser, and C. W. Hamm N-Terminal B-Type Natriuretic Peptide Assessment Provides Incremental Prognostic Information in Patients With Acute Coronary Syndromes and Normal Troponin T Values Upon Admission J. Am. Coll. Cardiol., March 25, 2008; 51(12): 1188 - 1195. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 Y. Matoba, T. Inoguchi, S. Nasu, S. Suzuki, T. Yanase, H. Nawata, and R. Takayanagi Optimal Cut Points of Waist Circumference for the Clinical Diagnosis of Metabolic Syndrome in the Japanese Population Diabetes Care, March 1, 2008; 31(3): 590 - 592. [Full Text] [PDF]
|
|
|
|
 |
|
 N. Vermeulen, I. Arijs, S. Joossens, S. Vermeire, S. Clerens, K. Van den Bergh, G. Michiels, L. Arckens, F. Schuit, L. Van Lommel, et al. Anti-{alpha}-enolase Antibodies in Patients with Inflammatory Bowel Disease Clin. Chem., March 1, 2008; 54(3): 534 - 541. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A Brunner, M Prelog, I Verdorfer, A Tzankov, G Mikuz, and C Ensinger EpCAM is predominantly expressed in high grade and advanced stage urothelial carcinoma of the bladder J. Clin. Pathol., March 1, 2008; 61(3): 307 - 310. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Tzankov, C. Meier, P. Hirschmann, P. Went, S. A. Pileri, and S. Dirnhofer Correlation of high numbers of intratumoral FOXP3+ regulatory T cells with improved survival in germinal center-like diffuse large B-cell lymphoma, follicular lymphoma and classical Hodgkin's lymphoma Haematologica, February 1, 2008; 93(2): 193 - 200. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. D. Ford, R. L. Trestman, V. Wiesbrock, and Wanli Zhang Development and Validation of a Brief Mental Health Screening Instrument for Newly Incarcerated Adults Assessment, September 1, 2007; 14(3): 279 - 299. [Abstract] [PDF]
|
|
|
|
 |
|
 L. D. Wendland, L. A. Zacher, P. A. Klein, D. R. Brown, D. Demcovitz, R. Littell, and M. B. Brown Improved Enzyme-Linked Immunosorbent Assay To Reveal Mycoplasma agassizii Exposure: a Valuable Tool in the Management of Environmentally Sensitive Tortoise Populations Clin. Vaccine Immunol., September 1, 2007; 14(9): 1190 - 1195. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Hachenberg, C. Weinkauf, S. Hiss, and H. Sauerwein Evaluation of classification modes potentially suitable to identify metabolic stress in healthy dairy cows during the peripartal period J Anim Sci, August 1, 2007; 85(8): 1923 - 1932. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. Hayashi, E. J. Boyko, M. J. McNeely, D. L. Leonetti, S. E. Kahn, and W. Y. Fujimoto Minimum Waist and Visceral Fat Values for Identifying Japanese Americans at Risk for the Metabolic Syndrome Diabetes Care, January 1, 2007; 30(1): 120 - 127. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. Zetterberg RE: "THE INCONSISTENCY OF 'OPTIMAL' CUTPOINTS OBTAINED USING TWO CRITERIA BASED ON THE RECEIVER OPERATING CHARACTERISTIC CURVE" Am. J. Epidemiol., October 1, 2006; 164(7): 707 - 708. [Full Text] [PDF]
|
|
|
|
|
|
N. J. Perkins and E. F. Schisterman THE AUTHORS REPLY Am. J. Epidemiol., October 1, 2006; 164(7): 708 - 708. [Full Text] [PDF]
|
|