NARA Discovery
Article Details
← Back to Search Results
Journal Article

AUC: a misleading measure of the performance of predictive distribution models

Jorge M. Lobo; Alberto Jiménez‐Valverde; Raimundo Real
Global Ecology and Biogeography · Vol. 17, Issue 2 · pp. 145-151 · 2008

Abstract

The area under the receiver operating characteristic (ROC) curve, known as the AUC, is currently considered to be the standard method to assess the accuracy of predictive distribution models. It avoids the supposed subjectivity in the threshold selection process, when continuous probability derived scores are converted to a binary presence–absence variable, by summarizing overall model performance over all possible thresholds. In this manuscript we review some of the features of this measure and bring into question its reliability as a comparative measure of accuracy between model results. We do not recommend using AUC for five reasons: (1) it ignores the predicted probability values and the goodness‐of‐fit of the model; (2) it summarises the test performance over regions of the ROC space in which one would rarely operate; (3) it weights omission and commission errors equally; (4) it does not give information about the spatial distribution of model errors; and, most importantly, (5) the total extent to which models are carried out highly influences the rate of well‐predicted absences and the AUC scores.

Bibliographic Information

JournalGlobal Ecology and Biogeography
PublisherWiley
Publication Date2008-03-01
Publication Year2008
Volume17
Issue2
Pages145-151
Document TypeJournal Article
Print ISSN1466-822X
eISSN1466-8238
DOI10.1111/j.1466-8238.2007.00358.x
SubjectEcology & Organismal Biology

Access Information

NARA Access Coverage1998-01-01~Current
Journal Homepagehttps://onlinelibrary.wiley.com/loi/14668238
Publisher PageOpen Publisher Page
Full-text access depends on NARA's subscribed coverage and institutional access.