pROC: an open-source package for R and S+ to analyze and compare ROC curves

<p>Abstract</p> <p>Background</p> <p>Receiver operating characteristic (ROC) curves are useful tools to evaluate classifiers in biomedical and bioinformatics applications. However, conclusions are often reached through inconsistent use or insufficient statistical analys...

Full description

Bibliographic Details
Main Authors: Lisacek Frédérique, Tiberti Natalia, Hainard Alexandre, Turck Natacha, Robin Xavier, Sanchez Jean-Charles, Müller Markus
Format: Article
Language:English
Published: BMC 2011-03-01
Series:BMC Bioinformatics
Online Access:http://www.biomedcentral.com/1471-2105/12/77
Description
Summary:<p>Abstract</p> <p>Background</p> <p>Receiver operating characteristic (ROC) curves are useful tools to evaluate classifiers in biomedical and bioinformatics applications. However, conclusions are often reached through inconsistent use or insufficient statistical analysis. To support researchers in their ROC curves analysis we developed <it>pROC</it>, a package for R and S+ that contains a set of tools displaying, analyzing, smoothing and comparing ROC curves in a user-friendly, object-oriented and flexible interface.</p> <p>Results</p> <p>With data previously imported into the R or S+ environment, the <it>pROC </it>package builds ROC curves and includes functions for computing confidence intervals, statistical tests for comparing total or partial area under the curve or the operating points of different classifiers, and methods for smoothing ROC curves. Intermediary and final results are visualised in user-friendly interfaces. A case study based on published clinical and biomarker data shows how to perform a typical ROC analysis with <it>pROC</it>.</p> <p>Conclusions</p> <p><it>pROC </it>is a package for R and S+ specifically dedicated to ROC analysis. It proposes multiple statistical tests to compare ROC curves, and in particular partial areas under the curve, allowing proper ROC interpretation. <it>pROC </it>is available in two versions: in the R programming language or with a graphical user interface in the S+ statistical software. It is accessible at <url>http://expasy.org/tools/pROC/</url> under the GNU General Public License. It is also distributed through the CRAN and CSAN public repositories, facilitating its installation.</p>
ISSN:1471-2105