ROC curves and the test
نویسنده
چکیده
In this paper we review the Receiver Operating Characteristic ROC curve and the test statistic in relation to the analysis of a confusion matrix We then show how these two methods are related and propose an extension to the ROC curve so that it shows contours of values These contours can be used to provide further insight into the appropriate setting of the decision threshold for a particular application
منابع مشابه
ROC curves and nonrandom data ∗ Jonathan Aaron
This paper shows that when a classifier is evaluated with nonrandom test data, ROC curves differ from the ROC curves that would be obtained with a random sample. To address this bias, this paper introduces a procedure for plotting ROC curves that are inferred from nonrandom test data. I provide simulations and an example with wine data to illustrate the procedure as well as the magnitude of bia...
متن کاملComparison between sodium hypochlorite and copper sulfate reducer in lightening of overexposed working length radiographs
Objectives: The aims of this study were to test whether lightening of the overexposed radiographs improve determination of endodontic files length and whether lightened radiographs are comparable with ideally exposed radiographs. Material and Methods: Four dried human skull coated with soft tissue-equivalent wax used for exposing radiographs of the upper molars. First, the endodontic file was p...
متن کاملROC curve equivalence using the Kolmogorov-Smirnov test
This paper describes a simple, non-parametric and generic test of the equivalence of Receiver Operating Characteristic (ROC) curves based on a modified Kolmogorov-Smirnov (KS) test. The test is described in relation to the commonly used techniques such as the Area Under the ROC curve (AUC) and the Neyman-Pearson method. We first review how the KS test is used to test the null hypotheses that th...
متن کاملEstimation and Comparison of Receiver Operating Characteristic Curves.
The receiver operating characteristic (ROC) curve displays the capacity of a marker or diagnostic test to discriminate between two groups of subjects, cases versus controls. We present a comprehensive suite of Stata commands for performing ROC analysis. Non-parametric, semiparametric and parametric estimators are calculated. Comparisons between curves are based on the area or partial area under...
متن کاملAsymptotic Properties of the Sequential Empirical ROC, PPV and NPV Curves Under Case-Control Sampling.
The receiver operating characteristic (ROC) curve, the positive predictive value (PPV) curve and the negative predictive value (NPV) curve are three measures of performance for a continuous diagnostic biomarker. The ROC, PPV and NPV curves are often estimated empirically to avoid assumptions about the distributional form of the biomarkers. Recently, there has been a push to incorporate group se...
متن کاملComparison of correlated receiver operating characteristic curves derived from repeated diagnostic test data.
RATIONAL AND OBJECTIVES It is common to administer the same diagnostic test more than once to the same set of patients. The purpose of this study was to develop two statistical methods for estimating and comparing correlated receiver operating characteristic (ROC) curves for data derived from repeated diagnostic tests. MATERIAL AND METHODS Parametric and semiparametric transformation models w...
متن کامل