The receiver operating characteristic (ROC) has emerged as the gold standard for assessing and comparing the performance of classifiers in a wide range of disciplines including the life sciences. ROC curves are frequently summarized in a single scalar, the area under the curve (AUC). This article discusses the caveats and pitfalls of ROC analysis in clinical microarray research, particularly in...

Compare the accuracy of two continuous-scale tests is increasing important when a new test is developed. The traditional approach that compares the entire areas under two Receiver Operating Characteristic (ROC) curves is not sensitive when two ROC curves cross each other. A better approach to compare the accuracy of two diagnostic tests is to compare the areas under two ROC curves (AUCs) in the...

conclusions optimal wc values for defining mets were 91.5 cm and 85.5 cm in men and women, respectively. the cut-off values recommended by world organizations are not appropriate for an adult population living in ahvaz city. results the cut-off points of wc, according to a maximum sum of sensitivity plus specificity for detecting at least two components of mets were found to be 91.5 cm and 85.5...

We propose serial correlation robust asymptotic confidence bands for the receiver operating characteristic (ROC) curves estimated by quasi-maximum likelihood in the binormal model. Our simulation experiments confirm that this new method performs fairly well in finite samples. The conventional procedure is found to be markedly undersized in terms of yielding empirical coverage probabilities lowe...

A mathematical description of fusion is presented using category theory. A category of fusion rules is developed. The category definition is derived for a model of a classification system beginning with an event set and leading to the final labeling of the event. Functionals on receiver operating characteristic (ROC) curves are developed to form a partial ordering of families of classification ...

Assessing the discriminative power of rating systems is an important question to banks and to regulators. In this article we analyze the Cumulative Accuracy Profile (CAP) and the Receiver Operating Characteristic (ROC) which are both commonly used in practice. We give a test-theoretic interpretation for the concavity of the CAP and the ROC curve and demonstrate how this observation can be used ...

There are different approaches in the literature for the assessment of steganographic algorithms and steganalytic attacks. In the early papers it was considered sufficient to show the existence of an effect for one or a few examples only. The more the area of steganography evolved, the more diverse became the goals and the harder to measure the improvements. Many branches of science are facing ...

This paper applies receiver operating characteristics (ROC) analysis to M3 Competition, micro monthly time series for one-month-ahead forecasts. Using the partial area under the curve (PAUC) criterion as a forecast accuracy measure and paired-comparison testing via bootstrapping, we find that complex methods (AutomatANN, Flores-Pearce2, Forecast ProSmart FCS, and Theta) perform best for forecas...

UNLABELLED Receiver operating characteristic (ROC) analysis is usually applied in bioinformatics to evaluate the abilities of biological markers to differentiate between the presence or absence of a disease. It includes the derivation of the useful scalar performance measure area under the ROC curve for binary classification tasks. As real applications often deal with more than two classes, mul...