The following picture shows the test omission rate and predicted area as a function of the cumulative threshold, averaged over the replicate runs. The omission rate should be close to the predicted omission, because of the definition of the cumulative threshold. The next picture is the receiver operating characteristic (ROC) curve for the same data, again averaged over the replicate runs. Note ...

Research examining models of memory has focused on differences in the shapes of ROC curves across tasks and has used these differences to argue for and against the existence of multiple memory processes. ROC functions are usually obtained from confidence judgments, but the reaction times associated with these judgments are rarely considered. The RTCON2 diffusion model for confidence judgments h...

The predictive accuracy of a survival model can be summarized using extensions of the proportion of variation explained by the model, or R2, commonly used for continuous response models, or using extensions of sensitivity and specificity, which are commonly used for binary response models. In this article we propose new time-dependent accuracy summaries based on time-specific versions of sensit...

If we consider the Brier score (B) in the context of the signal detection theory and assume that it makes sense to consider the existence of B as a parameter for the population (let B be this B), and if we assume that the calibration in the observer's probability estimate is perfect, we find that there is a theoretical relationship between B and the area under the binormal receiver operating ch...

Disease prevention is important and can be accomplished by developing diagnostic tests. The receiver operating characteristic (ROC) curve and the area under the ROC curve (AUC) are used to assess the accuracy of diagnostic tests. The assessment for the superiority between evaluating two diagnostic tests is needed when comparing two diagnostic tests. Existing tests are constructed by comparing t...

In many practical classiication problems it is important to distinguish false positive from false negative results when evaluating the performance of the classiier. This is of particular importance for medical diagnostic tests. In this context, receiver operating characteristic (ROC) curves have become a standard tool. Here we apply this concept to characterize the performance of a simple neura...