The Visual Concept Detection Task (VCDT) of ImageCLEF 2008 is described. A database of 2,827 images were manually annotated with 17 concepts. Of these, 1,827 were used for training and 1,000 for testing the automated assignment of categories. In total 11 groups participated and submitted 53 runs. The runs were evaluated using ROC curves, from which the Area Under the Curve (AUC) and Equal Error...

In the remember-know paradigm for studying recognition memory, participants distinguish items whose presentations are episodically remembered from those that are merely familiar. A one-dimensional model postulates that remember responses are just high-confidence old judgments, but a meta-analysis of 373 experiments shows that the receiver operating characteristic (ROC) curves predicted by this ...

We address the problem of applying machine-learning classifiers in domains where incorrect classifications have severe consequences. In these domains we propose to apply classifiers only when their performance can be defined by the domain expert prior to classification. The classifiers so obtained are called reliable classifiers. In the article we present three main contributions. First, we est...

A synthesis of the empirical Bayes method and the method of estimating equations is used to combine individual receiver operating characteristic (ROC) area estimates from different studies of the same diagnostic test into a single estimate. This single estimate represents the population mean from which individual areas under the ROC curves were sampled. The only data needed to carry out the met...

In this paper we establish the empirical likelihood method for the two-sample case in a general framework. We show that the result of Qin and Zhao (2000) basically covers the following two-sample models: the differences of two sample means, smooth Huber estimators, distribution and quantile functions, ROC curves, probability-probability (P-P) and quantile-quantile (Q-Q) plots. Finally, the stru...

Results The patients with active disease had greater IL-6 levels than did the patients with inactive disease (p=0.002) and controls (p=0.006).The cutoff value for active disease obtained from the ROC curve was 8,33pg/ml. During the active stage of the disease IL-6 levels were significantly higher in both systemic and polyarticular patients than in the oligoarticular patients. Serum IL-6 concent...

This paper shows that when a classifier is evaluated with nonrandom test data, ROC curves differ from the ROC curves that would be obtained with a random sample. To address this bias, this paper introduces a procedure for plotting ROC curves that are inferred from nonrandom test data. I provide simulations and an example with wine data to illustrate the procedure as well as the magnitude of bia...