Position Paper: Extensions of ROC Analysis to Multi-Class Domains
نویسنده
چکیده
Receiver-operating characteristic (ROC) analysis has proven to be a powerful method for dealing with misclassification costs and skewed class distributions (Provost & Fawcett, 1998). In the typical representation, an ROC analysis evaluates false accept versus false reject rates for a set of candidate binary classifiers under all possible (linear) cost and prior class distribution assumptions. The set of potentially optimal classifiers forms a convex hull (the ROCCH) in the 2-space of error rates, and a particular cost matrix and class distribution vector yields a linear surface tangent to the surface of the ROC hull. The set of points at the tangent of the ROCCH and the cost-surface constitutes the set of optimal classifiers for that particular cost assumption. Classifiers corresponding to points not on the hull are never optimal under any conditions and can be discarded without further consideration. Classifier-construction algorithms yielding a set of classifiers all of whom fall strictly below the ROCCH are said to be dominated by one or more other algorithms and can also be discarded from consideration.
منابع مشابه
Multi-class ROC analysis from a multi-objective optimisation perspective
The Receiver Operating Characteristic (ROC) has become a standard tool for the analysis and comparision of classifiers when the costs of misclassification are unknown. There has been relatively little work, however, examining ROC for more than two classes. Here we discuss and present a number of different extensions to the standard two-class ROC for multi-class problems. We define the ROC surfa...
متن کاملVolume under the ROC Surface for Multi-class Problems
Receiver Operating Characteristic (ROC) analysis has been successfully applied to classifier problems with two classes. The Area Under the ROC Curve (AUC) has been elected as a better way to evaluate classifiers than predictive accuracy or error and has also recently used for evaluating probability estimators. However, the extension of the Area Under the ROC Curve for more than two classes has ...
متن کاملA new class of function spaces on domains of R^d and its relations to classical function spaces
متن کامل
Comparison of three-class classification performance metrics: a case study in breast cancer CAD [5749-64]
Receiver Operating Characteristic (ROC) analysis is a widely used method for analyzing the performance of two-class classifiers. Advantages of ROC analysis include the fact that it explicitly considers the tradeoffs in sensitivity and specificity, includes visualization methods, and has clearly interpretable summary metrics. Currently, there does not exist a widely accepted performance method s...
متن کاملSocial Factors affecting Women's Political Participation in Hamadan Province of Iran (Case Study: Nahavand City)
Political participation is one of the important issues drawn to the special attention of various fields of social sciences and politics. Today, women as an effective group in participation and political participation especially have an important role in political decision-making. Therefore, the main objective of this study is to examine social factors affecting women's political participation i...
متن کامل