In regular statistical models, the leave-one-out cross-validation is asymptotically equivalent to the Akaike information criterion. However, since many learning machines are singular statistical models, the asymptotic behavior of the cross-validation remains unknown. In previous studies, we established the singular learning theory and proposed a widely applicable information criterion, the expe...

At present, the common operation mechanism of multiple classifier systems is the combination of classifier outputs. Recently, some researchers pointed out the potentialities of “dynamic classifier selection” as an alternative operation mechanism. However, such potentialities have been motivated so far by experimental results and qualitative arguments. This paper is aimed to provide a theoretica...

The performance of multiple classifier systems varies with the performance of component classifiers as well as the method of combination. In this paper, informationtheoretic methods are proposed for constructing multiple classifier systems, provided that the number of component classifiers is constrained in advance. These proposed methods are applied to a classifier pool and examine the possibl...

Bayesian inference requires all unknowns to be represented by probability distributions, which awkwardly implies that the probability of an event for which we are completely ignorant (e.g., that the world’s greatest boxer would defeat the world’s greatest wrestler) must be assigned a particular numerical value such as 1/2, as if it were known as precisely as the probability of a truly random ev...

The. development of automated assistance for medical diagnosis and decision making is an area of both theoretical and practical interest. Of methods for utilizing evidence to select diagnoses or decisions, probability theory has the firmest appeal. Probability theory in the form of Bayes’ Theorem has been used by a number of" workers (Ross, 1972). Notable among recent developments are those of ...