Learning Α-integrationwith Partially-labeled Data
نویسندگان
چکیده
Sensory data integration is an important task in human brain for multimodal processing as well as in machine learning for multisensor processing. α-integration was proposed by Amari as a principled way of blending multiple positive measures (e.g., stochastic models in the form of probability distributions), providing an optimal integration in the sense of minimizing the α-divergence. It also encompasses existing integration methods as its special case, e.g., weighted average and exponential mixture. In α-integration, the value of α determines the characteristics of the integration and the weight vector w assigns the degree of importance to each measure. In most of the existing work, however, α and w are given in advance rather than learned. In this paper we present two algorithms, for learning α and w from data when only a few integrated target values are available. Numerical experiments on synthetic as well as real-world data confirm the proposed method’s effectiveness.
منابع مشابه
Learning from partially labeled data
The Problem: Learning from data with both labeled training points (x,y pairs) and unlabeled training points (x alone). For the labeled points, supervised learning techniques apply, but they cannot take advantage of the unlabeled points. On the other hand, unsupervised techniques can model the unlabeled data distribution, but do not exploit the labels. Thus, this task falls between traditional s...
متن کاملDiverse reduct subspaces based co-training for partially labeled data
Keywords: Rough set theory Markov blanket Attribute reduction Rough co-training Partially labeled data Rough set theory is an effective supervised learning model for labeled data. However, it is often the case that practical problems involve both labeled and unlabeled data, which is outside the realm of traditional rough set theory. In this paper, the problem of attribute reduction for partiall...
متن کاملLearning Hybrid Models for Image Annotation with Partially Labeled Data
Extensive labeled data for image annotation systems, which learn to assign class labels to image regions, is difficult to obtain. We explore a hybrid model framework for utilizing partially labeled data that integrates a generative topic model for image appearance with discriminative label prediction. We propose three alternative formulations for imposing a spatial smoothness prior on the image...
متن کاملLearning model order from labeled and unlabeled data for partially supervised classification, with application to word sense disambiguation
Previous partially supervised classification methods can partition unlabeled data into positive examples and negative examples for a given class by learning from positive labeled examples and unlabeled examples, but they cannot further group the negative examples into meaningful clusters even if there are many different classes in the negative examples. Here we proposed an automatic method to o...
متن کاملSemi-supervised Clustering in Fuzzy Rule Generation
Inductive learning approaches traditionally categorized as supervised, which use labeled data sets, and unsupervised, which use unlabeled data sets in learning tasks. The great volume of available data and the cost involved in manual labeling has motivated the investigation of different solutions for machine learning tasks related to unlabeled data. The approach proposed here fits into this con...
متن کامل