Landauer’s principle [1] states that the erasure of classical information leads to an increase in the entropy of the environment by at least the same amount. The importance of this principle is the insight that it is not the act of obtaining information that necessarily generates heat and therefore entropy, but the erasure of information. This profound insight has led to the resolution of the p...

The extraction of statistically independent components from high-dimensional multi-sensory input streams is assumed to be an essential component of sensory processing in the brain. Such independent component analysis (or blind source separation) could provide a less redundant representation of information about the external world. Another powerful processing strategy is to extract preferentiall...

Merging the outputs of different search engines or information sources in response to a query has been shown to improve performance. In most cases, scores produced by different information sources are not comparable: merging techniques are often segregated into a score normalization step followed by a combination step. The Combination step is usually straight forward and has been an area of act...

In classification of incomplete pattern, the missing values can either play a crucial role in the class determination, or have only little influence (or eventually none) on the classification results according to the context. We propose a credal classification method for incomplete pattern with adaptive imputation of missing values based on belief function theory. At first, we try to classify t...

this article aims to study an important principle in discourse analysis, which belongs to paul grice, the contemporary philosopher. he believes that in addition to giving and taking information during a conversation, people also show their cooperation with each other, and so he suggests the ‘cooperative principle’ which contains some principles of subtext. since the cooperative principle is wit...

Median regression analysis has robustness properties which make it an attractive alternative to regression based on the mean. In this paper, the missing information principle is applied to a right-censored version of the median regression model, leading to a new estimator for the regression parameters. Our approach adapts Efron's derivation of self-consistency for the Kaplan{Meier estimator to ...

We study many-party correlations quantified in terms of the Umegaki relative entropy (divergence) from a Gibbs family known as a hierarchical model. We derive these quantities from the maximum-entropy principle which was used earlier to define the closely related irreducible correlation. We point out differences between quantum states and probability vectors which exist in hierarchical models, ...

Organizational capability has been regarded as one of the principle sources of sustainable competitive advantage and the foundation for strategy formulation. Meanwhile, many anecdotal evidences have indicated that information technology (IT) is playing a very important role in building an organization’s capabilities. Although there has been a myriad of research on how IT could help in today’s f...

There are two categories of well-known approach (as basic principle of classification process) for learning structure of Bayesian Network (BN) in data mining (DM): scoring-based and constraint-based algorithms. Inspired by those approaches, we present a new CB* algorithm that is developed by considering four related algorithms: K2, PC, CB, and BC. The improvement obtained by our algorithm is de...