We use information entropy measure to extend the rough set based notion of a reduct. We introduce the Approximate Entropy Reduction Principle (AERP). It states that any simplification (reduction of attributes) in the decision model, which approximately preserves its conditional entropy (the measure of inconsistency of defining decision by conditional attributes) should be performed to decrease ...

Entropy measures have been extensively used to assess heart rate variability (HRV), a noninvasive marker of cardiovascular autonomic regulation. It is yet to be elucidated whether those entropy measures can sensitively respond to changes of autonomic balance and whether the responses, if there are any, are consistent across different entropy measures. Sixteen healthy subjects were enrolled in t...

Cycle time optimization could be one of the great challenges in business process management. Although there is much research on this subject, task similarities have been paid little attention. In this paper, a new approach is proposed to optimize cycle time by minimizing entropy of work lists in resource allocation while keeping workloads balanced. The idea of the entropy of work lists comes fr...

Natural convection heat transfer has many applications in different fields of industry; such as cooling industries, electronic transformer devices and ventilation equipment; due to simple process, economic advantage, low noise and renewed retrieval. Recently, heat transfer of nanofluids have been considered because of higher thermal conductivity coefficient compared with those of ordinary fluid...

This paper concentrates on a new procedure which experimentally recognises gears and bearings faults of a typical gearbox system using a least square support vector machine (LSSVM). Two wavelet selection criteria Maximum Energy to Shannon Entropy ratio and Maximum Relative Wavelet Energy are used and compared to select an appropriate wavelet for feature extraction. The fault diagnosis method co...

purpose: this study aimed to measure the information load of words in farsi scientific texts and determine the relationship between some properties of the words and information load of the texts based on shannon entropy. methodology: the study was conducted based on the content analysis of a number of 320 articles that were published in scientific-research iranian journals in 2009. and the arti...

In this paper, we present a new image thresholding technique which uses the relative entropy (also known as the Kullback-Leiber discrimination distance function) as a criterion of thresholding an image. As a result, a gray level minimizing the relative entropy will be the desired threshold. The proposed relative entropy approach is different from two known entropy-based thresholding techniques,...

The classical Bayesian posterior arises naturally as the unique solution of several different optimization problems, without the necessity of interpreting data as conditional probabilities and then using Bayes' Theorem. For example, the classical Bayesian posterior is the unique posterior that minimizes the loss of Shannon information in combining the prior and the likelihood distributions. The...