Renyi’s entropy can be used as a cost function for blind source separation (BSS). Previous works have emphasized the advantage of setting Renyi’s exponent to a value different from one in the context of BSS. In this paper, we focus on zero-order Renyi’s entropy minimization for the blind extraction of bounded sources (BEBS). We point out the advantage of choosing the extended zero-order Renyi’s...

We formulate the entropy of a quantized artificial neural network as differentiable function that can be plugged regularization term into cost minimized by gradient descent. Our formulation scales efficiently beyond first order and is agnostic quantization scheme. The then trained to minimize parameters, so they optimally compressed via coding. experiment with our at quantizing compressing well...

Using distributed generations (DGs) with optimal scheduling and optimal distribution feeder reconfiguration (DFR) are two aspects that can improve efficiency as well as technical and economic features of microgrids (MGs). This work presents a stochastic copula scenario-based framework to jointly carry out optimal scheduling of DGs and DFR. This framework takes into account non-dispatchable and ...

natural convection heat transfer has many applications in different fields of industry; such as cooling industries, electronic transformer devices and ventilation equipment; due to simple process, economic advantage, low noise and renewed retrieval. recently, heat transfer of nanofluids have been considered because of higher thermal conductivity coefficient compared with those of ordinary fluid...

We study the cross-entropy method for diffusions. One of the results is a versatile cross-entropy algorithm that can be used to design efficient importance sampling strategies for rare events or to solve optimal control problems. The approach is based on the minimization of a suitable cross-entropy functional, with a parametric family of exponentially tilted probability distributions. We illust...

We present a constancy rate principle governing language generation. We show that this principle implies that local measures of entropy (ignoring context) should increase with the sentence number. We demonstrate that this is indeed the case by measuring entropy in three different ways. We also show that this effect has both lexical (which words are used) and non-lexical (how the words are used)...

We formalize the pair-wise registration problem in a maximum a posteriori (MAP) framework that employs a multinomial model of joint intensities with parameters for which we only have a prior distribution. To obtain an MAP estimate of the aligning transformation alone, we treat the multinomial parameters as nuisance parameters, and marginalize them out. If the prior on those is uninformative, th...