While it is generally agreed that neurons transmit information about their synaptic inputs through spike trains, the code by which this information is transmitted is not well understood. An upper bound on the information encoded is obtained by hypothesizing that the precise timing of each spike conveys information. Here we develop a general approach to quantifying the information carried by spi...

We elucidate the connection between the Kolmogorov-Sinai entropy rate k and the time evolution of the physical or statistical entropy S. For a large family of chaotic conservative dynamical systems including the simplest ones, the evolution of Sstd for far-from-equilibrium processes includes a stage during which S is a simple linear function of time whose slope is k. We present numerical confir...

In this paper, information entropy and ensemble learning based signal recognition theory and algorithms have been proposed. We have extracted 16 kinds of entropy features out of 9 types of modulated signals. The types of information entropy used are numerous, including Rényi entropy and energy entropy based on S Transform and Generalized S Transform. We have used three feature selection algorit...

After reviewing the relation of entropy to information, I derive the entropy bound as applied to bounded weakly gravitating systems, and review the bound’s applications to cosmology as well as its extensions to higher dimensions. I then discuss why black holes behave as 1-D objects when emitting entropy, which suggests that a black hole swallows information at a rate restricted by the one-chann...

[1] The long-term mean properties of the global climate system and those of turbulent fluid systems are reviewed from a thermodynamic viewpoint. Two general expressions are derived for a rate of entropy production due to thermal and viscous dissipation (turbulent dissipation) in a fluid system. It is shown with these expressions that maximum entropy production in the Earth s climate system sugg...

The time-frequency balanced spectral entropy of the EEG is a monitoring technique measuring the level of hypnosis during general anesthesia. Two components of spectral entropy are calculated: state entropy (SE) and response entropy (RE). Transcatheter aortic valve implantation (TAVI) is a less invasive treatment for patients suffering from symptomatic aortic stenosis with contraindications for ...

Under which circumstances are variational principles based on entropy production rate useful tools for modeling steady states of electric (gas) discharge systems far from equilibrium? It is first shown how various different approaches, as Steenbeck’s minimum voltage and Prigogine’s minimum entropy production rate principles are related to the maximum entropy production rate principle (MEPP). Se...

Two maximization problems of Rényi entropy rate are investigated: the maximization over all stochastic processes whose marginals satisfy a linear constraint, and the Burg-like maximization over all stochastic processes whose autocovariance function begins with some given values. The solutions are related to the solutions to the analogous maximization problems of Shannon entropy rate.

BACKGROUND Nonlinear analysis of heart rate variability (HRV) has been recently used as a predictor of prognosis in trauma patients. OBJECTIVES We applied nonlinear analysis of HRV in patients with blunt trauma and intraperitoneal bleeding to assess our ability to predict the outcome of conservative management. PATIENTS AND METHODS An analysis of electrocardiography (ECG) from 120 patients ...