Generalization Bound for Infinitely Divisible Empirical Process
نویسندگان
چکیده
In this paper, we study the generalization bound for an empirical process of samples independently drawn from an infinitely divisible (ID) distribution, which is termed as the ID empirical process. In particular, based on a martingale method, we develop deviation inequalities for the sequence of random variables of an ID distribution. By applying the obtained deviation inequalities, we then show the generalization bound for ID empirical process based on the annealed VapnikChervonenkis (VC) entropy. Afterward, according to Sauer’s lemma, we get the generalization bound for ID empirical process based on the VC dimension. Finally, by using a resulted result bound, we analyze the asymptotic convergence of ID empirical process and show that the convergence rate of ID empirical process can reach O ((ΛF (2N) N ) 1 1.3 ) and it is faster than the results of the generic i.i.d. empirical process (Vapnik, 1999).
منابع مشابه
Risk Bounds for Infinitely Divisible Distribution
In this paper, we study the risk bounds for samples independently drawn from an infinitely divisible (ID) distribution. In particular, based on a martingale method, we develop two deviation inequalities for a sequence of random variables of an ID distribution with zero Gaussian component. By applying the deviation inequalities, we obtain the risk bounds based on the covering number for the ID d...
متن کاملA Generalization of the Results of Pillai
In a recent article Pillai (1990, Ann. Inst. Statist. Math., 42, 157-161) showed that the distribution 1-E~(-x~), 0 < c~ _< 1; 0 _< x, where E~(x) is the Mittag-Lettter function, is infinitely divisible and geometrically infinitely divisible. He also clarified the relation between this distribution and a stable distribution. In the present paper, we generalize his results by using Bernstein fun...
متن کاملOn causal stochastic equations for log-stable multiplicative cascades
We reformulate various versions of infinitely divisible cascades proposed in the literature using stochastic equations. This approach sheds a new light on the differences and common points of several formulations that have been recently provided by several teams. In particular, we focus on the simplification occurring when the infinitely divisible noise at the heart of such model is stable: an ...
متن کاملModeling of Infinite Divisible Distributions Using Invariant and Equivariant Functions
Basu’s theorem is one of the most elegant results of classical statistics. Succinctly put, the theorem says: if T is a complete sufficient statistic for a family of probability measures, and V is an ancillary statistic, then T and V are independent. A very novel application of Basu’s theorem appears recently in proving the infinite divisibility of certain statistics. In addition ...
متن کاملA New Tight Upper Bound on the Entropy of Sums
We consider the independent sum of a given random variable with a Gaussian variable and an infinitely divisible one. We find a novel tight upper bound on the entropy of the sum which still holds when the variable possibly has an infinite second moment. The proven bound has several implications on both information theoretic problems and infinitely divisible noise channels’ transmission rates.
متن کامل