The Fokker-planck Machine as Deterministic Ensemble Annealing 1 the Fokker-planck Machine as Deterministic Ensemble Annealing
نویسندگان
چکیده
In this paper we discuss the relation between ensemble learning, deterministic annealing and Markov chain sample and optimization methods on the one hand and the Fokker-Planck Machine on the other hand. The latter was introduced as an alternative method for high-dimensional non-convex optimization, as often encountered in training of neural networks. We demonstrate how the Fokker-Planck Machine can be seen as a combination of and generalization to the aforementioned techniques.
منابع مشابه
Bayesian Learning and the Fokker-planck Machine 1 Bayesian Learning and the Fokker-planck Machine
In this paper we discuss the links between simulated annealing, Langevin optimisation, Markov Chain Monte Carlo methods and ensemble learning on the one hand and the Fokker-Planck machine on the other hand. The FP Machine was introduced as an alternative method for global optimization. Where most optimisation methods follow point-trajectories through search space (either deterministic or stocha...
متن کاملNonconvex Optimization Using a Fokker-planck Learning Machine
A new algorithm for nonconvex optimization by means of a so-called Fokker-Planck Learning Machine is proposed in this paper. This is done by considering the Fokker-Planck (FP) equation related to continuous simulated annealing, which has been proven to convergence to the global optimum under certain conditions. An approximate solution to the FP equation is sought by parametrizing the transition...
متن کاملNumerical Studies and Simulation of the Lower Hybrid Waves Current Drive by using Fokker – Planck Equation in NSST and HT-7 Tokamaks
Recent experiments on the spherical tokamak have discovered the conditions to create a powerful plasma and ensure easy shaping and amplification of stability, high bootstrap current and confinement energy. The spherical tours (ST) fusion energy development path is complementary to the tokamak burning plasma experiment such as NSTX and higher toroidal beta regimes and improves the design of a po...
متن کاملPseudo-spectral Matrix and Normalized Grunwald Approximation for Numerical Solution of Time Fractional Fokker-Planck Equation
This paper presents a new numerical method to solve time fractional Fokker-Planck equation. The space dimension is discretized to the Gauss-Lobatto points, then we apply pseudo-spectral successive integration matrix for this dimension. This approach shows that with less number of points, we can approximate the solution with more accuracy. The numerical results of the examples are displayed.
متن کامل