An investigation of the neural network convergence and prediction based on three optimization algorithms, namely, Levenberg-Marquardt, conjugate gradient, and delta rule, is described. Several simulated neural networks built using the above three algorithms indicated that the Levenberg-Marquardt optimizer implemented as a back-propagation neural network converged faster than the other two algor...

Financial forecasting is an example of signal processing problems. A number of ways to train/learn the network are available. We have used Levenberg-Marquardt algorithm for error back-propagation for weight adjustment. Pre-processing of data has reduced much of the variation at large scale to small scale, reducing the variation of training data. Keywords— Gradient descent method, jacobian matri...

In this work, two modifications on Levenberg-Marquardt algorithm for feedforward neural networks are studied. One modification is made on performance index, while the other one is on calculating gradient information. The modified algorithm gives a better convergence rate compared to the standard Levenberg-Marquard (LM) method and is less computationally intensive and requires less memory. The p...

The problem is considered of the estimation of a polygonal region in two dimensions from data approximately marking the outline of the region. A solution is sought by formulating and solving a nonlinear least squares problem. A Levenberg–Marquardt method is developed for this problem, with an implementation which exploits the special structure so that the Levenberg–Marquardt step can be compute...

1 – Introduction Parameter estimation for function optimization is a well established problem in computing, as there are countless applications in practice. For this work, we will focus specifically in implementing a distributed and parallel implementation of the Levenberg Marquardt algorithm, which is a well established numerical solver for function approximation given a limited data set. Para...

The rst part of this paper studies a Levenberg-Marquardt scheme for nonlinear inverse problems where the corresponding Lagrange (or regularization) parameter is chosen from an inexact Newton strategy. While the convergence analysis of standard implementations based on trust region strategies always requires the invertibility of the Fr echet derivative of the nonlinear operator at the exact solu...

Abstract In this paper, we propose a distributed algorithm for sensor network localization based on maximum likelihood formulation. It relies the Levenberg-Marquardt where computations are among different computational agents using message passing, or equivalently dynamic programming. The resulting provides good accuracy, and it converges to same solution as its centralized counterpart. Moreove...

This paper presents a tensor approximation algorithm, based on the Levenberg–Marquardt method for nonlinear least square problem, to decompose large-scale tensors into sum of products vector groups given scale, or obtain low-rank without losing too much accuracy. An Armijo-like rule inexact line search is also introduced this algorithm. The result decomposition adjustable, which implies that ca...

Training neural networks to capture an intrinsic property of a large volume of high dimensional data is a difficult task, as the training process is computationally expensive. Input attributes should be carefully selected to keep the dimensionality of input vectors relatively small. Technical indexes commonly used for stock market prediction using neural networks are investigated to determine i...