This article discusses a number of reasons why the use of non-monotonic functions as activation functions can lead to a marked improvement in the performance of a neural network. Using a wide range of benchmarks we show that a multilayer feed-forward network using sine activation functions (and an appropriate choice of initial parameters) learns much faster than one incorporating sigmoid functi...

The Resilient Propagation (Rprop) algorithm has been very popular for backpropagation training of multilayer feed-forward neural networks in various applications. The standard Rprop however encounters difficulties in the context of deep neural networks as typically happens with gradient-based learning algorithms. In this paper, we propose a modification of the Rprop that combines standard Rprop...

We present here a new model and algorithm which performs an efficient Natural gradient descent for Multilayer Perceptrons. Natural gradient descent was originally proposed from a point of view of information geometry, and it performs the steepest descent updates on manifolds in a Riemannian space. In particular, we extend an approach taken by the “Whitened neural networks” model. We make the wh...

In this paper a novel technique is proposed for the estimation of resonant frequency of coaxial feed equilateral triangular microstrip patch antenna. The major advantage of the proposed approach is that, after proper training, proposed neural model completely bypasses the repeated use of complex i terative process for calculation of resonant frequency, thus resulting in an extremely fast soluti...

This article investigates the use of a multilayer feedforward artificial neural network into a GPS integrated low cost inertial navigation system based on MEMS sensors. The neural network is applied as an alternative of integration technique, with the purpose of providing better navigation solutions, during the lack of information in GPS outages portions of time. An input-output neural network ...

Botnets have become a rampant platform for malicious attacks, which poses a significant threat to internet security. The recent botnets have begun using common protocols such as HTTP which makes it even harder to distinguish their communication patterns. Most of the HTTP bot communications are based on TCP connections. In this work some TCP related features have been identified for the detectio...

In this paper, Multilayer Feed Forward Artificial Neural Network with weight initialization method is Proposed for Image Compression. Image compression helps to reduce the storage space and transmission cost. Artificial Neural network (ANNs) is a training algorithm has used to compress the image. Artificial neural network is exceptionally Feed Forward Back propagation neural network (FFBPNN) in...

Determination of optimum feed forward artificial neural network (ANN) design and training parameters is an extremely important mission. It is a challenging and daunting task to find an ANN design, which is effective and accurate. This paper presents a new methodology for the optimization of ANN parameters as it introduces a process of training ANN which is effective and less human-dependent. Th...

Being difficult to attain the precise mathematical models, traditional control methods such as proportional integral (PI) and proportional integral differentiation (PID) cannot meet the demands for real time and robustness when applied in some nonlinear systems.The neural network controller is a good replacement to overcome these shortcomings. However, the performance of neural network controll...

This paper presents the use of artificial neural network for the estimation of different performance parameters (i.e. Directivity, Radiation Efficiency, Gain and Bandwidth) of a coaxial feed equilateral triangular microstrip patch antenna. Levenberg-Marquardt training algorithms of MLPFFBP-ANN (Multilayer Perceptron feed forward back propagation Artificial Neural Network) has been used to imple...