Pattern recognition in Hopfield type networks with a finite range of connections
نویسنده
چکیده
2014 We study pattern recognition in linear Hopfield type networks of N neurons where each neuron is connected to the z subsequent neurons such that the state of the ith neuron at time t + 1 is determined by the states of neurons i + 1, ...,i + z at time t. We find that for small values of z/N the retrieval behavior differs considerably from the behavior of diluted Hopfield networks. The maximum number of random patterns that can be retrieved increases in a non linear way with z and the asymptotic mean overlap between input and output patterns decreases sharply as z is decreased and reaches zero at a finite value of z. J. Phys. Frarcce 51 ( 1990) 1797-1801 1er SEPTEMBRE 1990, Classification Physics Abstracts 87.30 75. 10H 64.60 In recent years, Hopfield neural networks [1] have been studied extensively (for recent reviews see e.g. [2-4]). The Hopfield network provides a standard for neural nets since its long time retrieval behavior could be treated analytically [5] by solving for the equilibrium statistical mechanics of the net. The solution could be achieved since all neurons in the net are interconnected. In this paper we report on numerical studies of linear Hopfield type nets of (usually N = 400) neurons where each neuron is connected only to a certain number of other neurons, and periodic boundary conditions are employed. Previous work in this direction was mainly devoted to nearest neighbor and next nearest neighbor connections, or to dilute (damaged) networks where a certain fraction of connections was randomly cut [6-10]. The network consists of lV neurons, each of them can be in two states ?: = ±1. The coupling strength Ji,j between pairs of connected neurons is determined by the M random patterns (g> ) (eï çfv), J-t = 1, 2,..., M, which are to be stored in the network: The state of neuron i at a given time t + 1 is obtained from the states of the z subsequent neurons at time t by
منابع مشابه
Estimation of Network Reliability for a Fully Connected Network with Unreliable Nodes and Unreliable Edges using Neuro Optimization
In this paper it is tried to estimate the reliability of a fully connected network of some unreliable nodes and unreliable connections (edges) between them. The proliferation of electronic messaging has been witnessed during the last few years. The acute problem of node failure and connection failure is frequently encountered in communication through various types of networks. We know that a ne...
متن کاملEnhanced storage capacity with errors in scale-free Hopfield neural networks: An analytical study
The Hopfield model is a pioneering neural network model with associative memory retrieval. The analytical solution of the model in mean field limit revealed that memories can be retrieved without any error up to a finite storage capacity of O(N), where N is the system size. Beyond the threshold, they are completely lost. Since the introduction of the Hopfield model, the theory of neural network...
متن کاملApplication of Artificial Neural Networks in Particle Physics
The application of artificial neural networks in particle physics is reviewed. The use of feed-forward nets is most common for event classification and function approximation. This network type is best suited for a hardware implementation and special VLSI chips are available which are used in fast trigger processors. Also discussed are fully connected networks of the Hopfield type for pattern r...
متن کامل5 . Recurrent networks
So far we have been studying networks that only have forward connections and thus there have been no loops. Networks with loops — recurrent connections is the technical term used in the literature — have an internal dynamics. The networks that we have introduced so far have only retained information about the past in terms of their weights, which have been changed according to the learning rule...
متن کاملPattern-recalling processes in quantum Hopfield networks far from saturation
Abstract. As a mathematical model of associative memories, the Hopfield model was now well-established and a lot of studies to reveal the pattern-recalling process have been done from various different approaches. As well-known, a single neuron is itself an uncertain, noisy unit with a finite unnegligible error in the input-output relation. To model the situation artificially, a kind of ‘heat b...
متن کامل