Supervised Hebbian learning

نویسندگان

چکیده

In neural network's Literature, Hebbian learning traditionally refers to the procedure by which Hopfield model and its generalizations store archetypes (i.e., definite patterns that are experienced just once form synaptic matrix). However, term "Learning" in Machine Learning ability of machine extract features from supplied dataset (e.g., made blurred examples these archetypes), order make own representation unavailable archetypes. Here, given a sample examples, we define supervised protocol network can infer archetypes, detect correct control parameters (including size quality dataset) depict phase diagram for system performance. We also prove that, structureless datasets, equipped with this rule is equivalent restricted Boltzmann suggests an optimal interpretable training routine. Finally, approach generalized structured datasets: highlight quasi-ultrametric organization (reminiscent replica-symmetry-breaking) analyzed datasets and, consequently, introduce additional "replica hidden layer" (partial) disentanglement, shown improve MNIST classification 75% 95%, offer new perspective on deep architectures.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Robustness of Hebbian and Anti{hebbian Learning

Self{organizing neural networks with Hebbian and anti{Hebbian learning rules were found robust against variations in the parameters of neurons of the network, such as neural activities, learning rates and noisy inputs. Robustness was evaluated from the point of view of properties of soft competition for input correlations. Two models were studied: a neural network with presynaptic Hebbian learn...

متن کامل

Beyond Hebbian plasticity: Effective learning with ineffective Hebbian learning rules

In this paper we revisit the classical neuroscience paradigm of Hebbian learning. We find that a necessary requirement for effective associative memory learning is that the efficacies of the incoming synapses should be uncorrelated. This is difficult to achieve in a robust manner by Hebbian synaptic learning, since it depends on network level information. Effective learning can yet be achieved ...

متن کامل

Associative Learning: Hebbian Flies

Fruit flies can learn to associate an odor with an aversive stimulus, such as a shock. New findings indicate that disrupting the expression of N-methyl-D-aspartate (NMDA) receptors in flies impairs olfactory conditioning. The findings provide support for a critical role for NMDA receptors in associative learning.

متن کامل

Differential Hebbian Learning

The differential Hebbian law ~.. = C.. 6. is examined as an 13 1 j alternative to the traditional Hebbian law ~.. = C.C. for 13 1 J updating edge connection strengths in neural networks. The motivation is that concurrent change, rather than just concurrent activation, more accurately captures the "concomitant variation" that is central to inductively inferred functional relationships. The resul...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: EPL

سال: 2023

ISSN: ['0295-5075', '1286-4854']

DOI: https://doi.org/10.1209/0295-5075/aca55f