Dynamics of learning in coupled oscillators tutored with delayed reinforcements.
نویسندگان
چکیده
In this work we analyze the solutions of a simple system of coupled phase oscillators in which the connectivity is learned dynamically. The model is inspired by the process of learning of birdsongs by oscine birds. An oscillator acts as the generator of a basic rhythm and drives slave oscillators which are responsible for different motor actions. The driving signal arrives at each driven oscillator through two different pathways. One of them is a direct pathway. The other one is a reinforcement pathway, through which the signal arrives delayed. The coupling coefficients between the driving oscillator and the slave ones evolve in time following a Hebbian-like rule. We discuss the conditions under which a driven oscillator is capable of learning to lock to the driver. The resulting phase difference and connectivity are a function of the delay of the reinforcement. Around some specific delays, the system is capable of generating dramatic changes in the phase difference between the driver and the driven systems. We discuss the dynamical mechanism responsible for this effect and possible applications of this learning scheme.
منابع مشابه
Amplitude death of identical oscillators in networks with direct coupling.
It is known that amplitude death can occur in networks of coupled identical oscillators if they interact via diffusive time-delayed coupling links. Here we consider networks of oscillators that interact via direct time-delayed coupling links. It is shown analytically that amplitude death is impossible for directly coupled Stuart-Landau oscillators, in contradistinction to the case of diffusive ...
متن کاملA Phase Noise Reduction Technique in LC Cross-coupled Oscillators with Adjusting Transistors Operating Regions
In this paper, an intuitive analysis of a phase noise reduction technique is done, and then a modified structure is proposed to achieve higher phase noise reduction than the original one. This method reduces the impact of noise sources on the phase noise by decreasing closed-loop gain in zero-crossings points and moving this high closed-loop gain to the non-zero-crossings points. This reduction...
متن کاملDynamics of a Ring of Pulse-Coupled Oscillators: Group Theoretic Approach
The dynamics of coupled oscillator arrays has been the subject of much recent experimental and theoretical interest. Example systems include Josephson junctions [1,2], lasers [3], oscillatory chemical reactions [4], heart pacemaker cells [5], central pattern generators [6], and cortical neural oscillators [7]. In many applications the oscillators are identical, dissipative, and the coupling is ...
متن کاملTraining and delayed reinforcements in Q-learning agents
Q-learning can greatly improve its convergence speed if helped by immediate reinforcements provided by a trainer able to judge the usefulness of actions as stage setting with respect to the goal of the agent. This paper experimentally investigates this hypothesis studying the integration of immediate reinforcements (also called training reinforcements) with standard delayed reinforcements (name...
متن کاملStimulus-locked responses of two phase oscillators coupled with delayed feedback.
For a system of two phase oscillators coupled with delayed self-feedback we study the impact of pulsatile stimulation administered to both oscillators. This system models the dynamics of two coupled phase-locked loops (PLLs) with a finite internal delay within each loop. The delayed self-feedback leads to a rich variety of dynamical regimes, ranging from phase-locked and periodically modulated ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Physical review. E, Statistical, nonlinear, and soft matter physics
دوره 72 1 Pt 1 شماره
صفحات -
تاریخ انتشار 2005