Uous and Discrete Addressing Schemes
نویسندگان
چکیده
In this paper, we extend neural Turing machine (NTM) into a dynamic neural Turing machine (D-NTM) by introducing a trainable memory addressing scheme. This addressing scheme maintains for each memory cell two separate vectors, content and address vectors. This allows the D-NTM to learn a wide variety of location-based addressing strategies including both linear and nonlinear ones. We implement the D-NTM with both continuous, differentiable and discrete, non-differentiable read/write mechanisms. We investigate the mechanisms and effects for learning to read and write to a memory through experiments on Facebook bAbI tasks using both a feedforward and GRU-controller. The D-NTM is evaluated on a set of Facebook bAbI tasks and shown to outperform NTM and LSTM baselines. We also provide further experimental results on sequential MNIST, associative recall and copy tasks.
منابع مشابه
The comparison of two high-order semi-discrete central schemes for solving hyperbolic conservation laws
This work presents two high-order, semi-discrete, central-upwind schemes for computing approximate solutions of 1D systems of conservation laws. We propose a central weighted essentially non-oscillatory (CWENO) reconstruction, also we apply a fourth-order reconstruction proposed by Peer et al., and afterwards, we combine these reconstructions with a semi-discrete central-upwind numerical flux ...
متن کاملFormal Specifications for Hybrid Dynamical Systems
Modeling abstractions in physical systems re sult in hybrid models which encompass contin uous behaviors with discrete changes causing discontinuities in system behavior generation which violate the physical laws of conservation of energy and continuity of power This pa per develops a formal speci cation for handling discrete model con guration changes at well de ned points in time and a consis...
متن کاملSecurity Analysis of a Hash-Based Secret Sharing Scheme
Secret sharing schemes perform an important role in protecting se-cret by sharing it among multiple participants. In 1979, (t; n) threshold secret sharing schemes were proposed by Shamir and Blakley independently. In a (t; n) threshold secret sharing scheme a secret can be shared among n partic-ipants such that t or more participants can reconstruct the secret, but it can not be reconstructed b...
متن کاملNonstandard finite difference schemes for differential equations
In this paper, the reorganization of the denominator of the discrete derivative and nonlocal approximation of nonlinear terms are used in the design of nonstandard finite difference schemes (NSFDs). Numerical examples confirming then efficiency of schemes, for some differential equations are provided. In order to illustrate the accuracy of the new NSFDs, the numerical results are compared with ...
متن کاملAddressing Health Workforce Distribution Concerns: A Discrete Choice Experiment to Develop Rural Retention Strategies in Cameroon
Background Nearly every nation in the world faces shortages of health workers in remote areas. Cameroon is no exception to this. The Ministry of Public Health (MoPH) is currently considering several rural retention strategies to motivate qualified health personnel to practice in remote rural areas. Methods To better calibrate these mechanisms and to develop evidence-based retention strategies...
متن کامل