In this paper we focus on the linear algebra theory behind feedforward (FNN) and recurrent (RNN) neural networks. We review backward propagation, including backward propagation through time (BPTT). Also, we obtain a new exact expression for Hessian, which represents second order effects. We show that for t time steps the weight gradient can be expressed as a rank-t matrix, while the weight Hess...

BACKGROUNDS Recent explosion of biological data brings a great challenge for the traditional clustering algorithms. With increasing scale of data sets, much larger memory and longer runtime are required for the cluster identification problems. The affinity propagation algorithm outperforms many other classical clustering algorithms and is widely applied into the biological researches. However, ...

an efficient and cost effective protocol for in vitro propagation of pineapple (ananas comosus var. queen) has been developed. in the proliferation stage, agar based murashige and skoog (ms) media was supplemented with 3.0 mg/l benzyleaminopurine (bap), 0.5 mg/l indole acetic acid (iaa) and 50 mg/l adenine sulphate as rbc design experiment. two approaches were taken to reduce the chemical cost ...

We derive the off-shell scattering matrix for a spherical scatterer. The result obtained generalizes the off-on-shell matrix commonly used in the theory of scalar waves propagation in random media.

We consider the problem of reconstructing sparse symmetric block models with two blocks and connection probabilities a/n and b/n for interand intra-block edge probabilities respectively. It was recently shown that one can do better than a random guess if and only if (a − b) > 2(a + b). Using a variant of Belief Propagation, we give a reconstruction algorithm that is optimal in the sense that if...

A novel joint angle and delay estimation (JADE) algorithm for multipath signals, based on the PARAllel profiles with LINear Dependencies (PARALIND) model, is proposed. Capitalizing on the structure property of Vandermonde matrices, PARALIND model is proved to be unique. Angle and delay of multiple rays of sources can be estimated by PARALIND decomposition and an ESPRIT-like shift-invariance tec...

This work was supported by the Brain Korea 21 Project. Abstract~A code acquisition scheme is proposed for DS/ CDMA systems with multiple antennas. The proposed scheme employs a new search scheme, referred to as sparse search, to utilize multipath signals in reducing mean acquisition time over frequency-selective fading channels. The mean acquisition time performance of the proposed scheme is an...

A new complex Jacobi iterative technique adapted for the solution of three-dimensional (3D) non-paraxial beam propagation is presented. The beam propagation equation for analysis of optical propagation in waveguide structures is based on a novel modified Padé(1,1) approximant operator we recently proposed. The effectiveness of our new approach is demonstrated in comparison with the traditional ...