In this paper we consider simple neural network models consisting oftwo to three continuons nonlinear neurons, with no intrinsic synaptic plasticity, and with delay in neural signal transmission. We investigate thé différent dynamic régimes which may exist for thèse "minimal" neural network structures. Examples of stable, oscillatory (periodic or quasi-periodic), and chaotic régimes are reporte...