in this paper, we show that the chapman-kolmogorov formula could be used as a recursive formula for computing the m-step-ahead conditional density of a markov bilinear model. the stationary marginal probability density function of the model may be approximated by the m-step-ahead conditional density for sufficiently large m.