In this paper, one aims at investigating the stability and convergence properties of a set membership identification methods involving ARMAX and OE model structures and optimal bounding ellipsoid based parameter adaptation. Fundamental results are obtained, they generalize some results that have been already established for FIR and ARX model structures.