Texts are the major information carrier for internet users, from which learning latent representations has important research and practical value. Neural topic models have been proposed great performance in extracting interpretable topics of texts. However, there remain two limitations: (1) these methods generally ignore contextual texts limited feature representation ability due to shallow fee...