In this article, some new results on $M$-matrices, $H$-matrices and their inverse classes are proved. Specifically, we study when a singular $Z$-matrix is an $M$-matrix, convex combinations of $H$-matrices, almost monotone Cholesky factorizations $H$-matrices.