We prove that a harmonic map with small energy and monotonicity property is smooth if its singular set is rectifiable and has a finite uniform density; moreover, the monotonicity property holds if the singular set has a lower dimension or its gradient has higher integrability. This work generalizes the results in [CL][DF][LG12], which were proved under the assumptions that the singular sets are...