With the increase in use of machine learning classifiers several fields, providing human- understandable explanation their outputs has become an imperative. It is essential to generate trust for day-to-day tasks, especially sensible domains as medical imaging. Although many works have addressed this problem by generating visual maps, they often provide noisy and inaccurate results forcing heuri...