To accommodate rapid changes in the real world, cognition system of humans is capable continually learning concepts. On contrary, conventional deep models lack this capability preserving previously learned knowledge. When a neural network fine-tuned to learn new tasks, its performance on trained tasks will significantly deteriorate. Many recent works incremental object detection tackle problem ...