Visual tracking has achieved great progress due to numerous different algorithms. However, deep trackers based on classification or Siamese network still have their specific limitations. In this work, we show how teach machines track a generic object in videos like humans, who can use few search steps perform tracking. By constructing Markov decision process Deep Reinforcement Learning (DRL), o...