Video-based action recognition has recently attracted much attention in the field of computer vision. To solve more complex tasks, it become necessary to distinguish different levels interclass variations. Inspired by a common flowchart based on human decision-making process that first narrows down probable classes and then applies "rethinking" for finer-level recognition, we propose an effecti...