Multi-agent imitation learning aims to train multiple agents perform tasks from demonstrations by a mapping between observations and actions, which is essential for understanding physical, social, team-play systems. However, most existing works on modeling multi-agent interactions typically assume that make independent decisions based their observations, ignoring the complex dependence among ag...