Abstract Various deep neural network architectures (DNNs) maintain massive vital records in computer vision. While drawing attention worldwide, the design of overall structure lacks general guidance. Based on relationship between DNN and numerical differential equations, we performed a fair comparison residual with higher order perspectives. We show that widely used strategy, constantly stackin...