In this paper, a deep learning optimization algorithm is proposed, which based on the Grünwald–Letnikov (G-L) fractional order definition. An optimizer calculus gradient descent G-L definition (FCGD_G-L) designed. Using short-memory effect of definition, derivation only needs 10 time steps. At same time, via transforming formula Gamma function eliminated. Thereby, it can achieve unification and...