The emergence of big data has caused a dramatic shift in the operating regime for optimization algorithms. performance bottleneck, which used to be computations, is now often communications. Several gradient compression techniques have been proposed reduce communication load at price loss solution accuracy. Recently, it shown how errors can compensated algorithm improve Even though convergence ...
