0 and p. At any given time, a randomly selected agent is activated and performs computation to optimize its local objective. Such distributed computation model has been popular in large-scale machine learning and signal processing (6). Such model is also closely related to the (centralized) stochastic finite-sum optimization problem (14; 9; 13; 21; 1; 22), in which each time the iterate is upda...