This supplementary material is organised into three parts. In the first two parts we respectively state the proofs of the onaverage and uniform stability analysis. In the last part, we show that the specific loss presented in the paper is k-lipschitz. For the sake of readability we start by recalling our setting. Let T be a training set drawn from a distribution DT over X × Y . We consider the ...