Optimal scenario set partitioning for multistage stochastic programming with the progressive hedging algorithm

In this paper, we propose a new approach to reduce the total running time (RT) of the progressive hedging algorithm (PHA) for solving multistage stochastic programs (MSPs) defined on a scenario tree. Instead of using the conventional scenario decomposition scheme, we apply a multi-scenario decomposition scheme and partition the scenario set in order to minimize the number of non-anticipativity constraints (NACs) on which an augmented Lagrangian relaxation (ALR) must be applied. Our partitioning method is a heuristic algorithm that takes into account the complex branching structure of general multistage scenario trees. Minimizing the number of relaxed NACs (RNACs) enhances the PHA’s convergence rate by decreasing the variability of subproblems solutions at duplicated tree nodes. This is due to the fact that minimizing the RNACs reduces the anticipativity level of subproblems by increasing the branching level of subtrees. This makes RNACs easier to satisfy. Our partitioning method also reduces the total RT per iteration in two different ways. Firstly, it decreases the number of linear and quadratic penalty terms that need to be included in subproblems objective function. ∗Corresponding author. Tel. +1 514 343 7575, fax. +1 514 343 7121. Email address: [email protected] (Pierre-Luc Carpentier)