Performing policy iteration in dynamic programming should only require knowledge of relative rather than absolute measures of the utility of actions { what Baird (1993) calls the advantages of actions at states. Nevertheless, existing methods in dynamic programming (including Baird's) compute some form of absolute utility function. For smooth problems, advantages satisfy two di erential consist...