In this letter, we describe an approach to achieve dynamic legged locomotion on physical robots which combines existing methods for control with reinforcement learning. Specifically, our goal is a hierarchy in highest-level behaviors are planned through reduced-order models, the fundamental physics of locomotion, and lower level controllers utilize learned policy that can bridge gap between ide...