While there has been recent successes in learning single control policies, there are several several open challenges in robot motor skill learning. Firstly, many motor tasks can be solved in multiple ways, and, hence, we need to be able to learn each of these solutions as separate options from which the agent can choose from. Furthermore, we need to learn how to adapt an option to the current s...