1. Dietterich, T.: Hierarchical reinforcement learning with the MAXQ value function decomposition.

Journal of Artificial Intelligence Research, 13:227–303, 2000

2. Konidaris and Barto: Efficient Skill Learning using Abstraction Selection. IJCAI-09.
3. L. Frommberger: Situation Dependent Spatial Abstraction in Reinforcement Learning

Based on Structural Knowledge ICML-2009.