1.     Dearden et al: Bayesian Q-Learning  & Model-Based Bayesian Exploration

2.     A Bayesian Framework for Reinforcement Learning, Malcolm Strens

3.     Model-based Bayesian Reinforcement Learning in Partially Observable Domains

(model based bayesian rl for POMDPs ),  Pascal Poupart and Nikos Vlassis. AI-Math 2008

4.     Poupart, Vlassis, Hoey and Regan: An analytic solution to Discrete Bayesian Reinforcement Learning, 23rd ICML, 2006

5.     Christos Dimitrakakis, 2008:  Tree Exploration for Bayesian RL Exploration, Computational Intelligence for Modelling, Control and Automation (CIMCA 2008), Vienna, Austria

6.     Pandey, Chakrabarti, Agarwl : Multi-armed bandit problems with Dependent Arms. ICML-2007