Abstract
© 2015 IEEE. We present a Bayesian reinforcement learning model with a working memory module which can solve some non-Markovian decision processes. The model is tested, and compared against SARSA (lambda), on a standard working-memory task from the psychology literature. Our method uses the Kalman temporal difference framework, And its extension to stochastic state transitions, to give posterior distributions over state-Action values. This framework provides a natural mechanism for using reward information to update more than the current state-Action pair, and thus negates the use of eligibility traces. Furthermore, the existence of full posterior distributions allows the use of Thompson sampling for action selection, which in turn removes the need to choose an appropriately parameterised action-selection method.
Original language | English |
---|---|
Title of host publication | 2015 IEEE Symposium Series on Computational Intelligence |
Editors | Jacek Zurada, Marco Dorigo |
Publisher | IEEE, Institute of Electrical and Electronics Engineers |
Pages | 579-586 |
Number of pages | 8 |
ISBN (Print) | 9781479975600 |
DOIs | |
Publication status | Published - 2015 |
Event | IEEE Symposium Series on Computational Intelligence, SSCI 2015 - Cape Town, South Africa Duration: 8 Dec 2015 → 10 Dec 2015 |
Conference
Conference | IEEE Symposium Series on Computational Intelligence, SSCI 2015 |
---|---|
Country/Territory | South Africa |
City | Cape Town |
Period | 8/12/15 → 10/12/15 |