Document Server@UHasselt >
Research >
Research publications >

Please use this identifier to cite or link to this item: http://hdl.handle.net/1942/729

Title: A selection-mutation model for q-learning in multi-agent systems
Authors: TUYLS, Karl
Verbeeck, Katja
Lenaerts, Tom
Issue Date: 2003
Publisher: Association for Computing Machinery
Citation: International Conference on Autonomous Agents . Proceedings of the second international joint conference on Autonomous agents and multiagent systems. p. 693-700.
Abstract: Although well understood in the single-agent framework, the use of traditional reinforcement learning (RL) algorithms in multi-agent systems (MAS) is not always justified. The feedback an agent experiences in a MAS, is usually influenced by the other agents present in the system. Multi agent environments are therefore non-stationary and convergence and optimality guarantees of RL algorithms are lost. To better understand the dynamics of traditional RL algorithms we analyze the learning process in terms of evolutionary dynamics. More specifically we show how the Replicator Dynamics (RD) can be used as a model for Q-learning in games. The dynamical equations of Q-learning are derived and illustrated by some well chosen experiments. Both reveal an interesting connection between the exploitation-exploration scheme from RL and the selection-mutation mechanisms from evolutionary game theory.
URI: http://hdl.handle.net/1942/729
Link to publication: http://doi.acm.org/10.1145/860575.860687
ISBN: 1-58113-683-8
Category: C1
Type: Proceedings Paper
Appears in Collections: Research publications

Files in This Item:

There are no files associated with this item.

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.