Use this URL to cite or link to this record in EThOS: http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.553862
Title: Hybrid modular reinforcement learning for game agent control
Author: Hanna, Christopher J.
Awarding Body: University of Ulster
Current Institution: Ulster University
Date of Award: 2011
Availability of Full Text:
Access from EThOS:
Abstract:
Intelligent virtual characters play an important role in creating an engaging player experience in modern computer games. Imbuing these characters with learning capabilities curtails the need to define every nuance of their behaviour during development. For this reason, there is growing interest in introducing machine learning techniques into game agent control architectures. However, computer game environments tend to be highly complex and dynamic, which necessitates the use of large state spaces to define effective agent behaviour. Traditional learning strategies are not suited to operating under these circumstances due to the "Curse of Dimensionality". Therefore, in order for their learning to be effective, agents require architectures that can handle complex dynamic state spaces. Within this thesis it is demonstrated that modular reinforcement learning and reactive / deliberative hybridisation techniques present a powerful combination for the implementation of effective game agent architectures. A novel approach to modular reinforcement learning is presented that utilises a fine granularity of modules. This new approach necessitated the development and evaluation of new methods for action selection, reward distribution and exploration. Furthermore, a new method of hybridising modular architectures with deliberative mechanisms is proposed and evaluated. Results demonstrate that agents implemented with hybrid reactive / deliberative architecture can outperform purely reactive and purely deliberative agents, particularly in resource constrained applications.
Supervisor: Not available Sponsor: Not available
Qualification Name: Thesis (Ph.D.) Qualification Level: Doctoral
EThOS ID: uk.bl.ethos.553862  DOI: Not available
Share: