Loughborough University
Leicestershire, UK
LE11 3TU
+44 (0)1509 263171
Loughborough University

Loughborough University Institutional Repository

Please use this identifier to cite or link to this item: https://dspace.lboro.ac.uk/2134/17048

Title: Novelty of behaviour as a basis for the neuro-evolution of operant reward learning
Authors: Soltoggio, Andrea
Jones, Ben H.
Keywords: Artificial life
Issue Date: 2009
Publisher: © ACM
Citation: SOLTOGGIO, A. and JONES., B.H., 2009. Novelty of behaviour as a basis for the neuro-evolution of operant reward learning. IN: Proceedings of the 11th Annual Genetic and Evolutionary Computation Conference, GECCO-2009, pp. 169 - 176.
Abstract: An agent that deviates from a usual or previous course of action can be said to display novel or varying behaviour. Novelty of behaviour can be seen as the result of real or apparent randomness in decision making, which prevents an agent from repeating exactly past choices. In this paper, novelty of behaviour is considered as an evolutionary precursor of the exploring skill in reward learning, and conservative behaviour as the precursor of exploitation. Novelty of behaviour in neural control is hypothesised to be an important factor in the neuro-evolution of operant reward learning. Agents capable of varying behaviour, as opposed to conservative, when exposed to reward stimuli appear to acquire on a faster evolutionary scale the meaning and use of such reward information. The hypothesis is validated by comparing the performance during evolution in two environments that either favour or are neutral to novelty. Following these findings, we suggest that neuro-evolution of operant reward learning is fostered by environments where behavioural novelty is intrinsically beneficial, i.e. where varying or exploring behaviour is associated with low risk.
Description: This is a conference paper.
Version: Accepted for publication
DOI: 10.1145/1569901.1569925
URI: https://dspace.lboro.ac.uk/2134/17048
Publisher Link: http://dx.doi.org/10.1145/1569901.1569925
ISBN: 9781605583259
Appears in Collections:Conference Papers and Presentations (Computer Science)

Files associated with this item:

File Description SizeFormat
soltoggioJonesGECCO2009.pdfAccepted version611.72 kBAdobe PDFView/Open


SFX Query

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.