Loughborough University
Leicestershire, UK
LE11 3TU
+44 (0)1509 263171
Loughborough University

Loughborough University Institutional Repository

Please use this identifier to cite or link to this item: https://dspace.lboro.ac.uk/2134/16075

Title: Short-term plasticity as cause-effect hypothesis testing in distal reward learning
Authors: Soltoggio, Andrea
Keywords: Short-term plasticity
Transient weights
Distal reward
Operant learning
Plasticity versus stability
Memory consolidation
Issue Date: 2015
Publisher: © Springer-Verlag Berlin Heidelberg
Citation: SOLTOGGIO, A., 2015. Short-term plasticity as cause-effect hypothesis testing in distal reward learning. Biological Cybernetics, 109 (1), pp.75-94.
Abstract: Asynchrony, overlaps and delays in sensory-motor signals introduce ambiguity as to which stimuli, actions, and rewards are causally related. Only the repetition of reward episodes helps distinguish true cause-effect relationships from coincidental occurrences. In the model proposed here, a novel plasticity rule employs short and long-term changes to evaluate hypotheses on cause-effect relationships. Transient weights represent hypotheses that are consolidated in long-term memory only when they consistently predict or cause future rewards. The main objective of the model is to preserve existing network topologies when learning with ambiguous information flows. Learning is also improved by biasing the exploration of the stimulus-response space towards actions that in the past occurred before rewards. The model indicates under which conditions beliefs can be consolidated in long-term memory, it suggests a solution to the plasticity-stability dilemma, and proposes an interpretation of the role of short-term plasticity.
Description: This article was published in the journal, Biological Cybernetics. The final publication is available at Springer via http://dx.doi.org/
Sponsor: European Community’s Seventh Framework Programme FP7/2007-2013, Challenge 2 Cognitive Systems, Interaction, Robotics under Grant Agreement No. 248311-AMARSi
Version: Accepted for publication
DOI: 10.1007/s00422-014-0628-0
URI: https://dspace.lboro.ac.uk/2134/16075
Publisher Link: http://dx.doi.org/10.1007/s00422-014-0628-0
ISSN: 0340-1200
Appears in Collections:Published Articles (Computer Science)

Files associated with this item:

File Description SizeFormat
1402.0710v5.pdfAccepted version1.8 MBAdobe PDFView/Open

 

SFX Query

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.