Operant Conditioning: A Minimal Components Requirement in Artificial Spiking Neurons Designed for Bio-Inspired Robot’s Controller

• Main Authors: André eCyr, Mounir eBoukadoum, Frédéric eThériault
• Format: Article
• Language: English
• Published: Frontiers Media S.A. 2014-07-01
• Series: Frontiers in Neurorobotics
• Subjects: artificial intelligence; Adaptive Behavior; spiking neural networks; Learning robots; ∙ Bio-inspired Agents
• Online Access: http://journal.frontiersin.org/Journal/10.3389/fnbot.2014.00021/full

We demonstrate the operant conditioning (OC) learning process within a basic bio-inspired robot controller paradigm, using an artificial spiking neural network (ASNN) with minimal component count as artificial brain. In biological agents, OC results in behavioral changes that are learned from the consequences of previous actions, using progressive prediction adjustment triggered by reinforcers. In a robotics context, virtual and physical robots may benefit from a similar learning skill when facing unknown environments with no supervision. In this work, we demonstrate that a simple ASNN can efficiently realise many OC scenarios. The elementary learning kernel that we describe relies on a few critical neurons, synaptic links and the integration of habituation and spike-timing dependent plasticity (STDP) as learning rules. Using four tasks of incremental complexity, our experimental results show that such minimal neural component set may be sufficient to implement many OC procedures. Hence, with the described bio-inspired module, OC can be implemented in a wide range of robot controllers, including those with limited computational resources.