Action Selection and Operant Conditioning: A Neurorobotic Implementation

Action selection (AS) is thought to represent the mechanism involved by natural agents when deciding what should be the next move or action. Is there a functional elementary core sustaining this cognitive process? Could we reproduce the mechanism with an artificial agent and more specifically in a n...

Full description

Saved in:
Bibliographic Details
Main Authors: André Cyr, Frédéric Thériault
Format: Article
Language:English
Published: Wiley 2015-01-01
Series:Journal of Robotics
Online Access:http://dx.doi.org/10.1155/2015/643869
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832552742602670080
author André Cyr
Frédéric Thériault
author_facet André Cyr
Frédéric Thériault
author_sort André Cyr
collection DOAJ
description Action selection (AS) is thought to represent the mechanism involved by natural agents when deciding what should be the next move or action. Is there a functional elementary core sustaining this cognitive process? Could we reproduce the mechanism with an artificial agent and more specifically in a neurorobotic paradigm? Unsupervised autonomous robots may require a decision-making skill to evolve in the real world and the bioinspired approach is the avenue explored through this paper. We propose simulating an AS process by using a small spiking neural network (SNN) as the lower neural organisms, in order to control virtual and physical robots. We base our AS process on a simple central pattern generator (CPG), decision neurons, sensory neurons, and motor neurons as the main circuit components. As novelty, this study targets a specific operant conditioning (OC) context which is relevant in an AS process; choices do influence future sensory feedback. Using a simple adaptive scenario, we show the complementarity interaction of both phenomena. We also suggest that this AS kernel could be a fast track model to efficiently design complex SNN which include a growing number of input stimuli and motor outputs. Our results demonstrate that merging AS and OC brings flexibility to the behavior in generic dynamical situations.
format Article
id doaj-art-d759dfaf1f1746b4b8c4427253890cf8
institution Kabale University
issn 1687-9600
1687-9619
language English
publishDate 2015-01-01
publisher Wiley
record_format Article
series Journal of Robotics
spelling doaj-art-d759dfaf1f1746b4b8c4427253890cf82025-02-03T05:57:58ZengWileyJournal of Robotics1687-96001687-96192015-01-01201510.1155/2015/643869643869Action Selection and Operant Conditioning: A Neurorobotic ImplementationAndré Cyr0Frédéric Thériault1Département d’Informatique, Université du Québec à Montréal (UQAM), Succursale Centre-Ville, Case Postale 8888, Montreal, QC, H3C 3P8, CanadaDépartement d’Informatique, Université du Québec à Montréal (UQAM), Succursale Centre-Ville, Case Postale 8888, Montreal, QC, H3C 3P8, CanadaAction selection (AS) is thought to represent the mechanism involved by natural agents when deciding what should be the next move or action. Is there a functional elementary core sustaining this cognitive process? Could we reproduce the mechanism with an artificial agent and more specifically in a neurorobotic paradigm? Unsupervised autonomous robots may require a decision-making skill to evolve in the real world and the bioinspired approach is the avenue explored through this paper. We propose simulating an AS process by using a small spiking neural network (SNN) as the lower neural organisms, in order to control virtual and physical robots. We base our AS process on a simple central pattern generator (CPG), decision neurons, sensory neurons, and motor neurons as the main circuit components. As novelty, this study targets a specific operant conditioning (OC) context which is relevant in an AS process; choices do influence future sensory feedback. Using a simple adaptive scenario, we show the complementarity interaction of both phenomena. We also suggest that this AS kernel could be a fast track model to efficiently design complex SNN which include a growing number of input stimuli and motor outputs. Our results demonstrate that merging AS and OC brings flexibility to the behavior in generic dynamical situations.http://dx.doi.org/10.1155/2015/643869
spellingShingle André Cyr
Frédéric Thériault
Action Selection and Operant Conditioning: A Neurorobotic Implementation
Journal of Robotics
title Action Selection and Operant Conditioning: A Neurorobotic Implementation
title_full Action Selection and Operant Conditioning: A Neurorobotic Implementation
title_fullStr Action Selection and Operant Conditioning: A Neurorobotic Implementation
title_full_unstemmed Action Selection and Operant Conditioning: A Neurorobotic Implementation
title_short Action Selection and Operant Conditioning: A Neurorobotic Implementation
title_sort action selection and operant conditioning a neurorobotic implementation
url http://dx.doi.org/10.1155/2015/643869
work_keys_str_mv AT andrecyr actionselectionandoperantconditioninganeuroroboticimplementation
AT frederictheriault actionselectionandoperantconditioninganeuroroboticimplementation