Intrinsically motivated developmental learning of communication in robotic agents

• Main Author: Sheldon, Michael
• Other Authors: Lee, Mark ; Law, James Alexander
• Published: Aberystwyth University 2013
• Subjects: 004
• Online Access: https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.600143

This thesis is concerned with the emergence of communication in arti cial agents as an integrated part of a more general developmental progression. We demonstrate how early gestural communication can emerge out of sensorimotor exploration before moving on to linguistic communication. We then show how communicative abilities can feed back into more general motor learning. We take a cumulative developmental approach, with two di erent robotic platforms undergoing a series of psychologically inspired developmental stages. These begin with the robot learning about its own body's capabilities and limitations, then on to object interaction, the learning of proto-imperative pointing and early language learning. Finally this culminates in more complex object interaction in the form of learning to build stacks of objects with the linguistic capabilities developed earlier being used to help guide the robot's learning. This developmental progression is supported by a schema learning mechanism which constructs a hierarchy of competencies capable of dealing with problems of gradually increasing complexity. To allow for the learning of general concepts we introduce an algorithm for the generalisation of schemas from a small number of examples through parameterisation. Throughout the robot's development its actions are driven by an intrinsic motivation system designed to mimic the play-like behaviour seen in infants. We suggest a possible approach to intrinsic motivation in a schema learning system and demonstrate how this can lead to the rapid unsupervised learning of both speci c experiences and general concepts.