Toward Speech and Nonverbal Behaviors Integration for Humanoid Robot

• Main Authors: Wei Wang, Xiaodan Huang
• Format: Article
• Language: English
• Published: SAGE Publishing 2012-09-01
• Series: International Journal of Advanced Robotic Systems
• Online Access: https://doi.org/10.5772/50370

It is essential to integrate speeches and nonverbal behaviors for a humanoid robot in human-robot interaction. This paper presents an approach using multi-object genetic algorithm to match the speeches and behaviors automatically. Firstly, with humanoid robot's emotion status, we construct a hierarchical structure to link voice characteristics and nonverbal behaviors. Secondly, these behaviors corresponding to speeches are matched and integrated into an action sequence based on genetic algorithm, so the robot can consistently speak and perform emotional behaviors. Our approach takes advantage of relevant knowledge described by psychologists and nonverbal communication. And from experiment results, our ultimate goal, implementing an affective robot to act and speak with partners vividly and fluently, could be achieved.