Learning to stop: a unifying principle for legged locomotion in varying environments

• Main Authors: Thomas George Thuruthel, G. Picardi, F. Iida, C. Laschi, M. Calisti
• Format: Article
• Language: English
• Published: The Royal Society 2021-04-01
• Series: Royal Society Open Science
• Subjects: locomotion; modelling; reinforcement learning
• Online Access: https://royalsocietypublishing.org/doi/10.1098/rsos.210223

Evolutionary studies have unequivocally proven the transition of living organisms from water to land. Consequently, it can be deduced that locomotion strategies must have evolved from one environment to the other. However, the mechanism by which this transition happened and its implications on bio-mechanical studies and robotics research have not been explored in detail. This paper presents a unifying control strategy for locomotion in varying environments based on the principle of ‘learning to stop’. Using a common reinforcement learning framework, deep deterministic policy gradient, we show that our proposed learning strategy facilitates a fast and safe methodology for transferring learned controllers from the facile water environment to the harsh land environment. Our results not only propose a plausible mechanism for safe and quick transition of locomotion strategies from a water to land environment but also provide a novel alternative for safer and faster training of robots.