Navigation in Restricted Channels Under Environmental Conditions: Fast-Time Simulation by Asynchronous Deep Reinforcement Learning

Navigation in Restricted Channels Under Environmental Conditions: Fast-Time Simulation by Asynchronous Deep Reinforcement Learning

This paper proposes an efficient method, based on reinforcement learning, to be used as ship controller in fast-time simulators within restricted channels. The controller must operate the rudder in a realistic manner in both time and angle variation so as to approximate human piloting. The method is...

Full description

Bibliographic Details
Main Authors:	Jose Amendola, Lucas S. Miura, Anna H. Reali Costa, Fabio G. Cozman, Eduardo Aoun Tannuri
Format:	Article
Language:	English
Published:	IEEE 2020-01-01
Series:	IEEE Access
Subjects:	Fast-time maneuvering simulations machine learning deep reinforcement learning ship path following control
Online Access:	https://ieeexplore.ieee.org/document/9163360/

Similar Items

Comparing Deep Reinforcement Learning Algorithms’ Ability to Safely Navigate Challenging Waters
by: Thomas Nakken Larsen, et al.
Published: (2021-09-01)

Development of Navigator Behavior Models for the Evaluation of Collision Avoidance Behavior in the Collision-Prone Navigation Environment
by: Jeong-Bin Yim, et al.
Published: (2019-08-01)

Deep Interactive Reinforcement Learning for Path Following of Autonomous Underwater Vehicle
by: Qilei Zhang, et al.
Published: (2020-01-01)

Taming an Autonomous Surface Vehicle for Path Following and Collision Avoidance Using Deep Reinforcement Learning
by: Eivind Meyer, et al.
Published: (2020-01-01)

UGV Navigation Optimization Aided by Reinforcement Learning-Based Path Tracking
by: Minggao Wei, et al.
Published: (2018-01-01)

Path following method for AUV based on Q-Learning and RBF neural network
Published: (2021-06-01)

Path Following Control for Underactuated Airships with Magnitude and Rate Saturation
by: Huabei Gou, et al.
Published: (2020-12-01)

An Autonomous Path Planning Model for Unmanned Ships Based on Deep Reinforcement Learning
by: Siyu Guo, et al.
Published: (2020-01-01)

Deep Reinforcement Learning Controller for 3D Path Following and Collision Avoidance by Autonomous Underwater Vehicles
by: Simen Theie Havenstrøm, et al.
Published: (2021-01-01)

Score Following as a Multi-Modal Reinforcement Learning Problem
by: Florian Henkel, et al.
Published: (2019-11-01)

iADA*-RL: Anytime Graph-Based Path Planning with Deep Reinforcement Learning for an Autonomous UAV
by: Aye Aye Maw, et al.
Published: (2021-04-01)

EVALUATION OF PLANING CRAFT MANEUVERABILITY USING MATHEMATICAL MODELING
by: Sajad Hajizadeh, et al.
Published: (2016-03-01)

Pre-Filtered Backstepping Control for Underactuated Ship Path Following
by: Liu Zhiquan
Published: (2019-06-01)

Integrating Multiple Policies for Person-Following Robot Training Using Deep Reinforcement Learning
by: Chandra Kusuma Dewa, et al.
Published: (2021-01-01)

Numerical Study on Unified Seakeeping and Maneuvering of a Russian Trawler in Wind and Waves
by: Van Minh Nguyen, et al.
Published: (2021-06-01)

Locally Weighted Non-Parametric Modeling of Ship Maneuvering Motion Based on Sparse Gaussian Process
by: Zhao Zhang, et al.
Published: (2021-06-01)

Training neural networks using reinforcement learning to reactive path planning
by: Calderón Milton Vicente, et al.
Published: (2021-01-01)

Deep Reinforcement Learning for Path Planning by Cooperative Robots: Existing Approaches and Challenges
by: Walaa Othman, et al.
Published: (2021-01-01)

Research on Air Confrontation Maneuver Decision-Making Method Based on Reinforcement Learning
by: Xianbing Zhang, et al.
Published: (2018-10-01)

Maneuver Decision of UAV in Short-Range Air Combat Based on Deep Reinforcement Learning
by: Qiming Yang, et al.
Published: (2020-01-01)

A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
by: Ke Li, et al.
Published: (2021-03-01)

COLREG-Compliant Collision Avoidance for Unmanned Surface Vehicle Using Deep Reinforcement Learning
by: Eivind Meyer, et al.
Published: (2020-01-01)

Using deep reinforcement learning to speed up collective cell migration
by: Hanxu Hou, et al.
Published: (2019-11-01)

Evaluation of Mathematical Models for Tankers’ Maneuvering Motions
by: Erhan AKSU, et al.
Published: (2017-03-01)

Experimental Study of Forces Exerted on Ships Due to the Vertical Walls of Navigation Channels
by: Mohammadreza Fathi Kazerooni, et al.
Published: (2015-06-01)

Reinforcement Learning-Enabled UAV Itinerary Planning for Remote Sensing Applications in Smart Farming
by: Saeid Pourroostaei Ardakani, et al.
Published: (2021-07-01)

Intelligent Prediction of Ship Maneuvering
by: Miroslaw Lacki
Published: (2016-09-01)

Reactive Reinforcement Learning in Asynchronous Environments
by: Jaden B. Travnik, et al.
Published: (2018-06-01)

DARES: An Asynchronous Distributed Recommender System Using Deep Reinforcement Learning
by: Bichen Shi, et al.
Published: (2021-01-01)

A Reinforcement Learning Framework for Video Frame-Based Autonomous Car-Following
by: Mehdi Masmoudi, et al.
Published: (2021-01-01)

An AIS Data-Driven Approach to Analyze the Pattern of Ship Trajectories in Ports Using the DBSCAN Algorithm
by: Hyeong-Tak Lee, et al.
Published: (2021-01-01)

Temporal Graph Traversals Using Reinforcement Learning With Proximal Policy Optimization
by: Samuel Henrique Silva, et al.
Published: (2020-01-01)

Robot Navigation in Cluttered Environments with Deep Reinforcement Learning
by: Weideman, Ryan
Published: (2019)

Path-Following Control Method for Surface Ships Based on a New Guidance Algorithm
by: Zhanshuo Zhang, et al.
Published: (2021-02-01)

A Self-Adaptive Reinforcement-Exploration Q-Learning Algorithm
by: Lieping Zhang, et al.
Published: (2021-06-01)

Behavior tests of a new form of propulsion after ship reconstruction
by: Dauti Enis, et al.
Published: (2020-01-01)

Reinforcement Learning-Based Path Generation Using Sequential Pattern Reduction and Self-Directed Curriculum Learning
by: Taewoo Kim, et al.
Published: (2020-01-01)

Mobile Robot Path Optimization Technique Based on Reinforcement Learning Algorithm in Warehouse Environment
by: HyeokSoo Lee, et al.
Published: (2021-01-01)

UAV Path Planning Based on Multi-Layer Reinforcement Learning Technique
by: Zhengyang Cui, et al.
Published: (2021-01-01)

Decision-Making for the Autonomous Navigation of Maritime Autonomous Surface Ships Based on Scene Division and Deep Reinforcement Learning
by: Xinyu Zhang, et al.
Published: (2019-09-01)