Underwater-Drone With Panoramic Camera for Automatic Fish Recognition Based on Deep Learning

• Main Authors: Lin Meng, Takuma Hirayama, Shigeru Oyanagi
• Format: Article
• Language: English
• Published: IEEE 2018-01-01
• Series: IEEE Access
• Subjects: 360-degree panoramic image; underwater-drone; fish recognition; deep learning; open source hardware
• Online Access: https://ieeexplore.ieee.org/document/8327594/

Highly developed drone technology enables the use of drones in a wide variety of areas. However, those drones are mainly used in the unmanned aerial vehicles. We believe that underwater drones will become a big research topic and find a market in the near future. We developed an underwater drone with a 360° panoramic camera acting as the “eye”of the drone. The designs are based on the open-source hardware and will be shared as an open-source for contributing to the innovation of manufacturing including drone. The function of the 360° panoramic camera is generated by correcting the images taken by two fisheye lenses. The underwater drone was designed by extending the Raspberry Pi compute module, the frame was designed by OpenSCAD, and the printed circuit board was designed by MakePro. As for the application of the underwater drone, we focused on fish recognition for investigating fish species in a natural lake to help protect the original environment. Fish recognition is based on deep learning, which is the biggest topic in the artificial intelligence research field today. Experimental results show that the function of the underwater drone achieved at diving in the leak automatically. The 360° panoramic images were generated correctly. Fish recognition achieved 87% accuracy by deep learning.