Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD
Object detection and distance estimation based on videos are important issues in advanced driver-sssistant system (ADAS). In practice, fisheye cameras are widely used to capture images with a large field of view, which will produce distorted image frames. But most of the object detection algorithms...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Atlantis Press
2021-04-01
|
Series: | International Journal of Computational Intelligence Systems |
Subjects: | |
Online Access: | https://www.atlantis-press.com/article/125956005/view |
id |
doaj-ee5a0a21bc61458098d9800723b56c14 |
---|---|
record_format |
Article |
spelling |
doaj-ee5a0a21bc61458098d9800723b56c142021-05-06T12:00:39ZengAtlantis PressInternational Journal of Computational Intelligence Systems 1875-68832021-04-0114110.2991/ijcis.d.210419.001Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSDFanghui ZhangYi JinShichao KanLinna ZhangYigang CenWen JinObject detection and distance estimation based on videos are important issues in advanced driver-sssistant system (ADAS). In practice, fisheye cameras are widely used to capture images with a large field of view, which will produce distorted image frames. But most of the object detection algorithms were designed for the nonfisheye camera videos without distortion, which is not suitable for the application of ADAS since one always expects the panorama stitching and object detection system should share one set of cameras. The research of vehicle detection based on fisheye cameras is relatively rare. In this paper, vehicle detection and distance estimation based on fisheye cameras are studied. First, a multi-scale partition preprocessing is proposed, which can enlarge the size of small targets to improve the detection accuracy of small targets. Second, parameters learned from the public datasets without distortion is transferred to our fisheye video dataset. Then metric learning-based single shot multibox detector (MLSSD) is proposed to improve the accuracy of distorted vehicle detection. Combining metric learning and SSD network, MLSSD can significantly reduce the missing and false detection rates. Moreover, a scalable overlapping partition pooling method is proposed to explore the relations among the adjacent features in a feature map. Finally, the distance between the driving vehicle and vehicles around this vehicle is estimated based on the object detection results by the method of marker points. Experimental results show that our proposed MLSSD network significantly outperforms other networks for distorted object detection.https://www.atlantis-press.com/article/125956005/viewObject detectionVehicle distance estimationMetric learningScalable overlapping partition-pooling |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Fanghui Zhang Yi Jin Shichao Kan Linna Zhang Yigang Cen Wen Jin |
spellingShingle |
Fanghui Zhang Yi Jin Shichao Kan Linna Zhang Yigang Cen Wen Jin Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD International Journal of Computational Intelligence Systems Object detection Vehicle distance estimation Metric learning Scalable overlapping partition-pooling |
author_facet |
Fanghui Zhang Yi Jin Shichao Kan Linna Zhang Yigang Cen Wen Jin |
author_sort |
Fanghui Zhang |
title |
Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD |
title_short |
Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD |
title_full |
Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD |
title_fullStr |
Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD |
title_full_unstemmed |
Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD |
title_sort |
distorted vehicle detection and distance estimation by metric learning-based ssd |
publisher |
Atlantis Press |
series |
International Journal of Computational Intelligence Systems |
issn |
1875-6883 |
publishDate |
2021-04-01 |
description |
Object detection and distance estimation based on videos are important issues in advanced driver-sssistant system (ADAS). In practice, fisheye cameras are widely used to capture images with a large field of view, which will produce distorted image frames. But most of the object detection algorithms were designed for the nonfisheye camera videos without distortion, which is not suitable for the application of ADAS since one always expects the panorama stitching and object detection system should share one set of cameras. The research of vehicle detection based on fisheye cameras is relatively rare. In this paper, vehicle detection and distance estimation based on fisheye cameras are studied. First, a multi-scale partition preprocessing is proposed, which can enlarge the size of small targets to improve the detection accuracy of small targets. Second, parameters learned from the public datasets without distortion is transferred to our fisheye video dataset. Then metric learning-based single shot multibox detector (MLSSD) is proposed to improve the accuracy of distorted vehicle detection. Combining metric learning and SSD network, MLSSD can significantly reduce the missing and false detection rates. Moreover, a scalable overlapping partition pooling method is proposed to explore the relations among the adjacent features in a feature map. Finally, the distance between the driving vehicle and vehicles around this vehicle is estimated based on the object detection results by the method of marker points. Experimental results show that our proposed MLSSD network significantly outperforms other networks for distorted object detection. |
topic |
Object detection Vehicle distance estimation Metric learning Scalable overlapping partition-pooling |
url |
https://www.atlantis-press.com/article/125956005/view |
work_keys_str_mv |
AT fanghuizhang distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd AT yijin distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd AT shichaokan distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd AT linnazhang distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd AT yigangcen distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd AT wenjin distortedvehicledetectionanddistanceestimationbymetriclearningbasedssd |
_version_ |
1721456774254428160 |