Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning
In this paper, a novel online learning-based tracker is presented for the unmanned aerial vehicle (UAV) in different types of tracking applications, such as pedestrian following, automotive chasing, and building inspection. The presented tracker uses novel features, i.e., intensity, color names, and...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2019-03-01
|
Series: | Remote Sensing |
Subjects: | |
Online Access: | http://www.mdpi.com/2072-4292/11/5/549 |
id |
doaj-736c3923778146aa82196f79701ae0f5 |
---|---|
record_format |
Article |
spelling |
doaj-736c3923778146aa82196f79701ae0f52020-11-25T02:38:59ZengMDPI AGRemote Sensing2072-42922019-03-0111554910.3390/rs11050549rs11050549Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature LearningChanghong Fu0Fuling Lin1Yiming Li2Guang Chen3School of Mechanical Engineering, Tongji University, Shanghai 201804, ChinaSchool of Mechanical Engineering, Tongji University, Shanghai 201804, ChinaSchool of Mechanical Engineering, Tongji University, Shanghai 201804, ChinaSchool of Automotive Studies, Tongji University, Shanghai 201804, ChinaIn this paper, a novel online learning-based tracker is presented for the unmanned aerial vehicle (UAV) in different types of tracking applications, such as pedestrian following, automotive chasing, and building inspection. The presented tracker uses novel features, i.e., intensity, color names, and saliency, to respectively represent both the tracking object and its background information in a background-aware correlation filter (BACF) framework instead of only using the histogram of oriented gradient (HOG) feature. In other words, four different voters, which combine the aforementioned four features with the BACF framework, are used to locate the object independently. After obtaining the response maps generated by aforementioned voters, a new strategy is proposed to fuse these response maps effectively. In the proposed response map fusion strategy, the peak-to-sidelobe ratio, which measures the peak strength of the response, is utilized to weight each response, thereby filtering the noise for each response and improving final fusion map. Eventually, the fused response map is used to accurately locate the object. Qualitative and quantitative experiments on 123 challenging UAV image sequences, i.e., UAV123, show that the novel tracking approach, i.e., OMFL tracker, performs favorably against 13 state-of-the-art trackers in terms of accuracy, robustness, and efficiency. In addition, the multi-feature learning approach is able to improve the object tracking performance compared to the tracking method with single-feature learning applied in literature.http://www.mdpi.com/2072-4292/11/5/549visual trackingunmanned aerial vehicle (UAV)background-aware correlation filteronline multi-feature learningpeak-to-sidelobe ratio (PSR)response map fusion |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Changhong Fu Fuling Lin Yiming Li Guang Chen |
spellingShingle |
Changhong Fu Fuling Lin Yiming Li Guang Chen Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning Remote Sensing visual tracking unmanned aerial vehicle (UAV) background-aware correlation filter online multi-feature learning peak-to-sidelobe ratio (PSR) response map fusion |
author_facet |
Changhong Fu Fuling Lin Yiming Li Guang Chen |
author_sort |
Changhong Fu |
title |
Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning |
title_short |
Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning |
title_full |
Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning |
title_fullStr |
Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning |
title_full_unstemmed |
Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning |
title_sort |
correlation filter-based visual tracking for uav with online multi-feature learning |
publisher |
MDPI AG |
series |
Remote Sensing |
issn |
2072-4292 |
publishDate |
2019-03-01 |
description |
In this paper, a novel online learning-based tracker is presented for the unmanned aerial vehicle (UAV) in different types of tracking applications, such as pedestrian following, automotive chasing, and building inspection. The presented tracker uses novel features, i.e., intensity, color names, and saliency, to respectively represent both the tracking object and its background information in a background-aware correlation filter (BACF) framework instead of only using the histogram of oriented gradient (HOG) feature. In other words, four different voters, which combine the aforementioned four features with the BACF framework, are used to locate the object independently. After obtaining the response maps generated by aforementioned voters, a new strategy is proposed to fuse these response maps effectively. In the proposed response map fusion strategy, the peak-to-sidelobe ratio, which measures the peak strength of the response, is utilized to weight each response, thereby filtering the noise for each response and improving final fusion map. Eventually, the fused response map is used to accurately locate the object. Qualitative and quantitative experiments on 123 challenging UAV image sequences, i.e., UAV123, show that the novel tracking approach, i.e., OMFL tracker, performs favorably against 13 state-of-the-art trackers in terms of accuracy, robustness, and efficiency. In addition, the multi-feature learning approach is able to improve the object tracking performance compared to the tracking method with single-feature learning applied in literature. |
topic |
visual tracking unmanned aerial vehicle (UAV) background-aware correlation filter online multi-feature learning peak-to-sidelobe ratio (PSR) response map fusion |
url |
http://www.mdpi.com/2072-4292/11/5/549 |
work_keys_str_mv |
AT changhongfu correlationfilterbasedvisualtrackingforuavwithonlinemultifeaturelearning AT fulinglin correlationfilterbasedvisualtrackingforuavwithonlinemultifeaturelearning AT yimingli correlationfilterbasedvisualtrackingforuavwithonlinemultifeaturelearning AT guangchen correlationfilterbasedvisualtrackingforuavwithonlinemultifeaturelearning |
_version_ |
1724788208582000640 |