Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning

In this paper, a novel online learning-based tracker is presented for the unmanned aerial vehicle (UAV) in different types of tracking applications, such as pedestrian following, automotive chasing, and building inspection. The presented tracker uses novel features, i.e., intensity, color names, and...

Full description

Bibliographic Details
Main Authors: Changhong Fu, Fuling Lin, Yiming Li, Guang Chen
Format: Article
Language:English
Published: MDPI AG 2019-03-01
Series:Remote Sensing
Subjects:
Online Access:http://www.mdpi.com/2072-4292/11/5/549
id doaj-736c3923778146aa82196f79701ae0f5
record_format Article
spelling doaj-736c3923778146aa82196f79701ae0f52020-11-25T02:38:59ZengMDPI AGRemote Sensing2072-42922019-03-0111554910.3390/rs11050549rs11050549Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature LearningChanghong Fu0Fuling Lin1Yiming Li2Guang Chen3School of Mechanical Engineering, Tongji University, Shanghai 201804, ChinaSchool of Mechanical Engineering, Tongji University, Shanghai 201804, ChinaSchool of Mechanical Engineering, Tongji University, Shanghai 201804, ChinaSchool of Automotive Studies, Tongji University, Shanghai 201804, ChinaIn this paper, a novel online learning-based tracker is presented for the unmanned aerial vehicle (UAV) in different types of tracking applications, such as pedestrian following, automotive chasing, and building inspection. The presented tracker uses novel features, i.e., intensity, color names, and saliency, to respectively represent both the tracking object and its background information in a background-aware correlation filter (BACF) framework instead of only using the histogram of oriented gradient (HOG) feature. In other words, four different voters, which combine the aforementioned four features with the BACF framework, are used to locate the object independently. After obtaining the response maps generated by aforementioned voters, a new strategy is proposed to fuse these response maps effectively. In the proposed response map fusion strategy, the peak-to-sidelobe ratio, which measures the peak strength of the response, is utilized to weight each response, thereby filtering the noise for each response and improving final fusion map. Eventually, the fused response map is used to accurately locate the object. Qualitative and quantitative experiments on 123 challenging UAV image sequences, i.e., UAV123, show that the novel tracking approach, i.e., OMFL tracker, performs favorably against 13 state-of-the-art trackers in terms of accuracy, robustness, and efficiency. In addition, the multi-feature learning approach is able to improve the object tracking performance compared to the tracking method with single-feature learning applied in literature.http://www.mdpi.com/2072-4292/11/5/549visual trackingunmanned aerial vehicle (UAV)background-aware correlation filteronline multi-feature learningpeak-to-sidelobe ratio (PSR)response map fusion
collection DOAJ
language English
format Article
sources DOAJ
author Changhong Fu
Fuling Lin
Yiming Li
Guang Chen
spellingShingle Changhong Fu
Fuling Lin
Yiming Li
Guang Chen
Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning
Remote Sensing
visual tracking
unmanned aerial vehicle (UAV)
background-aware correlation filter
online multi-feature learning
peak-to-sidelobe ratio (PSR)
response map fusion
author_facet Changhong Fu
Fuling Lin
Yiming Li
Guang Chen
author_sort Changhong Fu
title Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning
title_short Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning
title_full Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning
title_fullStr Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning
title_full_unstemmed Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning
title_sort correlation filter-based visual tracking for uav with online multi-feature learning
publisher MDPI AG
series Remote Sensing
issn 2072-4292
publishDate 2019-03-01
description In this paper, a novel online learning-based tracker is presented for the unmanned aerial vehicle (UAV) in different types of tracking applications, such as pedestrian following, automotive chasing, and building inspection. The presented tracker uses novel features, i.e., intensity, color names, and saliency, to respectively represent both the tracking object and its background information in a background-aware correlation filter (BACF) framework instead of only using the histogram of oriented gradient (HOG) feature. In other words, four different voters, which combine the aforementioned four features with the BACF framework, are used to locate the object independently. After obtaining the response maps generated by aforementioned voters, a new strategy is proposed to fuse these response maps effectively. In the proposed response map fusion strategy, the peak-to-sidelobe ratio, which measures the peak strength of the response, is utilized to weight each response, thereby filtering the noise for each response and improving final fusion map. Eventually, the fused response map is used to accurately locate the object. Qualitative and quantitative experiments on 123 challenging UAV image sequences, i.e., UAV123, show that the novel tracking approach, i.e., OMFL tracker, performs favorably against 13 state-of-the-art trackers in terms of accuracy, robustness, and efficiency. In addition, the multi-feature learning approach is able to improve the object tracking performance compared to the tracking method with single-feature learning applied in literature.
topic visual tracking
unmanned aerial vehicle (UAV)
background-aware correlation filter
online multi-feature learning
peak-to-sidelobe ratio (PSR)
response map fusion
url http://www.mdpi.com/2072-4292/11/5/549
work_keys_str_mv AT changhongfu correlationfilterbasedvisualtrackingforuavwithonlinemultifeaturelearning
AT fulinglin correlationfilterbasedvisualtrackingforuavwithonlinemultifeaturelearning
AT yimingli correlationfilterbasedvisualtrackingforuavwithonlinemultifeaturelearning
AT guangchen correlationfilterbasedvisualtrackingforuavwithonlinemultifeaturelearning
_version_ 1724788208582000640