Efficient Consistent Labeling in Visual Surveillance System with Multiple Cameras

• Main Authors: Yu-Sheng Chen, 陳又生
• Other Authors: Li-Chen Fu
• Format: Others
• Language: en_US
• Published: 2010
• Online Access: http://ndltd.ncl.edu.tw/handle/17324782216857240123

碩士 === 臺灣大學 === 電機工程學研究所 === 98 === Visual surveillance in multi-camera system has attracted more interest in recent years. Using limited number of cameras to simultaneously track and correctly label as many people as possible becomes an important topic of research, with low-cost consideration. In this thesis, we propose a surveillance system that can robustly track and identify multiple humans, for general building environments. Rather than gathering all information into a central server every frame, we track and segment each observation from local single camera, and only sending necessary information to the central server for correspondence processing at necessary time. Thus our framework can achieve observation correspondence between multi-cameras with confidence levels as correspondence quality indices. After correspondence process, the tracked object information is stored into the target databases for solving people re-entering problem. Without assuming common ground plane is observed by all cameras, our labeling process, which hierarchically associates objects after correspondence to target databases with matching confidence orders, still can construct relevant and accurate labeling assignment. The people information is then updated to improve target databases and local tracking performance. Occlusion handling for multi-object tracking can effectively enhance labeling accuracy and reduce the error of appearance information extraction due to object overlapping. The proposed labeling system yields robust performance even in most partial occlusion cases. Finally, we conclude with experimental results in several real video sequences and their detailed analysis.