Automated Surveillance Systems with Multi-Camera and Robotic Platforms

• Main Author: Chen, Chung Hao
• Format: Others
• Published: Trace: Tennessee Research and Creative Exchange 2009
• Subjects: Electrical and Computer Engineering
• Online Access: http://trace.tennessee.edu/utk_graddiss/20

This dissertation addresses automated surveillance systems focusing on four topics: (1) spatial mappings of omnidirectional and PTZ cameras, and PTZ and PTZ cameras; (2) target hopping application for dual camera systems; (3) camera handoff and placement; (4) the mobile tracking platform. The four topics represent four contributions in this dissertation. Dual camera systems have been widely used in surveillance because of the ability to explore the wide field of view (FOV) of the omnidirectional camera and the wide zoom range of the PTZ camera. Most existing algorithms require a priori knowledge of the projection models of omnidirectional and PTZ cameras to solve the spatial mapping between any two cameras. The proposed methods not only improve the mapping accuracy by reducing the dependence on the knowledge of the projection model but also improved flexibility in adjusting to varying system configurations. The omnidirectional camera is capable of multi object tracking while the PTZ camera is able to track one individual target at one time to maintain the required resolution. It becomes necessary for the PTZ camera to distribute its observation time among multiple objects and visit them in sequence. In comparison with the sequential visiting and nearest neighbor methods, the proposed adaptive algorithm requires less computational and visiting time. Tracking with multiple cameras is mainly the consistent labeling or camera handoff problem. An automatic calibration procedure combined with Wilcoxon Signed-Rank Test is proposed to solve the consistent labeling problem. Meanwhile, we introduce an additional constraint to search for optimal cameras‘ overlapped field of views (FOVs) and resource management approach to improve camera handoff performance. Experiments show that our proposed camera handoff and placement can outperform existing approaches. However, in the majority of surveillance systems, their cameras are stationary. These stationary systems often require the desired object to stay within the surveillance range of the system. Thus, the robotic platform we propose uses a visual camera to sense the movement of the desired object and a range sensor to help the robot detect and then avoid obstacles in real time while continuing to track and follow the desired object. Experiment shows this robotic and intelligent system can fulfill the requirements of tracking an object and avoiding obstacles simultaneously when the object moves in speed of 4 km/hr.