Real-Time Single Image Sensor Man-Machine Interface Implementation with FPGA

• Main Authors: Po-Hung Chen, 陳柏宏
• Other Authors: Yaw-Hwang Chen
• Format: Others
• Language: zh-TW
• Published: 2010
• Online Access: http://ndltd.ncl.edu.tw/handle/93656451936664462399

碩士 === 崑山科技大學 === 電子工程研究所 === 98 === Common imaging based man-machine interactions are most realized using flexible software solutions while high-end hardware components such as high-performance CPU and large amount of memories are still required. For embedded system products with limited CPU power and memories, such as portable devices, low cost LSI chip solutions are then more desirable. We propose FPGA implementation of man-machine interaction system utilizing single imaging sensor and real-time buffering image processing techniques. We achieve real-time body movement tracking and identification without large memory requirement and no need of special wearing. We also propose method and environment setup for the interaction system verifications. The whole interaction system is implemented with a Xilinx Spartan 3 FPGA, XC3S1000. Under 43MHz clock, the processing speed is 140fps@640×480. Using a single 640x480 NTSC sensor, the maximum resolution of body motion is 4.267 pixels/cm. The whole system gate count and memory requirement are 440K gates and 24.75KB respectively including an USB 1.1 interface to achieve two hands, face, and simultaneous multi-object tracking.