Vision Based Fingertip Input System by Recognizing Mandarin Phonetic Symbol Combinations

• Main Authors: Qun-Jing Shen, 沈群景
• Other Authors: HSU-YUNG CHENG
• Format: Others
• Language: zh-TW
• Published: 2011
• Online Access: http://ndltd.ncl.edu.tw/handle/79238618527413016973

碩士 === 國立中央大學 === 資訊工程研究所 === 99 === This paper proposes a vision-based handwritten Mandarin phonetic symbols 1(MPS1, Bopomofo) combinations recognition system. This system uses web camera as the input device to detect the trajectory of user’s fingertip in order to recognize user’s handwritten Mandarin phonetic symbols combinations. First, the system locates the fingertip by considering the farthest point from center of palm and records every frame to form the fingertip trajectory. Second, we remove partial entering strokes and leaving strokes by using a bounding box which we propose in this paper. Afterwards, the preprocessed trajectory is encoded by 8-chain codes. Then we remove the rest of entering strokes, leaving strokes, and jitter strokes, and find the turning point of 8-chain codes. Third, we extract features to classify the number of MPS1 combinations by using a Naive Bayes classifier. Afterwards, we separate the MPS1 combinations into single MPS1 symbols and use Hidden Markov models (HMM) to recognize each single MPS1 symbol in the combinations. Finally, we combine the above HMM results with the Naive Bayes classifier’s result to recognize these MPS1symbol combinations.