Occupational skills learning based on computer vision techniques for intellectual disability

• Main Authors: LU, Yen-YU, 盧彥佑
• Other Authors: Chia, Tsorng-Lin
• Format: Others
• Language: zh-TW
• Published: 2016
• Online Access: http://ndltd.ncl.edu.tw/handle/82411175381508811908

碩士 === 銘傳大學 === 資訊傳播工程學系碩士班 === 104 === In this paper, we focus on the teaching problem of social and occupational skills in special education school and develop an instant feedback training system to solve the lack of the current teaching method. The research develops an interactive training system composited with multimedia teaching materials and techniques of non-contact sensing and human-machine interactive to improve the learning efficiency of the student with the intellectual disability. There are two parts in the proposed interactive training system: the social skill training and the occupational skill training. For verifying the usefulness of the training system, two courses: how to greet someone and sweeping the floor, are installed in the social skill training and the occupational skill training, respectively. The system uses the Kinect and the PTZ camera to capture student’s posture and the situation of the cleaned floor. Then, the system judges the practical results whether to meet the requirements of the static and practical tests. The system provides instant suggestions by text and real images for the student to understand the mistake action. In the occupational skill training, an interactive prompt to show the clean level of the cleaned floor is generated by the camera-projector set that can guide the practical student to improve the accuracy of cleaning work.