Development and Application of a Human–Machine Interface Using Head Control and Flexible Numeric Tables for the Severely Disabled

• Main Authors: Che-Ming Chang, Chern-Sheng Lin, Wei-Cheng Chen, Chung-Ting Chen, Yu-Liang Hsu
• Format: Article
• Language: English
• Published: MDPI AG 2020-10-01
• Series: Applied Sciences
• Subjects: computer vision; head gestures; numeric tables
• Online Access: https://www.mdpi.com/2076-3417/10/19/7005

The human–machine interface with head control can be applied in many domains. This technology has the valuable application of helping people who cannot use their hands, enabling them to use a computer or speak. This study combines several image processing and computer vision technologies, a digital camera, and software to develop the following system: image processing technologies are adopted to capture the features of head motion; the recognized head gestures include forward, upward, downward, leftward, rightward, right-upper, right-lower, left-upper, and left-lower; corresponding sound modules are used so that patients can communicate with others through a phonetic system and numeric tables. Innovative skin color recognition technology can obtain head features in images. The barycenter of pixels in the feature area is then quickly calculated, and the offset of the barycenter is observed to judge the direction of head motion. This architecture can substantially reduce the distraction of non-targeted objects and enhance the accuracy of systematic judgment.