Supporting Trembling Hand Typing Using Optical See-Through Mixed Reality

• Main Authors: Kai Wang, Daisuke Iwai, Kosuke Sato
• Format: Article
• Language: English
• Published: IEEE 2017-01-01
• Series: IEEE Access
• Subjects: Augmented human; hand tremor; keyboard challenged; optical see-through mixed reality; virtual stabilization
• Online Access: https://ieeexplore.ieee.org/document/7941993/

A tremor is an involuntary rhythmic shaking movement of the muscles, which reduces the precision of hand and finger movements. It is difficult for individuals with hand tremors to type accurately using small- and high-density targets, such as keyboard. This research proposes an optical see-through mixed reality system that reduces hand tremors so that the individual can type steadily. The system virtually stabilizes the individual's hand tremors by optically overlapping the trembling hand with a stabilized virtual hand to produce a realistic typing sensation without any tremors. The simulation experiments proved that the system supports trembling hand typing. By comprehensively investigating both the objective (time and error ratios) and the subjective (the sense of ownership, agency, and pertinence) aspects, the system with a virtual:real intensity ratio of 0.75:0.25 was found to be optimal.