Sensorimotor Piano System for People with Disabilities

• Main Authors: Tobias Blumenstein, Varvara Turova, Ana Alves-Pinto, Renée Lampe
• Format: Article
• Language: English
• Published: Hindawi Limited 2016-01-01
• Series: Journal of Sensors
• Online Access: http://dx.doi.org/10.1155/2016/9825905

A sensorimotor training system that facilitates learning to play piano was developed and tested. The system consists of three communicating units. The first unit comprises two pianos: an E-piano with a MIDI output for the teacher and an acoustic or an E-piano for the pupil. The pupil’s piano is supplied with an LED bar that illuminates the key to be struck. The second unit is a controller providing the interface between the teacher’s piano and the LED bar. The third unit consists of two pairs of gloves: one for the teacher and one for the pupil. The teacher gloves have integrated pressure sensors at every fingertip. The pupil’s gloves have vibration motors and LEDs at every finger. The pressure sensed on the teacher’s glove is transmitted to the corresponding finger on the pupil’s glove via the vibration motors and LEDs, such that the pupil knows which finger should strike which key. Additionally, two OLED displays showing the notation of the note played by the teacher can be attached to the left and right pupil’s gloves. Initially developed for people with cerebral palsy the sensorimotor system can support the learning also to all those with sensory, cognitive, and space perception impairments.