3D Sphere Virtual Instrument with multiple Kinect

• Main Authors: Ming-Fong Lu, 呂名峰
• Other Authors: Timothy K. Shih
• Format: Others
• Language: en_US
• Published: 2015
• Online Access: http://ndltd.ncl.edu.tw/handle/7q4x35

碩士 === 國立中央大學 === 資訊工程學系 === 103 === Human Computer Interaction is wildly used in our life, in this paper we design a virtual instrument by the Microsoft Kinect sensor. Kinect sensor can detect human body by representing a skeleton, and the program use the skeleton to control the music signal. Kinect has human body angle limits, if user’s side face to Kinect then Kinect cannot detect skeleton, this paper uses skeletons as point cloud and calibrate three Kinect to achieve side face detection. In our instrument we use a sphere for interface, inside the sphere has twelve blocks and the user can play a single note or chords. In order to play all of the blocks, we use the ICP algorithm to calibrate three Kinect and the users can the play instrument without side face limits. At program interface we use OpenGL for rendering the objects, and we will introduce the basic three dimensional concepts and OpenGL concept, explains how to put the skeleton inside the sphere and introduce MIDI concept to use MIDI for playing music. Finally the experiment result shows the accuracy of the skeleton in calibration and show the status of skeleton in figures.