Designing a robot with mixed reality interaction mechanism to increase the presence and learning motivation in learning environment

• Main Authors: Yen-Chieh Wang, 王彥傑
• Other Authors: Gwo-Dong Chen
• Format: Others
• Language: zh-TW
• Published: 2009
• Online Access: http://ndltd.ncl.edu.tw/handle/84488012193333164516

碩士 === 國立中央大學 === 資訊工程研究所 === 97 === The traditional instruction is carried out by the teacher in the class with single side. However, knowledge is the production of the interaction between learners and surroundings. It’s meaningful for students to learn in the physical surroundings. Actually, it’s hard to build a knowledge-manipulating surrounding which contains many limitations. With the advance of augmented reality techniques, building a mixed reality of rich scenes with augmented reality has come true in the class. To interact with the surroundings in the mixed reality is expensive and hard for students; it’s hard to promote the ideas to schools or family. Therefore, we had to find a student deputy as a representative to immerse in the mixed reality and to interact with the surroundings. Toy robots and robots for education become popular and the prices are acceptable within the budget, so we used robots as the student deputy to enter the mixed reality to interact with the surroundings. In this research, we design a program, which can control robot in a mixed reality surroundings. Robot can interact with surroundings and learners. The program will read the map and robot’s coordinate in the scene. So robot knows where it is. Robot can detect the occurrence of events and deal with the boundary and exceptions by itself. We designed the interaction modes with learners by using the sensors which the robot built-in. We also expanded the robot’s ability in voice recognition and voice output. Learners can use multiple way to interact with the robot. Students will feel like learning in the physical surroundings. In this research, the subjects are 36 second grade junior high school students. They used the mixed reality learning system with robot and the learning system which use robot icon substitute the physical robot. The experiment result shows that mixed reality learning system with robot, students feel more authentic and exciting. Students feel more interesting, engaging, and increasing the presence and learning motivation though interacting with robot.