A Realistic Speech Mission-based Digital Authentic Learning Theater with Mechanisms of Interactive Response

• Main Authors: Jui-Yi Wang, 王瑞翊
• Other Authors: Gwo-Dong Chen
• Format: Others
• Language: zh-TW
• Published: 2019
• Online Access: http://ndltd.ncl.edu.tw/handle/qf2a6m

碩士 === 國立中央大學 === 資訊工程學系 === 107 === 　　When learning a language, if you perform an authentic learning through a drama performance and have the responsibility to complete some particular missions in the dramatic situation, as the reality show actor strives to meet expectations of the audience, it will be helpful to promote the learning efficiency and outcomes. This study purpose to design a realistic speech mission-based digital authentic learning theater, with mechanisms of interactive response. Through the body tracking technology, the user's whole body image is put into the digital scene to enter a role-playing drama situation. Using motion detection, each person can wear the different virtual costumes which can automatically adjust the size and the angle. It can enhance the sense of role-playing and the cognitive interaction. In addition, an AI chatbot is added to the digital theater. Through speech recognition, natural language processing and speech synthesis, the chatbot can give the users some realistic speech missions and identify their pronunciation and grammar are correct or not, then provide an appropriate feedback to inform them about the performance of learning. 　　In order to understand the effectiveness of the study, we cooperated with two Japanese teachers at a university, and randomly selected 60 students which under their guidance to participate in the research activities. Then we analyze the effectiveness through the students’ dictation test and questionnaire. The experiment results showed that students improved their learning outcomes and interest of authentic learning by using realistic speech mission-based digital authentic learning theater.