Indonesian Alphabet Speech Recognition for Early Literacy using Convolutional Neural Network Approach

• Main Authors: Duman Care Khrisne, Theresia Hendrawati
• Format: Article
• Language: English
• Published: Universitas Udayana 2020-02-01
• Series: Journal of Electrical, Electronics and Informatics
• Online Access: https://ojs.unud.ac.id/index.php/JEEI/article/view/60184

Games are considered capable of being used as a learning medium that can help teachers to teach children how to pronounce the Indonesian alphabet in early literacy, we try to build one aspect of the game in this study. The approach we use is a speech recognition approach that uses the convolutional neural network method. The results of this study indicate that CNN can recognize speech, with input data is in the form of sound. We use the MFCC feature vector sound feature to make a 3-dimensional matrix of input sound into CNN input. We also use the Sequential CNN architecture made from a simple 10 layer neural network, which produces a model with a small size, approximately only about 6 MB, with high accuracy (84%) and an F-Measure of 0.91.