Klasifikasi Nyeri pada Video Ekspresi Wajah Bayi Menggunakan DCNN Autoencoder dan LSTM

• Main Authors: Yosi Kristian, I Ketut Eddy Purnama, Effendy Hadi Sutanto, Lukman Zaman, Esther Irawati Setiawan, Mauridhi Hery Purnomo
• Format: Article
• Language: English
• Published: Universitas Gadjah Mada 2018-09-01
• Series: Jurnal Nasional Teknik Elektro dan Teknologi Informasi
• Subjects: neural network, dcnn, lstm, autoencoder, klasifikasi nyeri, ekspresi wajah bayi
• Online Access: http://ejnteti.jteti.ugm.ac.id/index.php/JNTETI/article/view/440
• ISSN: 2301-4156; 2460-5719

Babies are still unable to inform the pain they experience, therefore, babies cry when experiencing pain. With the rapid development of computer vision technologies, in the last few years, many researchers have tried to recognize pain from babies expressions using machine learning and image processing. In this paper, a research using Deep Convolution Neural Network (DCNN) Autoencoder and Long-Short Term Memory (LSTM) Network is conducted to detect cry and pain level from baby facial expression on video. DCNN Autoencoder is used to extract latent features from a single frame of baby face. Sequences of extracted latent features are then fed to LSTM so the pain level and cry can be recognized. Face detection and face landmark detection is also used to frontalize baby facial image before it is processed by DCNN Autoencoder. From the testing on DCNN autoencoder, the result shows that the best architecture used three convolutional layers and three transposed convolutional layers. As for the LSTM classifier, the best model is using four frame sequences