HUMAN ACTIVITY RECOGNITION BASED ON SMARTPHONE SENSOR DATA USING CNN

• Main Authors: K. İsmail, K. Özacar
• Format: Article
• Language: English
• Published: Copernicus Publications 2020-11-01
• Series: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
• Online Access: https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIV-4-W3-2020/263/2020/isprs-archives-XLIV-4-W3-2020-263-2020.pdf

Human activity recognitions have been widely used nowadays by end users thanks to extensive usage of smartphones. Smartphones, by self-containing low-cost sensing technology, can track our daily activities for serving healthcare, sport, interactive AR/VR games and so on. However, smartphone technology is evolving and the techniques of using the data that smartphones go through are also improving. In this study, we used built-in sensing technologies (accelerometer and gyroscope) available in nearly every smartphone to detect the most common 5 daily activities of human by taking the data of these sensors and extract the features for a Convolutional Neural Network (CNN) model. We prepare a dataset and use TensorFlow to train the collected data from the sensors then filtered it to be processed. We also discuss the differences in CNN model accuracy with different optimizers. To demonstrate the model, we developed an android application that successfully predict an activity. We believe that after improving this application, it can be used for especially lonely old people to immediately warn authorities in case of any daily incidents.