Multimodal EEG and Keystroke Dynamics Based Biometric System Using Machine Learning Algorithms

• Main Authors: Arafat Rahman, Muhammad E. H. Chowdhury, Amith Khandakar, Serkan Kiranyaz, Kh Shahriya Zaman, Mamun Bin Ibne Reaz, Mohammad Tariqul Islam, Maymouna Ezeddin, Muhammad Abdul Kadir
• Format: Article
• Language: English
• Published: IEEE 2021-01-01
• Series: IEEE Access
• Subjects: Biometric system; electroencephalography (EEG); keystroke dynamics; identification; authentication; multimodal system
• Online Access: https://ieeexplore.ieee.org/document/9466102/

Electroencephalography (EEG) based biometric systems are gaining attention for their anti-spoofing capability but lack accuracy due to signal variability at different psychological and physiological conditions. On the other hand, keystroke dynamics-based systems achieve very high accuracy but have low anti-spoofing capability. To address these issues, a novel multimodal biometric system combining EEG and keystroke dynamics is proposed in this paper. A dataset was created by acquiring both keystroke dynamics and EEG signals simultaneously from 10 users. Each user participated in 500 trials at 10 different sessions (days) to replicate real-life signal variability. A machine learning classification pipeline is developed using multi-domain feature extraction (time, frequency, time-frequency), feature selection (Gini impurity), classifier design, and score level fusion. Different classifiers were trained, validated, and tested for two different classification experiments – personalized and generalized. For identification and authentication, 99.9% and 99.6% accuracies are achieved, respectively for the Random Forest classifier in 5 fold cross-validation. These results outperform the individual modalities with a significant margin (~5%). We also developed a binary template matching-based algorithm, which gives 93.64% accuracy 6X faster. The proposed method can be considered secure and reliable for any kind of biometric identification and authentication.