Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks

Functional near-infrared spectroscopy (fNIRS) has attracted increasing attention in the field of brain–computer interfaces (BCIs) owing to their advantages such as non-invasiveness, user safety, affordability, and portability. However, fNIRS signals are highly subject-specific and have low test-rete...

Full description

Bibliographic Details
Main Authors: Jinuk Kwon, Chang-Hwan Im
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-03-01
Series:Frontiers in Human Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fnhum.2021.646915/full
id doaj-0809131e4ce54f9fbcd288db6cf545c7
record_format Article
spelling doaj-0809131e4ce54f9fbcd288db6cf545c72021-03-12T04:34:27ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612021-03-011510.3389/fnhum.2021.646915646915Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural NetworksJinuk Kwon0Jinuk Kwon1Chang-Hwan Im2Chang-Hwan Im3Department of Biomedical Engineering, Hanyang University, Seoul, South KoreaDepartment of Electronic Engineering, Hanyang University, Seoul, South KoreaDepartment of Biomedical Engineering, Hanyang University, Seoul, South KoreaDepartment of Electronic Engineering, Hanyang University, Seoul, South KoreaFunctional near-infrared spectroscopy (fNIRS) has attracted increasing attention in the field of brain–computer interfaces (BCIs) owing to their advantages such as non-invasiveness, user safety, affordability, and portability. However, fNIRS signals are highly subject-specific and have low test-retest reliability. Therefore, individual calibration sessions need to be employed before each use of fNIRS-based BCI to achieve a sufficiently high performance for practical BCI applications. In this study, we propose a novel deep convolutional neural network (CNN)-based approach for implementing a subject-independent fNIRS-based BCI. A total of 18 participants performed the fNIRS-based BCI experiments, where the main goal of the experiments was to distinguish a mental arithmetic task from an idle state task. Leave-one-subject-out cross-validation was employed to evaluate the average classification accuracy of the proposed subject-independent fNIRS-based BCI. As a result, the average classification accuracy of the proposed method was reported to be 71.20 ± 8.74%, which was higher than the threshold accuracy for effective BCI communication (70%) as well as that obtained using conventional shrinkage linear discriminant analysis (65.74 ± 7.68%). To achieve a classification accuracy comparable to that of the proposed subject-independent fNIRS-based BCI, 24 training trials (of approximately 12 min) were necessary for the traditional subject-dependent fNIRS-based BCI. It is expected that our CNN-based approach would reduce the necessity of long-term individual calibration sessions, thereby enhancing the practicality of fNIRS-based BCIs significantly.https://www.frontiersin.org/articles/10.3389/fnhum.2021.646915/fullbrain–computer interfacefunctional near-infrared spectroscopydeep learningconvolutional neural networkbinary communication
collection DOAJ
language English
format Article
sources DOAJ
author Jinuk Kwon
Jinuk Kwon
Chang-Hwan Im
Chang-Hwan Im
spellingShingle Jinuk Kwon
Jinuk Kwon
Chang-Hwan Im
Chang-Hwan Im
Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks
Frontiers in Human Neuroscience
brain–computer interface
functional near-infrared spectroscopy
deep learning
convolutional neural network
binary communication
author_facet Jinuk Kwon
Jinuk Kwon
Chang-Hwan Im
Chang-Hwan Im
author_sort Jinuk Kwon
title Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks
title_short Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks
title_full Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks
title_fullStr Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks
title_full_unstemmed Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks
title_sort subject-independent functional near-infrared spectroscopy-based brain–computer interfaces based on convolutional neural networks
publisher Frontiers Media S.A.
series Frontiers in Human Neuroscience
issn 1662-5161
publishDate 2021-03-01
description Functional near-infrared spectroscopy (fNIRS) has attracted increasing attention in the field of brain–computer interfaces (BCIs) owing to their advantages such as non-invasiveness, user safety, affordability, and portability. However, fNIRS signals are highly subject-specific and have low test-retest reliability. Therefore, individual calibration sessions need to be employed before each use of fNIRS-based BCI to achieve a sufficiently high performance for practical BCI applications. In this study, we propose a novel deep convolutional neural network (CNN)-based approach for implementing a subject-independent fNIRS-based BCI. A total of 18 participants performed the fNIRS-based BCI experiments, where the main goal of the experiments was to distinguish a mental arithmetic task from an idle state task. Leave-one-subject-out cross-validation was employed to evaluate the average classification accuracy of the proposed subject-independent fNIRS-based BCI. As a result, the average classification accuracy of the proposed method was reported to be 71.20 ± 8.74%, which was higher than the threshold accuracy for effective BCI communication (70%) as well as that obtained using conventional shrinkage linear discriminant analysis (65.74 ± 7.68%). To achieve a classification accuracy comparable to that of the proposed subject-independent fNIRS-based BCI, 24 training trials (of approximately 12 min) were necessary for the traditional subject-dependent fNIRS-based BCI. It is expected that our CNN-based approach would reduce the necessity of long-term individual calibration sessions, thereby enhancing the practicality of fNIRS-based BCIs significantly.
topic brain–computer interface
functional near-infrared spectroscopy
deep learning
convolutional neural network
binary communication
url https://www.frontiersin.org/articles/10.3389/fnhum.2021.646915/full
work_keys_str_mv AT jinukkwon subjectindependentfunctionalnearinfraredspectroscopybasedbraincomputerinterfacesbasedonconvolutionalneuralnetworks
AT jinukkwon subjectindependentfunctionalnearinfraredspectroscopybasedbraincomputerinterfacesbasedonconvolutionalneuralnetworks
AT changhwanim subjectindependentfunctionalnearinfraredspectroscopybasedbraincomputerinterfacesbasedonconvolutionalneuralnetworks
AT changhwanim subjectindependentfunctionalnearinfraredspectroscopybasedbraincomputerinterfacesbasedonconvolutionalneuralnetworks
_version_ 1724223234570715136