Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks
Functional near-infrared spectroscopy (fNIRS) has attracted increasing attention in the field of brain–computer interfaces (BCIs) owing to their advantages such as non-invasiveness, user safety, affordability, and portability. However, fNIRS signals are highly subject-specific and have low test-rete...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2021-03-01
|
Series: | Frontiers in Human Neuroscience |
Subjects: | |
Online Access: | https://www.frontiersin.org/articles/10.3389/fnhum.2021.646915/full |
id |
doaj-0809131e4ce54f9fbcd288db6cf545c7 |
---|---|
record_format |
Article |
spelling |
doaj-0809131e4ce54f9fbcd288db6cf545c72021-03-12T04:34:27ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612021-03-011510.3389/fnhum.2021.646915646915Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural NetworksJinuk Kwon0Jinuk Kwon1Chang-Hwan Im2Chang-Hwan Im3Department of Biomedical Engineering, Hanyang University, Seoul, South KoreaDepartment of Electronic Engineering, Hanyang University, Seoul, South KoreaDepartment of Biomedical Engineering, Hanyang University, Seoul, South KoreaDepartment of Electronic Engineering, Hanyang University, Seoul, South KoreaFunctional near-infrared spectroscopy (fNIRS) has attracted increasing attention in the field of brain–computer interfaces (BCIs) owing to their advantages such as non-invasiveness, user safety, affordability, and portability. However, fNIRS signals are highly subject-specific and have low test-retest reliability. Therefore, individual calibration sessions need to be employed before each use of fNIRS-based BCI to achieve a sufficiently high performance for practical BCI applications. In this study, we propose a novel deep convolutional neural network (CNN)-based approach for implementing a subject-independent fNIRS-based BCI. A total of 18 participants performed the fNIRS-based BCI experiments, where the main goal of the experiments was to distinguish a mental arithmetic task from an idle state task. Leave-one-subject-out cross-validation was employed to evaluate the average classification accuracy of the proposed subject-independent fNIRS-based BCI. As a result, the average classification accuracy of the proposed method was reported to be 71.20 ± 8.74%, which was higher than the threshold accuracy for effective BCI communication (70%) as well as that obtained using conventional shrinkage linear discriminant analysis (65.74 ± 7.68%). To achieve a classification accuracy comparable to that of the proposed subject-independent fNIRS-based BCI, 24 training trials (of approximately 12 min) were necessary for the traditional subject-dependent fNIRS-based BCI. It is expected that our CNN-based approach would reduce the necessity of long-term individual calibration sessions, thereby enhancing the practicality of fNIRS-based BCIs significantly.https://www.frontiersin.org/articles/10.3389/fnhum.2021.646915/fullbrain–computer interfacefunctional near-infrared spectroscopydeep learningconvolutional neural networkbinary communication |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Jinuk Kwon Jinuk Kwon Chang-Hwan Im Chang-Hwan Im |
spellingShingle |
Jinuk Kwon Jinuk Kwon Chang-Hwan Im Chang-Hwan Im Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks Frontiers in Human Neuroscience brain–computer interface functional near-infrared spectroscopy deep learning convolutional neural network binary communication |
author_facet |
Jinuk Kwon Jinuk Kwon Chang-Hwan Im Chang-Hwan Im |
author_sort |
Jinuk Kwon |
title |
Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks |
title_short |
Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks |
title_full |
Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks |
title_fullStr |
Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks |
title_full_unstemmed |
Subject-Independent Functional Near-Infrared Spectroscopy-Based Brain–Computer Interfaces Based on Convolutional Neural Networks |
title_sort |
subject-independent functional near-infrared spectroscopy-based brain–computer interfaces based on convolutional neural networks |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Human Neuroscience |
issn |
1662-5161 |
publishDate |
2021-03-01 |
description |
Functional near-infrared spectroscopy (fNIRS) has attracted increasing attention in the field of brain–computer interfaces (BCIs) owing to their advantages such as non-invasiveness, user safety, affordability, and portability. However, fNIRS signals are highly subject-specific and have low test-retest reliability. Therefore, individual calibration sessions need to be employed before each use of fNIRS-based BCI to achieve a sufficiently high performance for practical BCI applications. In this study, we propose a novel deep convolutional neural network (CNN)-based approach for implementing a subject-independent fNIRS-based BCI. A total of 18 participants performed the fNIRS-based BCI experiments, where the main goal of the experiments was to distinguish a mental arithmetic task from an idle state task. Leave-one-subject-out cross-validation was employed to evaluate the average classification accuracy of the proposed subject-independent fNIRS-based BCI. As a result, the average classification accuracy of the proposed method was reported to be 71.20 ± 8.74%, which was higher than the threshold accuracy for effective BCI communication (70%) as well as that obtained using conventional shrinkage linear discriminant analysis (65.74 ± 7.68%). To achieve a classification accuracy comparable to that of the proposed subject-independent fNIRS-based BCI, 24 training trials (of approximately 12 min) were necessary for the traditional subject-dependent fNIRS-based BCI. It is expected that our CNN-based approach would reduce the necessity of long-term individual calibration sessions, thereby enhancing the practicality of fNIRS-based BCIs significantly. |
topic |
brain–computer interface functional near-infrared spectroscopy deep learning convolutional neural network binary communication |
url |
https://www.frontiersin.org/articles/10.3389/fnhum.2021.646915/full |
work_keys_str_mv |
AT jinukkwon subjectindependentfunctionalnearinfraredspectroscopybasedbraincomputerinterfacesbasedonconvolutionalneuralnetworks AT jinukkwon subjectindependentfunctionalnearinfraredspectroscopybasedbraincomputerinterfacesbasedonconvolutionalneuralnetworks AT changhwanim subjectindependentfunctionalnearinfraredspectroscopybasedbraincomputerinterfacesbasedonconvolutionalneuralnetworks AT changhwanim subjectindependentfunctionalnearinfraredspectroscopybasedbraincomputerinterfacesbasedonconvolutionalneuralnetworks |
_version_ |
1724223234570715136 |