Decoding Covert Speech From EEG-A Comprehensive Review

• Main Authors: Jerrin Thomas Panachakel, Angarai Ganesan Ramakrishnan
• Format: Article
• Language: English
• Published: Frontiers Media S.A. 2021-04-01
• Series: Frontiers in Neuroscience
• Subjects: imagined speech; brain-computer interfaces (BCI); neurorehabilitation; electroencephalogram (EEG); speech imagery; covert speech
• Online Access: https://www.frontiersin.org/articles/10.3389/fnins.2021.642251/full

Over the past decade, many researchers have come up with different implementations of systems for decoding covert or imagined speech from EEG (electroencephalogram). They differ from each other in several aspects, from data acquisition to machine learning algorithms, due to which, a comparison between different implementations is often difficult. This review article puts together all the relevant works published in the last decade on decoding imagined speech from EEG into a single framework. Every important aspect of designing such a system, such as selection of words to be imagined, number of electrodes to be recorded, temporal and spatial filtering, feature extraction and classifier are reviewed. This helps a researcher to compare the relative merits and demerits of the different approaches and choose the one that is most optimal. Speech being the most natural form of communication which human beings acquire even without formal education, imagined speech is an ideal choice of prompt for evoking brain activity patterns for a BCI (brain-computer interface) system, although the research on developing real-time (online) speech imagery based BCI systems is still in its infancy. Covert speech based BCI can help people with disabilities to improve their quality of life. It can also be used for covert communication in environments that do not support vocal communication. This paper also discusses some future directions, which will aid the deployment of speech imagery based BCI for practical applications, rather than only for laboratory experiments.