Robust, automated sleep scoring by a compact neural network with distributional shift correction.

Studying the biology of sleep requires the accurate assessment of the state of experimental subjects, and manual analysis of relevant data is a major bottleneck. Recently, deep learning applied to electroencephalogram and electromyogram data has shown great promise as a sleep scoring method, approac...

Full description

Bibliographic Details
Main Authors: Zeke Barger, Charles G Frye, Danqian Liu, Yang Dan, Kristofer E Bouchard
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2019-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0224642
id doaj-189859576b9941a4848701524b246dab
record_format Article
spelling doaj-189859576b9941a4848701524b246dab2021-03-03T21:15:14ZengPublic Library of Science (PLoS)PLoS ONE1932-62032019-01-011412e022464210.1371/journal.pone.0224642Robust, automated sleep scoring by a compact neural network with distributional shift correction.Zeke BargerCharles G FryeDanqian LiuYang DanKristofer E BouchardStudying the biology of sleep requires the accurate assessment of the state of experimental subjects, and manual analysis of relevant data is a major bottleneck. Recently, deep learning applied to electroencephalogram and electromyogram data has shown great promise as a sleep scoring method, approaching the limits of inter-rater reliability. As with any machine learning algorithm, the inputs to a sleep scoring classifier are typically standardized in order to remove distributional shift caused by variability in the signal collection process. However, in scientific data, experimental manipulations introduce variability that should not be removed. For example, in sleep scoring, the fraction of time spent in each arousal state can vary between control and experimental subjects. We introduce a standardization method, mixture z-scoring, that preserves this crucial form of distributional shift. Using both a simulated experiment and mouse in vivo data, we demonstrate that a common standardization method used by state-of-the-art sleep scoring algorithms introduces systematic bias, but that mixture z-scoring does not. We present a free, open-source user interface that uses a compact neural network and mixture z-scoring to allow for rapid sleep scoring with accuracy that compares well to contemporary methods. This work provides a set of computational tools for the robust automation of sleep scoring.https://doi.org/10.1371/journal.pone.0224642
collection DOAJ
language English
format Article
sources DOAJ
author Zeke Barger
Charles G Frye
Danqian Liu
Yang Dan
Kristofer E Bouchard
spellingShingle Zeke Barger
Charles G Frye
Danqian Liu
Yang Dan
Kristofer E Bouchard
Robust, automated sleep scoring by a compact neural network with distributional shift correction.
PLoS ONE
author_facet Zeke Barger
Charles G Frye
Danqian Liu
Yang Dan
Kristofer E Bouchard
author_sort Zeke Barger
title Robust, automated sleep scoring by a compact neural network with distributional shift correction.
title_short Robust, automated sleep scoring by a compact neural network with distributional shift correction.
title_full Robust, automated sleep scoring by a compact neural network with distributional shift correction.
title_fullStr Robust, automated sleep scoring by a compact neural network with distributional shift correction.
title_full_unstemmed Robust, automated sleep scoring by a compact neural network with distributional shift correction.
title_sort robust, automated sleep scoring by a compact neural network with distributional shift correction.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2019-01-01
description Studying the biology of sleep requires the accurate assessment of the state of experimental subjects, and manual analysis of relevant data is a major bottleneck. Recently, deep learning applied to electroencephalogram and electromyogram data has shown great promise as a sleep scoring method, approaching the limits of inter-rater reliability. As with any machine learning algorithm, the inputs to a sleep scoring classifier are typically standardized in order to remove distributional shift caused by variability in the signal collection process. However, in scientific data, experimental manipulations introduce variability that should not be removed. For example, in sleep scoring, the fraction of time spent in each arousal state can vary between control and experimental subjects. We introduce a standardization method, mixture z-scoring, that preserves this crucial form of distributional shift. Using both a simulated experiment and mouse in vivo data, we demonstrate that a common standardization method used by state-of-the-art sleep scoring algorithms introduces systematic bias, but that mixture z-scoring does not. We present a free, open-source user interface that uses a compact neural network and mixture z-scoring to allow for rapid sleep scoring with accuracy that compares well to contemporary methods. This work provides a set of computational tools for the robust automation of sleep scoring.
url https://doi.org/10.1371/journal.pone.0224642
work_keys_str_mv AT zekebarger robustautomatedsleepscoringbyacompactneuralnetworkwithdistributionalshiftcorrection
AT charlesgfrye robustautomatedsleepscoringbyacompactneuralnetworkwithdistributionalshiftcorrection
AT danqianliu robustautomatedsleepscoringbyacompactneuralnetworkwithdistributionalshiftcorrection
AT yangdan robustautomatedsleepscoringbyacompactneuralnetworkwithdistributionalshiftcorrection
AT kristoferebouchard robustautomatedsleepscoringbyacompactneuralnetworkwithdistributionalshiftcorrection
_version_ 1714817909054767104