Skip to main content
Erschienen in: Medical & Biological Engineering & Computing 9/2023

31.03.2023 | Original Article

A temporal multi-scale hybrid attention network for sleep stage classification

verfasst von: Zheng Jin, Kebin Jia

Erschienen in: Medical & Biological Engineering & Computing | Ausgabe 9/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Sleep is crucial for human health. Automatic sleep stage classification based on polysomnogram (PSG) is meaningful for the diagnosis of sleep disorders, which has attracted extensive attention in recent years. Most existing methods could not fully consider the different transitions of sleep stages and fit the visual inspection of sleep experts simultaneously. To this end, we propose a temporal multi-scale hybrid attention network, namely TMHAN, to automatically achieve sleep staging. The temporal multi-scale mechanism incorporates short-term abrupt and long-term periodic transitions of the successive PSG epochs. Furthermore, the hybrid attention mechanism includes 1-D local attention, 2-D global attention, and 2-D contextual sparse multi-head self-attention for three kinds of sequence-level representations. The concatenated representation is subsequently fed into a softmax layer to train an end-to-end model. Experimental results on two benchmark sleep datasets show that TMHAN obtains the best performance compared with several baselines, demonstrating the effectiveness of our model. In general, our work not only provides good classification performance, but also fits the actual sleep staging processes, which makes contribution for the combination of deep learning and sleep medicine.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chriskos P, Frantzidis CA, Gkivogkli PT et al (2020) Automatic sleep staging employing convolutional neural networks and cortical connectivity images. IEEE Trans Neural Netw Learn Syst 31(1):113–123CrossRefPubMed Chriskos P, Frantzidis CA, Gkivogkli PT et al (2020) Automatic sleep staging employing convolutional neural networks and cortical connectivity images. IEEE Trans Neural Netw Learn Syst 31(1):113–123CrossRefPubMed
2.
Zurück zum Zitat Delimayanti MK, Purnama B, Nguyen NG et al (2020) Classification of brainwaves for sleep stages by high-dimensional FFT features from EEG signals. Appl Sci-Basel 10(5):1797CrossRef Delimayanti MK, Purnama B, Nguyen NG et al (2020) Classification of brainwaves for sleep stages by high-dimensional FFT features from EEG signals. Appl Sci-Basel 10(5):1797CrossRef
3.
Zurück zum Zitat Iber C, Ancoli-Israel S, Chesson, AL Jr et al (2007) The AASM manual for the scoring of sleep and associated events. American Academy of Sleep Medicine, Westchester Iber C, Ancoli-Israel S, Chesson, AL Jr et al (2007) The AASM manual for the scoring of sleep and associated events. American Academy of Sleep Medicine, Westchester
4.
Zurück zum Zitat Memar P, Faradji F (2018) A novel multi-class EEG-based sleep stage classification system. IEEE Trans Neural Syst Rehabil Eng 26(1):84–95CrossRefPubMed Memar P, Faradji F (2018) A novel multi-class EEG-based sleep stage classification system. IEEE Trans Neural Syst Rehabil Eng 26(1):84–95CrossRefPubMed
5.
Zurück zum Zitat Zhao DC, Wang Y, Wang QQ et al (2019) Comparative analysis of different characteristics of automatic sleep stages. Comput Meth Programs Biomed 175:53–72CrossRef Zhao DC, Wang Y, Wang QQ et al (2019) Comparative analysis of different characteristics of automatic sleep stages. Comput Meth Programs Biomed 175:53–72CrossRef
6.
Zurück zum Zitat Kang DY, DeYoung PN, Malhotra A et al (2018) A state space and density estimation framework for sleep staging in obstructive sleep apnea. IEEE Trans Biomed Eng 65(6):1201–1212CrossRefPubMed Kang DY, DeYoung PN, Malhotra A et al (2018) A state space and density estimation framework for sleep staging in obstructive sleep apnea. IEEE Trans Biomed Eng 65(6):1201–1212CrossRefPubMed
7.
Zurück zum Zitat Ghimatgar H, Kazemi K, Helfroush MS et al (2019) An automatic single-channel EEG-based sleep stage scoring method based on hidden Markov model. J Neurosci Methods 324:108320CrossRefPubMed Ghimatgar H, Kazemi K, Helfroush MS et al (2019) An automatic single-channel EEG-based sleep stage scoring method based on hidden Markov model. J Neurosci Methods 324:108320CrossRefPubMed
8.
Zurück zum Zitat Chambon S, Galtier MN, Arnal PJ et al (2018) A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time series. IEEE Trans Neural Syst Rehabil Eng 26 (4):758–769CrossRefPubMed Chambon S, Galtier MN, Arnal PJ et al (2018) A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time series. IEEE Trans Neural Syst Rehabil Eng 26 (4):758–769CrossRefPubMed
9.
Zurück zum Zitat Phan H, Andreotti F, Cooray N et al (2019) Joint classification and prediction CNN framework for automatic sleep stage classification. IEEE Trans Biomed Eng 66(5):1285–1296CrossRefPubMed Phan H, Andreotti F, Cooray N et al (2019) Joint classification and prediction CNN framework for automatic sleep stage classification. IEEE Trans Biomed Eng 66(5):1285–1296CrossRefPubMed
10.
Zurück zum Zitat Jadhav P, Rajguru G, Datta D et al (2020) Original automatic sleep stage classification using time-frequency images of CWT and transfer learning using convolution neural network. Biocybern Biomed Eng 40 (1):494–504CrossRef Jadhav P, Rajguru G, Datta D et al (2020) Original automatic sleep stage classification using time-frequency images of CWT and transfer learning using convolution neural network. Biocybern Biomed Eng 40 (1):494–504CrossRef
11.
Zurück zum Zitat Jia ZY, Lin YF, Wang J et al (2020) GraphSleepNet: adaptive spatial-temporal graph convolutional networks for sleep stage classification. In: Proceedings of the 29th international joint conference on artificial intelligence, Yokohama Japan, pp 1324–1330 Jia ZY, Lin YF, Wang J et al (2020) GraphSleepNet: adaptive spatial-temporal graph convolutional networks for sleep stage classification. In: Proceedings of the 29th international joint conference on artificial intelligence, Yokohama Japan, pp 1324–1330
12.
Zurück zum Zitat Michielli N, Acharya UR, Molinari F (2019) Cascaded LSTM recurrent neural network for automated sleep stage classification using single-channel EEG signals. Comput Biol Med 106:71–81CrossRefPubMed Michielli N, Acharya UR, Molinari F (2019) Cascaded LSTM recurrent neural network for automated sleep stage classification using single-channel EEG signals. Comput Biol Med 106:71–81CrossRefPubMed
13.
Zurück zum Zitat Dong H, Supratak A, Pan W et al (2018) Mixed neural network approach for temporal sleep stage classification. IEEE Trans Neural Syst Rehabil Eng 26(2):324–333CrossRefPubMed Dong H, Supratak A, Pan W et al (2018) Mixed neural network approach for temporal sleep stage classification. IEEE Trans Neural Syst Rehabil Eng 26(2):324–333CrossRefPubMed
14.
Zurück zum Zitat Kwon HB, Choi SH, Lee D et al (2021) Attention-based LSTM for non-contact sleep stage classification using IR-UWB radar. IEEE J Biomed Health Inform 25(10):3844–3853CrossRefPubMed Kwon HB, Choi SH, Lee D et al (2021) Attention-based LSTM for non-contact sleep stage classification using IR-UWB radar. IEEE J Biomed Health Inform 25(10):3844–3853CrossRefPubMed
15.
Zurück zum Zitat Zhu TQ, Luo W, Yu F (2020) Convolution- and attention-based neural network for automated sleep stage classification. Int J Environ Res Public Health 17(11):4152CrossRefPubMedPubMedCentral Zhu TQ, Luo W, Yu F (2020) Convolution- and attention-based neural network for automated sleep stage classification. Int J Environ Res Public Health 17(11):4152CrossRefPubMedPubMedCentral
16.
Zurück zum Zitat Khalili E, Asl BM (2021) Automatic sleep stage classification using temporal convolutional neural network and new data augmentation technique from raw single-channel EEG. Comput Meth Programs Biomed 204:106063CrossRef Khalili E, Asl BM (2021) Automatic sleep stage classification using temporal convolutional neural network and new data augmentation technique from raw single-channel EEG. Comput Meth Programs Biomed 204:106063CrossRef
17.
Zurück zum Zitat Supratak A, Dong H, Wu C et al (2017) DeepSleepNet: a model for automatic sleep stage scoring based on raw single-channel EEG. IEEE Trans Neural Syst Rehabil Eng 25(11):1998–2008CrossRefPubMed Supratak A, Dong H, Wu C et al (2017) DeepSleepNet: a model for automatic sleep stage scoring based on raw single-channel EEG. IEEE Trans Neural Syst Rehabil Eng 25(11):1998–2008CrossRefPubMed
18.
Zurück zum Zitat Seo H, Back S, Lee S et al (2020) Intra- and inter-epoch temporal context network (IITNet) using sub-epoch features for automatic sleep scoring on raw single-channel EEG. Biomed Signal Process Control 61:102037CrossRef Seo H, Back S, Lee S et al (2020) Intra- and inter-epoch temporal context network (IITNet) using sub-epoch features for automatic sleep scoring on raw single-channel EEG. Biomed Signal Process Control 61:102037CrossRef
19.
Zurück zum Zitat Yuan Y, Xun GX, Ma FL et al (2018) MuVAN: a multi-view attention network for multivariate temporal data. In: Proceedings of the 18th IEEE international conference on data mining, Singapore, pp 717–726 Yuan Y, Xun GX, Ma FL et al (2018) MuVAN: a multi-view attention network for multivariate temporal data. In: Proceedings of the 18th IEEE international conference on data mining, Singapore, pp 717–726
20.
Zurück zum Zitat Phan H, Andreotti F, Cooray N et al (2019) SeqSleepNet: end-to-end hierarchical recurrent neural network for sequence-to-sequence automatic sleep staging. IEEE Trans Neural Syst Rehabil Eng 27(3):400–410CrossRefPubMedPubMedCentral Phan H, Andreotti F, Cooray N et al (2019) SeqSleepNet: end-to-end hierarchical recurrent neural network for sequence-to-sequence automatic sleep staging. IEEE Trans Neural Syst Rehabil Eng 27(3):400–410CrossRefPubMedPubMedCentral
21.
Zurück zum Zitat Guillot A, Sauvet F, During EH et al (2020) Dreem open datasets: multi-scored sleep datasets to compare human and automated sleep staging. IEEE Trans Neural Syst Rehabil Eng 28(9):1955–1965CrossRefPubMed Guillot A, Sauvet F, During EH et al (2020) Dreem open datasets: multi-scored sleep datasets to compare human and automated sleep staging. IEEE Trans Neural Syst Rehabil Eng 28(9):1955–1965CrossRefPubMed
22.
Zurück zum Zitat Berry RB, Brooks R, Gamaldo CE et al (2012) The AASM manual for the scoring of sleep and associated events. Rules, Terminol Tech Specifications Darien, Illinois, Amer Acad Sleep Med Berry RB, Brooks R, Gamaldo CE et al (2012) The AASM manual for the scoring of sleep and associated events. Rules, Terminol Tech Specifications Darien, Illinois, Amer Acad Sleep Med
24.
Zurück zum Zitat Yuan Y, Jia KB, Ma FL et al (2019) A hybrid self-attention deep learning framework for multivariate sleep stage classification. BMC Bioinforma 20(16):1–10 Yuan Y, Jia KB, Ma FL et al (2019) A hybrid self-attention deep learning framework for multivariate sleep stage classification. BMC Bioinforma 20(16):1–10
25.
Zurück zum Zitat Wang HF, Lu CG, Zhang Q et al (2022) A novel sleep staging network based on multi-scale dual attention. Biomed Sig Process Control 74:103486CrossRef Wang HF, Lu CG, Zhang Q et al (2022) A novel sleep staging network based on multi-scale dual attention. Biomed Sig Process Control 74:103486CrossRef
26.
Zurück zum Zitat Eldele E, Chen ZH, Liu CY et al (2021) An attention-based deep learning approach for sleep stage classification with single-channel EEG. IEEE Trans Neural Syst Rehabil Eng 29:809–818CrossRefPubMed Eldele E, Chen ZH, Liu CY et al (2021) An attention-based deep learning approach for sleep stage classification with single-channel EEG. IEEE Trans Neural Syst Rehabil Eng 29:809–818CrossRefPubMed
27.
Zurück zum Zitat Sun CL, Chen C, Li W et al (2020) A hierarchical neural network for sleep stage classification based on comprehensive feature learning and multi-flow sequence learning. IEEE J Biomed Health Inform 24 (5):1351–1366CrossRefPubMed Sun CL, Chen C, Li W et al (2020) A hierarchical neural network for sleep stage classification based on comprehensive feature learning and multi-flow sequence learning. IEEE J Biomed Health Inform 24 (5):1351–1366CrossRefPubMed
28.
Zurück zum Zitat Phan H, Andreotti F, Cooray N et al (2018) Automatic sleep stage classification using single-channel EEG: learning sequential features with attention-based recurrent neural networks. In: Proceedings of the 40th annual international conference of the ieee engineering in medicine and biology society, Honolulu, pp 1452–1455 Phan H, Andreotti F, Cooray N et al (2018) Automatic sleep stage classification using single-channel EEG: learning sequential features with attention-based recurrent neural networks. In: Proceedings of the 40th annual international conference of the ieee engineering in medicine and biology society, Honolulu, pp 1452–1455
29.
Zurück zum Zitat Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need. In: Proceedings of the 31st annual conference on neural information processing systems, Long Beach, pp 5999–6009 Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need. In: Proceedings of the 31st annual conference on neural information processing systems, Long Beach, pp 5999–6009
30.
Zurück zum Zitat Goldberger AL, Amaral LAN, Glass L et al (2000) PhysioBank, PhysioToolkit, and PhysioNet - components of a new research resource for complex physiologic signals. Circulation 101(23):E215–E220CrossRefPubMed Goldberger AL, Amaral LAN, Glass L et al (2000) PhysioBank, PhysioToolkit, and PhysioNet - components of a new research resource for complex physiologic signals. Circulation 101(23):E215–E220CrossRefPubMed
31.
Zurück zum Zitat Kemp B, Zwinderman AH, Tuk B et al (2000) Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG. IEEE Trans Biomed Eng 47(9):1185–1194CrossRefPubMed Kemp B, Zwinderman AH, Tuk B et al (2000) Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG. IEEE Trans Biomed Eng 47(9):1185–1194CrossRefPubMed
32.
Zurück zum Zitat Rechtschaffen A (1968) A manual for standardized terminology, techniques and scoring system for sleep stages in human subjects. Brain Inf Serv Rechtschaffen A (1968) A manual for standardized terminology, techniques and scoring system for sleep stages in human subjects. Brain Inf Serv
33.
Zurück zum Zitat Imtiaz SA, Rodriguez-Villegas E (2015) An open-source toolbox for standardized use of PhysioNet sleep EDF expanded database. In: Proceedings of the 37th annual international conference of the IEEE engineering in medicine and biology society, Milan, pp 6014–6017 Imtiaz SA, Rodriguez-Villegas E (2015) An open-source toolbox for standardized use of PhysioNet sleep EDF expanded database. In: Proceedings of the 37th annual international conference of the IEEE engineering in medicine and biology society, Milan, pp 6014–6017
34.
Zurück zum Zitat Paszke A, Gross S, Chintala S et al (2017) Automatic differentiation in pytorch. In: Proceedings of the 31st annual conference on neural information processing systems autodiff workshop, Long Beach, pp 1–4 Paszke A, Gross S, Chintala S et al (2017) Automatic differentiation in pytorch. In: Proceedings of the 31st annual conference on neural information processing systems autodiff workshop, Long Beach, pp 1–4
35.
Zurück zum Zitat Akiba T, Sano S, Yanase T et al (2019) Optuna: a next-generation hyperparameter optimization framework. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery and data mining, Anchorage, pp 2623–2631 Akiba T, Sano S, Yanase T et al (2019) Optuna: a next-generation hyperparameter optimization framework. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery and data mining, Anchorage, pp 2623–2631
36.
37.
Zurück zum Zitat Davies HJ, Nakamura T, Mandic DP (2019) A transition probability based classification model for enhanced N1 sleep stage identification during automatic sleep stage scoring. In: Proceedings of the 41st annual international conference of the IEEE engineering in medicine and biology society, Berlin, pp 3641–3644 Davies HJ, Nakamura T, Mandic DP (2019) A transition probability based classification model for enhanced N1 sleep stage identification during automatic sleep stage scoring. In: Proceedings of the 41st annual international conference of the IEEE engineering in medicine and biology society, Berlin, pp 3641–3644
38.
Zurück zum Zitat Hassan AR, Subasi A (2017) A decision support system for automated identification of sleep stages from single-channel EEG signals. Knowledge-Based Syst 128:115–124CrossRef Hassan AR, Subasi A (2017) A decision support system for automated identification of sleep stages from single-channel EEG signals. Knowledge-Based Syst 128:115–124CrossRef
Metadaten
Titel
A temporal multi-scale hybrid attention network for sleep stage classification
verfasst von
Zheng Jin
Kebin Jia
Publikationsdatum
31.03.2023
Verlag
Springer Berlin Heidelberg
Erschienen in
Medical & Biological Engineering & Computing / Ausgabe 9/2023
Print ISSN: 0140-0118
Elektronische ISSN: 1741-0444
DOI
https://doi.org/10.1007/s11517-023-02808-z

Weitere Artikel der Ausgabe 9/2023

Medical & Biological Engineering & Computing 9/2023 Zur Ausgabe

Premium Partner