Skip to main content
Erschienen in: Neural Computing and Applications 7/2021

26.06.2020 | Original Article

Automated cell division classification in early mouse and human embryos using convolutional neural networks

verfasst von: Jonas Malmsten, Nikica Zaninovic, Qiansheng Zhan, Zev Rosenwaks, Juan Shan

Erschienen in: Neural Computing and Applications | Ausgabe 7/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

During in vitro fertilization (IVF), the timing of cell divisions in early human embryos is a key predictor of embryo viability. Recent developments in time-lapse microscopy (TLM) have allowed us to observe cell divisions in much greater detail than previously possible. However, it is a time-consuming process that relies on a highly trained staff and subjective observations. We describe an automated method based on a convolutional neural network to detect and classify cell divisions from original (unprocessed) TLM images. Here, we used two embryo TLM image datasets to evaluate our method: a public dataset with mouse embryos up to the 4-cell stage and a private dataset with human embryos up to the 8-cell stage. Compared to embryologists’ annotations, our results were almost 100% accurate for the mouse embryo images and accurate within five frames in 93.9% of cell stage transitions for the human embryos. Our approach can be used to improve the consistency and quality of the existing annotations or as part of a platform for fully automated embryo assessment. The code is available at http://​github.​com/​JonasEMalmsten/​CellDivision.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Land J, Evers J (2003) Risks and complications in assisted reproduction techniques: report of an ESHRE consensus meeting. Human Reprod 18(2):455–457CrossRef Land J, Evers J (2003) Risks and complications in assisted reproduction techniques: report of an ESHRE consensus meeting. Human Reprod 18(2):455–457CrossRef
4.
Zurück zum Zitat Braude P, Bolton V, Moore S (1988) Human gene expression first occurs between the four-and eight-cell stages of preimplantation development. Nature 332(6163):459–461CrossRef Braude P, Bolton V, Moore S (1988) Human gene expression first occurs between the four-and eight-cell stages of preimplantation development. Nature 332(6163):459–461CrossRef
5.
Zurück zum Zitat Lundin K, Bergh C, Hardarson T (2001) Early embryo cleavage is a strong indicator of embryo quality in human IVF. Hum Reprod 16(12):2652–2657CrossRef Lundin K, Bergh C, Hardarson T (2001) Early embryo cleavage is a strong indicator of embryo quality in human IVF. Hum Reprod 16(12):2652–2657CrossRef
6.
Zurück zum Zitat Veeck, L.I. and N. Zaninovic, Atlas of Human Blastocysts. 2007: CRC Press Veeck, L.I. and N. Zaninovic, Atlas of Human Blastocysts. 2007: CRC Press
7.
Zurück zum Zitat Meseguer M et al (2011) The use of morphokinetics as a predictor of embryo implantation. Hum Reprod 26(10):2658–2671CrossRef Meseguer M et al (2011) The use of morphokinetics as a predictor of embryo implantation. Hum Reprod 26(10):2658–2671CrossRef
8.
Zurück zum Zitat Wong CC et al (2010) Non-invasive imaging of human embryos before embryonic genome activation predicts development to the blastocyst stage. Nat Biotech 28(10):1115–1121CrossRef Wong CC et al (2010) Non-invasive imaging of human embryos before embryonic genome activation predicts development to the blastocyst stage. Nat Biotech 28(10):1115–1121CrossRef
9.
Zurück zum Zitat Rai R, Regan L (2006) Recurrent miscarriage. The Lancet 368(9535):601–611CrossRef Rai R, Regan L (2006) Recurrent miscarriage. The Lancet 368(9535):601–611CrossRef
10.
Zurück zum Zitat Khosravi P et al. (2018) Robust automated assessment of human blastocyst quality using deep learning. bioRxiv, 2018: p. 394882 Khosravi P et al. (2018) Robust automated assessment of human blastocyst quality using deep learning. bioRxiv, 2018: p. 394882
11.
Zurück zum Zitat Giusti A et al. (2009) Segmentation of human zygotes in hoffman modulation contrast images. In: Proc. of MIUA Giusti A et al. (2009) Segmentation of human zygotes in hoffman modulation contrast images. In: Proc. of MIUA
12.
Zurück zum Zitat Giusti A et al. (2010) Blastomere segmentation and 3d morphology measurements of early embryos from hoffman modulation contrast image stacks. In: Biomedical imaging: from nano to macro, 2010 IEEE International Symposium on. 2010. IEEE Giusti A et al. (2010) Blastomere segmentation and 3d morphology measurements of early embryos from hoffman modulation contrast image stacks. In: Biomedical imaging: from nano to macro, 2010 IEEE International Symposium on. 2010. IEEE
13.
Zurück zum Zitat Moussavi F et al (2014) A unified graphical models framework for automated mitosis detection in human embryos. IEEE Trans Med Imaging 33(7):1551–1562CrossRef Moussavi F et al (2014) A unified graphical models framework for automated mitosis detection in human embryos. IEEE Trans Med Imaging 33(7):1551–1562CrossRef
14.
Zurück zum Zitat LeCun Y et al (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef LeCun Y et al (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef
15.
Zurück zum Zitat Szegedy C et al. (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition Szegedy C et al. (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition
16.
Zurück zum Zitat He K et al. (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition He K et al. (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition
17.
Zurück zum Zitat Khan A, Gould S, Salzmann M (2016) Deep convolutional neural networks for human embryonic cell counting. In: European conference on computer vision. 2016. Springer Khan A, Gould S, Salzmann M (2016) Deep convolutional neural networks for human embryonic cell counting. In: European conference on computer vision. 2016. Springer
18.
Zurück zum Zitat Gingold J et al (2018) Predicting embryo morphokinetic annotations from time-lapse videos using convolutional neural networks. Fertil Steril 110(4):e220CrossRef Gingold J et al (2018) Predicting embryo morphokinetic annotations from time-lapse videos using convolutional neural networks. Fertil Steril 110(4):e220CrossRef
19.
Zurück zum Zitat Malmsten J et al (2018) Automatic prediction of embryo cell stages using artificial intelligence convolutional neural network. Fertil Steril 110(4):e360CrossRef Malmsten J et al (2018) Automatic prediction of embryo cell stages using artificial intelligence convolutional neural network. Fertil Steril 110(4):e360CrossRef
20.
Zurück zum Zitat Lau T et al. (2019) Embryo staging with weakly-supervised region selection and dynamically-decoded predictions. arXiv preprint arXiv:1904.04419 Lau T et al. (2019) Embryo staging with weakly-supervised region selection and dynamically-decoded predictions. arXiv preprint arXiv:​1904.​04419
21.
Zurück zum Zitat Tran A et al (2018) Artificial intelligence as a novel approach for embryo selection. Fertil Steril 110(4):e430CrossRef Tran A et al (2018) Artificial intelligence as a novel approach for embryo selection. Fertil Steril 110(4):e430CrossRef
22.
Zurück zum Zitat Malmsten J et al. (2019) Automated cell stage predictions in early mouse and human embryos using convolutional neural networks. In: 2019 IEEE EMBS international conference on biomedical & health informatics (BHI). 2019. IEEE Malmsten J et al. (2019) Automated cell stage predictions in early mouse and human embryos using convolutional neural networks. In: 2019 IEEE EMBS international conference on biomedical & health informatics (BHI). 2019. IEEE
23.
Zurück zum Zitat Szegedy C et al. (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition Szegedy C et al. (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition
26.
Zurück zum Zitat Cicconet M et al (2014) Label free cell-tracking and division detection based on 2d time-lapse images for lineage analysis of early embryo development. Comput Biol Med 51:24–34CrossRef Cicconet M et al (2014) Label free cell-tracking and division detection based on 2d time-lapse images for lineage analysis of early embryo development. Comput Biol Med 51:24–34CrossRef
27.
Zurück zum Zitat Khan AS, Gould, Salzmann M (2015) Automated monitoring of human embryonic cells up to the 5-cell stage in time-lapse microscopy images. In: Biomedical imaging (ISBI), 2015 IEEE 12th international symposium on. 2015. IEEE Khan AS, Gould, Salzmann M (2015) Automated monitoring of human embryonic cells up to the 5-cell stage in time-lapse microscopy images. In: Biomedical imaging (ISBI), 2015 IEEE 12th international symposium on. 2015. IEEE
Metadaten
Titel
Automated cell division classification in early mouse and human embryos using convolutional neural networks
verfasst von
Jonas Malmsten
Nikica Zaninovic
Qiansheng Zhan
Zev Rosenwaks
Juan Shan
Publikationsdatum
26.06.2020
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 7/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05127-8

Weitere Artikel der Ausgabe 7/2021

Neural Computing and Applications 7/2021 Zur Ausgabe