Skip to main content
Top

2019 | OriginalPaper | Chapter

A Convolutional Neural Network for Spot Detection in Microscopy Images

Authors : Matsilele Mabaso, Daniel Withey, Bhekisipho Twala

Published in: Biomedical Engineering Systems and Technologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper developed and evaluated a method for the detection of spots in microscopy images. Spots are subcellular particles formed as a result of biomarkers tagged to biomolecules in a specimen and observed via fluorescence microscopy as bright spots. Various approaches that automatically detect spots have been proposed to improve the analysis of biological images. The proposed spot detection method named, detectSpot includes the following steps: (1) A convolutional neural network is trained on image patches containing single spots. This trained network will act as a classifier to the next step. (2) Apply a sliding-window on images containing multiple spots, classify and accept all windows with a score above a given threshold. (3) Perform post-processing on all accepted windows to extract spot locations, then, (4) finally, suppress overlapping detections which are caused by the sliding window-approach. The proposed method was evaluated on realistic synthetic images with known and reliable ground truth. The proposed approach was compared to two other popular CNNs namely, GoogleNet and AlexNet and three traditional methods namely, Isotropic Undecimated Wavelet Transform, Laplacian of Gaussian and Feature Point Detection, using two types of synthetic images. The experimental results indicate that the proposed methodology provides fast spot detection with precision, recall and F_score values that are comparable to GoogleNet and higher compared to other methods in comparison. Statistical test between detectSpot and GoogleNet shows that the difference in performance between them is insignificant. This implies that one can use either of these two methods for solving the problem of spot detection.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bashir, A., Mustafa, Z.A., Abdelhameid, I., Ibrahem, R.: Detection of malaria parasites using digital image processing. In: Proceedings of the International Conference on Communication, Control, Computing and Electronics Engineering (ICCCCEE), Khartoum (2017) Bashir, A., Mustafa, Z.A., Abdelhameid, I., Ibrahem, R.: Detection of malaria parasites using digital image processing. In: Proceedings of the International Conference on Communication, Control, Computing and Electronics Engineering (ICCCCEE), Khartoum (2017)
2.
go back to reference Verma, A., Khanna, G.: Survey on digital image processing techniques for tumor detection. Indian J. Sci. Technol. 9(14), 1–15 (2016) Verma, A., Khanna, G.: Survey on digital image processing techniques for tumor detection. Indian J. Sci. Technol. 9(14), 1–15 (2016)
3.
go back to reference Mabaso, M., Withey, D., Twala, B.: Spot detection in microscopy images using convolutional neural network with sliding-window approach. In: Proceedings of the 5th International Conference on Bioimaging, Funchal-Madeira (2018) Mabaso, M., Withey, D., Twala, B.: Spot detection in microscopy images using convolutional neural network with sliding-window approach. In: Proceedings of the 5th International Conference on Bioimaging, Funchal-Madeira (2018)
4.
go back to reference Varga, D., Szirányi, T.: Detecting pedestrians in surveillance videos based on convolutional neural network and motion. In: 24th European Signal Processing Conference (EUSIPCO), Budapest, Hungary (2016) Varga, D., Szirányi, T.: Detecting pedestrians in surveillance videos based on convolutional neural network and motion. In: 24th European Signal Processing Conference (EUSIPCO), Budapest, Hungary (2016)
5.
go back to reference Wang, Z., Li, Z., Wang, B., Liu, H.: Robot grasp detection using multimodal deep convolutional neural networks. Adv. Mech. Eng. 8(9), 1–12 (2016) Wang, Z., Li, Z., Wang, B., Liu, H.: Robot grasp detection using multimodal deep convolutional neural networks. Adv. Mech. Eng. 8(9), 1–12 (2016)
6.
go back to reference Li, R., et al.: Deep learning based imaging data completion for improved brain disease diagnosis. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, Quebec City (2014)CrossRef Li, R., et al.: Deep learning based imaging data completion for improved brain disease diagnosis. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, Quebec City (2014)CrossRef
7.
go back to reference Genovesio, A., Liendl, T., Emiliana, V., Parak, W.J., Coppey-Moisan, M., Olivo-Marin, J.-C.: Multiple particle tracking in 3D+t microscopy: method and application to the tracking of endocytosed quantum dots. IEEE Trans. Image Process. 15(5), 1062–1070 (2006)CrossRef Genovesio, A., Liendl, T., Emiliana, V., Parak, W.J., Coppey-Moisan, M., Olivo-Marin, J.-C.: Multiple particle tracking in 3D+t microscopy: method and application to the tracking of endocytosed quantum dots. IEEE Trans. Image Process. 15(5), 1062–1070 (2006)CrossRef
8.
go back to reference Olivo-Marin, J.-C.: Extraction of spots in biological images using multiscale products. Pattern Recogn. 35(9), 1989–1996 (2002)CrossRef Olivo-Marin, J.-C.: Extraction of spots in biological images using multiscale products. Pattern Recogn. 35(9), 1989–1996 (2002)CrossRef
9.
go back to reference Kimori, Y., Baba, N., Morone, N.: Extended morphological processing: a practical method for automatic spot detection of biological markers from microscopic images. BMC Bioinf. 11(373), 1–13 (2010) Kimori, Y., Baba, N., Morone, N.: Extended morphological processing: a practical method for automatic spot detection of biological markers from microscopic images. BMC Bioinf. 11(373), 1–13 (2010)
10.
go back to reference Smal, I., Loog, M., Niessen, W., Meijering, E.: Quantitative comparison of spot detection methods in fluorescence microscopy. IEEE Trans. Med. Imaging 29(2), 282–301 (2010)CrossRef Smal, I., Loog, M., Niessen, W., Meijering, E.: Quantitative comparison of spot detection methods in fluorescence microscopy. IEEE Trans. Med. Imaging 29(2), 282–301 (2010)CrossRef
11.
go back to reference Mabaso, M., Withey, D., Twala, B.: Spot detection methods in fluorescence microscopy imaging: a review. Image Anal. Stereol. 37(3), 173–190 (2018)CrossRef Mabaso, M., Withey, D., Twala, B.: Spot detection methods in fluorescence microscopy imaging: a review. Image Anal. Stereol. 37(3), 173–190 (2018)CrossRef
13.
go back to reference Noh, H., Hong, S., Han, B.: Learning deconvolution network for semantic segmentation. In: IEEE International Conference on Computer Vision (2015) Noh, H., Hong, S., Han, B.: Learning deconvolution network for semantic segmentation. In: IEEE International Conference on Computer Vision (2015)
14.
go back to reference Tajbakhsh, N., et al.: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans. Med. Imaging 35(5), 1299–1312 (2016)CrossRef Tajbakhsh, N., et al.: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans. Med. Imaging 35(5), 1299–1312 (2016)CrossRef
15.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet Classification with deep convolutional neural networks. In: Neural Information Processing Systems (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet Classification with deep convolutional neural networks. In: Neural Information Processing Systems (2012)
16.
go back to reference Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations (2014) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations (2014)
17.
go back to reference Szegedy, C., et al.: Going deeper with convolutions. In: Computer Vision and Pattern Recognition, Boston (2015) Szegedy, C., et al.: Going deeper with convolutions. In: Computer Vision and Pattern Recognition, Boston (2015)
18.
go back to reference Van Valen, D.A., et al.: Deep learning automates the quantitative analysis of individual cells in live-cell imaging experiments. PLoS Comput. Biol. 12(11), 1–24 (2016)MathSciNet Van Valen, D.A., et al.: Deep learning automates the quantitative analysis of individual cells in live-cell imaging experiments. PLoS Comput. Biol. 12(11), 1–24 (2016)MathSciNet
19.
go back to reference Mabaso, M., Withey, D., Twala, B. Spot detection in microscopy images using convolutional neural network with sliding-window approach. In: Proceedings of the 5th International Conference on Bioimaging, Funchal (2018) Mabaso, M., Withey, D., Twala, B. Spot detection in microscopy images using convolutional neural network with sliding-window approach. In: Proceedings of the 5th International Conference on Bioimaging, Funchal (2018)
21.
go back to reference Nair, V., Hinton, G.E.: Rectified linear units improve restricted Boltzmann machines. In: Proceedings of the 27th International Conference on Machine Learning (2010) Nair, V., Hinton, G.E.: Rectified linear units improve restricted Boltzmann machines. In: Proceedings of the 27th International Conference on Machine Learning (2010)
22.
23.
go back to reference Abadi, M., et al.: TensorFlow: large-scale machine learning on heterogeneous system. In: 12th USENIX Symposium on Operating Systems Design and Implementation (2015) Abadi, M., et al.: TensorFlow: large-scale machine learning on heterogeneous system. In: 12th USENIX Symposium on Operating Systems Design and Implementation (2015)
24.
go back to reference Kingma, D.P., Ba, J.L.: Adam: a method for stochastic optimization. In: 3rd International Conference for Learning Representations, San Diego (2015) Kingma, D.P., Ba, J.L.: Adam: a method for stochastic optimization. In: 3rd International Conference for Learning Representations, San Diego (2015)
25.
go back to reference Mabaso, M., Withey, D., Twala, B.: A framework for creating realistic synthetic fluorescence microscopy image sequences. In: Bioimaging 2016, Rome (2016) Mabaso, M., Withey, D., Twala, B.: A framework for creating realistic synthetic fluorescence microscopy image sequences. In: Bioimaging 2016, Rome (2016)
28.
go back to reference Sbalzarini, I.F., Koumoutsakos, P.: Feature point tracking and trajectory analysis for video imaging in cell biology. J. Struct. Biol. 151(2), 182–195 (2005)CrossRef Sbalzarini, I.F., Koumoutsakos, P.: Feature point tracking and trajectory analysis for video imaging in cell biology. J. Struct. Biol. 151(2), 182–195 (2005)CrossRef
29.
go back to reference Olivo-Marin, J.-C.: Extraction of spots in biological images using multiscale products. Pattern Recognit. 35(9), 1989–1996 (2002)CrossRef Olivo-Marin, J.-C.: Extraction of spots in biological images using multiscale products. Pattern Recognit. 35(9), 1989–1996 (2002)CrossRef
30.
go back to reference Raj, A., van den Bogaard, P., Rifkin, S.A., van Oudenaarfen, A., Tyagi, S.: Imaging individual mRNA molecules using multiple singly labeled probes. Nat. Methods 5(10), 877–879 (2008)CrossRef Raj, A., van den Bogaard, P., Rifkin, S.A., van Oudenaarfen, A., Tyagi, S.: Imaging individual mRNA molecules using multiple singly labeled probes. Nat. Methods 5(10), 877–879 (2008)CrossRef
Metadata
Title
A Convolutional Neural Network for Spot Detection in Microscopy Images
Authors
Matsilele Mabaso
Daniel Withey
Bhekisipho Twala
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-29196-9_8

Premium Partner