Skip to main content

2020 | OriginalPaper | Buchkapitel

Exploring Deep Convolutional Neural Networks as Feature Extractors for Cell Detection

verfasst von : Bruno C. Gregório da Silva, Ricardo J. Ferrari

Erschienen in: Computational Science and Its Applications – ICCSA 2020

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Among different biological studies, the analysis of leukocyte recruitment is fundamental for the comprehension of immunological diseases. The task of detecting and counting cells in these studies is, however, commonly performed by visual analysis. Although many machine learning techniques have been successfully applied to cell detection, they still rely on domain knowledge, demanding high expertise to create handcrafted features capable of describing the object of interest. In this study, we explored the idea of transfer learning by using pre-trained deep convolutional neural networks (DCNN) as feature extractors for leukocytes detection. We tested several DCNN models trained on the ImageNet dataset in six different videos of mice organs from intravital video microscopy. To evaluate our extracted image features, we used the multiple template matching technique in various scenarios. Our results showed an average increase of 5.5% in the \(\text {F}_{1}\)-score values when compared with the traditional application of template matching using only the original image information. Code is available at: https://​github.​com/​brunoggregorio/​DCNN-feature-extraction.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Department of Physiology and Biophysics, Federal University of Minas Gerais, Belo Horizonte, MG, Brazil.
 
2
Special Laboratory of Applied Toxinology (Center of Toxins Immune-Response and Cell Signaling), Butantan Institute, São Paulo, Brazil.
 
Literatur
1.
Zurück zum Zitat Acton, S.T., Wethmar, K., Ley, K.: Automatic tracking of rolling leukocytes in vivo. Microvasc. Res. 63(1), 139–148 (2002)CrossRef Acton, S.T., Wethmar, K., Ley, K.: Automatic tracking of rolling leukocytes in vivo. Microvasc. Res. 63(1), 139–148 (2002)CrossRef
4.
Zurück zum Zitat Cui, J., Acton, S.T., Lin, Z.: A Monte Carlo approach to rolling leukocyte tracking in vivo. Med. Image Anal. 10(4), 598–610 (2006)CrossRef Cui, J., Acton, S.T., Lin, Z.: A Monte Carlo approach to rolling leukocyte tracking in vivo. Med. Image Anal. 10(4), 598–610 (2006)CrossRef
5.
Zurück zum Zitat Dong, G., Ray, N., Acton, S.T.: Intravital leukocyte detection using the gradient inverse coefficient of variation. IEEE Trans. Med. Imaging 24(7), 910–924 (2005)CrossRef Dong, G., Ray, N., Acton, S.T.: Intravital leukocyte detection using the gradient inverse coefficient of variation. IEEE Trans. Med. Imaging 24(7), 910–924 (2005)CrossRef
6.
Zurück zum Zitat Dos Santos, A.C., Barsante, M.M., Arantes, R.M.E., Bernard, C., Teixeira, M.M., Carvalho-Tavares, J.: CCL2 and CCL5 mediate leukocyte adhesion in experimental autoimmune encephalomyelitis an intravital microscopy study. J. Neuroimmunol. 162(1–2), 122–129 (2005)CrossRef Dos Santos, A.C., Barsante, M.M., Arantes, R.M.E., Bernard, C., Teixeira, M.M., Carvalho-Tavares, J.: CCL2 and CCL5 mediate leukocyte adhesion in experimental autoimmune encephalomyelitis an intravital microscopy study. J. Neuroimmunol. 162(1–2), 122–129 (2005)CrossRef
7.
Zurück zum Zitat Dos Santos, A.C., et al.: Kinin B2 receptor regulates chemokines CCL2 and CCL5 expression and modulates leukocyte recruitment and pathology in experimental autoimmune encephalomyelitis (EAE) in mice. J. Neuroinflammation 5, 49–58 (2008)CrossRef Dos Santos, A.C., et al.: Kinin B2 receptor regulates chemokines CCL2 and CCL5 expression and modulates leukocyte recruitment and pathology in experimental autoimmune encephalomyelitis (EAE) in mice. J. Neuroinflammation 5, 49–58 (2008)CrossRef
8.
Zurück zum Zitat Eden, E., Waisman, D., Rudzsky, M., Bitterman, H., Brod, V., Rivlin, E.: An automated method for analysis of flow characteristics of circulating particles from in vivo video microscopy. IEEE Trans. Med. Imaging 12(8), 1011–1024 (2005)CrossRef Eden, E., Waisman, D., Rudzsky, M., Bitterman, H., Brod, V., Rivlin, E.: An automated method for analysis of flow characteristics of circulating particles from in vivo video microscopy. IEEE Trans. Med. Imaging 12(8), 1011–1024 (2005)CrossRef
9.
Zurück zum Zitat Egmont-Petersen, M., Schreiner, U., Tromp, S.C., Lehmann, T.M., Slaaf, D.W., Arts, T.: Detection of leukocytes in contact with the vessel wall from in vivo microscope recordings using a neural network. IEEE Trans. Biomed. Eng. 47(7), 941–951 (2000)CrossRef Egmont-Petersen, M., Schreiner, U., Tromp, S.C., Lehmann, T.M., Slaaf, D.W., Arts, T.: Detection of leukocytes in contact with the vessel wall from in vivo microscope recordings using a neural network. IEEE Trans. Biomed. Eng. 47(7), 941–951 (2000)CrossRef
10.
Zurück zum Zitat Elisa de Souza, K., Gregório da Silva, B.C., Carvalho-Tavares, J., Ferrari, R.J.: Automatic detection of leukocytes from intravital video microscopy using the phase congruency technique. In: Proceedigns of XI Workshop de Visão Computacional (WVC), pp. 387–391. BDBComp, São Carlos (2015) Elisa de Souza, K., Gregório da Silva, B.C., Carvalho-Tavares, J., Ferrari, R.J.: Automatic detection of leukocytes from intravital video microscopy using the phase congruency technique. In: Proceedigns of XI Workshop de Visão Computacional (WVC), pp. 387–391. BDBComp, São Carlos (2015)
11.
Zurück zum Zitat Elisa de Souza, K., Gregório da Silva, B.C., Carvalho-Tavares, J., Ferrari, R.J.: Detection of leukocytes in intravital microscopy video images using the phase congruency technique. Revista de Informática Teórica e Aplicada 23(2), 33–55 (2016) Elisa de Souza, K., Gregório da Silva, B.C., Carvalho-Tavares, J., Ferrari, R.J.: Detection of leukocytes in intravital microscopy video images using the phase congruency technique. Revista de Informática Teórica e Aplicada 23(2), 33–55 (2016)
12.
Zurück zum Zitat Gavins, F.N.E.: Intravital microscopy: new insights into cellular interactions. Curr. Opinion Pharmacol. 12(5), 601–607 (2012)CrossRef Gavins, F.N.E.: Intravital microscopy: new insights into cellular interactions. Curr. Opinion Pharmacol. 12(5), 601–607 (2012)CrossRef
13.
Zurück zum Zitat Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Addison-Wesley, Boston (1992) Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Addison-Wesley, Boston (1992)
14.
Zurück zum Zitat Goobic, A.P., Welser, M.E., Acton, S.T., Ley, K.: Biomedical application of target tracking in clutter. In: Conference on Signals, Systems and Computers, vol. 1, pp. 88–92. IEEE, Pacific Grove (2001) Goobic, A.P., Welser, M.E., Acton, S.T., Ley, K.: Biomedical application of target tracking in clutter. In: Conference on Signals, Systems and Computers, vol. 1, pp. 88–92. IEEE, Pacific Grove (2001)
18.
Zurück zum Zitat Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4700–4708. IEEE (2017) Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4700–4708. IEEE (2017)
19.
Zurück zum Zitat Khosravi, M., Schafer, R.W.: Template matching based on a grayscale hit-or-miss transform. IEEE Trans. Image Process. 5(6), 1060–1066 (1996)CrossRef Khosravi, M., Schafer, R.W.: Template matching based on a grayscale hit-or-miss transform. IEEE Trans. Image Process. 5(6), 1060–1066 (1996)CrossRef
20.
Zurück zum Zitat Lewis, J.P.: Fast template matching. In: Vision Interface, vol. 95. pp. 120–123. Canadian Image Processing and Pattern Recognition Society, Quebec City, Canada (1995) Lewis, J.P.: Fast template matching. In: Vision Interface, vol. 95. pp. 120–123. Canadian Image Processing and Pattern Recognition Society, Quebec City, Canada (1995)
21.
Zurück zum Zitat Mukherjee, D.P., Ray, N., Acton, S.T.: Level set analysis for leukocyte detection and tracking. IEEE Trans. Image Process. 13(4), 562–572 (2004)CrossRef Mukherjee, D.P., Ray, N., Acton, S.T.: Level set analysis for leukocyte detection and tracking. IEEE Trans. Image Process. 13(4), 562–572 (2004)CrossRef
22.
Zurück zum Zitat Ray, N.: A concave cost formulation for parametric curve fitting: detection of leukocytes from intravital microscopy images. In: Proceedings of the International Conference on Image Processing, pp. 53–56. IEEE, Hong Kong (2010) Ray, N.: A concave cost formulation for parametric curve fitting: detection of leukocytes from intravital microscopy images. In: Proceedings of the International Conference on Image Processing, pp. 53–56. IEEE, Hong Kong (2010)
23.
Zurück zum Zitat Ray, N., Acton, S.T.: Motion gradient vector flow: an external force for tracking rolling leukocytes with shape and size constrained active contours. IEEE Trans. Med. Imaging 23(12), 1466–1478 (2004)CrossRef Ray, N., Acton, S.T.: Motion gradient vector flow: an external force for tracking rolling leukocytes with shape and size constrained active contours. IEEE Trans. Med. Imaging 23(12), 1466–1478 (2004)CrossRef
24.
Zurück zum Zitat Ray, N., Acton, S.T., Ley, K.: Tracking leukocytes in vivo with shape and size constrained active contours. IEEE Trans. Med. Imaging 21(10), 1222–1235 (2002)CrossRef Ray, N., Acton, S.T., Ley, K.: Tracking leukocytes in vivo with shape and size constrained active contours. IEEE Trans. Med. Imaging 21(10), 1222–1235 (2002)CrossRef
26.
Zurück zum Zitat Sahoo, S., Ray, N., Acton, S.T.: Rolling leukocyte detection based on teardrop shape and the gradient inverse coefficient of variation. In: International Conference on Medical Information Visualisation, pp. 29–33. IEEE Computer Society, London (2006) Sahoo, S., Ray, N., Acton, S.T.: Rolling leukocyte detection based on teardrop shape and the gradient inverse coefficient of variation. In: International Conference on Medical Information Visualisation, pp. 29–33. IEEE Computer Society, London (2006)
28.
Zurück zum Zitat Gregório da Silva, B.C., Carvalho-Tavares, J., Ferrari, R.J.: Detection of leukocytes in intravital video microscopy based on the analysis of Hessian matrix eigenvalues. In: 28th Conference on Graphics, Patterns and Images, pp. 345–352. IEEE, Salvador (2015). https://doi.org/10.1109/SIBGRAPI.2015.48 Gregório da Silva, B.C., Carvalho-Tavares, J., Ferrari, R.J.: Detection of leukocytes in intravital video microscopy based on the analysis of Hessian matrix eigenvalues. In: 28th Conference on Graphics, Patterns and Images, pp. 345–352. IEEE, Salvador (2015). https://​doi.​org/​10.​1109/​SIBGRAPI.​2015.​48
30.
Zurück zum Zitat Gregório da Silva, B.C., Freire, P.G.L., Mello, R.F., Bernardes, D., Carvalho-Tavares, J., Ferrari, R.J.: Técnica de estabilização de movimento em microscopia intravital utilizando métodos de co-registro de imagens. In: XXIV Congresso Brasileiro de Engenharia Biomédica (CBEB), pp. 193–196. CBEB, Uberlândia, MG, Brazil (2014) Gregório da Silva, B.C., Freire, P.G.L., Mello, R.F., Bernardes, D., Carvalho-Tavares, J., Ferrari, R.J.: Técnica de estabilização de movimento em microscopia intravital utilizando métodos de co-registro de imagens. In: XXIV Congresso Brasileiro de Engenharia Biomédica (CBEB), pp. 193–196. CBEB, Uberlândia, MG, Brazil (2014)
31.
Zurück zum Zitat Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognitions. In: International Conference on Learning Representations (ICLR) (2015) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognitions. In: International Conference on Learning Representations (ICLR) (2015)
32.
Zurück zum Zitat Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.A.: Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-first AAAI Conference on Artificial Intelligence (2017) Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.A.: Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-first AAAI Conference on Artificial Intelligence (2017)
33.
Zurück zum Zitat Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2818–2826. IEEE, Las Vegas (2016). https://doi.org/10.1109/CVPR.2016.308 Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2818–2826. IEEE, Las Vegas (2016). https://​doi.​org/​10.​1109/​CVPR.​2016.​308
34.
Zurück zum Zitat Xu, C., Prince, J.L.: Generalized gradient vector flow external forces for active contours. Sig. Process. 71(2), 131–139 (1998)CrossRef Xu, C., Prince, J.L.: Generalized gradient vector flow external forces for active contours. Sig. Process. 71(2), 131–139 (1998)CrossRef
35.
Zurück zum Zitat Xu, C., Prince, J.L.: Snakes, shapes, and gradient vector flow. IEEE Trans. Image Process. 7(3), 359–369 (1998)MathSciNetCrossRef Xu, C., Prince, J.L.: Snakes, shapes, and gradient vector flow. IEEE Trans. Image Process. 7(3), 359–369 (1998)MathSciNetCrossRef
36.
Zurück zum Zitat Yosinski, J., Clune, J., Bengio, Y., Lipson, H.: How transferable are features in deep neural networks? In: Advances in Neural Information Processing Systems 27, vol. 2, pp. 3320–3328. Curran Associates Inc, Montreal (2014) Yosinski, J., Clune, J., Bengio, Y., Lipson, H.: How transferable are features in deep neural networks? In: Advances in Neural Information Processing Systems 27, vol. 2, pp. 3320–3328. Curran Associates Inc, Montreal (2014)
37.
Zurück zum Zitat Zoph, B., Vasudevan, V., Shlens, J., Le, Q.V.: Learning transferable architectures for scalable image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8697–8710. IEEE (2018) Zoph, B., Vasudevan, V., Shlens, J., Le, Q.V.: Learning transferable architectures for scalable image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8697–8710. IEEE (2018)
Metadaten
Titel
Exploring Deep Convolutional Neural Networks as Feature Extractors for Cell Detection
verfasst von
Bruno C. Gregório da Silva
Ricardo J. Ferrari
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-58802-1_7

Premium Partner