Skip to main content
Top

2019 | OriginalPaper | Chapter

Patch Clustering for Representation of Histopathology Images

Authors : Wafa Chenni, Habib Herbi, Morteza Babaie, Hamid R. Tizhoosh

Published in: Digital Pathology

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Whole Slide Imaging (WSI) has become an important topic during the last decade. Even though significant progress in both medical image processing and computational resources has been achieved, there are still problems in WSI that need to be solved. A major challenge is the scan size. The dimensions of digitized tissue samples may exceed 100,000 by 100,000 pixels causing memory and efficiency obstacles for real-time processing. The main contribution of this work is representing a WSI by selecting a small number of patches for algorithmic processing (e.g., indexing and search). As a result, we reduced the search time and storage by various factors between (50%–90%), while losing only a few percentages in the patch retrieval accuracy. A self-organizing map (SOM) has been applied on local binary patterns (LBP) and deep features of the KimiaPath24 dataset in order to cluster patches that share the same characteristics. We used a Gaussian mixture model (GMM) to represent each class with a rather small (10%–50%) portion of patches. The results showed that LBP features can outperform deep features. By selecting only 50% of all patches after SOM clustering and GMM patch selection, we received 65% accuracy for retrieval of the best match, while the maximum accuracy (using all patches) was 69%.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
TissueScope LE scanner by Huron Digital Pathology.
 
Literature
1.
go back to reference Adiga, U., Malladi, R., Fernandez-Gonzalez, R., de Solorzano, C.O.: High-throughput analysis of multispectral images of breast cancer tissue. IEEE Trans. Image Process. 15(8), 2259–2268 (2006)CrossRef Adiga, U., Malladi, R., Fernandez-Gonzalez, R., de Solorzano, C.O.: High-throughput analysis of multispectral images of breast cancer tissue. IEEE Trans. Image Process. 15(8), 2259–2268 (2006)CrossRef
2.
go back to reference Aiad, H.A., Abdou, A.G., Bashandy, M.A., Said, A.N., Ezz-Elarab, S.S., Zahran, A.A.: Computerized nuclear morphometry in the diagnosis of thyroid lesions with predominant follicular pattern. Ecancermedicalscience 3, 146 (2009). can-3-146[PII] Aiad, H.A., Abdou, A.G., Bashandy, M.A., Said, A.N., Ezz-Elarab, S.S., Zahran, A.A.: Computerized nuclear morphometry in the diagnosis of thyroid lesions with predominant follicular pattern. Ecancermedicalscience 3, 146 (2009). can-3-146[PII]
3.
go back to reference Ali Sharif Razavian, Hossein Azizpour, J.S.S.C.: CNN features off-the-shelf: an astounding baseline for recognition (2014) Ali Sharif Razavian, Hossein Azizpour, J.S.S.C.: CNN features off-the-shelf: an astounding baseline for recognition (2014)
4.
go back to reference AlZubaidi, A.K., Sideseq, F.B., Faeq, A., Basil, M.: Computer aided diagnosis in digital pathology application: review and perspective approach in lung cancer classification. In: 2017 Annual Conference on New Trends in Information and Communications Technology Applications (NTICT), pp. 219–224. IEEE (2017) AlZubaidi, A.K., Sideseq, F.B., Faeq, A., Basil, M.: Computer aided diagnosis in digital pathology application: review and perspective approach in lung cancer classification. In: 2017 Annual Conference on New Trends in Information and Communications Technology Applications (NTICT), pp. 219–224. IEEE (2017)
5.
go back to reference Babaie, M., et al.: Classification and retrieval of digital pathology scans: a new dataset. In: CVMI Workshop@ CVPR (2017) Babaie, M., et al.: Classification and retrieval of digital pathology scans: a new dataset. In: CVMI Workshop@ CVPR (2017)
6.
go back to reference Babaie, M., Tizhoosh, H.R., Zhu, S., Shiri, M.: Retrieving similar X-ray images from big image data using Radon barcodes with single projections. arXiv preprint arXiv:1701.00449 (2017) Babaie, M., Tizhoosh, H.R., Zhu, S., Shiri, M.: Retrieving similar X-ray images from big image data using Radon barcodes with single projections. arXiv preprint arXiv:​1701.​00449 (2017)
7.
go back to reference Chan, S.H., Zickler, T.E., Lu, Y.M.: Demystifying symmetric smoothing filters. CoRR abs/1601.00088 (2016) Chan, S.H., Zickler, T.E., Lu, Y.M.: Demystifying symmetric smoothing filters. CoRR abs/1601.00088 (2016)
8.
go back to reference Cooper, L.A.D., et al.: Digital pathology: data-intensive frontier in medical imaging. Proc. IEEE 100(4), 991–1003 (2012)CrossRef Cooper, L.A.D., et al.: Digital pathology: data-intensive frontier in medical imaging. Proc. IEEE 100(4), 991–1003 (2012)CrossRef
9.
go back to reference Garcia-Gasulla, D., et al.: On the behavior of convolutional nets for feature extraction. J. Artif. Intell. Res. 61, 563–592 (2017)MathSciNetCrossRef Garcia-Gasulla, D., et al.: On the behavior of convolutional nets for feature extraction. J. Artif. Intell. Res. 61, 563–592 (2017)MathSciNetCrossRef
10.
go back to reference Han, S., Mao, H., Dally, W.J.: Deep compression: compressing deep neural networks with pruning, trained quantization and Huffman coding. arXiv preprint arXiv:1510.00149 (2015) Han, S., Mao, H., Dally, W.J.: Deep compression: compressing deep neural networks with pruning, trained quantization and Huffman coding. arXiv preprint arXiv:​1510.​00149 (2015)
11.
go back to reference Hou, L., Samaras, D., Kurc, T.M., Gao, Y., Davis, J.E., Saltz, J.H.: Patch-based convolutional neural network for whole slide tissue image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2424–2433 (2016) Hou, L., Samaras, D., Kurc, T.M., Gao, Y., Davis, J.E., Saltz, J.H.: Patch-based convolutional neural network for whole slide tissue image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2424–2433 (2016)
12.
go back to reference Khatami, A., Babaie, M., Khosravi, A., Tizhoosh, H.R., Nahavandi, S.: Parallel deep solutions for image retrieval from imbalanced medical imaging archives. Appl. Soft Comput. 63, 197–205 (2018)CrossRef Khatami, A., Babaie, M., Khosravi, A., Tizhoosh, H.R., Nahavandi, S.: Parallel deep solutions for image retrieval from imbalanced medical imaging archives. Appl. Soft Comput. 63, 197–205 (2018)CrossRef
13.
go back to reference LeCun, Y., Haffner, P., Bottou, L., Bengio, Y.: Object recognition with gradient-based learning. In: Forsyth, D.A., Mundy, J.L., di Gesú, V., Cipolla, R. (eds.) Shape, Contour and Grouping in Computer Vision. LNCS, vol. 1681, pp. 319–345. Springer, Heidelberg (1999). https://doi.org/10.1007/3-540-46805-6_19CrossRef LeCun, Y., Haffner, P., Bottou, L., Bengio, Y.: Object recognition with gradient-based learning. In: Forsyth, D.A., Mundy, J.L., di Gesú, V., Cipolla, R. (eds.) Shape, Contour and Grouping in Computer Vision. LNCS, vol. 1681, pp. 319–345. Springer, Heidelberg (1999). https://​doi.​org/​10.​1007/​3-540-46805-6_​19CrossRef
14.
go back to reference Lotz, J., et al.: Patch-based nonlinear image registration for gigapixel whole slide images. IEEE Trans. Biomed. Eng. 63(9), 1812–1819 (2016)CrossRef Lotz, J., et al.: Patch-based nonlinear image registration for gigapixel whole slide images. IEEE Trans. Biomed. Eng. 63(9), 1812–1819 (2016)CrossRef
15.
go back to reference Madabhushi, A., Lee, G.: Image analysis and machine learning in digital pathology: challenges and opportunities. Med. Image Anal. 33, 170–175 (2016)CrossRef Madabhushi, A., Lee, G.: Image analysis and machine learning in digital pathology: challenges and opportunities. Med. Image Anal. 33, 170–175 (2016)CrossRef
17.
go back to reference Moriya, T., et al.: Unsupervised pathology image segmentation using representation learning with spherical k-means. In: Medical Imaging 2018: Digital Pathology, vol. 10581, p. 1058111. International Society for Optics and Photonics (2018) Moriya, T., et al.: Unsupervised pathology image segmentation using representation learning with spherical k-means. In: Medical Imaging 2018: Digital Pathology, vol. 10581, p. 1058111. International Society for Optics and Photonics (2018)
18.
go back to reference Stathonikos, N., Veta, M., Huisman, A., van Diest, P.J.: Going fully digital: perspective of a Dutch academic pathology lab. J. Pathol. Inform. 4, 15 (2013)CrossRef Stathonikos, N., Veta, M., Huisman, A., van Diest, P.J.: Going fully digital: perspective of a Dutch academic pathology lab. J. Pathol. Inform. 4, 15 (2013)CrossRef
19.
go back to reference Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recogn. 29(1), 51–59 (1996)CrossRef Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recogn. 29(1), 51–59 (1996)CrossRef
20.
go back to reference Onega, T., et al.: Digitized whole slides for breast pathology interpretation: current practices and perceptions. J. Dig. Imaging 27, 642–648 (2014)CrossRef Onega, T., et al.: Digitized whole slides for breast pathology interpretation: current practices and perceptions. J. Dig. Imaging 27, 642–648 (2014)CrossRef
21.
go back to reference Pitiot, A., Bardinet, E., Thompson, P., Malandain, G.: Piecewise affine registration of biological images for volume reconstruction. Med. Image Anal. 10, 465–83 (2006)CrossRef Pitiot, A., Bardinet, E., Thompson, P., Malandain, G.: Piecewise affine registration of biological images for volume reconstruction. Med. Image Anal. 10, 465–83 (2006)CrossRef
22.
go back to reference Robboy, S.J., Altshuler, B.S., Chen, H.Y.: Retrieval in a computer-assisted pathology encoding and reporting system (CAPER). Am. J. Clin. Pathol. 75(5), 654–661 (2016)CrossRef Robboy, S.J., Altshuler, B.S., Chen, H.Y.: Retrieval in a computer-assisted pathology encoding and reporting system (CAPER). Am. J. Clin. Pathol. 75(5), 654–661 (2016)CrossRef
23.
go back to reference Roberts, N., et al.: Toward routine use of 3D histopathology as a research tool. Am. J. Pathol. 180(5), 1835–1842 (2012)CrossRef Roberts, N., et al.: Toward routine use of 3D histopathology as a research tool. Am. J. Pathol. 180(5), 1835–1842 (2012)CrossRef
24.
go back to reference Al-Janabi, S., Huisman, A., Jonges, G.N., ten Kate, F.J., Goldschmeding, R., van Diest, P.J.: Whole slide images for primary diagnostics of urinary system pathology: a feasibility study. J. Pathol. Inform. 3(4), 91–96 (2014) Al-Janabi, S., Huisman, A., Jonges, G.N., ten Kate, F.J., Goldschmeding, R., van Diest, P.J.: Whole slide images for primary diagnostics of urinary system pathology: a feasibility study. J. Pathol. Inform. 3(4), 91–96 (2014)
25.
go back to reference Sridhar, A., Doyle, S., Madabhushi, A.: Content-based image retrieval of digitized histopathology in boosted spectrally embedded spaces. J. Pathol. Inform. 6(1), 41 (2015)CrossRef Sridhar, A., Doyle, S., Madabhushi, A.: Content-based image retrieval of digitized histopathology in boosted spectrally embedded spaces. J. Pathol. Inform. 6(1), 41 (2015)CrossRef
26.
go back to reference Srinivas, U., Mousavi, H.S., Monga, V., Hattel, A., Jayarao, B.: Simultaneous sparsity model for histopathological image representation and classification. IEEE Trans. Med. Imaging 33(5), 1163–1179 (2014)CrossRef Srinivas, U., Mousavi, H.S., Monga, V., Hattel, A., Jayarao, B.: Simultaneous sparsity model for histopathological image representation and classification. IEEE Trans. Med. Imaging 33(5), 1163–1179 (2014)CrossRef
27.
go back to reference Tizhoosh, H., Babaie, M.: Representing medical images with encoded local projections. IEEE Trans. Biomed. Eng. 65(10), 2267–2277 (2018)CrossRef Tizhoosh, H., Babaie, M.: Representing medical images with encoded local projections. IEEE Trans. Biomed. Eng. 65(10), 2267–2277 (2018)CrossRef
28.
go back to reference Topi, M., Timo, O., Matti, P., Maricor, S.: Robust texture classification by subsets of local binary patterns. In: 15th International Conference on Pattern Recognition, ICPR, vol. 3, pp. 935–938, September 2000 Topi, M., Timo, O., Matti, P., Maricor, S.: Robust texture classification by subsets of local binary patterns. In: 15th International Conference on Pattern Recognition, ICPR, vol. 3, pp. 935–938, September 2000
29.
go back to reference Yang, L., et al.: A boosting framework for visuality-preserving distance metric learning and its application to medical image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 32, 30–44 (2010)CrossRef Yang, L., et al.: A boosting framework for visuality-preserving distance metric learning and its application to medical image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 32, 30–44 (2010)CrossRef
30.
go back to reference Zhang, X., Liu, W., Dundar, M., Badve, S., Zhang, S.: Towards large-scale histopathological image analysis: hashing-based image retrieval. IEEE Trans. Med. Imaging 34(2), 496–506 (2015)CrossRef Zhang, X., Liu, W., Dundar, M., Badve, S., Zhang, S.: Towards large-scale histopathological image analysis: hashing-based image retrieval. IEEE Trans. Med. Imaging 34(2), 496–506 (2015)CrossRef
Metadata
Title
Patch Clustering for Representation of Histopathology Images
Authors
Wafa Chenni
Habib Herbi
Morteza Babaie
Hamid R. Tizhoosh
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-23937-4_4

Premium Partner