Skip to main content
Erschienen in: International Journal of Computer Vision 1/2015

01.05.2015

Stacked Predictive Sparse Decomposition for Classification of Histology Sections

verfasst von: Hang Chang, Yin Zhou, Alexander Borowsky, Kenneth Barner, Paul Spellman, Bahram Parvin

Erschienen in: International Journal of Computer Vision | Ausgabe 1/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Image-based classification of histology sections, in terms of distinct components (e.g., tumor, stroma, normal), provides a series of indices for histology composition (e.g., the percentage of each distinct components in histology sections), and enables the study of nuclear properties within each component. Furthermore, the study of these indices, constructed from each whole slide image in a large cohort, has the potential to provide predictive models of clinical outcome. For example, correlations can be established between the constructed indices and the patients’ survival information at cohort level, which is a fundamental step towards personalized medicine. However, performance of the existing techniques is hindered as a result of large technical variations (e.g., variations of color/textures in tissue images due to non-standard experimental protocols) and biological heterogeneities (e.g., cell type, cell state) that are always present in a large cohort. We propose a system that automatically learns a series of dictionary elements for representing the underlying spatial distribution using stacked predictive sparse decomposition. The learned representation is then fed into the spatial pyramid matching framework with a linear support vector machine classifier. The system has been evaluated for classification of distinct histological components for two cohorts of tumor types. Throughput has been increased by using of graphical processing unit (GPU), and evaluation indicates a superior performance results, compared with previous research.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Acar, E., Plopper, G., & Yener, B. (2012). Coupled analysis of in vitro and histology samples to quantify structure-function relationships. PLoS One, 7, e32227.CrossRef Acar, E., Plopper, G., & Yener, B. (2012). Coupled analysis of in vitro and histology samples to quantify structure-function relationships. PLoS One, 7, e32227.CrossRef
Zurück zum Zitat Axelrod, D., Miller, N., Lickley, H., Qian, J., Christens-Barry, W., Yuan, Y., et al. (2008). Effect of quantitative nuclear features on recurrence of ductal carcinoma in situ (DCIS) of breast. Cancer Informatics, 4, 99–109. Axelrod, D., Miller, N., Lickley, H., Qian, J., Christens-Barry, W., Yuan, Y., et al. (2008). Effect of quantitative nuclear features on recurrence of ductal carcinoma in situ (DCIS) of breast. Cancer Informatics, 4, 99–109.
Zurück zum Zitat Basavanhally, A., Xu, J., Madabhushu, A., & Ganesan, S. (2009) Computer-aided prognosis of ER+ breast cancer histopathology and correlating survival outcome with oncotype DX assay. ISBI, 851–854. Basavanhally, A., Xu, J., Madabhushu, A., & Ganesan, S. (2009) Computer-aided prognosis of ER+ breast cancer histopathology and correlating survival outcome with oncotype DX assay. ISBI, 851–854.
Zurück zum Zitat Bhagavatula, R., Fickus, M. C., Kelly, W., Guo, C., Ozolek, J. A., Castro, C. A., & Kovacevic, J. (2010). Automatic identification and delineation of germ layer components in H&E stained images of teratomas derived from human and nonhuman primate embryonic stem cells. In Proceedings of the 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Rotterdam, The Netherlands, 14–17 April 2010, pp. 1041–1044. doi:10.1109/ISBI.2010.5490168. Bhagavatula, R., Fickus, M. C., Kelly, W., Guo, C., Ozolek, J. A., Castro, C. A., & Kovacevic, J. (2010). Automatic identification and delineation of germ layer components in H&E stained images of teratomas derived from human and nonhuman primate embryonic stem cells. In Proceedings of the 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Rotterdam, The Netherlands, 14–17 April 2010, pp. 1041–1044. doi:10.​1109/​ISBI.​2010.​5490168.
Zurück zum Zitat Bilgin, C., Ray, S., Baydil, B., Daley, W., Larsen, M., & Yener, B. (2012). Multiscale feature analysis of salivary gland branching morphogenesis. PLoS One, 7, e32906.CrossRef Bilgin, C., Ray, S., Baydil, B., Daley, W., Larsen, M., & Yener, B. (2012). Multiscale feature analysis of salivary gland branching morphogenesis. PLoS One, 7, e32906.CrossRef
Zurück zum Zitat Boiman, O., Shechtman, E., & Irani, M. (2008). In defense of nearest-neighbor based image classification. In Proceedings of the conference on computer vision and pattern recognition, 1–8. Boiman, O., Shechtman, E., & Irani, M. (2008). In defense of nearest-neighbor based image classification. In Proceedings of the conference on computer vision and pattern recognition, 1–8.
Zurück zum Zitat Bosch, A., Zisserman, A., & Muñoz, X. (2008). Scene classification using a hybrid generative/discriminative approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 712–727. Bosch, A., Zisserman, A., & Muñoz, X. (2008). Scene classification using a hybrid generative/discriminative approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 712–727.
Zurück zum Zitat Chang, H., Borowsky, A., Spellman, P., & Parvin, B. (2013a). Classification of tumor histology via morphometric context. In Proceedings of the conference on computer vision and pattern recognition. Chang, H., Borowsky, A., Spellman, P., & Parvin, B. (2013a). Classification of tumor histology via morphometric context. In Proceedings of the conference on computer vision and pattern recognition.
Zurück zum Zitat Chang, H., Nayak, N., Spellman, P., & Parvin, B. (2013b). Characterization of tissue histopathology via predictive sparse decomposition and spatial pyramid matching. Medical Image Computing and Computed-Assisted Intervention-MICCAI. Chang, H., Nayak, N., Spellman, P., & Parvin, B. (2013b). Characterization of tissue histopathology via predictive sparse decomposition and spatial pyramid matching. Medical Image Computing and Computed-Assisted Intervention-MICCAI.
Zurück zum Zitat Chang, H., Han, J., Borowsky, A., Loss, L. A., Gray, J. W., Spellman, P. T., et al. (2013c). Invariant delineation of nuclear architecture in glioblastoma multiforme for clinical and molecular association. IEEE Transactions on Medical Imaging, 32, 670–682. Chang, H., Han, J., Borowsky, A., Loss, L. A., Gray, J. W., Spellman, P. T., et al. (2013c). Invariant delineation of nuclear architecture in glioblastoma multiforme for clinical and molecular association. IEEE Transactions on Medical Imaging, 32, 670–682.
Zurück zum Zitat Ciresan, D. C., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2013). Mitosis detection in breast cancer histology images with deep neural networks. MICCAI, 2, 411–418. Ciresan, D. C., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2013). Mitosis detection in breast cancer histology images with deep neural networks. MICCAI, 2, 411–418.
Zurück zum Zitat Cruz-Roa, A. A., Ovalle, J. E. A., Madabhushi, A., & Osorio, F. A. G. (2013). A deep learning architecture for image representation, visual interpretability and automated basal-cell carcinoma cancer detection. MICCAI, 8150, 403–410. Cruz-Roa, A. A., Ovalle, J. E. A., Madabhushi, A., & Osorio, F. A. G. (2013). A deep learning architecture for image representation, visual interpretability and automated basal-cell carcinoma cancer detection. MICCAI, 8150, 403–410.
Zurück zum Zitat Datar, M., Padfield, D. R., & Cline, H. (2008). Color and texture based segmentation of molecular pathology images using HSOMs. In Proceedings of the 2008 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Paris, 14–17 May 2008, pp. 292–295. doi:10.1109/ISBI.2008.4540990. Datar, M., Padfield, D. R., & Cline, H. (2008). Color and texture based segmentation of molecular pathology images using HSOMs. In Proceedings of the 2008 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Paris, 14–17 May 2008, pp. 292–295. doi:10.​1109/​ISBI.​2008.​4540990.
Zurück zum Zitat Demir, C., & Yener, B. (2009). Automated cancer diagnosis based on histopathological images: A systematic survey. Technical report, Rensselaer Polytechnic Institute, Department of Computer Science. Demir, C., & Yener, B. (2009). Automated cancer diagnosis based on histopathological images: A systematic survey. Technical report, Rensselaer Polytechnic Institute, Department of Computer Science.
Zurück zum Zitat Doyle, S., Feldman, M. D., Tomaszewski, J., Shih, N., & Madabhushi, A. (2011). Cascaded multi-class pairwise classifier (CascaMPa) for normal, cancerous, and cancer confounder classes in prostate histology. In Proceedings of the 8th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Chicago, IL, 30 March–2 April 2011, pp. 715–718. doi:10.1109/ISBI.2011.5872506. Doyle, S., Feldman, M. D., Tomaszewski, J., Shih, N., & Madabhushi, A. (2011). Cascaded multi-class pairwise classifier (CascaMPa) for normal, cancerous, and cancer confounder classes in prostate histology. In Proceedings of the 8th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Chicago, IL, 30 March–2 April 2011, pp. 715–718. doi:10.​1109/​ISBI.​2011.​5872506.
Zurück zum Zitat Elad, M., & Aharon, M. (2006). Image denoising via sparse and redundant representations over learned dictionaries. IEEE Transactions on Image Processing, 15, 3736–3745.CrossRefMathSciNet Elad, M., & Aharon, M. (2006). Image denoising via sparse and redundant representations over learned dictionaries. IEEE Transactions on Image Processing, 15, 3736–3745.CrossRefMathSciNet
Zurück zum Zitat Fatakdawala, H., Xu, J., Basavanhally, A., Bhanot, G., Ganesan, S., Feldman, F., et al. (2010). Expectation-maximization-driven geodesic active contours with overlap resolution (EMaGACOR): Application to lymphocyte segmentation on breast cancer histopathology. IEEE Transactions on Biomedical Engineering, 57, 1676–1690.CrossRef Fatakdawala, H., Xu, J., Basavanhally, A., Bhanot, G., Ganesan, S., Feldman, F., et al. (2010). Expectation-maximization-driven geodesic active contours with overlap resolution (EMaGACOR): Application to lymphocyte segmentation on breast cancer histopathology. IEEE Transactions on Biomedical Engineering, 57, 1676–1690.CrossRef
Zurück zum Zitat Gurcan, M., Boucheron, L., Can, A., Madabhushi, A., Rajpoot, N., & Bulent, Y. (2009). Histopathological image analysis: A review. IEEE Transactions on Biomedical Engineering, 2, 147–171.CrossRef Gurcan, M., Boucheron, L., Can, A., Madabhushi, A., Rajpoot, N., & Bulent, Y. (2009). Histopathological image analysis: A review. IEEE Transactions on Biomedical Engineering, 2, 147–171.CrossRef
Zurück zum Zitat Han, J., Chang, H., Loss, L. A., Zhang, K., Baehner, F. L., Gray, J. W., Spellman, P. T., & Parvin, B. (2011). Comparison of sparse coding and kernel methods for histopathological classification of glioblastoma multiforme. In Proceedings of the 8th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Chicago, IL, 30 March–2 April 2011, pp. 711–714. doi:10.1109/ISBI.2011.5872505. Han, J., Chang, H., Loss, L. A., Zhang, K., Baehner, F. L., Gray, J. W., Spellman, P. T., & Parvin, B. (2011). Comparison of sparse coding and kernel methods for histopathological classification of glioblastoma multiforme. In Proceedings of the 8th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Chicago, IL, 30 March–2 April 2011, pp. 711–714. doi:10.​1109/​ISBI.​2011.​5872505.
Zurück zum Zitat Huang, F. J., & LeCun, Y. (2006). Large-scale learning with SVM and convolutional for generic object categorization. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), New York, 17–22 June 2006, pp. 284–291. doi:10.1109/CVPR.2006.164. Huang, F. J., & LeCun, Y. (2006). Large-scale learning with SVM and convolutional for generic object categorization. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), New York, 17–22 June 2006, pp. 284–291. doi:10.​1109/​CVPR.​2006.​164.
Zurück zum Zitat Huang, C., Veillard, A., Lomeine, N., Racoceanu, D., & Roux, L. (2011). Time efficient sparse analysis of histopathological whole slide images. Computerized Medical Imaging and Graphics, 35, 579–591.CrossRef Huang, C., Veillard, A., Lomeine, N., Racoceanu, D., & Roux, L. (2011). Time efficient sparse analysis of histopathological whole slide images. Computerized Medical Imaging and Graphics, 35, 579–591.CrossRef
Zurück zum Zitat Jarrett, K., Kavukcuoglu, K., Ranzato, M., & LeCun, Y. (2009). What is the best multi-stage architecture for object recognition? In Proceedings international conference on computer vision (ICCV’09), IEEE. Jarrett, K., Kavukcuoglu, K., Ranzato, M., & LeCun, Y. (2009). What is the best multi-stage architecture for object recognition? In Proceedings international conference on computer vision (ICCV’09), IEEE.
Zurück zum Zitat Kavukcuoglu, K., Ranzato, M., & LeCun, Y. (2008). Fast inference in sparse coding algorithms with applications to object recognition. Technical report CBLL-TR-2008-12-01, Computational and Biological Learning Lab, Courant Institute, NYU. Kavukcuoglu, K., Ranzato, M., & LeCun, Y. (2008). Fast inference in sparse coding algorithms with applications to object recognition. Technical report CBLL-TR-2008-12-01, Computational and Biological Learning Lab, Courant Institute, NYU.
Zurück zum Zitat Kong, J., Cooper, L., Sharma, A., Kurk, T., Brat, D., & Saltz, J. (2010). Texture based image recognition in microscopy images of diffuse gliomas with multi-class gentle boosting mechanism. ICASSAP, 457–460. Kong, J., Cooper, L., Sharma, A., Kurk, T., Brat, D., & Saltz, J. (2010). Texture based image recognition in microscopy images of diffuse gliomas with multi-class gentle boosting mechanism. ICASSAP, 457–460.
Zurück zum Zitat Kothari, S., Phan, J., Osunkoya, A., & Wang, M. (2012). Biological interpretation of morphological patterns in histopathological whole slide images. In: ACM conference on bioinformatics, computational biology and biomedicine. Kothari, S., Phan, J., Osunkoya, A., & Wang, M. (2012). Biological interpretation of morphological patterns in histopathological whole slide images. In: ACM conference on bioinformatics, computational biology and biomedicine.
Zurück zum Zitat Lazebnik, S., Schmid, C., & Ponce, J. (2006). Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Proceedings of the conference on computer vision and pattern recognition. 2169–2178. Lazebnik, S., Schmid, C., & Ponce, J. (2006). Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Proceedings of the conference on computer vision and pattern recognition. 2169–2178.
Zurück zum Zitat Le, Q. V., Han, J., Gray, J. W., Spellman, P. T., Borowsky, A., & Parvin, B. (2012). Learning invariant features from tumor signatures. Proceedings of the 9th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Barcelona, 2–5 May 2012, pp. 302–305. doi:10.1109/ISBI.2012.6235544. Le, Q. V., Han, J., Gray, J. W., Spellman, P. T., Borowsky, A., & Parvin, B. (2012). Learning invariant features from tumor signatures. Proceedings of the 9th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Barcelona, 2–5 May 2012, pp. 302–305. doi:10.​1109/​ISBI.​2012.​6235544.
Zurück zum Zitat LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. In Proceedings of the IEEE, 86(11), 2278–2324. LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. In Proceedings of the IEEE, 86(11), 2278–2324.
Zurück zum Zitat Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2010). Online learning for matrix factorization and sparse coding. The Journal of Machine Learning Research, 11, 19–60.MATHMathSciNet Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2010). Online learning for matrix factorization and sparse coding. The Journal of Machine Learning Research, 11, 19–60.MATHMathSciNet
Zurück zum Zitat Moosmann, F., Nowak, E., & Jurie, F. (2008). Randomized clustering forests for image classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(9), 1632–1646. doi:10.1109/TPAMI.2007.70822. Moosmann, F., Nowak, E., & Jurie, F. (2008). Randomized clustering forests for image classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(9), 1632–1646. doi:10.​1109/​TPAMI.​2007.​70822.
Zurück zum Zitat Nayak, N., Chang, H., Borowsky, A., Spellman, P., & Parvin, B. (2013). Classification of tumor histopathology via sparse feature learning. In: Proceedings of ISBI, 410–413. Nayak, N., Chang, H., Borowsky, A., Spellman, P., & Parvin, B. (2013). Classification of tumor histopathology via sparse feature learning. In: Proceedings of ISBI, 410–413.
Zurück zum Zitat Poultney, C., Chopra, S., & Lecun, Y. (2006). Efficient learning of sparse representations with an energy-based model. In Advances in neural information processing systems (NIPS 2006, MIT Press: Cambridge. Poultney, C., Chopra, S., & Lecun, Y. (2006). Efficient learning of sparse representations with an energy-based model. In Advances in neural information processing systems (NIPS 2006, MIT Press: Cambridge.
Zurück zum Zitat Ranzato, M., Boureau, Y. L., & LeCun, Y. (2008). Sparse feature learning for deep belief networks. In J. Platt, D. Koller, Y. Singer, & S. Roweis (Eds.), Advances in Neural Information Processing Systems 20 (pp. 1185–1192). Cambridge, MA: MIT Press. Ranzato, M., Boureau, Y. L., & LeCun, Y. (2008). Sparse feature learning for deep belief networks. In J. Platt, D. Koller, Y. Singer, & S. Roweis (Eds.), Advances in Neural Information Processing Systems 20 (pp. 1185–1192). Cambridge, MA: MIT Press.
Zurück zum Zitat Tropp, J., & Gilbert, A. (2007). Signal recovery from random measurements via orthogonal matching pursuit. IEEE Transactions on Information Theory, 53, 4655–4666.CrossRefMATHMathSciNet Tropp, J., & Gilbert, A. (2007). Signal recovery from random measurements via orthogonal matching pursuit. IEEE Transactions on Information Theory, 53, 4655–4666.CrossRefMATHMathSciNet
Zurück zum Zitat Vedaldi, A., & Zisserman, A. (2012). Efficient additive kernels via explicit feature maps. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34, 480–492.CrossRef Vedaldi, A., & Zisserman, A. (2012). Efficient additive kernels via explicit feature maps. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34, 480–492.CrossRef
Zurück zum Zitat Wu, R., Yu, Y., & Wang, W. (2013). Scale: Supervised and cascaded laplacian eigenmaps for visual object recognition based on nearest neighbors. CVPR, 867–874. Wu, R., Yu, Y., & Wang, W. (2013). Scale: Supervised and cascaded laplacian eigenmaps for visual object recognition based on nearest neighbors. CVPR, 867–874.
Zurück zum Zitat Yang, J., Yu, K., Gong, Y., & Huang, T. (2009). Linear spatial pyramid matching using sparse coding for image classification. In Proceedings of the conference on computer vision and pattern recognition, 1794–1801. Yang, J., Yu, K., Gong, Y., & Huang, T. (2009). Linear spatial pyramid matching using sparse coding for image classification. In Proceedings of the conference on computer vision and pattern recognition, 1794–1801.
Zurück zum Zitat Young, R. A., & Lesperance, R. M. (2001). The gaussian derivative model for spatial-temporal vision. I Cortical Model Spatial Vision, 2001, 3–4. Young, R. A., & Lesperance, R. M. (2001). The gaussian derivative model for spatial-temporal vision. I Cortical Model Spatial Vision, 2001, 3–4.
Zurück zum Zitat Zhou, Y., Chang, H., Barner, K. E., Spellman, P. T., & Parvin, B. (2014). Classification of histology sections via multispectral convolutional sparse coding. 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, 23–28 June 2014, pp. 3081–3088. doi:10.1109/CVPR.2014.394. Zhou, Y., Chang, H., Barner, K. E., Spellman, P. T., & Parvin, B. (2014). Classification of histology sections via multispectral convolutional sparse coding. 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, 23–28 June 2014, pp. 3081–3088. doi:10.​1109/​CVPR.​2014.​394.
Metadaten
Titel
Stacked Predictive Sparse Decomposition for Classification of Histology Sections
verfasst von
Hang Chang
Yin Zhou
Alexander Borowsky
Kenneth Barner
Paul Spellman
Bahram Parvin
Publikationsdatum
01.05.2015
Verlag
Springer US
Erschienen in
International Journal of Computer Vision / Ausgabe 1/2015
Print ISSN: 0920-5691
Elektronische ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-014-0790-9

Weitere Artikel der Ausgabe 1/2015

International Journal of Computer Vision 1/2015 Zur Ausgabe