Skip to main content
Top

2024 | OriginalPaper | Chapter

Spatial Gene Expression Prediction Using Multi-Neighborhood Network with Reconstructing Attention

Authors : Panrui Tang, Zuping Zhang, Cui Chen, Yubin Sheng

Published in: Advances in Knowledge Discovery and Data Mining

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Spatial transcriptomics (ST) has made it possible to link local spatial gene expression with the properties of tissue, which is very helpful to the research of histopathology and pathology. To obtain more ST data, we utilize deep learning methods to predict gene expression on tissue slide images. Considering the importance of the dependence of local tissue images on their neighborhoods, we propose the novel Multi-Neighborhood Network (MNN), composed of down-sampling module and vanilla Transformer blocks. Moreover, to satisfy the needs of architecture and address the computational and parameter challenges arising from it, we introduce dual-scale attention block and reconstructing attention block. To demonstrate the effectiveness of this network structure and the superiority of attention mechanisms, we conducted comparative experiments, where MNN achieved optimal PCC@M \((1\times 10^1)\) of 9.23 and 8.54 for the lung cancer and mouse brain datasets of 10x Genomics website, respectively, outperforming several state-of-the-art (SOTA) methods. This reveals the superiority of our method in terms of spatial gene prediction.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chen, M., Zhang, B., Topatana, W., Cao, J., Zhu, H., Juengpanich, S., Mao, Q., Yu, H., Cai, X.: Classification and mutation prediction based on histopathology h &e images in liver cancer using deep learning. NPJ Precis. Oncol. 4(1), 14 (2020)CrossRef Chen, M., Zhang, B., Topatana, W., Cao, J., Zhu, H., Juengpanich, S., Mao, Q., Yu, H., Cai, X.: Classification and mutation prediction based on histopathology h &e images in liver cancer using deep learning. NPJ Precis. Oncol. 4(1), 14 (2020)CrossRef
2.
go back to reference Chen, S., Xie, E., Ge, C., Chen, R., Liang, D., Luo, P.: CycleMLP: a MLP-like architecture for dense prediction. arxiv 2021. arXiv preprint arXiv:2107.10224 Chen, S., Xie, E., Ge, C., Chen, R., Liang, D., Luo, P.: CycleMLP: a MLP-like architecture for dense prediction. arxiv 2021. arXiv preprint arXiv:​2107.​10224
3.
go back to reference Chen, Z., et al.: DPT: deformable patch-based transformer for visual recognition. In: Proceedings of the 29th ACM International Conference on Multimedia, pp. 2899–2907 (2021) Chen, Z., et al.: DPT: deformable patch-based transformer for visual recognition. In: Proceedings of the 29th ACM International Conference on Multimedia, pp. 2899–2907 (2021)
4.
go back to reference Dawood, M., Branson, K., Rajpoot, N.M., Minhas, F.U.A.A.: All you need is color: image based spatial gene expression prediction using neural stain learning. In: Kamp, M., et al. Machine Learning and Principles and Practice of Knowledge Discovery in Databases. ECML PKDD 2021. Communications in Computer and Information Science, vol. 1525, pp. 437–450. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-93733-1_32 Dawood, M., Branson, K., Rajpoot, N.M., Minhas, F.U.A.A.: All you need is color: image based spatial gene expression prediction using neural stain learning. In: Kamp, M., et al. Machine Learning and Principles and Practice of Knowledge Discovery in Databases. ECML PKDD 2021. Communications in Computer and Information Science, vol. 1525, pp. 437–450. Springer, Cham (2021). https://​doi.​org/​10.​1007/​978-3-030-93733-1_​32
5.
go back to reference Dong, X., et al.: CSWIN transformer: a general vision transformer backbone with cross-shaped windows. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 12124–12134 (2022) Dong, X., et al.: CSWIN transformer: a general vision transformer backbone with cross-shaped windows. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 12124–12134 (2022)
6.
go back to reference Gerlinger, M., et al.: Intratumor heterogeneity and branched evolution revealed by multiregion sequencing. N. Engl. J. Med. 366(10), 883–892 (2012)CrossRef Gerlinger, M., et al.: Intratumor heterogeneity and branched evolution revealed by multiregion sequencing. N. Engl. J. Med. 366(10), 883–892 (2012)CrossRef
7.
go back to reference He, B., et al.: Integrating spatial gene expression and breast tumour morphology via deep learning. Nat. Biomed. Eng. 4(8), 827–834 (2020)CrossRef He, B., et al.: Integrating spatial gene expression and breast tumour morphology via deep learning. Nat. Biomed. Eng. 4(8), 827–834 (2020)CrossRef
8.
go back to reference Ho, J., Kalchbrenner, N., Weissenborn, D., Salimans, T.: Axial attention in multidimensional transformers. arXiv preprint arXiv:1912.12180 (2019) Ho, J., Kalchbrenner, N., Weissenborn, D., Salimans, T.: Axial attention in multidimensional transformers. arXiv preprint arXiv:​1912.​12180 (2019)
9.
go back to reference Huang, Z., Wang, X., Huang, L., Huang, C., Wei, Y., Liu, W.: CCNet: CRISS-cross attention for semantic segmentation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 603–612 (2019) Huang, Z., Wang, X., Huang, L., Huang, C., Wei, Y., Liu, W.: CCNet: CRISS-cross attention for semantic segmentation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 603–612 (2019)
10.
go back to reference Jian, S., Kaiming, H., Shaoqing, R., Xiangyu, Z.: Deep residual learning for image recognition. In: IEEE Conference on Computer Vision & Pattern Recognition, pp. 770–778 (2016) Jian, S., Kaiming, H., Shaoqing, R., Xiangyu, Z.: Deep residual learning for image recognition. In: IEEE Conference on Computer Vision & Pattern Recognition, pp. 770–778 (2016)
11.
go back to reference Lee, Y., Kim, J., Willette, J., Hwang, S.J.: Mpvit: Multi-path vision transformer for dense prediction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7287–7296 (2022) Lee, Y., Kim, J., Willette, J., Hwang, S.J.: Mpvit: Multi-path vision transformer for dense prediction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7287–7296 (2022)
12.
go back to reference Li, X., Wang, C.Y.: From bulk, single-cell to spatial RNA sequencing. Int. J. Oral Sci. 13(1), 36 (2021)CrossRef Li, X., Wang, C.Y.: From bulk, single-cell to spatial RNA sequencing. Int. J. Oral Sci. 13(1), 36 (2021)CrossRef
13.
go back to reference Liu, Z., et al.: SWIN transformer: hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10012–10022 (2021) Liu, Z., et al.: SWIN transformer: hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10012–10022 (2021)
14.
go back to reference Lu, W., Graham, S., Bilal, M., Rajpoot, N., Minhas, F.: Capturing cellular topology in multi-gigapixel pathology images. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 260–261 (2020) Lu, W., Graham, S., Bilal, M., Rajpoot, N., Minhas, F.: Capturing cellular topology in multi-gigapixel pathology images. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 260–261 (2020)
15.
go back to reference Ren, S., Zhou, D., He, S., Feng, J., Wang, X.: Shunted self-attention via multi-scale token aggregation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10853–10862 (2022) Ren, S., Zhou, D., He, S., Feng, J., Wang, X.: Shunted self-attention via multi-scale token aggregation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10853–10862 (2022)
16.
go back to reference Rodriques, S.G., et al.: Slide-SEQ: a scalable technology for measuring genome-wide expression at high spatial resolution. Science 363(6434), 1463–1467 (2019)CrossRef Rodriques, S.G., et al.: Slide-SEQ: a scalable technology for measuring genome-wide expression at high spatial resolution. Science 363(6434), 1463–1467 (2019)CrossRef
17.
go back to reference Ståhl, P.L., et al.: Visualization and analysis of gene expression in tissue sections by spatial transcriptomics. Science 353(6294), 78–82 (2016)CrossRef Ståhl, P.L., et al.: Visualization and analysis of gene expression in tissue sections by spatial transcriptomics. Science 353(6294), 78–82 (2016)CrossRef
18.
go back to reference Tay, Y., Dehghani, M., Bahri, D., Metzler, D.: Efficient transformers: a survey (2022) Tay, Y., Dehghani, M., Bahri, D., Metzler, D.: Efficient transformers: a survey (2022)
20.
go back to reference Wang, W., et al.: Pyramid vision transformer: a versatile backbone for dense prediction without convolutions. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 568–578 (2021) Wang, W., et al.: Pyramid vision transformer: a versatile backbone for dense prediction without convolutions. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 568–578 (2021)
21.
go back to reference Xia, Z., Pan, X., Song, S., Li, L.E., Huang, G.: Vision transformer with deformable attention (2022) Xia, Z., Pan, X., Song, S., Li, L.E., Huang, G.: Vision transformer with deformable attention (2022)
22.
go back to reference Xu, Y., Zhang, Q., Zhang, J., Tao, D.: Vitae: vision transformer advanced by exploring intrinsic inductive bias. Adv. Neural. Inf. Process. Syst. 34, 28522–28535 (2021) Xu, Y., Zhang, Q., Zhang, J., Tao, D.: Vitae: vision transformer advanced by exploring intrinsic inductive bias. Adv. Neural. Inf. Process. Syst. 34, 28522–28535 (2021)
23.
go back to reference Yang, Y., Hossain, M.Z., Stone, E.A., Rahman, S.: Exemplar guided deep neural network for spatial transcriptomics analysis of gene expression prediction. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 5039–5048 (2023) Yang, Y., Hossain, M.Z., Stone, E.A., Rahman, S.: Exemplar guided deep neural network for spatial transcriptomics analysis of gene expression prediction. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 5039–5048 (2023)
24.
go back to reference Zeng, W., et al.: Not all tokens are equal: human-centric visual analysis via token clustering transformer (2022) Zeng, W., et al.: Not all tokens are equal: human-centric visual analysis via token clustering transformer (2022)
25.
go back to reference Zhu, L., Wang, X., Ke, Z., Zhang, W., Lau, R.W.: Biformer: vision transformer with bi-level routing attention. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10323–10333 (2023) Zhu, L., Wang, X., Ke, Z., Zhang, W., Lau, R.W.: Biformer: vision transformer with bi-level routing attention. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10323–10333 (2023)
Metadata
Title
Spatial Gene Expression Prediction Using Multi-Neighborhood Network with Reconstructing Attention
Authors
Panrui Tang
Zuping Zhang
Cui Chen
Yubin Sheng
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2238-9_13

Premium Partner