Skip to main content

2023 | OriginalPaper | Buchkapitel

Diffusion Transport Alignment

verfasst von : Andrés F. Duque, Guy Wolf, Kevin R. Moon

Erschienen in: Advances in Intelligent Data Analysis XXI

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The integration of multimodal data presents a challenge in cases where the study of a given phenomena by different instruments or conditions generates distinct but related domains. Many existing data integration methods assume a known one-to-one correspondence between domains of the entire dataset, which may be unrealistic. Furthermore, existing manifold alignment methods are not suited for cases where the data contains domain-specific regions, i.e., there is not a counterpart for a certain portion of the data in the other domain. We propose Diffusion Transport Alignment (DTA), a semi-supervised manifold alignment method that exploits prior knowledge of between only a few points to align the domains. After building a diffusion process, DTA finds a transportation plan between data measured from two heterogeneous domains with different feature spaces, which by assumption, share a similar geometrical structure coming from the same underlying data generating process. DTA can also compute a partial alignment in a data-driven fashion, resulting in accurate alignments when some data are measured in only one domain. We empirically demonstrate that DTA outperforms other methods in aligning multiview data in this semi-supervised setting. We also show that the alignment obtained by DTA can improve the performance of machine learning tasks, such as domain adaptation, inter-domain feature mapping, and exploratory data analysis, while outperforming competing methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Amodio, M., Krishnaswamy, S.: MAGAN: aligning biological manifolds. In: International Conference on Machine Learning, pp. 215–223. PMLR (2018) Amodio, M., Krishnaswamy, S.: MAGAN: aligning biological manifolds. In: International Conference on Machine Learning, pp. 215–223. PMLR (2018)
2.
Zurück zum Zitat Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 15(6), 1373–1396 (2003)CrossRefMATH Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 15(6), 1373–1396 (2003)CrossRefMATH
3.
Zurück zum Zitat Cao, K., Bai, X., Hong, Y., Wan, L.: Unsupervised topological alignment for single-cell multi-omics integration. Bioinformatics 36, 48–56 (2020)CrossRef Cao, K., Bai, X., Hong, Y., Wan, L.: Unsupervised topological alignment for single-cell multi-omics integration. Bioinformatics 36, 48–56 (2020)CrossRef
4.
Zurück zum Zitat Cao, K., Hong, Y., Wan, L.: Manifold alignment for heterogeneous single-cell multi-omics data integration using Pamona. Bioinformatics 38(1), 211–219 (2022)CrossRef Cao, K., Hong, Y., Wan, L.: Manifold alignment for heterogeneous single-cell multi-omics data integration using Pamona. Bioinformatics 38(1), 211–219 (2022)CrossRef
5.
Zurück zum Zitat Chang, B., Kruger, U., Kustra, R., Zhang, J.: Canonical correlation analysis based on Hilbert-Schmidt independence criterion and centered kernel target alignment. In: International Conference on Machine Learning, pp. 316–324. PMLR (2013) Chang, B., Kruger, U., Kustra, R., Zhang, J.: Canonical correlation analysis based on Hilbert-Schmidt independence criterion and centered kernel target alignment. In: International Conference on Machine Learning, pp. 316–324. PMLR (2013)
6.
Zurück zum Zitat Chapel, L., Alaya, M.Z., Gasso, G.: Partial optimal transport with applications on positive-unlabeled learning. arXiv preprint arXiv:2002.08276 (2020) Chapel, L., Alaya, M.Z., Gasso, G.: Partial optimal transport with applications on positive-unlabeled learning. arXiv preprint arXiv:​2002.​08276 (2020)
7.
Zurück zum Zitat Coates, A., Ng, A., Lee, H.: An analysis of single-layer networks in unsupervised feature learning. In: Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, pp. 215–223. JMLR Workshop and Conference Proceedings (2011) Coates, A., Ng, A., Lee, H.: An analysis of single-layer networks in unsupervised feature learning. In: Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, pp. 215–223. JMLR Workshop and Conference Proceedings (2011)
9.
Zurück zum Zitat Courty, N., Flamary, R., Habrard, A., Rakotomamonjy, A.: Joint distribution optimal transportation for domain adaptation. In: Advances in Neural Information Processing Systems, vol. 30 (2017) Courty, N., Flamary, R., Habrard, A., Rakotomamonjy, A.: Joint distribution optimal transportation for domain adaptation. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
11.
Zurück zum Zitat Cui, Z., Chang, H., Shan, S., Chen, X.: Generalized unsupervised manifold alignment. In: Advances in Neural Information Processing Systems, vol. 27 (2014) Cui, Z., Chang, H., Shan, S., Chen, X.: Generalized unsupervised manifold alignment. In: Advances in Neural Information Processing Systems, vol. 27 (2014)
12.
Zurück zum Zitat Demetci, P., Santorella, R., Sandstede, B., Noble, W.S., Singh, R.: SCOT: single-cell multi-omics alignment with optimal transport. J. Comput. Biol. 29(1), 3–18 (2022)MathSciNetCrossRefMATH Demetci, P., Santorella, R., Sandstede, B., Noble, W.S., Singh, R.: SCOT: single-cell multi-omics alignment with optimal transport. J. Comput. Biol. 29(1), 3–18 (2022)MathSciNetCrossRefMATH
13.
Zurück zum Zitat Gao, G., Ma, H.: Multi-modality movie scene detection using kernel canonical correlation analysis. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 3074–3077. IEEE (2012) Gao, G., Ma, H.: Multi-modality movie scene detection using kernel canonical correlation analysis. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 3074–3077. IEEE (2012)
14.
Zurück zum Zitat Gravina, R., Alinia, P., Ghasemzadeh, H., Fortino, G.: Multi-sensor fusion in body sensor networks: state-of-the-art and research challenges. Inf. Fusion 35, 68–80 (2017)CrossRef Gravina, R., Alinia, P., Ghasemzadeh, H., Fortino, G.: Multi-sensor fusion in body sensor networks: state-of-the-art and research challenges. Inf. Fusion 35, 68–80 (2017)CrossRef
15.
Zurück zum Zitat Ham, J.H., Lee, D.D., Saul, L.K.: Learning high dimensional correspondences from low dimensional manifolds (2003) Ham, J.H., Lee, D.D., Saul, L.K.: Learning high dimensional correspondences from low dimensional manifolds (2003)
16.
Zurück zum Zitat Ham, J., Lee, D., Saul, L.: Semisupervised alignment of manifolds. In: International Workshop on Artificial Intelligence and Statistics, pp. 120–127. PMLR (2005) Ham, J., Lee, D., Saul, L.: Semisupervised alignment of manifolds. In: International Workshop on Artificial Intelligence and Statistics, pp. 120–127. PMLR (2005)
17.
Zurück zum Zitat Hu, J., Hong, D., Zhu, X.X.: MIMA: mapper-induced manifold alignment for semi-supervised fusion of optical image and polarimetric SAR data. IEEE Trans. Geosci. Remote Sens. 57(11), 9025–9040 (2019)CrossRef Hu, J., Hong, D., Zhu, X.X.: MIMA: mapper-induced manifold alignment for semi-supervised fusion of optical image and polarimetric SAR data. IEEE Trans. Geosci. Remote Sens. 57(11), 9025–9040 (2019)CrossRef
18.
Zurück zum Zitat Katz, O., Talmon, R., Lo, Y.L., Wu, H.T.: Alternating diffusion maps for multimodal data fusion. Inf. Fusion 45, 346–360 (2019)CrossRef Katz, O., Talmon, R., Lo, Y.L., Wu, H.T.: Alternating diffusion maps for multimodal data fusion. Inf. Fusion 45, 346–360 (2019)CrossRef
19.
Zurück zum Zitat Kuchroo, M., Godavarthi, A., Tong, A., Wolf, G., Krishnaswamy, S.: Multimodal data visualization and denoising with integrated diffusion. In: 2021 IEEE 31st International Workshop on Machine Learning for Signal Processing (MLSP), pp. 1–6. IEEE (2021) Kuchroo, M., Godavarthi, A., Tong, A., Wolf, G., Krishnaswamy, S.: Multimodal data visualization and denoising with integrated diffusion. In: 2021 IEEE 31st International Workshop on Machine Learning for Signal Processing (MLSP), pp. 1–6. IEEE (2021)
20.
Zurück zum Zitat Lafon, S., Keller, Y., Coifman, R.R.: Data fusion and multicue data matching by diffusion maps. IEEE Trans. Pattern Anal. Mach. Intell. 28(11), 1784–1797 (2006)CrossRef Lafon, S., Keller, Y., Coifman, R.R.: Data fusion and multicue data matching by diffusion maps. IEEE Trans. Pattern Anal. Mach. Intell. 28(11), 1784–1797 (2006)CrossRef
21.
Zurück zum Zitat Lahat, D., Adali, T., Jutten, C.: Multimodal data fusion: an overview of methods, challenges, and prospects. Proc. IEEE 103(9), 1449–1477 (2015)CrossRef Lahat, D., Adali, T., Jutten, C.: Multimodal data fusion: an overview of methods, challenges, and prospects. Proc. IEEE 103(9), 1449–1477 (2015)CrossRef
22.
Zurück zum Zitat Lindenbaum, O., Yeredor, A., Salhov, M., Averbuch, A.: Multi-view diffusion maps. Inf. Fusion 55, 127–149 (2020)CrossRef Lindenbaum, O., Yeredor, A., Salhov, M., Averbuch, A.: Multi-view diffusion maps. Inf. Fusion 55, 127–149 (2020)CrossRef
23.
Zurück zum Zitat Liu, J., Huang, Y., Singh, R., Vert, J.P., Noble, W.S.: Jointly embedding multiple single-cell omics measurements. In: Algorithms in bioinformatics:... International Workshop, WABI..., Proceedings. WABI (Workshop), vol. 143. NIH Public Access (2019) Liu, J., Huang, Y., Singh, R., Vert, J.P., Noble, W.S.: Jointly embedding multiple single-cell omics measurements. In: Algorithms in bioinformatics:... International Workshop, WABI..., Proceedings. WABI (Workshop), vol. 143. NIH Public Access (2019)
24.
Zurück zum Zitat Liu, Z., Wang, W., Jin, Q.: Manifold alignment using discrete surface RICCI flow. CAAI Trans. Intell. Technol. 1(3), 285–292 (2016)CrossRef Liu, Z., Wang, W., Jin, Q.: Manifold alignment using discrete surface RICCI flow. CAAI Trans. Intell. Technol. 1(3), 285–292 (2016)CrossRef
25.
26.
Zurück zum Zitat McInnes, L., Healy, J., Melville, J.: UMAP: uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018) McInnes, L., Healy, J., Melville, J.: UMAP: uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:​1802.​03426 (2018)
27.
Zurück zum Zitat Moon, K.R., et al.: Visualizing structure and transitions in high-dimensional biological data. Nat. Biotechnol. 37(12), 1482–1492 (2019)CrossRef Moon, K.R., et al.: Visualizing structure and transitions in high-dimensional biological data. Nat. Biotechnol. 37(12), 1482–1492 (2019)CrossRef
28.
Zurück zum Zitat Peyré, G., Cuturi, M., et al.: Computational optimal transport: with applications to data science. Found. Trends® Mach. Learn. 11(5–6), 355–607 (2019) Peyré, G., Cuturi, M., et al.: Computational optimal transport: with applications to data science. Found. Trends® Mach. Learn. 11(5–6), 355–607 (2019)
29.
Zurück zum Zitat Stanley, J.S., III., Gigante, S., Wolf, G., Krishnaswamy, S.: Harmonic alignment. In: Proceedings of the 2020 SIAM International Conference on Data Mining, pp. 316–324. SIAM (2020) Stanley, J.S., III., Gigante, S., Wolf, G., Krishnaswamy, S.: Harmonic alignment. In: Proceedings of the 2020 SIAM International Conference on Data Mining, pp. 316–324. SIAM (2020)
30.
Zurück zum Zitat Stuart, T., et al.: Comprehensive integration of single-cell data. Cell 177(7), 1888–1902 (2019)CrossRef Stuart, T., et al.: Comprehensive integration of single-cell data. Cell 177(7), 1888–1902 (2019)CrossRef
31.
Zurück zum Zitat Thompson, B.: Canonical Correlation Analysis: Uses and Interpretation, vol. 47. Sage, Thousand Oaks (1984)CrossRef Thompson, B.: Canonical Correlation Analysis: Uses and Interpretation, vol. 47. Sage, Thousand Oaks (1984)CrossRef
32.
Zurück zum Zitat Tuia, D., Camps-Valls, G.: Kernel manifold alignment for domain adaptation. PLoS ONE 11(2), e0148655 (2016)CrossRef Tuia, D., Camps-Valls, G.: Kernel manifold alignment for domain adaptation. PLoS ONE 11(2), e0148655 (2016)CrossRef
33.
Zurück zum Zitat Vieira, S., Pinaya, W.H.L., Garcia-Dias, R., Mechelli, A.: Multimodal integration. In: Machine Learning, pp. 283–305. Elsevier (2020) Vieira, S., Pinaya, W.H.L., Garcia-Dias, R., Mechelli, A.: Multimodal integration. In: Machine Learning, pp. 283–305. Elsevier (2020)
34.
Zurück zum Zitat Wang, C., Mahadevan, S.: Manifold alignment using procrustes analysis. In: Proceedings of the 25th International Conference on Machine Learning, pp. 1120–1127 (2008) Wang, C., Mahadevan, S.: Manifold alignment using procrustes analysis. In: Proceedings of the 25th International Conference on Machine Learning, pp. 1120–1127 (2008)
35.
Zurück zum Zitat Wang, C., Mahadevan, S.: Manifold alignment without correspondence. In: Twenty-First International Joint Conference on Artificial Intelligence (2009) Wang, C., Mahadevan, S.: Manifold alignment without correspondence. In: Twenty-First International Joint Conference on Artificial Intelligence (2009)
36.
Zurück zum Zitat Wang, C., Mahadevan, S.: Heterogeneous domain adaptation using manifold alignment. In: Twenty-Second International Joint Conference on Artificial Intelligence (2011) Wang, C., Mahadevan, S.: Heterogeneous domain adaptation using manifold alignment. In: Twenty-Second International Joint Conference on Artificial Intelligence (2011)
37.
Zurück zum Zitat Zappia, L., Phipson, B., Oshlack, A.: Splatter: simulation of single-cell RNA sequencing data. Genome Biol. 18(1), 1–15 (2017)CrossRef Zappia, L., Phipson, B., Oshlack, A.: Splatter: simulation of single-cell RNA sequencing data. Genome Biol. 18(1), 1–15 (2017)CrossRef
38.
Zurück zum Zitat Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2223–2232 (2017) Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2223–2232 (2017)
Metadaten
Titel
Diffusion Transport Alignment
verfasst von
Andrés F. Duque
Guy Wolf
Kevin R. Moon
Copyright-Jahr
2023
DOI
https://doi.org/10.1007/978-3-031-30047-9_10

Premium Partner