Skip to main content

2021 | OriginalPaper | Buchkapitel

Equivariant Deep Learning via Morphological and Linear Scale Space PDEs on the Space of Positions and Orientations

verfasst von : Remco Duits, Bart Smets, Erik Bekkers, Jim Portegies

Erschienen in: Scale Space and Variational Methods in Computer Vision

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present PDE-based Group Convolutional Neural Networks (PDE-G-CNNs) that generalize Group equivariant Convolutional Neural Networks (G-CNNs). In PDE-G-CNNs a network layer is a set of PDE-solvers where geometrically meaningful PDE-coefficients become trainable weights. The underlying PDEs are morphological and linear scale space PDEs on the homogeneous space \(\mathbb {M}_d\) of positions and orientations. They provide an equivariant, geometrical PDE-design and model interpretability of the network.
The network is implemented by morphological convolutions with approximations to kernels solving morphological \(\alpha \)-scale-space PDEs, and to linear convolutions solving linear \(\alpha \)-scale-space PDEs. In the morphological setting, the parameter \(\alpha \) regulates soft max-pooling over balls, whereas in the linear setting the cases \(\alpha = 1/2\) and \(\alpha = 1\) correspond to Poisson and Gaussian scale spaces respectively.
We show that our analytic approximation kernels are accurate and practical. We build on techniques introduced by Weickert and Burgeth who revealed a key isomorphism between linear and morphological scale spaces via the Fourier-Cramér transform. It maps linear \(\alpha \)-stable Lévy processes to Bellman processes. We generalize this to \(\mathbb {M}_{d}\) and exploit this relation between linear and morphological scale-space kernels.
We present blood vessel segmentation experiments that show the benefits of PDE-G-CNNs compared to state-of-the-art G-CNNs: increase of performance along with a huge reduction in network parameters.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Akian, M., Quadrat, J., Viot, M.: Bellman processes. LNCIS 199, 302–311 (1994)MATH Akian, M., Quadrat, J., Viot, M.: Bellman processes. LNCIS 199, 302–311 (1994)MATH
2.
Zurück zum Zitat Bardi, M., Capuzzo-Dolcetta, I.: Discontinuous viscosity solutions and applications. In: Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations. Systems and Control: Foundations and Applications. Birkhäuser, Boston, MA (1997) https://doi.org/10.1007/978-0-8176-4755-1_5 Bardi, M., Capuzzo-Dolcetta, I.: Discontinuous viscosity solutions and applications. In: Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations. Systems and Control: Foundations and Applications. Birkhäuser, Boston, MA (1997) https://​doi.​org/​10.​1007/​978-0-8176-4755-1_​5
3.
Zurück zum Zitat Bekkers, E.J., Lafarge, M.W., Veta, M., Eppenhof, K.A.J., Pluim, J.P.W., Duits, R.: Roto-translation covariant convolutional networks for medical image analysis. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11070, pp. 440–448. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00928-1_50CrossRef Bekkers, E.J., Lafarge, M.W., Veta, M., Eppenhof, K.A.J., Pluim, J.P.W., Duits, R.: Roto-translation covariant convolutional networks for medical image analysis. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11070, pp. 440–448. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-030-00928-1_​50CrossRef
4.
Zurück zum Zitat Ben Arous, G.: Development asymptotique du noyau de la chaleur hypoelliptique sur la diagonale. In: Annales de l’institut Fourier, pp. 73–99 (1989) Ben Arous, G.: Development asymptotique du noyau de la chaleur hypoelliptique sur la diagonale. In: Annales de l’institut Fourier, pp. 73–99 (1989)
5.
Zurück zum Zitat Burgeth, B., Weickert, J.: An explanation for the logarithmic connection between linear and morphological systems. In: Proceedings 4th SSVM pp. 325–339 (2003) Burgeth, B., Weickert, J.: An explanation for the logarithmic connection between linear and morphological systems. In: Proceedings 4th SSVM pp. 325–339 (2003)
6.
Zurück zum Zitat Cohen, T., Welling, M.: Group equivariant convolutional networks. In: Proceedings of the 33rd International Conference on Machine Learning, pp. 2990–2999 (2016) Cohen, T., Welling, M.: Group equivariant convolutional networks. In: Proceedings of the 33rd International Conference on Machine Learning, pp. 2990–2999 (2016)
7.
Zurück zum Zitat Duits, R., Bekkers, E.J., Mashtakov, A.: Fourier transform on \(\mathbb{M}_3\) for exact solutions to linear PDEs. Entropy (SI: 250 year of Fourier) 21(1), 1–38 (2019) Duits, R., Bekkers, E.J., Mashtakov, A.: Fourier transform on \(\mathbb{M}_3\) for exact solutions to linear PDEs. Entropy (SI: 250 year of Fourier) 21(1), 1–38 (2019)
8.
Zurück zum Zitat Duits, R., Franken, E.M.: Left invariant parabolic evolution equations on \({SE}(2)\) and contour enhancement via orientation scores. QAM-AMS 68, 255–331 (2010)MATH Duits, R., Franken, E.M.: Left invariant parabolic evolution equations on \({SE}(2)\) and contour enhancement via orientation scores. QAM-AMS 68, 255–331 (2010)MATH
9.
Zurück zum Zitat Duits, R., Meesters, S., Mirebeau, J.M., Portegies, J.M.: Optimal paths of the reeds-shepp car with applications in image analysis. JMIV 60(6), 816–848 (2018)CrossRef Duits, R., Meesters, S., Mirebeau, J.M., Portegies, J.M.: Optimal paths of the reeds-shepp car with applications in image analysis. JMIV 60(6), 816–848 (2018)CrossRef
10.
Zurück zum Zitat Elad, M.: Deep, Deep Trouble. SIAM-NEWS p. 12 (2017) Elad, M.: Deep, Deep Trouble. SIAM-NEWS p. 12 (2017)
11.
Zurück zum Zitat ter Elst, A.F.M., Robinson, D.W.: Weighted subcoercive operators on Lie groups. J. Funct. Anal. 157, 88–163 (1998)MathSciNetCrossRef ter Elst, A.F.M., Robinson, D.W.: Weighted subcoercive operators on Lie groups. J. Funct. Anal. 157, 88–163 (1998)MathSciNetCrossRef
12.
Zurück zum Zitat Evans, L.C.: Partial differential equations. AMS, Providence, R.I. (2010)MATH Evans, L.C.: Partial differential equations. AMS, Providence, R.I. (2010)MATH
14.
Zurück zum Zitat Garoni, T., Frankel, N.: Lévy flights: exact results and asymptotics beyond all orders. J. Math. Phys. 43(5), 2670–2689 (2002)MathSciNetCrossRef Garoni, T., Frankel, N.: Lévy flights: exact results and asymptotics beyond all orders. J. Math. Phys. 43(5), 2670–2689 (2002)MathSciNetCrossRef
15.
Zurück zum Zitat Grigorian, A.: Heat Kernel and Analysis on Manifolds. Math. Dep, Bielefeld (2009) Grigorian, A.: Heat Kernel and Analysis on Manifolds. Math. Dep, Bielefeld (2009)
16.
Zurück zum Zitat LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nat. Res. 521(7553), 436–444 (2015) LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nat. Res. 521(7553), 436–444 (2015)
17.
Zurück zum Zitat Litjens, G., Bejnodri, B., van Ginneken, B., Sánchez, C.: A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60–88 (2017)CrossRef Litjens, G., Bejnodri, B., van Ginneken, B., Sánchez, C.: A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60–88 (2017)CrossRef
18.
Zurück zum Zitat Pauwels, E., van Gool, L., Fiddelaers, P., Moons, T.: An extended class of scale-invariant and recursive scale space filters. IEEE Trans. Pattern Anal Mach. Intell. 17(7), 691–701 (1995)CrossRef Pauwels, E., van Gool, L., Fiddelaers, P., Moons, T.: An extended class of scale-invariant and recursive scale space filters. IEEE Trans. Pattern Anal Mach. Intell. 17(7), 691–701 (1995)CrossRef
19.
Zurück zum Zitat Schmidt, M., Weickert, J.: Morphological counterparts of linear shift-invariant scale-spaces. J. Math. Imag. Vision 56(2), 352–366 (2016)MathSciNetCrossRef Schmidt, M., Weickert, J.: Morphological counterparts of linear shift-invariant scale-spaces. J. Math. Imag. Vision 56(2), 352–366 (2016)MathSciNetCrossRef
20.
Zurück zum Zitat Siffre, L.: Rigid-motion scattering for image classification. Ph.D. thesis, Ecole Polyechnique, Paris (2014) Siffre, L.: Rigid-motion scattering for image classification. Ph.D. thesis, Ecole Polyechnique, Paris (2014)
21.
Zurück zum Zitat Smets, B., Portegies, J., Bekkers, E., Duits, R.: PDE-based group equivariant convolutional neural networks. arXiv preprint arXiv:2001.09046 (2020) Smets, B., Portegies, J., Bekkers, E., Duits, R.: PDE-based group equivariant convolutional neural networks. arXiv preprint arXiv:​2001.​09046 (2020)
22.
Zurück zum Zitat Staal, J., Abramoff, M., Niemeijer, M., Viergever, M., van Ginneken, B.: Ridge-based vessel segmentation in images of the retina. IEEE TMI 23(4), 501–509 (2004) Staal, J., Abramoff, M., Niemeijer, M., Viergever, M., van Ginneken, B.: Ridge-based vessel segmentation in images of the retina. IEEE TMI 23(4), 501–509 (2004)
23.
Zurück zum Zitat Weiler, M., Geiger, M., Welling, M., Boomsma, W., Cohen, T.: 3D steerable CNNs: learning equivariant features in volumetric data. In: NeurIPS, pp. 1–12 (2018) Weiler, M., Geiger, M., Welling, M., Boomsma, W., Cohen, T.: 3D steerable CNNs: learning equivariant features in volumetric data. In: NeurIPS, pp. 1–12 (2018)
Metadaten
Titel
Equivariant Deep Learning via Morphological and Linear Scale Space PDEs on the Space of Positions and Orientations
verfasst von
Remco Duits
Bart Smets
Erik Bekkers
Jim Portegies
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-75549-2_3