Skip to main content

2018 | OriginalPaper | Buchkapitel

The Mutex Watershed: Efficient, Parameter-Free Image Partitioning

verfasst von : Steffen Wolf, Constantin Pape, Alberto Bailoni, Nasim Rahaman, Anna Kreshuk, Ullrich Köthe, Fred A. Hamprecht

Erschienen in: Computer Vision – ECCV 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Image partitioning, or segmentation without semantics, is the task of decomposing an image into distinct segments; or equivalently, the task of detecting closed contours in an image. Most prior work either requires seeds, one per segment; or a threshold; or formulates the task as an NP-hard signed graph partitioning problem. Here, we propose an algorithm with empirically linearithmic complexity. Unlike seeded watershed, the algorithm can accommodate not only attractive but also repulsive cues, allowing it to find a previously unspecified number of segments without the need for explicit seeds or a tunable threshold. The algorithm itself, which we dub “Mutex Watershed”, is closely related to a minimal spanning tree computation. It is deterministic and easy to implement. When presented with short-range attractive and long-range repulsive cues from a deep neural network, the Mutex Watershed gives results that currently define the state-of-the-art in the competitive ISBI 2012 EM segmentation benchmark. These results are also better than those obtained from other recently proposed clustering strategies operating on the very same network outputs.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Vincent, L., Soille, P.: Watersheds in digital spaces: an efficient algorithm based on immersion simulations. IEEE Trans. Pattern Anal. Mach. Intell. 6, 583–598 (1991)CrossRef Vincent, L., Soille, P.: Watersheds in digital spaces: an efficient algorithm based on immersion simulations. IEEE Trans. Pattern Anal. Mach. Intell. 6, 583–598 (1991)CrossRef
2.
Zurück zum Zitat Beucher, S., Meyer, F.: The morphological approach to segmentation: the watershed transformation. Opt. Eng. 34, 433–433 (1992) Beucher, S., Meyer, F.: The morphological approach to segmentation: the watershed transformation. Opt. Eng. 34, 433–433 (1992)
3.
Zurück zum Zitat Grimaud, M.: New measure of contrast: the dynamics. In: Gader, P.D., Dougherty, E.R., Serra, J.C. (eds.), Proceedings of the Image Algebra and Morphological Processing, vol. 1769. SPIE Conference Series, pp. 292–305 (1992) Grimaud, M.: New measure of contrast: the dynamics. In: Gader, P.D., Dougherty, E.R., Serra, J.C. (eds.), Proceedings of the Image Algebra and Morphological Processing, vol. 1769. SPIE Conference Series, pp. 292–305 (1992)
5.
Zurück zum Zitat Vachier, C., Meyer, F.: Extinction value: a new measurement of persistence. In: Worksh. Nonlinear Signal and Image Processing, vol. 1, pp. 254–257 (1995) Vachier, C., Meyer, F.: Extinction value: a new measurement of persistence. In: Worksh. Nonlinear Signal and Image Processing, vol. 1, pp. 254–257 (1995)
6.
Zurück zum Zitat Najman, L., Schmitt, M.: Geodesic saliency of watershed contours and hierarchical segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 18(12), 1163–1173 (1996)CrossRef Najman, L., Schmitt, M.: Geodesic saliency of watershed contours and hierarchical segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 18(12), 1163–1173 (1996)CrossRef
7.
Zurück zum Zitat Soille, P.: Constrained connectivity for hierarchical image decomposition and simplification. IEEE Trans. Patt. Anal. Mach. Intell. 30(7), 1132–1145 (2008)CrossRef Soille, P.: Constrained connectivity for hierarchical image decomposition and simplification. IEEE Trans. Patt. Anal. Mach. Intell. 30(7), 1132–1145 (2008)CrossRef
8.
Zurück zum Zitat Perret, B., Cousty, J., Guimaraes, S.J., Maia, D.S.: Evaluation of hierarchical watersheds (2017). HAL preprint 01430865 Perret, B., Cousty, J., Guimaraes, S.J., Maia, D.S.: Evaluation of hierarchical watersheds (2017). HAL preprint 01430865
9.
Zurück zum Zitat Meyer, F.: Morphological multiscale and interactive segmentation. In: WS on Nonlinear Signal and Image Processing, pp. 369–377 (1999) Meyer, F.: Morphological multiscale and interactive segmentation. In: WS on Nonlinear Signal and Image Processing, pp. 369–377 (1999)
10.
Zurück zum Zitat Najman, L.: On the equivalence between hierarchical segmentations and ultrametric watersheds. J. Math. Imaging Vis. 40(3), 231–247 (2011)MathSciNetCrossRef Najman, L.: On the equivalence between hierarchical segmentations and ultrametric watersheds. J. Math. Imaging Vis. 40(3), 231–247 (2011)MathSciNetCrossRef
11.
Zurück zum Zitat Salembier, P., Garrido, L.: Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval. IEEE Trans. Image Proc. 9, 561–576 (2000)CrossRef Salembier, P., Garrido, L.: Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval. IEEE Trans. Image Proc. 9, 561–576 (2000)CrossRef
13.
Zurück zum Zitat Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59(2), 167–181 (2004)CrossRef Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59(2), 167–181 (2004)CrossRef
14.
Zurück zum Zitat Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE Trans. Patt. Anal. Mach. Intell. 33(5), 898–916 (2011)CrossRef Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE Trans. Patt. Anal. Mach. Intell. 33(5), 898–916 (2011)CrossRef
15.
Zurück zum Zitat Kiran, B.R., Serra, J.: Global-local optimizations by hierarchical cuts and climbing energies. Pattern Recogn. 47(1), 12–24 (2014)CrossRef Kiran, B.R., Serra, J.: Global-local optimizations by hierarchical cuts and climbing energies. Pattern Recogn. 47(1), 12–24 (2014)CrossRef
16.
Zurück zum Zitat Andres, B., Kappes, J.H., Beier, T., Köthe, U., Hamprecht, F.A.: Probabilistic image segmentation with closedness constraints. In: Proceedings of the ICCV 2011, pp. 2611–26181 (2011) Andres, B., Kappes, J.H., Beier, T., Köthe, U., Hamprecht, F.A.: Probabilistic image segmentation with closedness constraints. In: Proceedings of the ICCV 2011, pp. 2611–26181 (2011)
19.
Zurück zum Zitat Pape, C., Beier, T., Li, P., Jain, V., Bock, D.D., Kreshuk, A.: Solving large multicut problems for connectomics via domain decomposition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–10 (2017) Pape, C., Beier, T., Li, P., Jain, V., Bock, D.D., Kreshuk, A.: Solving large multicut problems for connectomics via domain decomposition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–10 (2017)
21.
Zurück zum Zitat Horňáková, A., Lange, J.H., Andres, B.: Analysis and optimization of graph decompositions by lifted multicuts. In: International Conference on Machine Learning, pp. 1539–1548 (2017) Horňáková, A., Lange, J.H., Andres, B.: Analysis and optimization of graph decompositions by lifted multicuts. In: International Conference on Machine Learning, pp. 1539–1548 (2017)
22.
Zurück zum Zitat Keuper, M., Levinkov, E., Bonneel, N., Lavoué, G., Brox, T., Andres, B.: Efficient decomposition of image and mesh graphs by lifted multicuts. In: Proceedings of the ICCV 2015, pp. 1751–1759 (2015) Keuper, M., Levinkov, E., Bonneel, N., Lavoué, G., Brox, T., Andres, B.: Efficient decomposition of image and mesh graphs by lifted multicuts. In: Proceedings of the ICCV 2015, pp. 1751–1759 (2015)
24.
Zurück zum Zitat Beier, T., Pape, C., Rahaman, N., Prange, T.E.A.: Multicut brings automated neurite segmentation closer to human performance. Nat. Methods 14(2), 101–102 (2017)CrossRef Beier, T., Pape, C., Rahaman, N., Prange, T.E.A.: Multicut brings automated neurite segmentation closer to human performance. Nat. Methods 14(2), 101–102 (2017)CrossRef
25.
Zurück zum Zitat Lee, K., Zung, J., Li, P., Jain, V., Seung, H.S.: Superhuman accuracy on the snemi3d connectomics challenge. arXiv preprint arXiv:1706.00120 (2017) Lee, K., Zung, J., Li, P., Jain, V., Seung, H.S.: Superhuman accuracy on the snemi3d connectomics challenge. arXiv preprint arXiv:​1706.​00120 (2017)
26.
Zurück zum Zitat Jain, V., et al.: Supervised learning of image restoration with convolutional networks. In: Proceedings of the ICCV 2007, pp. 1–8 (2007) Jain, V., et al.: Supervised learning of image restoration with convolutional networks. In: Proceedings of the ICCV 2007, pp. 1–8 (2007)
27.
Zurück zum Zitat Ciresan, D.C., Giusti, A., Gambardella, L.M., Schmidhuber, J.: Deep neural networks segment neuronal membranes in electron microscopy images. In: Proceedings of the NIPS 2012 (2012) Ciresan, D.C., Giusti, A., Gambardella, L.M., Schmidhuber, J.: Deep neural networks segment neuronal membranes in electron microscopy images. In: Proceedings of the NIPS 2012 (2012)
28.
Zurück zum Zitat Arganda-Carreras, I., Turaga, S., Berger, D.: Crowdsourcing the creation of image segmentation algorithms for connectomics. Front. Neuroanat. 9, 142 (2015)CrossRef Arganda-Carreras, I., Turaga, S., Berger, D.: Crowdsourcing the creation of image segmentation algorithms for connectomics. Front. Neuroanat. 9, 142 (2015)CrossRef
30.
Zurück zum Zitat Quan, T.M., Hilderbrand, D.G., Jeong, W.K.: FusionNet: a deep fully residual convolutional neural network for image segmentation in connectomics. arXiv:1612.05360 (2016) Quan, T.M., Hilderbrand, D.G., Jeong, W.K.: FusionNet: a deep fully residual convolutional neural network for image segmentation in connectomics. arXiv:​1612.​05360 (2016)
31.
Zurück zum Zitat Nunez-Iglesias, J., Kennedy, R., Parag, T., Shi, J., Chklovskii, D.: Machine learning of hierarchical clustering to segment 2D and 3D images. PLoS One 8, e71715 (2013)CrossRef Nunez-Iglesias, J., Kennedy, R., Parag, T., Shi, J., Chklovskii, D.: Machine learning of hierarchical clustering to segment 2D and 3D images. PLoS One 8, e71715 (2013)CrossRef
34.
Zurück zum Zitat Meirovitch, Y., et al.: A multi-pass approach to large-scale connectomics. arXiv preprint:1612.02120 (2016) Meirovitch, Y., et al.: A multi-pass approach to large-scale connectomics. arXiv preprint:1612.02120 (2016)
35.
36.
Zurück zum Zitat Zlateski, A., Seung, H.S.: Image segmentation by size-dependent single linkage clustering of a watershed basin graph. arXiv:1505.00249 (2015) Zlateski, A., Seung, H.S.: Image segmentation by size-dependent single linkage clustering of a watershed basin graph. arXiv:​1505.​00249 (2015)
37.
Zurück zum Zitat Parag, T., et al.: Anisotropic EM segmentation by 3D affinity learning and agglomeration. arXiv preprint 1707.08935 (2017) Parag, T., et al.: Anisotropic EM segmentation by 3D affinity learning and agglomeration. arXiv preprint 1707.08935 (2017)
38.
Zurück zum Zitat Turaga, S.C., et al.: Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comput. 22(2), 511–538 (2010)CrossRef Turaga, S.C., et al.: Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comput. 22(2), 511–538 (2010)CrossRef
39.
Zurück zum Zitat Turaga, S.C., Briggman, K.L., Helmstaedter, M., Denk, W., Seung, H.S.: Maximin affinity learning of image segmentation. arXiv:0911.5372 (2009) Turaga, S.C., Briggman, K.L., Helmstaedter, M., Denk, W., Seung, H.S.: Maximin affinity learning of image segmentation. arXiv:​0911.​5372 (2009)
40.
Zurück zum Zitat Wolf, S., Schott, L., Köthe, U., Hamprecht, F.: Learned watershed: End-to-end learning of seeded segmentation. Proceedings of the ICCV 2017 (2017) Wolf, S., Schott, L., Köthe, U., Hamprecht, F.: Learned watershed: End-to-end learning of seeded segmentation. Proceedings of the ICCV 2017 (2017)
42.
Zurück zum Zitat Xie, S., Tu, Z.: Holistically-nested edge detection. In: Proceedings of the ICCV 2015, pp. 1395–1403 (2015) Xie, S., Tu, Z.: Holistically-nested edge detection. In: Proceedings of the ICCV 2015, pp. 1395–1403 (2015)
44.
Zurück zum Zitat Cai, J., Lu, L., Xie, Y., Xing, F., Yang, L.: Pancreas segmentation in MRI using graph-based decision fusion on convolutional neural networks. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 674–682. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66179-7_77CrossRef Cai, J., Lu, L., Xie, Y., Xing, F., Yang, L.: Pancreas segmentation in MRI using graph-based decision fusion on convolutional neural networks. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 674–682. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-66179-7_​77CrossRef
45.
Zurück zum Zitat Meyer, F.: Topographic distance and watershed lines. Signal Process. 38(1), 113–125 (1994)CrossRef Meyer, F.: Topographic distance and watershed lines. Signal Process. 38(1), 113–125 (1994)CrossRef
47.
Zurück zum Zitat Falcão, A.X., Stolfi, J., de Alencar Lotufo, R.: The image foresting transform: theory, algorithms, and applications. IEEE Trans. Patt. Anal. Mach. Intell. 26(1), 19–29 (2004)CrossRef Falcão, A.X., Stolfi, J., de Alencar Lotufo, R.: The image foresting transform: theory, algorithms, and applications. IEEE Trans. Patt. Anal. Mach. Intell. 26(1), 19–29 (2004)CrossRef
48.
Zurück zum Zitat Cormen, T.H.: Introduction to Algorithms. MIT press, Cambridge (2009)MATH Cormen, T.H.: Introduction to Algorithms. MIT press, Cambridge (2009)MATH
49.
Zurück zum Zitat Schlegel, P., Costa, M., Jefferis, G.S.: Learning from connectomics on the fly. Curr. Opin. Insect Sci. (2017) Schlegel, P., Costa, M., Jefferis, G.S.: Learning from connectomics on the fly. Curr. Opin. Insect Sci. (2017)
50.
Zurück zum Zitat Funke, J., et al.: Large scale image segmentation with structured loss based deep learning for connectome reconstruction. IEEE Trans. Pattern Anal. Mach. Intell. (2018) Funke, J., et al.: Large scale image segmentation with structured loss based deep learning for connectome reconstruction. IEEE Trans. Pattern Anal. Mach. Intell. (2018)
51.
Zurück zum Zitat Shen, W., Wang, B., Jiang, Y., Wang, Y., Yuille, A.: Multi-stage multi-recursive-input fully convolutional networks for neuronal boundary detection. arXiv preprint arXiv:1703.08493 (2017) Shen, W., Wang, B., Jiang, Y., Wang, Y., Yuille, A.: Multi-stage multi-recursive-input fully convolutional networks for neuronal boundary detection. arXiv preprint arXiv:​1703.​08493 (2017)
52.
Zurück zum Zitat Weiler, M., Hamprecht, F.A., Storath, M.: Learning steerable filters for rotation equivariant CNNs. arXiv preprint arXiv:1711.07289 (2017) Weiler, M., Hamprecht, F.A., Storath, M.: Learning steerable filters for rotation equivariant CNNs. arXiv preprint arXiv:​1711.​07289 (2017)
53.
Zurück zum Zitat Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of the 8th International Conference on Computer Vision, vol. 2, pp. 416–423, July 2001 Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of the 8th International Conference on Computer Vision, vol. 2, pp. 416–423, July 2001
54.
Zurück zum Zitat Cordts, M., et al.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016) Cordts, M., et al.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)
56.
Zurück zum Zitat Mottaghi, R., et al.: The role of context for object detection and semantic segmentation in the wild. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014) Mottaghi, R., et al.: The role of context for object detection and semantic segmentation in the wild. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014)
Metadaten
Titel
The Mutex Watershed: Efficient, Parameter-Free Image Partitioning
verfasst von
Steffen Wolf
Constantin Pape
Alberto Bailoni
Nasim Rahaman
Anna Kreshuk
Ullrich Köthe
Fred A. Hamprecht
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01225-0_34