Skip to main content
Erschienen in: International Journal of Computer Vision 3/2013

01.09.2013

A Distributed Mincut/Maxflow Algorithm Combining Path Augmentation and Push-Relabel

verfasst von: Alexander Shekhovtsov, Václav Hlaváč

Erschienen in: International Journal of Computer Vision | Ausgabe 3/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We propose a novel distributed algorithm for the minimum cut problem. Motivated by applications like volumetric segmentation in computer vision, we aim at solving large sparse problems. When the problem does not fully fit in the memory, we need to either process it by parts, looking at one part at a time, or distribute across several computers. Many mincut/maxflow algorithms are designed for the shared memory architecture and do not scale to this setting. We consider algorithms that work on disjoint regions of the problem and exchange messages between the regions. We show that the region push-relabel algorithm of Delong and Boykov (A scalable graph-cut algorithm for N-D grids, in CVPR, 2008) uses Θ(n 2) rounds of message exchange, where n is the number of vertices. Our new algorithm performs path augmentations inside the regions and push-relabel style updates between the regions. It uses asymptotically less message exchanges, \(O(\mathcal{B}^{2})\), where \(\mathcal{B}\) is the set of boundary vertices. The sequential and parallel versions of our algorithm are competitive with the state-of-the-art in the shared memory model. By achieving a lower amount of message exchanges (even asymptotically lower in our synthetic experiments), they suit better for solving large problems using a disk storage or a distributed system.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
A maximum preflow can be completed to a maximum flow using the flow decomposition, in O(mlogm) time. Because we are primarily interested in the minimum cut, we do not consider this step or whether it can be distributed.
 
2
The number of sequential phases required in a general case is equal to the minimal coloring of the region interaction graph, i.e. 2 for bipartite graph and so on.
 
3
An algorithm is said to be Ω(f(n)) if for some numbers c′ and n 0 and all n>=n 0, the algorithm takes at least cf(n) time on some problem instance. Here we measure complexity in sweeps.
 
4
Region-gap-relabel (Delong and Boykov 2008, Fig. 10) seems to contain an error: only vertices above the gap should be processed in step 3.
 
5
The worst-case complexity of breadth-first search shortest path augmentation algorithm is just O(m|C|). The tree adaptation step, introduced by Boykov and Kolmogorov (2004) to speed-up the search, does not have a good bound and introduces an additional n 2 factor.
 
6
There is a discrepancy with Delong and Boykov (2008, Fig. 4) regarding the results for the basic push-relabel. The main implementation difference is in the order of processing (HIPR versus FILO). It is also possible that their plot is illustrative and is not using the gap heuristic.
 
8
Strandmark and Kahl (2010) stated their theorem for even integer costs in the case of two-subproblem separator sets. They remarked that a multiple of 4, resp., 8 is needed in the cases of decompositions for 2D and 3D grids. However, this multiplication is unnecessary if we chose to split the cost unevenly but preserving the integrality (like we did in the example).
 
Literatur
Zurück zum Zitat Anderson, R., & Setubal, J. C. (1995). A parallel implementation of the push-relabel algorithm for the maximum flow problem. Journal of Parallel Distributed Computing, 29(1), 17–26. CrossRef Anderson, R., & Setubal, J. C. (1995). A parallel implementation of the push-relabel algorithm for the maximum flow problem. Journal of Parallel Distributed Computing, 29(1), 17–26. CrossRef
Zurück zum Zitat Boros, E., Hammer, P. L., & Sun, X. (1991). Network flows and minimization of quadratic pseudo-Boolean functions. Tech. rep. RRR 17-1991, RUTCOR. Boros, E., Hammer, P. L., & Sun, X. (1991). Network flows and minimization of quadratic pseudo-Boolean functions. Tech. rep. RRR 17-1991, RUTCOR.
Zurück zum Zitat Boykov, Y., & Funka-Lea, G. (2006). Graph cuts and efficient N-D image segmentation. International Journal of Computer Vision, 70(2), 109–137. CrossRef Boykov, Y., & Funka-Lea, G. (2006). Graph cuts and efficient N-D image segmentation. International Journal of Computer Vision, 70(2), 109–137. CrossRef
Zurück zum Zitat Boykov, Y., & Jolly, M. P. (2001). Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images. In ICCV. Boykov, Y., & Jolly, M. P. (2001). Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images. In ICCV.
Zurück zum Zitat Boykov, Y., & Kolmogorov, V. (2003). Computing geodesics and minimal surfaces via graph cuts. In ICCV. Boykov, Y., & Kolmogorov, V. (2003). Computing geodesics and minimal surfaces via graph cuts. In ICCV.
Zurück zum Zitat Boykov, Y., & Kolmogorov, V. (2004). An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(9), 1124–1137. CrossRef Boykov, Y., & Kolmogorov, V. (2004). An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(9), 1124–1137. CrossRef
Zurück zum Zitat Boykov, Y., & Lempitsky, V. (2006). From photohulls to photoflux optimization. In BMVC. Boykov, Y., & Lempitsky, V. (2006). From photohulls to photoflux optimization. In BMVC.
Zurück zum Zitat Boykov, Y., Veksler, O., & Zabih, R. (1998). Markov random fields with efficient approximations. In CVPR. Boykov, Y., Veksler, O., & Zabih, R. (1998). Markov random fields with efficient approximations. In CVPR.
Zurück zum Zitat Boykov, Y., Veksler, O., & Zabih, R. (1999). Fast approximate energy minimization via graph cuts. In ICCV. Boykov, Y., Veksler, O., & Zabih, R. (1999). Fast approximate energy minimization via graph cuts. In ICCV.
Zurück zum Zitat Cherkassky, B. V., & Goldberg, A. V. (1994). On implementing push-relabel method for the maximum flow problem. Tech. rep. Cherkassky, B. V., & Goldberg, A. V. (1994). On implementing push-relabel method for the maximum flow problem. Tech. rep.
Zurück zum Zitat Delong, A., & Boykov, Y. (2008). A scalable graph-cut algorithm for N-D grids. In CVPR. Delong, A., & Boykov, Y. (2008). A scalable graph-cut algorithm for N-D grids. In CVPR.
Zurück zum Zitat Goldberg, A. (1987). Efficient graph algorithms for sequential and parallel computers. Ph.D. thesis, Massachusetts Institute of Technology. Goldberg, A. (1987). Efficient graph algorithms for sequential and parallel computers. Ph.D. thesis, Massachusetts Institute of Technology.
Zurück zum Zitat Goldberg, A. V. (1991). Processor-efficient implementation of a maximum flow algorithm. Information Processing Letters, 38(4), 179–185. MATHCrossRef Goldberg, A. V. (1991). Processor-efficient implementation of a maximum flow algorithm. Information Processing Letters, 38(4), 179–185. MATHCrossRef
Zurück zum Zitat Goldberg, A. V. (2008). The partial augment–relabel algorithm for the maximum flow problem. In Proceedings of the 16th annual European symposium on algorithms. Goldberg, A. V. (2008). The partial augment–relabel algorithm for the maximum flow problem. In Proceedings of the 16th annual European symposium on algorithms.
Zurück zum Zitat Goldberg, A. V., & Rao, S. (1998). Beyond the flow decomposition barrier. J. ACM. Goldberg, A. V., & Rao, S. (1998). Beyond the flow decomposition barrier. J. ACM.
Zurück zum Zitat Goldberg, A. V., & Tarjan, R. E. (1988). A new approach to the maximum flow problem. Journal of the ACM, 35. Goldberg, A. V., & Tarjan, R. E. (1988). A new approach to the maximum flow problem. Journal of the ACM, 35.
Zurück zum Zitat Ishikawa, H. (2003). Exact optimization for Markov random fields with convex priors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(10), 1333–1336. CrossRef Ishikawa, H. (2003). Exact optimization for Markov random fields with convex priors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(10), 1333–1336. CrossRef
Zurück zum Zitat Jancosek, M., & Pajdla, T. (2011). Robust, accurate and weakly-supported-surfaces preserving multi-vew reconstruction. In CVPR. Jancosek, M., & Pajdla, T. (2011). Robust, accurate and weakly-supported-surfaces preserving multi-vew reconstruction. In CVPR.
Zurück zum Zitat Kohli, P., & Torr, P. (2005). Efficiently solving dynamic Markov random fields using graph cuts. In ICCV05 (Vol. 2, pp. 922–929). Kohli, P., & Torr, P. (2005). Efficiently solving dynamic Markov random fields using graph cuts. In ICCV05 (Vol. 2, pp. 922–929).
Zurück zum Zitat Kohli, P., Shekhovtsov, A., Rother, C., Kolmogorov, V., & Torr, P. (2008). On partial optimality in multi-label MRFs. In ICML. Kohli, P., Shekhovtsov, A., Rother, C., Kolmogorov, V., & Torr, P. (2008). On partial optimality in multi-label MRFs. In ICML.
Zurück zum Zitat Kolmogorov, V. (2004). Graph based algorithms for scene reconstruction from two or more views. Ph.D. thesis, Ithaca, NY, USA, aAI3114475. Kolmogorov, V. (2004). Graph based algorithms for scene reconstruction from two or more views. Ph.D. thesis, Ithaca, NY, USA, aAI3114475.
Zurück zum Zitat Kolmogorov, V., & Rother, C. (2007). Minimizing non-submodular functions with graph cuts—a review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(7), 1274–1279. CrossRef Kolmogorov, V., & Rother, C. (2007). Minimizing non-submodular functions with graph cuts—a review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(7), 1274–1279. CrossRef
Zurück zum Zitat Kolmogorov, V., & Zabih, R. (2001). Computing visual correspondence with occlusions via graph cuts. In ICCV. Kolmogorov, V., & Zabih, R. (2001). Computing visual correspondence with occlusions via graph cuts. In ICCV.
Zurück zum Zitat Kovtun, I. (2004). Image segmentation based on sufficient conditions of optimality in np-complete classes of structural labelling problem. Ph.D. thesis (in Ukrainian). Kovtun, I. (2004). Image segmentation based on sufficient conditions of optimality in np-complete classes of structural labelling problem. Ph.D. thesis (in Ukrainian).
Zurück zum Zitat Labatut, P., Pons, J. P., & Keriven, R. (2009). Robust and efficient surface reconstruction from range data. Computer Graphics Forum, 28(8), 2275–2290. CrossRef Labatut, P., Pons, J. P., & Keriven, R. (2009). Robust and efficient surface reconstruction from range data. Computer Graphics Forum, 28(8), 2275–2290. CrossRef
Zurück zum Zitat Lempitsky, V., & Boykov, Y. (2007). Global optimization for shape fitting. In CVPR. Lempitsky, V., & Boykov, Y. (2007). Global optimization for shape fitting. In CVPR.
Zurück zum Zitat Lempitsky, V., Boykov, Y., Ivanov, D., & Ivanov, D. (2006). Oriented visibility for multiview reconstruction. In ECCV. Lempitsky, V., Boykov, Y., Ivanov, D., & Ivanov, D. (2006). Oriented visibility for multiview reconstruction. In ECCV.
Zurück zum Zitat Lempitsky, V., Rother, C., Roth, S., & Blake, A. (2010). Fusion moves for Markov random field optimization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(8), 1392–1405. CrossRef Lempitsky, V., Rother, C., Roth, S., & Blake, A. (2010). Fusion moves for Markov random field optimization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(8), 1392–1405. CrossRef
Zurück zum Zitat Liu, J., & Sun, J. (2010). Parallel graph-cuts by adaptive bottom-up merging. In CVPR. Liu, J., & Sun, J. (2010). Parallel graph-cuts by adaptive bottom-up merging. In CVPR.
Zurück zum Zitat Schlesinger, D., & Flach, B. (2006). Transforming an arbitrary minsum problem into a binary one. Research report, Dresden University of Technology. Schlesinger, D., & Flach, B. (2006). Transforming an arbitrary minsum problem into a binary one. Research report, Dresden University of Technology.
Zurück zum Zitat Shekhovtsov, A., & Hlavac, V. (2011). A distributed mincut/maxflow algorithm combining path augmentation and push-relabel. In Lecture notes in computer science. Proceedings of the 8th international conference on energy minimization methods in computer vision and pattern recognition (EMMCVPR) (p. 14). Berlin: Springer. Shekhovtsov, A., & Hlavac, V. (2011). A distributed mincut/maxflow algorithm combining path augmentation and push-relabel. In Lecture notes in computer science. Proceedings of the 8th international conference on energy minimization methods in computer vision and pattern recognition (EMMCVPR) (p. 14). Berlin: Springer.
Zurück zum Zitat Strandmark, P., & Kahl, F. (2010). Parallel and distributed graph cuts by dual decomposition. In CVPR. Strandmark, P., & Kahl, F. (2010). Parallel and distributed graph cuts by dual decomposition. In CVPR.
Metadaten
Titel
A Distributed Mincut/Maxflow Algorithm Combining Path Augmentation and Push-Relabel
verfasst von
Alexander Shekhovtsov
Václav Hlaváč
Publikationsdatum
01.09.2013
Verlag
Springer US
Erschienen in
International Journal of Computer Vision / Ausgabe 3/2013
Print ISSN: 0920-5691
Elektronische ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-012-0571-2

Weitere Artikel der Ausgabe 3/2013

International Journal of Computer Vision 3/2013 Zur Ausgabe