Skip to main content
Top

2015 | OriginalPaper | Chapter

A Graphical Model for Rapid Obstacle Image-Map Estimation from Unmanned Surface Vehicles

Authors : Matej Kristan, Janez Perš, Vildana Sulič, Stanislav Kovačič

Published in: Computer Vision -- ACCV 2014

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Obstacle detection plays an important role in unmanned surface vehicles (USV). Continuous detection from images taken onboard the vessel poses a particular challenge due to the diversity of the environment and the obstacle appearance. An obstacle may be a floating piece of wood, a scuba diver, a pier, or some other part of a shoreline. In this paper we tackle this problem by proposing a new graphical model that affords a fast and continuous obstacle image-map estimation from a single video stream captured onboard a USV. The model accounts for the semantic structure of marine environment as observed from USV by imposing weak structural constraints. A Markov random field framework is adopted and a highly efficient algorithm for simultaneous optimization of model parameters and segmentation mask estimation is derived. Our approach does not require computationally intensive extraction of texture features and runs faster than real-time. We also present a new, challenging, dataset for segmentation and obstacle detection in marine environments, which is the largest annotated dataset of its kind. Results on this dataset show that our model compares favorably in accuracy to the related approaches, requiring a fraction of computational effort.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
For research purposes, we will provide the reference Matlab code of our approach, including the evaluation routines from the authors page.
 
Literature
1.
go back to reference Heidarsson, H., Sukhatme, G.: Obstacle detection from overhead imagery using self-supervised learning for autonomous surface vehicles. In: International Conference on Intelligent Robots and Systems, pp. 3160–3165 (2011) Heidarsson, H., Sukhatme, G.: Obstacle detection from overhead imagery using self-supervised learning for autonomous surface vehicles. In: International Conference on Intelligent Robots and Systems, pp. 3160–3165 (2011)
2.
go back to reference Rasmussen, C., Lu, Y., Kocamaz, M.K.: Trail following with omnidirectional vision. In: International Conference on Intelligent Robots and Systems, pp. 829–836 (2010) Rasmussen, C., Lu, Y., Kocamaz, M.K.: Trail following with omnidirectional vision. In: International Conference on Intelligent Robots and Systems, pp. 829–836 (2010)
3.
go back to reference Montemerlo, M., Thrun, S., Dahlkamp, H., Stavens, D.: Winning the darpa grand challenge with an ai robot. In: AAAI National Conference on Artificial Intelligence, pp. 17–20 (2006) Montemerlo, M., Thrun, S., Dahlkamp, H., Stavens, D.: Winning the darpa grand challenge with an ai robot. In: AAAI National Conference on Artificial Intelligence, pp. 17–20 (2006)
4.
go back to reference Dahlkamp, H., Kaehler, A., Stavens, D., Thrun, S., Bradski, G.: Self-supervised monocular road detection in desert terrain. In: RSS, Philadelphia, USA (2006) Dahlkamp, H., Kaehler, A., Stavens, D., Thrun, S., Bradski, G.: Self-supervised monocular road detection in desert terrain. In: RSS, Philadelphia, USA (2006)
5.
go back to reference Ettinger, S.M., Nechyba, M.C., Ifju, P.G., Waszak, M.: Vision-guided flight stability and control for micro air vehicles. Adv. Rob. 17, 617–640 (2003)CrossRef Ettinger, S.M., Nechyba, M.C., Ifju, P.G., Waszak, M.: Vision-guided flight stability and control for micro air vehicles. Adv. Rob. 17, 617–640 (2003)CrossRef
6.
go back to reference Lu, Y., Rasmussen, C.: Simplified markov random fields for efficient semantic labeling of 3D point clouds. In: IROS, pp. 2690–2697 (2012) Lu, Y., Rasmussen, C.: Simplified markov random fields for efficient semantic labeling of 3D point clouds. In: IROS, pp. 2690–2697 (2012)
7.
go back to reference Scherer, S., Rehder, J., Achar, S., Cover, H., Chambers, A., Nuske, S., Singh, S.: River mapping from a flying robot: state estimation, river detection, and obstacle mapping. Auton. Rob. 33, 189–214 (2012)CrossRef Scherer, S., Rehder, J., Achar, S., Cover, H., Chambers, A., Nuske, S., Singh, S.: River mapping from a flying robot: state estimation, river detection, and obstacle mapping. Auton. Rob. 33, 189–214 (2012)CrossRef
8.
go back to reference Onunka, C., Bright, G.: Autonomous marine craft navigation: on the study of radar obstacle detection. In: ICARCV, pp. 567–572 (2010) Onunka, C., Bright, G.: Autonomous marine craft navigation: on the study of radar obstacle detection. In: ICARCV, pp. 567–572 (2010)
9.
go back to reference Heidarsson, H., Sukhatme, G.: Obstacle detection and avoidance for an autonomous surface vehicle using a profiling sonar. In: ICRA, pp. 731–736 (2011) Heidarsson, H., Sukhatme, G.: Obstacle detection and avoidance for an autonomous surface vehicle using a profiling sonar. In: ICRA, pp. 731–736 (2011)
10.
go back to reference Rankin, A., Matthies, L.: Daytime water detection based on color variation. In: International Conference on Intelligent Robots and Systems, pp. 215–221 (2010) Rankin, A., Matthies, L.: Daytime water detection based on color variation. In: International Conference on Intelligent Robots and Systems, pp. 215–221 (2010)
11.
go back to reference Elkins, L., Sellers, D., Reynolds, W.M.: The autonomous maritime navigation (amn) project: field tests, autonomous and cooperative behaviors, data fusion, sensors, and vehicles. J. Field Rob. 27, 790–818 (2010)CrossRef Elkins, L., Sellers, D., Reynolds, W.M.: The autonomous maritime navigation (amn) project: field tests, autonomous and cooperative behaviors, data fusion, sensors, and vehicles. J. Field Rob. 27, 790–818 (2010)CrossRef
12.
go back to reference Hong, T.H., Rasmussen, C., Chang, T., Shneier, M.: Fusing ladar and color image information for mobile robot feature detection and tracking. In: IAS, pp. 124–133 (2002) Hong, T.H., Rasmussen, C., Chang, T., Shneier, M.: Fusing ladar and color image information for mobile robot feature detection and tracking. In: IAS, pp. 124–133 (2002)
13.
go back to reference Santana, P., Mendica, R., Barata, J.: Water detection with segmentation guided dynamic texture recognition. In: IEEE Robotics and Biomimetics (ROBIO), pp. 1836–1841 (2012) Santana, P., Mendica, R., Barata, J.: Water detection with segmentation guided dynamic texture recognition. In: IEEE Robotics and Biomimetics (ROBIO), pp. 1836–1841 (2012)
14.
go back to reference Socek, D., Culibrk, D., Marques, O., Kalva, H., Furht, B.: A hybrid color-based foreground object detection method for automated marine surveillance. In: Blanc-Talon, J., Philips, W., Popescu, D.C., Scheunders, P. (eds.) ACIVS 2005. LNCS, vol. 3708, pp. 340–347. Springer, Heidelberg (2005) CrossRef Socek, D., Culibrk, D., Marques, O., Kalva, H., Furht, B.: A hybrid color-based foreground object detection method for automated marine surveillance. In: Blanc-Talon, J., Philips, W., Popescu, D.C., Scheunders, P. (eds.) ACIVS 2005. LNCS, vol. 3708, pp. 340–347. Springer, Heidelberg (2005) CrossRef
15.
go back to reference Fefilatyev, S., Goldgof, D.: Detection and tracking of marine vehicles in video. In: Proceedings of the International Conference on Pattern Recognition, pp. 1–4 (2008) Fefilatyev, S., Goldgof, D.: Detection and tracking of marine vehicles in video. In: Proceedings of the International Conference on Pattern Recognition, pp. 1–4 (2008)
16.
go back to reference Wang, H., Wei, Z., Wang, S., Ow, C., Ho, K., Feng, B.: A vision-based obstacle detection system for unmanned surface vehicle. In: International Conference on Robotics, Automation and Mechatronics, pp. 364–369 (2011) Wang, H., Wei, Z., Wang, S., Ow, C., Ho, K., Feng, B.: A vision-based obstacle detection system for unmanned surface vehicle. In: International Conference on Robotics, Automation and Mechatronics, pp. 364–369 (2011)
17.
go back to reference Huntsberger, T., Aghazarian, H., Howard, A., Trotz, D.C.: Stereo visionbased navigation for autonomous surface vessels. JFR 28, 3–18 (2011) Huntsberger, T., Aghazarian, H., Howard, A., Trotz, D.C.: Stereo visionbased navigation for autonomous surface vessels. JFR 28, 3–18 (2011)
18.
go back to reference Khan, S., Shah, M.: Object based segmentation of video using color, motion and spatial information. In: Computer Vision Pattern Recognition, vol. 2, pp. 746–751 (2001) Khan, S., Shah, M.: Object based segmentation of video using color, motion and spatial information. In: Computer Vision Pattern Recognition, vol. 2, pp. 746–751 (2001)
19.
go back to reference Felzenszwalb, P., Huttenlocher, D.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59, 167–181 (2004)CrossRef Felzenszwalb, P., Huttenlocher, D.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59, 167–181 (2004)CrossRef
20.
21.
go back to reference Boykov, Y., Funka-Lea, G.: Graph cuts and efficient ND image segmentation. Int. J. Comput. Vis. 70, 109–131 (2006)CrossRef Boykov, Y., Funka-Lea, G.: Graph cuts and efficient ND image segmentation. Int. J. Comput. Vis. 70, 109–131 (2006)CrossRef
22.
go back to reference Wojek, C., Schiele, B.: A dynamic conditional random field model for joint labeling of object and scene classes. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 733–747. Springer, Heidelberg (2008) CrossRef Wojek, C., Schiele, B.: A dynamic conditional random field model for joint labeling of object and scene classes. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 733–747. Springer, Heidelberg (2008) CrossRef
23.
go back to reference Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the International Conference on Machine Learning, pp. 282–289 (2001) Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the International Conference on Machine Learning, pp. 282–289 (2001)
24.
go back to reference Kontschieder, P., Bulo, S., Bischof, H., Pelillo, M.: Structured class-labels in random forests for semantic image labelling. In: ICCV, pp. 2190–2197 (2011) Kontschieder, P., Bulo, S., Bischof, H., Pelillo, M.: Structured class-labels in random forests for semantic image labelling. In: ICCV, pp. 2190–2197 (2011)
25.
go back to reference Alpert., S.Galun, M., Basri, R., Brandt, A.: Image segmentation by probabilistic bottom-up aggregation and cue integration. In: CVPR, pp. 1–8 (2012) Alpert., S.Galun, M., Basri, R., Brandt, A.: Image segmentation by probabilistic bottom-up aggregation and cue integration. In: CVPR, pp. 1–8 (2012)
26.
go back to reference Ren, X., Malik, J.: Learning a classification model for segmentation. In: ICCV, pp. 10–17 (2003) Ren, X., Malik, J.: Learning a classification model for segmentation. In: ICCV, pp. 10–17 (2003)
27.
go back to reference Li, Z., Wu, X.M., Chang, S.F.: Segmentation using superpixels: a bipartite graph partitioning approach. In: CVPR, pp. 789–796 (2012) Li, Z., Wu, X.M., Chang, S.F.: Segmentation using superpixels: a bipartite graph partitioning approach. In: CVPR, pp. 789–796 (2012)
28.
go back to reference Diplaros, A., Vlassis, N., Gevers, T.: A spatially constrained generative model and an EM algorithm for image segmentation. IEEETNN 18, 798–808 (2007) Diplaros, A., Vlassis, N., Gevers, T.: A spatially constrained generative model and an EM algorithm for image segmentation. IEEETNN 18, 798–808 (2007)
29.
go back to reference Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The pascal visual object classes (VOC) challenge. IJCV 88, 303–338 (2010)CrossRef Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The pascal visual object classes (VOC) challenge. IJCV 88, 303–338 (2010)CrossRef
30.
go back to reference Rother, C., Kolmogorov, V., Blake, A.: GrabCut: interactive foreground extraction using iterated graph cuts. In: SIGGRAPH, vol. 23, pp. 309–314 (2004) Rother, C., Kolmogorov, V., Blake, A.: GrabCut: interactive foreground extraction using iterated graph cuts. In: SIGGRAPH, vol. 23, pp. 309–314 (2004)
31.
go back to reference Bagon, S.: Matlab wrapper for graph cut (2006) Bagon, S.: Matlab wrapper for graph cut (2006)
32.
go back to reference Felzenszwalb, P.F., Veksler, O.: Tiered scene labeling with dynamic programming. In: CVPR, pp. 3097–3104 (2010) Felzenszwalb, P.F., Veksler, O.: Tiered scene labeling with dynamic programming. In: CVPR, pp. 3097–3104 (2010)
Metadata
Title
A Graphical Model for Rapid Obstacle Image-Map Estimation from Unmanned Surface Vehicles
Authors
Matej Kristan
Janez Perš
Vildana Sulič
Stanislav Kovačič
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-16808-1_27

Premium Partner