Skip to main content

2015 | OriginalPaper | Buchkapitel

A Graphical Model for Rapid Obstacle Image-Map Estimation from Unmanned Surface Vehicles

verfasst von : Matej Kristan, Janez Perš, Vildana Sulič, Stanislav Kovačič

Erschienen in: Computer Vision -- ACCV 2014

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Obstacle detection plays an important role in unmanned surface vehicles (USV). Continuous detection from images taken onboard the vessel poses a particular challenge due to the diversity of the environment and the obstacle appearance. An obstacle may be a floating piece of wood, a scuba diver, a pier, or some other part of a shoreline. In this paper we tackle this problem by proposing a new graphical model that affords a fast and continuous obstacle image-map estimation from a single video stream captured onboard a USV. The model accounts for the semantic structure of marine environment as observed from USV by imposing weak structural constraints. A Markov random field framework is adopted and a highly efficient algorithm for simultaneous optimization of model parameters and segmentation mask estimation is derived. Our approach does not require computationally intensive extraction of texture features and runs faster than real-time. We also present a new, challenging, dataset for segmentation and obstacle detection in marine environments, which is the largest annotated dataset of its kind. Results on this dataset show that our model compares favorably in accuracy to the related approaches, requiring a fraction of computational effort.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
For research purposes, we will provide the reference Matlab code of our approach, including the evaluation routines from the authors page.
 
Literatur
1.
Zurück zum Zitat Heidarsson, H., Sukhatme, G.: Obstacle detection from overhead imagery using self-supervised learning for autonomous surface vehicles. In: International Conference on Intelligent Robots and Systems, pp. 3160–3165 (2011) Heidarsson, H., Sukhatme, G.: Obstacle detection from overhead imagery using self-supervised learning for autonomous surface vehicles. In: International Conference on Intelligent Robots and Systems, pp. 3160–3165 (2011)
2.
Zurück zum Zitat Rasmussen, C., Lu, Y., Kocamaz, M.K.: Trail following with omnidirectional vision. In: International Conference on Intelligent Robots and Systems, pp. 829–836 (2010) Rasmussen, C., Lu, Y., Kocamaz, M.K.: Trail following with omnidirectional vision. In: International Conference on Intelligent Robots and Systems, pp. 829–836 (2010)
3.
Zurück zum Zitat Montemerlo, M., Thrun, S., Dahlkamp, H., Stavens, D.: Winning the darpa grand challenge with an ai robot. In: AAAI National Conference on Artificial Intelligence, pp. 17–20 (2006) Montemerlo, M., Thrun, S., Dahlkamp, H., Stavens, D.: Winning the darpa grand challenge with an ai robot. In: AAAI National Conference on Artificial Intelligence, pp. 17–20 (2006)
4.
Zurück zum Zitat Dahlkamp, H., Kaehler, A., Stavens, D., Thrun, S., Bradski, G.: Self-supervised monocular road detection in desert terrain. In: RSS, Philadelphia, USA (2006) Dahlkamp, H., Kaehler, A., Stavens, D., Thrun, S., Bradski, G.: Self-supervised monocular road detection in desert terrain. In: RSS, Philadelphia, USA (2006)
5.
Zurück zum Zitat Ettinger, S.M., Nechyba, M.C., Ifju, P.G., Waszak, M.: Vision-guided flight stability and control for micro air vehicles. Adv. Rob. 17, 617–640 (2003)CrossRef Ettinger, S.M., Nechyba, M.C., Ifju, P.G., Waszak, M.: Vision-guided flight stability and control for micro air vehicles. Adv. Rob. 17, 617–640 (2003)CrossRef
6.
Zurück zum Zitat Lu, Y., Rasmussen, C.: Simplified markov random fields for efficient semantic labeling of 3D point clouds. In: IROS, pp. 2690–2697 (2012) Lu, Y., Rasmussen, C.: Simplified markov random fields for efficient semantic labeling of 3D point clouds. In: IROS, pp. 2690–2697 (2012)
7.
Zurück zum Zitat Scherer, S., Rehder, J., Achar, S., Cover, H., Chambers, A., Nuske, S., Singh, S.: River mapping from a flying robot: state estimation, river detection, and obstacle mapping. Auton. Rob. 33, 189–214 (2012)CrossRef Scherer, S., Rehder, J., Achar, S., Cover, H., Chambers, A., Nuske, S., Singh, S.: River mapping from a flying robot: state estimation, river detection, and obstacle mapping. Auton. Rob. 33, 189–214 (2012)CrossRef
8.
Zurück zum Zitat Onunka, C., Bright, G.: Autonomous marine craft navigation: on the study of radar obstacle detection. In: ICARCV, pp. 567–572 (2010) Onunka, C., Bright, G.: Autonomous marine craft navigation: on the study of radar obstacle detection. In: ICARCV, pp. 567–572 (2010)
9.
Zurück zum Zitat Heidarsson, H., Sukhatme, G.: Obstacle detection and avoidance for an autonomous surface vehicle using a profiling sonar. In: ICRA, pp. 731–736 (2011) Heidarsson, H., Sukhatme, G.: Obstacle detection and avoidance for an autonomous surface vehicle using a profiling sonar. In: ICRA, pp. 731–736 (2011)
10.
Zurück zum Zitat Rankin, A., Matthies, L.: Daytime water detection based on color variation. In: International Conference on Intelligent Robots and Systems, pp. 215–221 (2010) Rankin, A., Matthies, L.: Daytime water detection based on color variation. In: International Conference on Intelligent Robots and Systems, pp. 215–221 (2010)
11.
Zurück zum Zitat Elkins, L., Sellers, D., Reynolds, W.M.: The autonomous maritime navigation (amn) project: field tests, autonomous and cooperative behaviors, data fusion, sensors, and vehicles. J. Field Rob. 27, 790–818 (2010)CrossRef Elkins, L., Sellers, D., Reynolds, W.M.: The autonomous maritime navigation (amn) project: field tests, autonomous and cooperative behaviors, data fusion, sensors, and vehicles. J. Field Rob. 27, 790–818 (2010)CrossRef
12.
Zurück zum Zitat Hong, T.H., Rasmussen, C., Chang, T., Shneier, M.: Fusing ladar and color image information for mobile robot feature detection and tracking. In: IAS, pp. 124–133 (2002) Hong, T.H., Rasmussen, C., Chang, T., Shneier, M.: Fusing ladar and color image information for mobile robot feature detection and tracking. In: IAS, pp. 124–133 (2002)
13.
Zurück zum Zitat Santana, P., Mendica, R., Barata, J.: Water detection with segmentation guided dynamic texture recognition. In: IEEE Robotics and Biomimetics (ROBIO), pp. 1836–1841 (2012) Santana, P., Mendica, R., Barata, J.: Water detection with segmentation guided dynamic texture recognition. In: IEEE Robotics and Biomimetics (ROBIO), pp. 1836–1841 (2012)
14.
Zurück zum Zitat Socek, D., Culibrk, D., Marques, O., Kalva, H., Furht, B.: A hybrid color-based foreground object detection method for automated marine surveillance. In: Blanc-Talon, J., Philips, W., Popescu, D.C., Scheunders, P. (eds.) ACIVS 2005. LNCS, vol. 3708, pp. 340–347. Springer, Heidelberg (2005) CrossRef Socek, D., Culibrk, D., Marques, O., Kalva, H., Furht, B.: A hybrid color-based foreground object detection method for automated marine surveillance. In: Blanc-Talon, J., Philips, W., Popescu, D.C., Scheunders, P. (eds.) ACIVS 2005. LNCS, vol. 3708, pp. 340–347. Springer, Heidelberg (2005) CrossRef
15.
Zurück zum Zitat Fefilatyev, S., Goldgof, D.: Detection and tracking of marine vehicles in video. In: Proceedings of the International Conference on Pattern Recognition, pp. 1–4 (2008) Fefilatyev, S., Goldgof, D.: Detection and tracking of marine vehicles in video. In: Proceedings of the International Conference on Pattern Recognition, pp. 1–4 (2008)
16.
Zurück zum Zitat Wang, H., Wei, Z., Wang, S., Ow, C., Ho, K., Feng, B.: A vision-based obstacle detection system for unmanned surface vehicle. In: International Conference on Robotics, Automation and Mechatronics, pp. 364–369 (2011) Wang, H., Wei, Z., Wang, S., Ow, C., Ho, K., Feng, B.: A vision-based obstacle detection system for unmanned surface vehicle. In: International Conference on Robotics, Automation and Mechatronics, pp. 364–369 (2011)
17.
Zurück zum Zitat Huntsberger, T., Aghazarian, H., Howard, A., Trotz, D.C.: Stereo visionbased navigation for autonomous surface vessels. JFR 28, 3–18 (2011) Huntsberger, T., Aghazarian, H., Howard, A., Trotz, D.C.: Stereo visionbased navigation for autonomous surface vessels. JFR 28, 3–18 (2011)
18.
Zurück zum Zitat Khan, S., Shah, M.: Object based segmentation of video using color, motion and spatial information. In: Computer Vision Pattern Recognition, vol. 2, pp. 746–751 (2001) Khan, S., Shah, M.: Object based segmentation of video using color, motion and spatial information. In: Computer Vision Pattern Recognition, vol. 2, pp. 746–751 (2001)
19.
Zurück zum Zitat Felzenszwalb, P., Huttenlocher, D.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59, 167–181 (2004)CrossRef Felzenszwalb, P., Huttenlocher, D.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59, 167–181 (2004)CrossRef
20.
Zurück zum Zitat Besag, J.: On the statistical analysis of dirty pictures. J. Roy. Stat. Soc. 48, 259–302 (1986)MATHMathSciNet Besag, J.: On the statistical analysis of dirty pictures. J. Roy. Stat. Soc. 48, 259–302 (1986)MATHMathSciNet
21.
Zurück zum Zitat Boykov, Y., Funka-Lea, G.: Graph cuts and efficient ND image segmentation. Int. J. Comput. Vis. 70, 109–131 (2006)CrossRef Boykov, Y., Funka-Lea, G.: Graph cuts and efficient ND image segmentation. Int. J. Comput. Vis. 70, 109–131 (2006)CrossRef
22.
Zurück zum Zitat Wojek, C., Schiele, B.: A dynamic conditional random field model for joint labeling of object and scene classes. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 733–747. Springer, Heidelberg (2008) CrossRef Wojek, C., Schiele, B.: A dynamic conditional random field model for joint labeling of object and scene classes. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 733–747. Springer, Heidelberg (2008) CrossRef
23.
Zurück zum Zitat Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the International Conference on Machine Learning, pp. 282–289 (2001) Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the International Conference on Machine Learning, pp. 282–289 (2001)
24.
Zurück zum Zitat Kontschieder, P., Bulo, S., Bischof, H., Pelillo, M.: Structured class-labels in random forests for semantic image labelling. In: ICCV, pp. 2190–2197 (2011) Kontschieder, P., Bulo, S., Bischof, H., Pelillo, M.: Structured class-labels in random forests for semantic image labelling. In: ICCV, pp. 2190–2197 (2011)
25.
Zurück zum Zitat Alpert., S.Galun, M., Basri, R., Brandt, A.: Image segmentation by probabilistic bottom-up aggregation and cue integration. In: CVPR, pp. 1–8 (2012) Alpert., S.Galun, M., Basri, R., Brandt, A.: Image segmentation by probabilistic bottom-up aggregation and cue integration. In: CVPR, pp. 1–8 (2012)
26.
Zurück zum Zitat Ren, X., Malik, J.: Learning a classification model for segmentation. In: ICCV, pp. 10–17 (2003) Ren, X., Malik, J.: Learning a classification model for segmentation. In: ICCV, pp. 10–17 (2003)
27.
Zurück zum Zitat Li, Z., Wu, X.M., Chang, S.F.: Segmentation using superpixels: a bipartite graph partitioning approach. In: CVPR, pp. 789–796 (2012) Li, Z., Wu, X.M., Chang, S.F.: Segmentation using superpixels: a bipartite graph partitioning approach. In: CVPR, pp. 789–796 (2012)
28.
Zurück zum Zitat Diplaros, A., Vlassis, N., Gevers, T.: A spatially constrained generative model and an EM algorithm for image segmentation. IEEETNN 18, 798–808 (2007) Diplaros, A., Vlassis, N., Gevers, T.: A spatially constrained generative model and an EM algorithm for image segmentation. IEEETNN 18, 798–808 (2007)
29.
Zurück zum Zitat Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The pascal visual object classes (VOC) challenge. IJCV 88, 303–338 (2010)CrossRef Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The pascal visual object classes (VOC) challenge. IJCV 88, 303–338 (2010)CrossRef
30.
Zurück zum Zitat Rother, C., Kolmogorov, V., Blake, A.: GrabCut: interactive foreground extraction using iterated graph cuts. In: SIGGRAPH, vol. 23, pp. 309–314 (2004) Rother, C., Kolmogorov, V., Blake, A.: GrabCut: interactive foreground extraction using iterated graph cuts. In: SIGGRAPH, vol. 23, pp. 309–314 (2004)
31.
Zurück zum Zitat Bagon, S.: Matlab wrapper for graph cut (2006) Bagon, S.: Matlab wrapper for graph cut (2006)
32.
Zurück zum Zitat Felzenszwalb, P.F., Veksler, O.: Tiered scene labeling with dynamic programming. In: CVPR, pp. 3097–3104 (2010) Felzenszwalb, P.F., Veksler, O.: Tiered scene labeling with dynamic programming. In: CVPR, pp. 3097–3104 (2010)
Metadaten
Titel
A Graphical Model for Rapid Obstacle Image-Map Estimation from Unmanned Surface Vehicles
verfasst von
Matej Kristan
Janez Perš
Vildana Sulič
Stanislav Kovačič
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-16808-1_27

Premium Partner