Skip to main content
Top

2014 | OriginalPaper | Chapter

14. Underwater Multimodal Survey: Merging Optical and Acoustic Data

Authors : Pierre Drap, Djamal Merad, Jean-Marc Boï, Amine Mahiddine, Daniela Peloso, Bertrand Chemisky, Emmanuelle Seguin, Frederic Alcala, Olivier Bianchimani

Published in: Underwater Seascapes

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

ROV 3D project aims at developing innovative tools which link underwater photogrammetry and acoustic measurements from an active underwater sensor. The results will be 3D high resolution surveys of underwater sites and landscapes useful to keep in memory cultural and natural heritage. The new means and methods developed aim at reducing the investigation time in situ, and proposing comprehensive and non-intrusive measurement tools for the studied environment.
In this paper, we are presenting a new method of 3D surveys which are dedicated to high resolution modeling of underwater sites. The main met constraints in situ are taken into account and this method leads to a precise 3D reconstruction. Some examples will present both the main obtained results and their limitations. We will end with the perspectives and the necessary improvements to the method, so as to automate the multimodal registration step.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Agarwal S, Furukawa Y, Snavely N, Curless B, Seitz SM, Szeliski R (2010) Reconstructing Rome. Computer 43:40–47 (isbn/issn:0018–9162)CrossRef Agarwal S, Furukawa Y, Snavely N, Curless B, Seitz SM, Szeliski R (2010) Reconstructing Rome. Computer 43:40–47 (isbn/issn:0018–9162)CrossRef
go back to reference Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041CrossRef Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041CrossRef
go back to reference Baluja S, Rowley HA (2005) Boosting sex identification performance. AAAI 1508–1513 Baluja S, Rowley HA (2005) Boosting sex identification performance. AAAI 1508–1513
go back to reference Barazzetti L, Scaioni M, Remondino F (2010) Orientation and 3D modelling from markerless terrestrial images: combining accuracy with automation. Photogramm Rec 25:356–381 (Blackwell Publishing Ltd(Pub.), isbn/issn:1477–9730).CrossRef Barazzetti L, Scaioni M, Remondino F (2010) Orientation and 3D modelling from markerless terrestrial images: combining accuracy with automation. Photogramm Rec 25:356–381 (Blackwell Publishing Ltd(Pub.), isbn/issn:1477–9730).CrossRef
go back to reference Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded-up robust features (SURF). Comput Vis Image Underst 110:346–359 (isbn/issn:1077–3142)CrossRef Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded-up robust features (SURF). Comput Vis Image Underst 110:346–359 (isbn/issn:1077–3142)CrossRef
go back to reference Bazeille S, Quidu I, Jaulin L, Malkasse J-P (2006, 16–19 Oct) Automatic underwater image pre-processing. Paper presented at the CMM’06—CARACTERISATION DU MILIEU MARIN Bazeille S, Quidu I, Jaulin L, Malkasse J-P (2006, 16–19 Oct) Automatic underwater image pre-processing. Paper presented at the CMM’06—CARACTERISATION DU MILIEU MARIN
go back to reference Besl PJ, Mckay ND (1992) A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell 14:239–256 (IEEE Computer Society(Pub.), isbn/issn:0162–8828)CrossRef Besl PJ, Mckay ND (1992) A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell 14:239–256 (IEEE Computer Society(Pub.), isbn/issn:0162–8828)CrossRef
go back to reference Chambah M, Semani D, Renouf A, Courtellemont, P, Rizzi A (2004) Underwater color constancy: enhancement of automatic live fish recognition. Paper presented at the 16th Annual symposium on electronic imaging, United States Chambah M, Semani D, Renouf A, Courtellemont, P, Rizzi A (2004) Underwater color constancy: enhancement of automatic live fish recognition. Paper presented at the 16th Annual symposium on electronic imaging, United States
go back to reference Chen Y, Medioni G (1991) Object modeling by Reg strat ion of multiple range images. Int Conf Robotic Autom 2724–2729 Chen Y, Medioni G (1991) Object modeling by Reg strat ion of multiple range images. Int Conf Robotic Autom 2724–2729
go back to reference Drap P, Long L (2005, 16 and 17 juin) Relevés optiques et systèmes d’information pour l’archéologie sous-marine. Paper presented at the Des images au 3D: Extraction automatique et assistée de modèles 3D, ENSTA, Paris Drap P, Long L (2005, 16 and 17 juin) Relevés optiques et systèmes d’information pour l’archéologie sous-marine. Paper presented at the Des images au 3D: Extraction automatique et assistée de modèles 3D, ENSTA, Paris
go back to reference Fan F, Kecheng Y, Bo F, Min X, Wei Z (2010) Application of blind deconvolution approach with image quality metric in underwater image restoration. Paper presented at the image analysis and signal processing (IASP), 2010 international conference on 9–11 Apr 2010, pp 236–239 Fan F, Kecheng Y, Bo F, Min X, Wei Z (2010) Application of blind deconvolution approach with image quality metric in underwater image restoration. Paper presented at the image analysis and signal processing (IASP), 2010 international conference on 9–11 Apr 2010, pp 236–239
go back to reference Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55:119–139 (isbn/issn:0022–0000)CrossRef Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55:119–139 (isbn/issn:0022–0000)CrossRef
go back to reference Furukawa Y, Ponce J (2010) Accurate, dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell 32:1362–1376 (isbn/issn:0162–8828)CrossRef Furukawa Y, Ponce J (2010) Accurate, dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell 32:1362–1376 (isbn/issn:0162–8828)CrossRef
go back to reference Fusiello A, Murino V (2004) Augmented scene modeling and visualization by optical and acoustic sensor integration. IEEE Trans Vis Comput Graph 10:625–636 (isbn/issn:1077–2626)CrossRef Fusiello A, Murino V (2004) Augmented scene modeling and visualization by optical and acoustic sensor integration. IEEE Trans Vis Comput Graph 10:625–636 (isbn/issn:1077–2626)CrossRef
go back to reference Hurtós N, Cufí X, Salvi J (2010) Calibration of optical camera coupled to acoustic multibeam for underwater 3D scene reconstruction, Sydney, NSW (isbn/issn:9781424452217 (ISBN)) Hurtós N, Cufí X, Salvi J (2010) Calibration of optical camera coupled to acoustic multibeam for underwater 3D scene reconstruction, Sydney, NSW (isbn/issn:9781424452217 (ISBN))
go back to reference Iqbal K, Abdul Salam R, Osman A, Talib AZ (2007) Underwater image enhancement using an integrated colour model. IAENG Int J Comput Sci 34:239–244 Iqbal K, Abdul Salam R, Osman A, Talib AZ (2007) Underwater image enhancement using an integrated colour model. IAENG Int J Comput Sci 34:239–244
go back to reference Johnson AE (1997) Spin-images: a representation for 3-D surface matching. PhD thesis, Carnegie Mellon University, Pittsburgh, Pennsylvania Johnson AE (1997) Spin-images: a representation for 3-D surface matching. PhD thesis, Carnegie Mellon University, Pittsburgh, Pennsylvania
go back to reference Kalia R, Keun-Dong L, Samir BVR, Je S-K, Oh W-G (2011, 9–11 Fev). An analysis of the effect of different image preprocessing techniques on the performance of SURF: speeded up robust feature. Paper presented at the 17th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV). pp 1–6 Kalia R, Keun-Dong L, Samir BVR, Je S-K, Oh W-G (2011, 9–11 Fev). An analysis of the effect of different image preprocessing techniques on the performance of SURF: speeded up robust feature. Paper presented at the 17th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV). pp 1–6
go back to reference Lourakis M, Argyros A (2009) SBA: a software package for generic sparse bundle adjustment. ACM Trans Math Softw 36:1–30CrossRef Lourakis M, Argyros A (2009) SBA: a software package for generic sparse bundle adjustment. ACM Trans Math Softw 36:1–30CrossRef
go back to reference Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110CrossRef Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110CrossRef
go back to reference Merad D, Didier JY, Scuturici M (2006) Tracking 3D free form object in video sequence. Third Canadian conference on computer and robot vision Merad D, Didier JY, Scuturici M (2006) Tracking 3D free form object in video sequence. Third Canadian conference on computer and robot vision
go back to reference Mian AS, Bennamoun M, Owens R (2006) Three-dimensional model-based object recognition and segmentation in cluttered scenes. IEEE Trans Pattern Anal Mach Intell 28:1584–1601 (isbn/issn:0162–8828)CrossRef Mian AS, Bennamoun M, Owens R (2006) Three-dimensional model-based object recognition and segmentation in cluttered scenes. IEEE Trans Pattern Anal Mach Intell 28:1584–1601 (isbn/issn:0162–8828)CrossRef
go back to reference Morris D, Kanade T (2000) Image-consistent surface triangulation. IEEE Trans Vis Comput Graph 1:332–338 Morris D, Kanade T (2000) Image-consistent surface triangulation. IEEE Trans Vis Comput Graph 1:332–338
go back to reference Nicosevici T, Gracias N, Negahdaripour S, Garcia R (2009) Efficient three-dimensional scene modeling and mosaicing. J Field Robot 26:759–788 (Wiley Ltd.(Pub.), isbn/issn:1556–4959)CrossRef Nicosevici T, Gracias N, Negahdaripour S, Garcia R (2009) Efficient three-dimensional scene modeling and mosaicing. J Field Robot 26:759–788 (Wiley Ltd.(Pub.), isbn/issn:1556–4959)CrossRef
go back to reference Petit F (2010) Traitement et analyse d’images couleur sous-marines: modèles physiques et représentation quaternionique. Doctorat, Sciences et Ingénierie pour l’Information, Poitier Petit F (2010) Traitement et analyse d’images couleur sous-marines: modèles physiques et représentation quaternionique. Doctorat, Sciences et Ingénierie pour l’Information, Poitier
go back to reference Pierrot-Deseilligny M, Cléry I (2011, 2–4 Mar) APERO, an open source bundle adjusment software for automatic calibration and orientation of a set of images. Paper presented at the 3D Arch 2011, Trento, Italy. ISPRS Commission V Symposium, Image Engineering and Vision Metrology (Pub.) Pierrot-Deseilligny M, Cléry I (2011, 2–4 Mar) APERO, an open source bundle adjusment software for automatic calibration and orientation of a set of images. Paper presented at the 3D Arch 2011, Trento, Italy. ISPRS Commission V Symposium, Image Engineering and Vision Metrology (Pub.)
go back to reference Rizzi A, Gatta C (2004) From retinex to automatic color equalization: issues in developing a new algorithm for unsupervised color equalization. J Electron Imaging 13:75–84CrossRef Rizzi A, Gatta C (2004) From retinex to automatic color equalization: issues in developing a new algorithm for unsupervised color equalization. J Electron Imaging 13:75–84CrossRef
go back to reference Rusinkiewicz S, Levoy M (2001) Efficient variants of the ICP algorithm. Third international conference on 3D digital imaging and modeling (3DIM) Rusinkiewicz S, Levoy M (2001) Efficient variants of the ICP algorithm. Third international conference on 3D digital imaging and modeling (3DIM)
go back to reference Rusu RB, Blodow N, Marton ZC, Beetz M (2008) Aligning point cloud views using persistent feature histograms, Intelligent Robots and Systems. IROS 2008. IEEE/RSJ, 22–26 Sept. 2008, Nice, France. pp 3384–3391. ISBN 978-1-4244-2057-5 Rusu RB, Blodow N, Marton ZC, Beetz M (2008) Aligning point cloud views using persistent feature histograms, Intelligent Robots and Systems. IROS 2008. IEEE/RSJ, 22–26 Sept. 2008, Nice, France. pp 3384–3391. ISBN 978-1-4244-2057-5
go back to reference Sahillioglu Y, Yemez Y (2010) 3D shape correspondence by isometry-driven greedy optimization. In the twenty-third IEEE conference on computer vision and pattern recognition, CVPR 2010, San Francisco, CA, USA, pp 453–458 Sahillioglu Y, Yemez Y (2010) 3D shape correspondence by isometry-driven greedy optimization. In the twenty-third IEEE conference on computer vision and pattern recognition, CVPR 2010, San Francisco, CA, USA, pp 453–458
go back to reference Sehgal A, Cernea D, Makaveeva M (2010) Real-time scale invariant 3D range point cloud registration. International conference on image analysis and recognition (ICIAR 2010), Vol. 6111 of LNCS, Povoa de Varzim, Portugal, pp 220–229 Sehgal A, Cernea D, Makaveeva M (2010) Real-time scale invariant 3D range point cloud registration. International conference on image analysis and recognition (ICIAR 2010), Vol. 6111 of LNCS, Povoa de Varzim, Portugal, pp 220–229
go back to reference Shokoufandeh A, Macrini D, Dickinson S, Siddiqi K, Zucker SW (2005) Indexing Hierarchical structures using graph spectra. IEEE Trans Pattern Anal Mach Intell 27(7):1125–1140CrossRef Shokoufandeh A, Macrini D, Dickinson S, Siddiqi K, Zucker SW (2005) Indexing Hierarchical structures using graph spectra. IEEE Trans Pattern Anal Mach Intell 27(7):1125–1140CrossRef
go back to reference Shortis M, Harvey E, Abdo D (2009) A review of underwater stereo-image measurement for marine biology and ecology applications. Oceanogr Mar Biol 47:257–292 (Crc Press-Taylor & Francis Group(Pub.), isbn/issn:0078–3218)CrossRef Shortis M, Harvey E, Abdo D (2009) A review of underwater stereo-image measurement for marine biology and ecology applications. Oceanogr Mar Biol 47:257–292 (Crc Press-Taylor & Francis Group(Pub.), isbn/issn:0078–3218)CrossRef
go back to reference Shunyi Z, Ruifang Z, Zuxun Z (2007) Generation of 3D surface model of complex objects based on non-metric camera. Paper presented at the image processing, 2007. ICIP 2007. IEEE international conference on Sept 16–Oct 19 2007. Vol 3, pp III—89-III—92, isbn/issn:1522–4880 Shunyi Z, Ruifang Z, Zuxun Z (2007) Generation of 3D surface model of complex objects based on non-metric camera. Paper presented at the image processing, 2007. ICIP 2007. IEEE international conference on Sept 16–Oct 19 2007. Vol 3, pp III—89-III—92, isbn/issn:1522–4880
go back to reference Singh H, Roman C, Whitcomb L, Yoerger D (2000) Advances in fusion of high resolution underwater optical and acoustic data. Paper presented at the Proceedings of the 2000 International Symposium on Underwater Technology, Tokyo Japan Singh H, Roman C, Whitcomb L, Yoerger D (2000) Advances in fusion of high resolution underwater optical and acoustic data. Paper presented at the Proceedings of the 2000 International Symposium on Underwater Technology, Tokyo Japan
go back to reference Singh H, Roman C, Pizarro O, Eustice R, Can A (2007) Towards high-resolution imaging from underwater vehicles. Int J Robot Res 26:55–74 (Sage Publications, Inc.(Pub.), isbn/issn:0278–3649)CrossRef Singh H, Roman C, Pizarro O, Eustice R, Can A (2007) Towards high-resolution imaging from underwater vehicles. Int J Robot Res 26:55–74 (Sage Publications, Inc.(Pub.), isbn/issn:0278–3649)CrossRef
go back to reference Snavely N, Simon I, Goesele M, Szeliski R, Seitz SM (2010) Scene reconstruction and visualization from community photo collections. Proc IEEE 98:1370–1390 (isbn/issn:0018–9219)CrossRef Snavely N, Simon I, Goesele M, Szeliski R, Seitz SM (2010) Scene reconstruction and visualization from community photo collections. Proc IEEE 98:1370–1390 (isbn/issn:0018–9219)CrossRef
go back to reference Thome N, Merad D, Miguet S (2008) Learning articulated appearance models for tracking humans: a spectral graph matching approach. Image Comm 23(10):769–787 Thome N, Merad D, Miguet S (2008) Learning articulated appearance models for tracking humans: a spectral graph matching approach. Image Comm 23(10):769–787
go back to reference Viola PA, Jones MJ (2001) Robust real-time object detection. Int J Comput Vis 57(2):747 Viola PA, Jones MJ (2001) Robust real-time object detection. Int J Comput Vis 57(2):747
go back to reference Wahl E, Hillenbrand U, Hirzinger G (2003) Surflet-pair-relation histograms: a statistical 3D-shape representation for rapid classification. In proceedings of the fourth international conference on 3-D digital imaging and modeling, pp 474–481 Wahl E, Hillenbrand U, Hirzinger G (2003) Surflet-pair-relation histograms: a statistical 3D-shape representation for rapid classification. In proceedings of the fourth international conference on 3-D digital imaging and modeling, pp 474–481
go back to reference Zeng Gang S, Quan PL, Sillion F (2005) Progressive surface reconstruction from images using a local prior. Paper presented at the Computer Vision, 2005. ICCV 2005. Tenth IEEE international conference on 17–21 Oct 2005. Vol. 2, pp. 1230–1237 Vol. 1232, isbn/issn:1550–5499 Zeng Gang S, Quan PL, Sillion F (2005) Progressive surface reconstruction from images using a local prior. Paper presented at the Computer Vision, 2005. ICCV 2005. Tenth IEEE international conference on 17–21 Oct 2005. Vol. 2, pp. 1230–1237 Vol. 1232, isbn/issn:1550–5499
Metadata
Title
Underwater Multimodal Survey: Merging Optical and Acoustic Data
Authors
Pierre Drap
Djamal Merad
Jean-Marc Boï
Amine Mahiddine
Daniela Peloso
Bertrand Chemisky
Emmanuelle Seguin
Frederic Alcala
Olivier Bianchimani
Copyright Year
2014
DOI
https://doi.org/10.1007/978-3-319-03440-9_14