Skip to main content
Erschienen in: Soft Computing 19/2018

05.12.2017 | Foundations

Multi-view 3D reconstruction and modeling of the unknown 3D scenes using genetic algorithms

verfasst von: Mostafa Merras, Abderrahim Saaidi, Nabil El Akkad, Khalid Satori

Erschienen in: Soft Computing | Ausgabe 19/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a complete pipeline of the reconstruction and the modeling of the unknown complex 3D scenes from a sequence of unconstrained images. The proposed system is based on the formulation of a nonlinear cost function by determining the relationship between 2D points of the images and the cameras parameters; the optimization of this function by a genetic algorithm makes finding the optimal cameras parameters. The determination of these parameters allows thereafter to estimate the 3D points of the observed scene. Then, the mesh of the 3D points is achieved by 3D Crust algorithm and the texture mapping is performed by multiple dependent viewpoints. Extensive experiments on synthetic and real data are performed to validate the proposed approach, and the results indicate that our system is robust and can achieve a very satisfactory reconstruction quality.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Amenta N (1999) The crust algorithm for 3D surface reconstruction. In: Proceedings of symposium on computational geometry, pp 423–424 Amenta N (1999) The crust algorithm for 3D surface reconstruction. In: Proceedings of symposium on computational geometry, pp 423–424
Zurück zum Zitat Amenta N, Choi S, Kolluri RK (2001) The power crust. In: Proceedings of the sixth ACM symposium on solid modeling and applications, University of Texas at Austin, pp 249–266 Amenta N, Choi S, Kolluri RK (2001) The power crust. In: Proceedings of the sixth ACM symposium on solid modeling and applications, University of Texas at Austin, pp 249–266
Zurück zum Zitat Anam S, Islam MS, Kashem MA, Islam MN, Islam MR, Islam MS (2009) Face recognition using genetic algorithm and back propagation neural network. In: International multi conference of engineers and computer scientists, vol I Anam S, Islam MS, Kashem MA, Islam MN, Islam MR, Islam MS (2009) Face recognition using genetic algorithm and back propagation neural network. In: International multi conference of engineers and computer scientists, vol I
Zurück zum Zitat Baumgart BG et al (1974) Geometric modeling for computer vision. Doctoral dissertation, Stanford University Baumgart BG et al (1974) Geometric modeling for computer vision. Doctoral dissertation, Stanford University
Zurück zum Zitat Cazals F, Giesen J (2004) Delaunay triangulation based surface reconstruction: ideas and algorithms. Technical report, RR-5393, INRIA Cazals F, Giesen J (2004) Delaunay triangulation based surface reconstruction: ideas and algorithms. Technical report, RR-5393, INRIA
Zurück zum Zitat Chang CC, Kuo Y-T (2008) Genetic-based approach for synthesizing texture. Int J Artif Intell Tools 17(04):731–743CrossRef Chang CC, Kuo Y-T (2008) Genetic-based approach for synthesizing texture. Int J Artif Intell Tools 17(04):731–743CrossRef
Zurück zum Zitat Craciun DI (2011) Modélisation des équivalents dynamiques des réseaux électriques. Thèse, Université de Grenoble, p 174 Craciun DI (2011) Modélisation des équivalents dynamiques des réseaux électriques. Thèse, Université de Grenoble, p 174
Zurück zum Zitat Dipanda A, Woo S, Marzani F, Bilbault JM (2003) 3D shape reconstruction in an active stereo vision system using genetic algorithms. J Pattern Recognit Soc 36:2143–2159CrossRefMATH Dipanda A, Woo S, Marzani F, Bilbault JM (2003) 3D shape reconstruction in an active stereo vision system using genetic algorithms. J Pattern Recognit Soc 36:2143–2159CrossRefMATH
Zurück zum Zitat El Hazzat S, Saaidi A, Satori K (2014) Euclidean 3D reconstruction of unknown objects from multiple images. J Emerg Technol Web Intell 6(1):59–63 El Hazzat S, Saaidi A, Satori K (2014) Euclidean 3D reconstruction of unknown objects from multiple images. J Emerg Technol Web Intell 6(1):59–63
Zurück zum Zitat Faugeras O, Luong QT, Papadopoulou T (2001) The geometry of multiple images: the laws that govern the formation of images of a scene and some of their applications. MIT Press, CambridgeMATH Faugeras O, Luong QT, Papadopoulou T (2001) The geometry of multiple images: the laws that govern the formation of images of a scene and some of their applications. MIT Press, CambridgeMATH
Zurück zum Zitat Franco J (2010) Efficient polyhedral modeling from silhouettes. IEEE Trans Pattern Anal Mach Intell 31(3):853–861 Franco J (2010) Efficient polyhedral modeling from silhouettes. IEEE Trans Pattern Anal Mach Intell 31(3):853–861
Zurück zum Zitat Fuhrmann S et al (2015) MVE—an image-based reconstruction environment. Comput Graph 53:44–53CrossRef Fuhrmann S et al (2015) MVE—an image-based reconstruction environment. Comput Graph 53:44–53CrossRef
Zurück zum Zitat Furukawa Y, Ponce J (2010) Accurate, dense, and robust multi-view stereopsis. Trans Pattern Anal Mach Intell 32(8):1362–1376CrossRef Furukawa Y, Ponce J (2010) Accurate, dense, and robust multi-view stereopsis. Trans Pattern Anal Mach Intell 32(8):1362–1376CrossRef
Zurück zum Zitat Furukawa Y, Curless B, Seitz SM, Szeliski R (2010) Towards internet-scale multi-view stereo. In: Conference on computer vision and pattern recognition Furukawa Y, Curless B, Seitz SM, Szeliski R (2010) Towards internet-scale multi-view stereo. In: Conference on computer vision and pattern recognition
Zurück zum Zitat Goldberg DE (1989) Genetic algorithms in search, optimization & machine learning. Addison-Wesley, BostonMATH Goldberg DE (1989) Genetic algorithms in search, optimization & machine learning. Addison-Wesley, BostonMATH
Zurück zum Zitat Goldberg DE, Deb K (1991) A comparative analysis of selection scheme used in genetic algorithms. In: Rawlins G (ed) Foundations of genetic algorithms. Morgan Kaufman, San Mateo, pp 69–93 Goldberg DE, Deb K (1991) A comparative analysis of selection scheme used in genetic algorithms. In: Rawlins G (ed) Foundations of genetic algorithms. Morgan Kaufman, San Mateo, pp 69–93
Zurück zum Zitat Harris C, Stephens M (1988) A combined corner et edge detector. In: 4th Alvey vision conference, pp 147–151 Harris C, Stephens M (1988) A combined corner et edge detector. In: 4th Alvey vision conference, pp 147–151
Zurück zum Zitat Hartley RI, Zisserman A (2000) Multiple view geometry in computer vision. Cambridge University Press, Cambridge, p 265. ISBN: 0521623049 Hartley RI, Zisserman A (2000) Multiple view geometry in computer vision. Cambridge University Press, Cambridge, p 265. ISBN: 0521623049
Zurück zum Zitat Holland JH (1992) Adaptation in natural and artificial systems. MIT Press, Cambridge Holland JH (1992) Adaptation in natural and artificial systems. MIT Press, Cambridge
Zurück zum Zitat Hornung A, Kobbelt L, (2006) Robust reconstruction of watertight 3D models from non-uniformly sampled point-clouds without normal information. In: Eurographics symposium on geometry processing, pp 41–50 Hornung A, Kobbelt L, (2006) Robust reconstruction of watertight 3D models from non-uniformly sampled point-clouds without normal information. In: Eurographics symposium on geometry processing, pp 41–50
Zurück zum Zitat Janko Z, Chetverikov D, Ekart A (1995) Using genetic algorithms in computer vision: registering images to 3D surface model. Acta Cybern 18(2):193–212MATH Janko Z, Chetverikov D, Ekart A (1995) Using genetic algorithms in computer vision: registering images to 3D surface model. Acta Cybern 18(2):193–212MATH
Zurück zum Zitat Jean-Denis D, Adrien B, Pierre G (1998) Interactive 3D modeling from multiple images using scene regularities. Lecture notes in computer science, vol, 1506, pp 236–252 Jean-Denis D, Adrien B, Pierre G (1998) Interactive 3D modeling from multiple images using scene regularities. Lecture notes in computer science, vol, 1506, pp 236–252
Zurück zum Zitat Jean-Denis D, Adrien B, Pierre G (2010) Shape-from-texture revisited. In: Francophone congress of pattern recognition and artificial intelligence, pp 1–8 Jean-Denis D, Adrien B, Pierre G (2010) Shape-from-texture revisited. In: Francophone congress of pattern recognition and artificial intelligence, pp 1–8
Zurück zum Zitat Johnson CM, Bhat A, et Thibault W (2006) An evolutionary approach to camera-based projector calibration. In: Genetic and evolutionary computation conference, pp 1871–1872 Johnson CM, Bhat A, et Thibault W (2006) An evolutionary approach to camera-based projector calibration. In: Genetic and evolutionary computation conference, pp 1871–1872
Zurück zum Zitat Kazhdan M, Hoppe H (2013) Screened Poisson surface reconstruction. ACM Trans Graph 32(3):1–29CrossRefMATH Kazhdan M, Hoppe H (2013) Screened Poisson surface reconstruction. ACM Trans Graph 32(3):1–29CrossRefMATH
Zurück zum Zitat Kolev K, Klodt M et al (2009) Continuous global optimization in multiview 3D reconstruction. Int J Comput Vis 4(1):80–96CrossRef Kolev K, Klodt M et al (2009) Continuous global optimization in multiview 3D reconstruction. Int J Comput Vis 4(1):80–96CrossRef
Zurück zum Zitat Kolev K, Brox T, Cremers D (2012) Fast joint estimation of silhouettes and dense 3D geometry from multiple images. Trans Pattern Anal Mach Intell 34(3):493–505CrossRef Kolev K, Brox T, Cremers D (2012) Fast joint estimation of silhouettes and dense 3D geometry from multiple images. Trans Pattern Anal Mach Intell 34(3):493–505CrossRef
Zurück zum Zitat Kutulakos KN, Seitz SM (2000) A theory of shape by space carving. Int J Comput Vis 38(3):199–218CrossRefMATH Kutulakos KN, Seitz SM (2000) A theory of shape by space carving. Int J Comput Vis 38(3):199–218CrossRefMATH
Zurück zum Zitat Lobay A, Forsyth DA (2006) Shape from texture without boundaries. Int J Comput Vis 67(1):71–91CrossRef Lobay A, Forsyth DA (2006) Shape from texture without boundaries. Int J Comput Vis 67(1):71–91CrossRef
Zurück zum Zitat Loh M, Hartley R (2005) Shape from non homogeneous, non-stationary, anisotropic, perspective texture. In: BMVC’05. Royaume-Uni, Oxford, pp 69–78 Loh M, Hartley R (2005) Shape from non homogeneous, non-stationary, anisotropic, perspective texture. In: BMVC’05. Royaume-Uni, Oxford, pp 69–78
Zurück zum Zitat Ma Y, Soatto S, Kosecka J, Sastry SS (2003) An invitation to 3-D vision: from images to geometric models. Springer, BerlinMATH Ma Y, Soatto S, Kosecka J, Sastry SS (2003) An invitation to 3-D vision: from images to geometric models. Springer, BerlinMATH
Zurück zum Zitat Matusik W, Buehler C, McMillan L (2001) Polyhedral visual hulls for real-time rendering. In: Euro graphics workshop on rendering, pp 115–125 Matusik W, Buehler C, McMillan L (2001) Polyhedral visual hulls for real-time rendering. In: Euro graphics workshop on rendering, pp 115–125
Zurück zum Zitat Merras M, El Akkad N, Saaidi A, Nazih AG, Satori K (2014) Camera calibration with varying parameters based on improved genetic algorithm. WSEAS Trans Comput 13:129–137 Merras M, El Akkad N, Saaidi A, Nazih AG, Satori K (2014) Camera calibration with varying parameters based on improved genetic algorithm. WSEAS Trans Comput 13:129–137
Zurück zum Zitat Merras M et al (2015) Camera self calibration with varying parameters by an unknown three dimensional scene using the improved genetic algorithm. 3D Res 6(1):1–14CrossRef Merras M et al (2015) Camera self calibration with varying parameters by an unknown three dimensional scene using the improved genetic algorithm. 3D Res 6(1):1–14CrossRef
Zurück zum Zitat Nguyen MH et al (2011) Modeling of 3D object using unconstrained and uncalibrated images taken with a handheld camera. Comput Vis Imaging Comput Graph Theory Appl 274:1–5 Nguyen MH et al (2011) Modeling of 3D object using unconstrained and uncalibrated images taken with a handheld camera. Comput Vis Imaging Comput Graph Theory Appl 274:1–5
Zurück zum Zitat Nguyen MH et al (2013) A hybrid image base modeling algorithm. In: Proceedings of the thirty sixth Australasian computer sciences conference, vol 135, pp 115–123 Nguyen MH et al (2013) A hybrid image base modeling algorithm. In: Proceedings of the thirty sixth Australasian computer sciences conference, vol 135, pp 115–123
Zurück zum Zitat Nistér D (2005) Preemptive RANSAC for live structure and motion estimation. Mach Vis Appl 16(5):321–329CrossRef Nistér D (2005) Preemptive RANSAC for live structure and motion estimation. Mach Vis Appl 16(5):321–329CrossRef
Zurück zum Zitat Olsson C, Enqvist O (2011) Stable structure from motion for unordered image collections. In: Scandinavian conference on image analysis, SCIA 2011 Olsson C, Enqvist O (2011) Stable structure from motion for unordered image collections. In: Scandinavian conference on image analysis, SCIA 2011
Zurück zum Zitat Pighin F (2002) Modeling and animating realistic faces from images. Int J Comput Vis 50(2):143–169CrossRefMATH Pighin F (2002) Modeling and animating realistic faces from images. Int J Comput Vis 50(2):143–169CrossRefMATH
Zurück zum Zitat Pollefeys M, Koch R, Gool LV (1999) Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. Int J Comput Vis 32(1):7–25CrossRef Pollefeys M, Koch R, Gool LV (1999) Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. Int J Comput Vis 32(1):7–25CrossRef
Zurück zum Zitat Ren Z-W, San Y, Chen J-F (2007) Hybrid implex-improved genetic algorithm for global numerical optimization. Acta Autom Sin 33(1):91–95CrossRef Ren Z-W, San Y, Chen J-F (2007) Hybrid implex-improved genetic algorithm for global numerical optimization. Acta Autom Sin 33(1):91–95CrossRef
Zurück zum Zitat Roberts R, Szeliski R (2011) Structure from motion for scenes with large duplicate structures. In: Computer vision and pattern recognition, pp 3137–3144 Roberts R, Szeliski R (2011) Structure from motion for scenes with large duplicate structures. In: Computer vision and pattern recognition, pp 3137–3144
Zurück zum Zitat Saaidi A, Tairi H, Satori K (2006) Fast stereo matching using rectification and correlation techniques. In: ISCCSP, second international symposium on communications, control and signal processing. Marrakech, Morrocco, pp 1–4 Saaidi A, Tairi H, Satori K (2006) Fast stereo matching using rectification and correlation techniques. In: ISCCSP, second international symposium on communications, control and signal processing. Marrakech, Morrocco, pp 1–4
Zurück zum Zitat Salman N, Yvinec M (2010) Surface reconstruction from multi-view stereo of large-scale outdoor scenes. Int J Virtual Real 5(3):1–6 Salman N, Yvinec M (2010) Surface reconstruction from multi-view stereo of large-scale outdoor scenes. Int J Virtual Real 5(3):1–6
Zurück zum Zitat Seitz S, Curless B, Diebel J, Scharstein D, Szeliski R (2006) A comparison and evaluation of multi-view stereo reconstruction algorithms. In: Conference on computer vision and pattern recognition Seitz S, Curless B, Diebel J, Scharstein D, Szeliski R (2006) A comparison and evaluation of multi-view stereo reconstruction algorithms. In: Conference on computer vision and pattern recognition
Zurück zum Zitat Snavely N, Seitz SM, Szeliski R (2006) Photo tourism: exploring photo collections in 3D. ACM Trans Graph 25:835–846CrossRef Snavely N, Seitz SM, Szeliski R (2006) Photo tourism: exploring photo collections in 3D. ACM Trans Graph 25:835–846CrossRef
Zurück zum Zitat Tan P et al (2006) Image based tree graphics. ACM Trans Graph 27(3):418–433 Tan P et al (2006) Image based tree graphics. ACM Trans Graph 27(3):418–433
Zurück zum Zitat Triggs B, McLauchlan P, Hartley RI, Fitzgibbon A (1999) Bundle adjustment—a modern synthesis. In: Vision algorithms, pp 298–372 Triggs B, McLauchlan P, Hartley RI, Fitzgibbon A (1999) Bundle adjustment—a modern synthesis. In: Vision algorithms, pp 298–372
Zurück zum Zitat Wang G, Wu QMJ (2009) Perspective 3-d Euclidean reconstruction with varying camera parameters. IEEE Trans Circuits Syst Video Technol 19(12):1793–1803CrossRef Wang G, Wu QMJ (2009) Perspective 3-d Euclidean reconstruction with varying camera parameters. IEEE Trans Circuits Syst Video Technol 19(12):1793–1803CrossRef
Zurück zum Zitat Wilczkowiak M, Boyer E, Sturm P (2001) Camera calibration and 3D reconstruction from single images using parallelepipeds. In: ICCV. Vancouver, Canada, pp 142–148 Wilczkowiak M, Boyer E, Sturm P (2001) Camera calibration and 3D reconstruction from single images using parallelepipeds. In: ICCV. Vancouver, Canada, pp 142–148
Zurück zum Zitat Wojciech et al (2000) Image based visual hulls. In: 27th conference on computer graphics and interactive techniques, pp 369–374 Wojciech et al (2000) Image based visual hulls. In: 27th conference on computer graphics and interactive techniques, pp 369–374
Zurück zum Zitat Wu C (2013) Towards linear-time incremental structurefrom motion. In: International conference on 3D vision, pp 127–134 Wu C (2013) Towards linear-time incremental structurefrom motion. In: International conference on 3D vision, pp 127–134
Zurück zum Zitat Wu C, Agarwal S, Curless B, Seitz S (2011) Multicore bundle adjustment. In: Conference on computer vision and pattern recognition, pp 3057–3064 Wu C, Agarwal S, Curless B, Seitz S (2011) Multicore bundle adjustment. In: Conference on computer vision and pattern recognition, pp 3057–3064
Zurück zum Zitat Xiao J et al (2008) Image based façade modeling. ACM Trans Graph 27(5):26–34CrossRef Xiao J et al (2008) Image based façade modeling. ACM Trans Graph 27(5):26–34CrossRef
Metadaten
Titel
Multi-view 3D reconstruction and modeling of the unknown 3D scenes using genetic algorithms
verfasst von
Mostafa Merras
Abderrahim Saaidi
Nabil El Akkad
Khalid Satori
Publikationsdatum
05.12.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 19/2018
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2966-z

Weitere Artikel der Ausgabe 19/2018

Soft Computing 19/2018 Zur Ausgabe