Skip to main content
Top
Published in: Neural Processing Letters 2/2016

01-04-2016

3D Surface Reconstruction of Noisy Point Clouds Using Growing Neural Gas: 3D Object/Scene Reconstruction

Authors: Sergio Orts-Escolano, Jose Garcia-Rodriguez, Vicente Morell, Miguel Cazorla, Jose Antonio Serra Perez, Alberto Garcia-Garcia

Published in: Neural Processing Letters | Issue 2/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the advent of low-cost 3D sensors and 3D printers, scene and object 3D surface reconstruction has become an important research topic in the last years. In this work, we propose an automatic (unsupervised) method for 3D surface reconstruction from raw unorganized point clouds acquired using low-cost 3D sensors. We have modified the growing neural gas network, which is a suitable model because of its flexibility, rapid adaptation and excellent quality of representation, to perform 3D surface reconstruction of different real-world objects and scenes. Some improvements have been made on the original algorithm considering colour and surface normal information of input data during the learning stage and creating complete triangular meshes instead of basic wire-frame representations. The proposed method is able to successfully create 3D faces online, whereas existing 3D reconstruction methods based on self-organizing maps required post-processing steps to close gaps and holes produced during the 3D reconstruction process. A set of quantitative and qualitative experiments were carried out to validate the proposed method. The method has been implemented and tested on real data, and has been found to be effective at reconstructing noisy point clouds obtained using low-cost 3D sensors.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Kinect for XBox 360: http://​www.​xbox.​com/​kinect Microsoft.
 
3
Genus: A topologically invariant property of a surface defined as the largest number of nonintersecting simple closed curves that can be drawn on the surface without separating it. Roughly speaking, it is the number of holes in a surface [26].
 
Literature
1.
go back to reference Hoppe H, DeRose T, Duchamp T, McDonald J, Stuetzle W (1992) Surface reconstruction from unorganized points. SIGGRAPH Comput Graph 26(2):71–78, ISSN 0097–8930, doi:10.1145/142920.134011 Hoppe H, DeRose T, Duchamp T, McDonald J, Stuetzle W (1992) Surface reconstruction from unorganized points. SIGGRAPH Comput Graph 26(2):71–78, ISSN 0097–8930, doi:10.​1145/​142920.​134011
2.
go back to reference Amenta N, Choi S, Kolluri RK (2001) The power crust. In: Proceedings of the sixth ACM symposium on solid modeling and applications, SMA ’01, ACM, New York, NY, USA, pp 249–266, ISBN 1-58113-366-9, doi:10.1145/376957.376986 Amenta N, Choi S, Kolluri RK (2001) The power crust. In: Proceedings of the sixth ACM symposium on solid modeling and applications, SMA ’01, ACM, New York, NY, USA, pp 249–266, ISBN 1-58113-366-9, doi:10.​1145/​376957.​376986
3.
go back to reference Berger M, Tagliasacchi A, Seversky LM, Alliez P, Levine JA, Sharf A, Silva C (2014) State of the art in surface reconstruction from point clouds. In: Proceedings of eurographics state-of-the-art reports (EG’14), Springer, New York Berger M, Tagliasacchi A, Seversky LM, Alliez P, Levine JA, Sharf A, Silva C (2014) State of the art in surface reconstruction from point clouds. In: Proceedings of eurographics state-of-the-art reports (EG’14), Springer, New York
4.
go back to reference Yu Y (1999) Surface reconstruction from unorganized points using self-organizing neural networks. In: Yu Y (ed) Proceedings of the IEEE visualization 99 conference, San Francisco, pp 61–64 Yu Y (1999) Surface reconstruction from unorganized points using self-organizing neural networks. In: Yu Y (ed) Proceedings of the IEEE visualization 99 conference, San Francisco, pp 61–64
5.
go back to reference Junior A, Neto ADD, de Melo J (2004) Surface reconstruction using neural networks and adaptive geometry meshes. In: Proceedings of the international joint conference on neural networks, vol 1–807, Budapest, ISSN 1098–7576, doi:10.1109/IJCNN.2004.1380023 Junior A, Neto ADD, de Melo J (2004) Surface reconstruction using neural networks and adaptive geometry meshes. In: Proceedings of the international joint conference on neural networks, vol 1–807, Budapest, ISSN 1098–7576, doi:10.​1109/​IJCNN.​2004.​1380023
6.
go back to reference Fritzke B (1993) Growing cell structures—a self-organizing network for unsupervised and supervised learning. Neural Netw 7:1441–1460CrossRef Fritzke B (1993) Growing cell structures—a self-organizing network for unsupervised and supervised learning. Neural Netw 7:1441–1460CrossRef
7.
go back to reference Ivrissimtzis I, Jeong WK, Seidel HP (2003) Using growing cell structures for surface reconstruction. In: Proceedings of the shape modeling international, IEEE Computer Society, Seoul, pp 78–86 Ivrissimtzis I, Jeong WK, Seidel HP (2003) Using growing cell structures for surface reconstruction. In: Proceedings of the shape modeling international, IEEE Computer Society, Seoul, pp 78–86
8.
go back to reference Martinetz T, Schulten K (1994) Topology representing networks. Neural Netw 7(3):507–522CrossRef Martinetz T, Schulten K (1994) Topology representing networks. Neural Netw 7(3):507–522CrossRef
9.
go back to reference Barhak J (2002) Freeform objects with arbitrary topology from multirange images. Ph.D. thesis, Israel Institute of Technology, Haifa, Israel Barhak J (2002) Freeform objects with arbitrary topology from multirange images. Ph.D. thesis, Israel Institute of Technology, Haifa, Israel
10.
go back to reference Fritzke B (1995) A growing neural gas network learns topologies, vol 7. MIT Press, Cambridge Fritzke B (1995) A growing neural gas network learns topologies, vol 7. MIT Press, Cambridge
11.
go back to reference Cretu AM, Petriu EM, Payeur P (2008) Evaluation of growing neural gas networks for selective 3D scanning. In: Proceedings of the international workshop robotic and sensors environments ROSE 2008, Vancouver, pp 108–113 Cretu AM, Petriu EM, Payeur P (2008) Evaluation of growing neural gas networks for selective 3D scanning. In: Proceedings of the international workshop robotic and sensors environments ROSE 2008, Vancouver, pp 108–113
12.
go back to reference Holdstein Y, Fischer A (2008) Three-dimensional surface reconstruction using meshing growing neural gas (MGNG). Vis Comput 24:295–302CrossRef Holdstein Y, Fischer A (2008) Three-dimensional surface reconstruction using meshing growing neural gas (MGNG). Vis Comput 24:295–302CrossRef
14.
go back to reference Orts-Escolano S, Garcia-Rodriguez J, Morell V, Cazorla M, Garcia-Chamizo JM (2014) 3D colour object reconstruction based on growing neural gas. In: Proceedings of 2014 international joint conference on neural networks, IJCNN 2014, Beijing, China, July 6–11, 2014, pp 1474–1481, doi:10.1109/IJCNN.2014.6889546 Orts-Escolano S, Garcia-Rodriguez J, Morell V, Cazorla M, Garcia-Chamizo JM (2014) 3D colour object reconstruction based on growing neural gas. In: Proceedings of 2014 international joint conference on neural networks, IJCNN 2014, Beijing, China, July 6–11, 2014, pp 1474–1481, doi:10.​1109/​IJCNN.​2014.​6889546
15.
go back to reference Kazhdan M, Bolitho M, Hoppe H (2006) Poisson surface reconstruction. In: Proceedings of the fourth eurographics symposium on geometry processing, SGP ’06, Eurographics Association, Aire-la-Ville, Switzerland, 61–70, ISBN 3-905673-36-3 Kazhdan M, Bolitho M, Hoppe H (2006) Poisson surface reconstruction. In: Proceedings of the fourth eurographics symposium on geometry processing, SGP ’06, Eurographics Association, Aire-la-Ville, Switzerland, 61–70, ISBN 3-905673-36-3
16.
go back to reference Rusu RB, Blodow N, Beetz M (2009) Fast point feature histograms (FPFH) for 3D registration. In: Proceedings of IEEE international conference on robotics and automation 2009, ICRA ’09, pp 3212–3217, ISSN 1050–4729, doi:10.1109/ROBOT.2009.5152473 Rusu RB, Blodow N, Beetz M (2009) Fast point feature histograms (FPFH) for 3D registration. In: Proceedings of IEEE international conference on robotics and automation 2009, ICRA ’09, pp 3212–3217, ISSN 1050–4729, doi:10.​1109/​ROBOT.​2009.​5152473
17.
go back to reference Tombari F, Salti S (2011) A combined texture-shape descriptor for enhanced 3D feature matching. In: Proceedings of 18th IEEE international conference on image processing (ICIP), Brussels, pp 809–812, ISSN 1522–4880, doi:10.1109/ICIP.2011.6116679 Tombari F, Salti S (2011) A combined texture-shape descriptor for enhanced 3D feature matching. In: Proceedings of 18th IEEE international conference on image processing (ICIP), Brussels, pp 809–812, ISSN 1522–4880, doi:10.​1109/​ICIP.​2011.​6116679
18.
go back to reference Mian AS, Bennamoun M, Owens RA (2006) A novel representation and feature matching algorithm for automatic pairwise registration of range images. Int J Comput Vis 66(1):19–40, ISSN 0920–5691, doi:10.1007/s11263-005-3221-0 Mian AS, Bennamoun M, Owens RA (2006) A novel representation and feature matching algorithm for automatic pairwise registration of range images. Int J Comput Vis 66(1):19–40, ISSN 0920–5691, doi:10.​1007/​s11263-005-3221-0
19.
go back to reference Orts-Escolano S, Morell V, Garcia-Rodriguez J, Cazorla M (2013) Point cloud data filtering and downsampling using growing neural gas. In: Proceedings of the the 2013 international joint conference on neural networks, IJCNN 2013, Dallas, TX, USA, August 4–9, 2013, pp 1–8, doi:10.1109/IJCNN.2013.6706719 Orts-Escolano S, Morell V, Garcia-Rodriguez J, Cazorla M (2013) Point cloud data filtering and downsampling using growing neural gas. In: Proceedings of the the 2013 international joint conference on neural networks, IJCNN 2013, Dallas, TX, USA, August 4–9, 2013, pp 1–8, doi:10.​1109/​IJCNN.​2013.​6706719
21.
22.
go back to reference Cignoni P, Rocchini C, Scopigno R (1996) Metro: Measuring Error on Simplified Surfaces. Tech. rep, Paris, France, France Cignoni P, Rocchini C, Scopigno R (1996) Metro: Measuring Error on Simplified Surfaces. Tech. rep, Paris, France, France
23.
go back to reference Rusu RB, Cousins S (2011) 3D is here: point cloud library (PCL). In: Proceedings of the IEEE international conference on robotics and automation (ICRA), Shanghai, China Rusu RB, Cousins S (2011) 3D is here: point cloud library (PCL). In: Proceedings of the IEEE international conference on robotics and automation (ICRA), Shanghai, China
24.
go back to reference Tombari F, Salti S, Di Stefano L (2010) Unique signatures of histograms for local surface description. In: Proceedings of the 11th European conference on computer vision conference on computer vision: Part III, ECCV’10, Springer-Verlag, Berlin, Heidelberg, pp 356–369, ISBN 978–3-642-15557-X-642-15557-4 Tombari F, Salti S, Di Stefano L (2010) Unique signatures of histograms for local surface description. In: Proceedings of the 11th European conference on computer vision conference on computer vision: Part III, ECCV’10, Springer-Verlag, Berlin, Heidelberg, pp 356–369, ISBN 978–3-642-15557-X-642-15557-4
25.
go back to reference Mian AS, Bennamoun M, Owens R (2006) Three-dimensional model-based object recognition and segmentation in cluttered scenes. IEEE Trans Pattern Anal Mach Intell 28(10):1584–1601, ISSN 0162–8828, doi:10.1109/TPAMI.2006.213 Mian AS, Bennamoun M, Owens R (2006) Three-dimensional model-based object recognition and segmentation in cluttered scenes. IEEE Trans Pattern Anal Mach Intell 28(10):1584–1601, ISSN 0162–8828, doi:10.​1109/​TPAMI.​2006.​213
26.
go back to reference Gray A (1996) Modern differential geometry of curves and surfaces with mathematica, 1st edn. CRC Press Inc, Boca Raton, ISBN 0849371643 Gray A (1996) Modern differential geometry of curves and surfaces with mathematica, 1st edn. CRC Press Inc, Boca Raton, ISBN 0849371643
Metadata
Title
3D Surface Reconstruction of Noisy Point Clouds Using Growing Neural Gas: 3D Object/Scene Reconstruction
Authors
Sergio Orts-Escolano
Jose Garcia-Rodriguez
Vicente Morell
Miguel Cazorla
Jose Antonio Serra Perez
Alberto Garcia-Garcia
Publication date
01-04-2016
Publisher
Springer US
Published in
Neural Processing Letters / Issue 2/2016
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-015-9421-x

Other articles of this Issue 2/2016

Neural Processing Letters 2/2016 Go to the issue