Skip to main content

2021 | OriginalPaper | Buchkapitel

City-Scale Point Cloud Stitching Using 2D/3D Registration for Large Geographical Coverage

verfasst von : Shizeng Yao, Hadi AliAkbarpour, Guna Seetharaman, Kannappan Palaniappan

Erschienen in: Pattern Recognition. ICPR International Workshops and Challenges

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

3D city-scale point cloud stitching is a critical component for large data collection, environment change detection, in which massive amounts of 3D data are captured under different times and conditions. This paper proposes a novel point cloud stitching approach, that automatically and accurately stitches multiple city-scale point clouds, which only share relatively small overlapping areas, into one single model for a larger geographical coverage. The proposed method firstly employs 2D image mosaicking techniques to estimate 3D overlapping areas among multiple point clouds, then applies 3D point cloud registration techniques to estimate the most accurate transformation matrix for 3D stitching. The proposed method is quantitatively evaluated on city-scale reconstructed point cloud dataset and real-world city LiDAR dataset, in which, our method outperforms other competing methods with significant margins and achieved the highest precision score, recall score, and F-score. Our method makes an important step towards automatic and accurate city-scale point cloud data stitching, which could be used in a variety of applications.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Besl, P.J., McKay, N.D.: Method for registration of 3-D shapes. In: Sensor Fusion IV: Control Paradigms and Data Structures, vol. 1611, pp. 586–606. International Society for Optics and Photonics (1992) Besl, P.J., McKay, N.D.: Method for registration of 3-D shapes. In: Sensor Fusion IV: Control Paradigms and Data Structures, vol. 1611, pp. 586–606. International Society for Optics and Photonics (1992)
2.
Zurück zum Zitat Campbell, D., Petersson, L.: An adaptive data representation for robust point-set registration and merging. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4292–4300 (2015) Campbell, D., Petersson, L.: An adaptive data representation for robust point-set registration and merging. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4292–4300 (2015)
3.
Zurück zum Zitat Chen, Y., Medioni, G.G.: Object modeling by registration of multiple range images. Image Vis. Comput. 10(3), 145–155 (1992)CrossRef Chen, Y., Medioni, G.G.: Object modeling by registration of multiple range images. Image Vis. Comput. 10(3), 145–155 (1992)CrossRef
4.
Zurück zum Zitat Chetverikov, D., Stepanov, D., Krsek, P.: Robust Euclidean alignment of 3D point sets: the trimmed iterative closest point algorithm. Image Vis. Comput. 23(3), 299–309 (2005)CrossRef Chetverikov, D., Stepanov, D., Krsek, P.: Robust Euclidean alignment of 3D point sets: the trimmed iterative closest point algorithm. Image Vis. Comput. 23(3), 299–309 (2005)CrossRef
5.
Zurück zum Zitat Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32(8), 1362–1376 (2009)CrossRef Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32(8), 1362–1376 (2009)CrossRef
6.
Zurück zum Zitat Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Towards internet-scale multi-view stereo. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1434–1441 . IEEE (2010) Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Towards internet-scale multi-view stereo. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1434–1441 . IEEE (2010)
8.
Zurück zum Zitat Brown, L.G.: A survey of image registration techniques. ACM Comput. Surv. (CSUR) 24(4), 325–376 (1992)CrossRef Brown, L.G.: A survey of image registration techniques. ACM Comput. Surv. (CSUR) 24(4), 325–376 (1992)CrossRef
9.
Zurück zum Zitat Zitova, B., Flusser, J.: Image registration methods: a survey. Image Vis. Comput. 21(11), 977–1000 (2003)CrossRef Zitova, B., Flusser, J.: Image registration methods: a survey. Image Vis. Comput. 21(11), 977–1000 (2003)CrossRef
10.
Zurück zum Zitat Aktar, R., Aliakbarpour, H., Bunyak, F., Seetharaman, G., Palaniappan, K.: Performance evaluation of feature descriptors for aerial imagery mosaicking. In: (2018) IEEE Applied Imagery Pattern Recognition Workshop (AIPR), pp. 1–7. IEEE (2018) Aktar, R., Aliakbarpour, H., Bunyak, F., Seetharaman, G., Palaniappan, K.: Performance evaluation of feature descriptors for aerial imagery mosaicking. In: (2018) IEEE Applied Imagery Pattern Recognition Workshop (AIPR), pp. 1–7. IEEE (2018)
14.
Zurück zum Zitat Lucas, B.D., Kanade, T., et al.: An iterative image registration technique with an application to stereo vision, Vancouver, British Columbia (1981) Lucas, B.D., Kanade, T., et al.: An iterative image registration technique with an application to stereo vision, Vancouver, British Columbia (1981)
15.
Zurück zum Zitat Harris, C.G., Stephens, M., et al.: A combined corner and edge detector. In: Alvey Vision Conference, vol. 15, no. 50, , pp. 10–5244. Citeseer (1988) Harris, C.G., Stephens, M., et al.: A combined corner and edge detector. In: Alvey Vision Conference, vol. 15, no. 50, , pp. 10–5244. Citeseer (1988)
16.
Zurück zum Zitat Morel, J.-M., Yu, G.: ASIFT: a new framework for fully affine invariant image comparison. SIAM J. Imaging Sci. 2(2), 438–469 (2009)MathSciNetCrossRef Morel, J.-M., Yu, G.: ASIFT: a new framework for fully affine invariant image comparison. SIAM J. Imaging Sci. 2(2), 438–469 (2009)MathSciNetCrossRef
17.
Zurück zum Zitat Eckart, B., Kim, K., Troccoli, A., Kelly, A., Kautz, J.: MLMD: maximum likelihood mixture decoupling for fast and accurate point cloud registration. In: 2015 International Conference on 3D Vision, pp. 241–249. IEEE (2015) Eckart, B., Kim, K., Troccoli, A., Kelly, A., Kautz, J.: MLMD: maximum likelihood mixture decoupling for fast and accurate point cloud registration. In: 2015 International Conference on 3D Vision, pp. 241–249. IEEE (2015)
18.
Zurück zum Zitat Eckart, B., Kim, K., Troccoli, A., Kelly, A., Kautz, J.: Accelerated generative models for 3D point cloud data. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5497–5505 (2016) Eckart, B., Kim, K., Troccoli, A., Kelly, A., Kautz, J.: Accelerated generative models for 3D point cloud data. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5497–5505 (2016)
19.
Zurück zum Zitat Segal, A., Haehnel, D., Thrun, S.: Generalized-ICP. In: Robotics: Science and Systems, vol. 2, no. 4, p. 435, Seattle, WA (2009) Segal, A., Haehnel, D., Thrun, S.: Generalized-ICP. In: Robotics: Science and Systems, vol. 2, no. 4, p. 435, Seattle, WA (2009)
20.
Zurück zum Zitat Korn, M., Holzkothen, M., Pauli, J.: Color supported generalized-ICP. In: 2014 International Conference on Computer Vision Theory and Applications (VISAPP), vol. 3, pp. 592–599. IEEE (2014) Korn, M., Holzkothen, M., Pauli, J.: Color supported generalized-ICP. In: 2014 International Conference on Computer Vision Theory and Applications (VISAPP), vol. 3, pp. 592–599. IEEE (2014)
21.
Zurück zum Zitat Rusu, R.B., Blodow, N., Beetz, M.: Fast point feature histograms (FPFH) for 3D registration. In: 2009 IEEE International Conference on Robotics and Automation, pp. 3212–3217. IEEE (2009) Rusu, R.B., Blodow, N., Beetz, M.: Fast point feature histograms (FPFH) for 3D registration. In: 2009 IEEE International Conference on Robotics and Automation, pp. 3212–3217. IEEE (2009)
22.
Zurück zum Zitat Söderkvist, I.: Using SVD for some fitting problems. University Lecture (2009) Söderkvist, I.: Using SVD for some fitting problems. University Lecture (2009)
23.
Zurück zum Zitat Huber, P.J.: Robust Statistics, vol. 523. Wiley, Hoboken (2004) Huber, P.J.: Robust Statistics, vol. 523. Wiley, Hoboken (2004)
24.
Zurück zum Zitat Palaniappan, K., Rao, R.M., Seetharaman, G.: Wide-area persistent airborne video: architecture and challenges. In: Bhanu, B., Ravishankar, C., Roy-Chowdhury, A., Aghajan, H., Terzopoulos, D. (eds.) Distributed Video Sensor Networks. Springer, London (2011). https://doi.org/10.1007/978-0-85729-127-1_24 Palaniappan, K., Rao, R.M., Seetharaman, G.: Wide-area persistent airborne video: architecture and challenges. In: Bhanu, B., Ravishankar, C., Roy-Chowdhury, A., Aghajan, H., Terzopoulos, D. (eds.) Distributed Video Sensor Networks. Springer, London (2011). https://​doi.​org/​10.​1007/​978-0-85729-127-1_​24
26.
Zurück zum Zitat Knapitsch, A., Park, J., Zhou, Q.-Y., Koltun, V.: Tanks and temples: benchmarking large-scale scene reconstruction. ACM Trans. Graph. 36(4), 1–3 (2017)CrossRef Knapitsch, A., Park, J., Zhou, Q.-Y., Koltun, V.: Tanks and temples: benchmarking large-scale scene reconstruction. ACM Trans. Graph. 36(4), 1–3 (2017)CrossRef
Metadaten
Titel
City-Scale Point Cloud Stitching Using 2D/3D Registration for Large Geographical Coverage
verfasst von
Shizeng Yao
Hadi AliAkbarpour
Guna Seetharaman
Kannappan Palaniappan
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-68793-9_3