Skip to main content

2021 | OriginalPaper | Buchkapitel

Modeling and Simulation Framework for Airborne Camera Systems

verfasst von : Marc-Antoine Drouin, Jonathan Fournier, Jonathan Boisvert, Louis Borgeat

Erschienen in: Pattern Recognition. ICPR International Workshops and Challenges

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Full Motion Video (FMV) and Wide Area Motion Imagery (WAMI) systems have been used extensively in the recent years to collect overhead imagery to produce value-added geospatial products. In order to better understand the limitations of these systems and to define the best flight conditions under which they can be operated, an integrated modeling and simulation (M&S) framework named Sensair was developed. This paper presents how this tool can be leveraged to simulate data collections with airborne camera systems using different parameters under varied conditions. Sensair can simulate realistic large-scale environments with moving vehicles and generate representative FMV and WAMI high-resolution imagery. The built-in interactive analysis tools enable the study of the different factors impacting the application of computer vision algorithms to aerial images. This paper presents Sensair’s M&S capabilities and describes use cases where the framework is used to perform tasks that include 3D reconstruction and the generation of an image dataset to support the evaluation of vehicle detection approaches.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abdelli, A., Choi, H.J.: A four-frames differencing technique for moving objects detection in wide area surveillance. In: 2017 IEEE International Conference on Big Data and Smart Computing (BigComp), pp. 210–214. IEEE (2017) Abdelli, A., Choi, H.J.: A four-frames differencing technique for moving objects detection in wide area surveillance. In: 2017 IEEE International Conference on Big Data and Smart Computing (BigComp), pp. 210–214. IEEE (2017)
2.
Zurück zum Zitat AlSaadi, A.H., Swamidoss, I., Almarzooqi, A., Sayadi, S.: Analysis of different background subtraction methods applied on drone imagery under various weather conditions in the UAE region. In: Dijk, J. (ed.) Artificial Intelligence and Machine Learning in Defense Applications, vol. 11169, pp. 181–193. International Society for Optics and Photonics, SPIE (2019) AlSaadi, A.H., Swamidoss, I., Almarzooqi, A., Sayadi, S.: Analysis of different background subtraction methods applied on drone imagery under various weather conditions in the UAE region. In: Dijk, J. (ed.) Artificial Intelligence and Machine Learning in Defense Applications, vol. 11169, pp. 181–193. International Society for Optics and Photonics, SPIE (2019)
3.
Zurück zum Zitat Borgeat, L., Godin, G., Blais, F., Massicotte, P., Lahanier, C.: Gold: interactive display of huge colored and textured models. In: ACM SIGGRAPH 2005 Papers, SIGGRAPH 2005, pp. 869–877. ACM, New York (2005) Borgeat, L., Godin, G., Blais, F., Massicotte, P., Lahanier, C.: Gold: interactive display of huge colored and textured models. In: ACM SIGGRAPH 2005 Papers, SIGGRAPH 2005, pp. 869–877. ACM, New York (2005)
4.
Zurück zum Zitat Carrivick, J.L., Smith, M.W., Quincey, D.J.: Structure from Motion in the Geosciences. Wiley, Hoboken (2016)CrossRef Carrivick, J.L., Smith, M.W., Quincey, D.J.: Structure from Motion in the Geosciences. Wiley, Hoboken (2016)CrossRef
5.
Zurück zum Zitat Chen, L., Liu, F., Zhao, Y., Wang, W., Yuan, X., Zhu, J.: VALID: a comprehensive virtual aerial image dataset. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 2009–2016. IEEE (2020) Chen, L., Liu, F., Zhao, Y., Wang, W., Yuan, X., Zhu, J.: VALID: a comprehensive virtual aerial image dataset. In: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 2009–2016. IEEE (2020)
6.
Zurück zum Zitat Cheng, B.T.: A simulation of wide area surveillance (WAS) systems and algorithm for digital elevation model (DEM) extraction. In: SPIE, vol. 7668, p. 76680A (2010) Cheng, B.T.: A simulation of wide area surveillance (WAS) systems and algorithm for digital elevation model (DEM) extraction. In: SPIE, vol. 7668, p. 76680A (2010)
7.
Zurück zum Zitat Degol, J., Lee, J.Y., Kataria, R., Yuan, D., Bretl, T., Hoiem, D.: FEATS: synthetic feature tracks for structure from motion evaluation. In: 2018 International Conference on 3D Vision (3DV), pp. 352–361. IEEE (2018) Degol, J., Lee, J.Y., Kataria, R., Yuan, D., Bretl, T., Hoiem, D.: FEATS: synthetic feature tracks for structure from motion evaluation. In: 2018 International Conference on 3D Vision (3DV), pp. 352–361. IEEE (2018)
8.
Zurück zum Zitat Drouin, M.A., Beraldin, J.A., Cournoyer, L., MacKinnon, D., Godin, G., Fournier, J.: A methodology for creating large scale reference models with known uncertainty for evaluating imaging solution. In: Proceedings of the 2014 Second International Conference on 3D Vision-Volume 02, pp. 137–144. IEEE Computer Society (2014) Drouin, M.A., Beraldin, J.A., Cournoyer, L., MacKinnon, D., Godin, G., Fournier, J.: A methodology for creating large scale reference models with known uncertainty for evaluating imaging solution. In: Proceedings of the 2014 Second International Conference on 3D Vision-Volume 02, pp. 137–144. IEEE Computer Society (2014)
9.
Zurück zum Zitat Fournier, J., Drouin, M.A., Borgeat, L., Boisvert, J.: Image-based modeling from images collected with an airborne EO/IR sensor platform. In: NATO STO-MP-SET-241, pp. 12A–3. NATO (2017) Fournier, J., Drouin, M.A., Borgeat, L., Boisvert, J.: Image-based modeling from images collected with an airborne EO/IR sensor platform. In: NATO STO-MP-SET-241, pp. 12A–3. NATO (2017)
10.
Zurück zum Zitat Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Towards internet-scale multi-view stereo. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1434–1441. IEEE (2010) Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Towards internet-scale multi-view stereo. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1434–1441. IEEE (2010)
11.
Zurück zum Zitat Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32(8), 1362–1376 (2010)CrossRef Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32(8), 1362–1376 (2010)CrossRef
12.
Zurück zum Zitat Griffith, E.J., Mishra, C., Ralph, J.F., Maskell, S.: A system for the generation of synthetic wide area aerial surveillance imagery. Simul. Model. Pract. Theory 84, 286–308 (2018)CrossRef Griffith, E.J., Mishra, C., Ralph, J.F., Maskell, S.: A system for the generation of synthetic wide area aerial surveillance imagery. Simul. Model. Pract. Theory 84, 286–308 (2018)CrossRef
13.
Zurück zum Zitat Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2003)MATH Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2003)MATH
14.
Zurück zum Zitat Iglhaut, J., Cabo, C., Puliti, S., Piermattei, L., O’Connor, J., Rosette, J.: Structure from motion photogrammetry in forestry: a review. Curr. For. Rep. 5(3), 155–168 (2019) Iglhaut, J., Cabo, C., Puliti, S., Piermattei, L., O’Connor, J., Rosette, J.: Structure from motion photogrammetry in forestry: a review. Curr. For. Rep. 5(3), 155–168 (2019)
15.
Zurück zum Zitat James, M.R., Robson, S., Smith, M.W.: 3-D uncertainty-based topographic change detection with structure-from-motion photogrammetry: precision maps for ground control and directly georeferenced surveys. Earth Surf. Process. Land. 42(12), 1769–1788 (2017)CrossRef James, M.R., Robson, S., Smith, M.W.: 3-D uncertainty-based topographic change detection with structure-from-motion photogrammetry: precision maps for ground control and directly georeferenced surveys. Earth Surf. Process. Land. 42(12), 1769–1788 (2017)CrossRef
16.
Zurück zum Zitat Jurevičius, R., Marcinkevičius, V.: A data set of aerial imagery from robotics simulator for map-based localization systems benchmark. Int. J. Intell. Unmanned Syst. 8, 177–186 (2019)CrossRef Jurevičius, R., Marcinkevičius, V.: A data set of aerial imagery from robotics simulator for map-based localization systems benchmark. Int. J. Intell. Unmanned Syst. 8, 177–186 (2019)CrossRef
17.
Zurück zum Zitat Lindner, S.: Optimization based coverage path planning for autonomous 3D data acquisition. Ph.D. thesis, Heidelberg University (2020) Lindner, S.: Optimization based coverage path planning for autonomous 3D data acquisition. Ph.D. thesis, Heidelberg University (2020)
18.
Zurück zum Zitat Lopez, P.A., et al.: Microscopic traffic simulation using SUMO. In: The 21st IEEE International Conference on Intelligent Transportation Systems. IEEE (2018) Lopez, P.A., et al.: Microscopic traffic simulation using SUMO. In: The 21st IEEE International Conference on Intelligent Transportation Systems. IEEE (2018)
20.
Zurück zum Zitat Quigley, M., et al.: ROS: an open-source robot operating system. In: ICRA Workshop on Open Source Software, Kobe, Japan, p. 5, no. 3.2 in 3 (2009) Quigley, M., et al.: ROS: an open-source robot operating system. In: ICRA Workshop on Open Source Software, Kobe, Japan, p. 5, no. 3.2 in 3 (2009)
21.
Zurück zum Zitat Robinson, G., Zhang, D.: Object detection in wide area aerial surveillance imagery with deep convolutional networks. In: Research Experience for Undergraduates in Computer Vision 2016 (2019) Robinson, G., Zhang, D.: Object detection in wide area aerial surveillance imagery with deep convolutional networks. In: Research Experience for Undergraduates in Computer Vision 2016 (2019)
23.
Zurück zum Zitat Slocum, R.K., Parrish, C.E.: Simulated imagery rendering workflow for UAS-based photogrammetric 3D reconstruction accuracy assessments. Remote Sens. 9(4), 396 (2017)CrossRef Slocum, R.K., Parrish, C.E.: Simulated imagery rendering workflow for UAS-based photogrammetric 3D reconstruction accuracy assessments. Remote Sens. 9(4), 396 (2017)CrossRef
24.
Zurück zum Zitat Smith, M., Carrivick, J., Quincey, D.: Structure from motion photogrammetry in physical geography. Prog. Phys. Geogr. 40(2), 247–275 (2016)CrossRef Smith, M., Carrivick, J., Quincey, D.: Structure from motion photogrammetry in physical geography. Prog. Phys. Geogr. 40(2), 247–275 (2016)CrossRef
25.
Zurück zum Zitat Sommer, L.W., Teutsch, M., Schuchert, T., Beyerer, J.: A survey on moving object detection for wide area motion imagery. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) (2016) Sommer, L.W., Teutsch, M., Schuchert, T., Beyerer, J.: A survey on moving object detection for wide area motion imagery. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) (2016)
26.
Zurück zum Zitat Sommer, L.: Systematic evaluation of moving object detection methods for wide area motion imagery. In: Proceedings of the 2015 Joint Workshop of Fraunhofer IOSB and Institute for Anthropomatics, Vision and Fusion Laboratory, p. 153 (2016) Sommer, L.: Systematic evaluation of moving object detection methods for wide area motion imagery. In: Proceedings of the 2015 Joint Workshop of Fraunhofer IOSB and Institute for Anthropomatics, Vision and Fusion Laboratory, p. 153 (2016)
27.
Zurück zum Zitat Vella, E., Azim, A., Gaetjens, H.X., Repasky, B., Payne, T.: Improved detection for WAMI using background contextual information. In: 2019 Digital Image Computing: Techniques and Applications (DICTA), pp. 1–9. IEEE (2019) Vella, E., Azim, A., Gaetjens, H.X., Repasky, B., Payne, T.: Improved detection for WAMI using background contextual information. In: 2019 Digital Image Computing: Techniques and Applications (DICTA), pp. 1–9. IEEE (2019)
28.
Zurück zum Zitat Wu, C.: Towards linear-time incremental structure from motion. In: 2013 International Conference on 3D Vision-3DV 2013, pp. 127–134. IEEE (2013) Wu, C.: Towards linear-time incremental structure from motion. In: 2013 International Conference on 3D Vision-3DV 2013, pp. 127–134. IEEE (2013)
Metadaten
Titel
Modeling and Simulation Framework for Airborne Camera Systems
verfasst von
Marc-Antoine Drouin
Jonathan Fournier
Jonathan Boisvert
Louis Borgeat
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-68793-9_5