Skip to main content
Top

2016 | OriginalPaper | Chapter

Change Detection and Object Recognition Using Aerial Robots

Authors : Shehryar Khattak, Christos Papachristos, Kostas Alexis

Published in: Advances in Visual Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This work proposes a strategy for autonomous change detection and classification using aerial robots. For aerial robotic missions that were conducted in different spatio–temporal conditions, the pose–annotated camera data are first compared for similarity in order to identify the correspondence map among the different image sets. Then efficient feature matching techniques relying on binary descriptors are used to estimate the geometric transformations among the corresponding images, and subsequently perform image subtraction and filtering to robustly detect change. To further decrease the computational load, the known poses of the images are used to create local subsets within which similar images are expected to be found. Once change detection is accomplished, a small set of the images that present the maximum levels of change are used to classify the change by searching to recognize a list of known objects through a bag–of–features approach. The proposed algorithm is evaluated using both handheld–smartphone collected data, as well as experiments using an aerial robot.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Alexis, K., Papachristos, C., Siegwart, R., Tzes, A.: Robust explicit model predictive flight control of unmanned rotorcrafts: design and experimental evaluation. In: 2014 European Control Conference (ECC), pp. 498–503 (2014) Alexis, K., Papachristos, C., Siegwart, R., Tzes, A.: Robust explicit model predictive flight control of unmanned rotorcrafts: design and experimental evaluation. In: 2014 European Control Conference (ECC), pp. 498–503 (2014)
2.
go back to reference Papachristos, C., Alexis, K., Tzes, A.: Dual authority thrust vectoring of a tri-tiltrotor employing model predictive control. J. Intell. Rob. Syst. 81, 1–34 (2015) Papachristos, C., Alexis, K., Tzes, A.: Dual authority thrust vectoring of a tri-tiltrotor employing model predictive control. J. Intell. Rob. Syst. 81, 1–34 (2015)
3.
go back to reference Papachristos, C., Alexis, K., Carrillo, L.R.G., Tzes, A.: Distributed infrastructure inspection path planning for aerial robotics subject to time constraints. In: 2016 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 406–412. IEEE (2016) Papachristos, C., Alexis, K., Carrillo, L.R.G., Tzes, A.: Distributed infrastructure inspection path planning for aerial robotics subject to time constraints. In: 2016 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 406–412. IEEE (2016)
4.
go back to reference Bircher, A., Kamel, M., Alexis, K., Oleynikova, H., Siegwart, R.: Receding horizon “next-best-view” planner for 3d exploration. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 1462–1468 (2016) Bircher, A., Kamel, M., Alexis, K., Oleynikova, H., Siegwart, R.: Receding horizon “next-best-view” planner for 3d exploration. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 1462–1468 (2016)
5.
go back to reference Bircher, A., Kamel, M., Alexis, K., Burri, M., Oettershagen, P., Omari, S., Mantel, T., Siegwart, R.: Three-dimensional coverage path planning via viewpoint resampling and tour optimization for aerial robots. Auton. Rob., 1–25 (2015) Bircher, A., Kamel, M., Alexis, K., Burri, M., Oettershagen, P., Omari, S., Mantel, T., Siegwart, R.: Three-dimensional coverage path planning via viewpoint resampling and tour optimization for aerial robots. Auton. Rob., 1–25 (2015)
6.
go back to reference Alexis, K., Papachristos, C., Siegwart, R., Tzes, A.: Uniform coverage structural inspection path-planning for micro aerial vehicles (2015) Alexis, K., Papachristos, C., Siegwart, R., Tzes, A.: Uniform coverage structural inspection path-planning for micro aerial vehicles (2015)
7.
go back to reference Bircher, A., Alexis, K., Schwesinger, U., Omari, S., Burri, M., Siegwart, R.: An incremental sampling-based approach to inspection planning: the rapidly-exploring random tree of trees (2015) Bircher, A., Alexis, K., Schwesinger, U., Omari, S., Burri, M., Siegwart, R.: An incremental sampling-based approach to inspection planning: the rapidly-exploring random tree of trees (2015)
8.
go back to reference Oettershagen, P., Stastny, T., Mantel, T., Melzer, A., Rudin, K., Gohl, P., Agamennoni, G., Alexis, K., Siegwart, R.: Long-endurance sensing and mapping using a hand-launchable solar-powered UAV. In: Wettergreen, D.S., Barfoot, T.D. (eds.) Field and Service Robotics. STAR, vol. 113, pp. 441–454. Springer, Heidelberg (2016). doi:10.1007/978-3-319-27702-8_29 CrossRef Oettershagen, P., Stastny, T., Mantel, T., Melzer, A., Rudin, K., Gohl, P., Agamennoni, G., Alexis, K., Siegwart, R.: Long-endurance sensing and mapping using a hand-launchable solar-powered UAV. In: Wettergreen, D.S., Barfoot, T.D. (eds.) Field and Service Robotics. STAR, vol. 113, pp. 441–454. Springer, Heidelberg (2016). doi:10.​1007/​978-3-319-27702-8_​29 CrossRef
9.
go back to reference Minu, S., Shetty, A.: A comparative study of image change detection algorithms in matlab. Aquatic Proc. 4, 1366–1373 (2015)CrossRef Minu, S., Shetty, A.: A comparative study of image change detection algorithms in matlab. Aquatic Proc. 4, 1366–1373 (2015)CrossRef
10.
go back to reference Fisher, R.: Change detection in color images. In: Proceedings of 7th IEEE Conference on Computer Vision and Pattern. Citeseer (1999) Fisher, R.: Change detection in color images. In: Proceedings of 7th IEEE Conference on Computer Vision and Pattern. Citeseer (1999)
11.
go back to reference Lu, D., Mausel, P., Brondizio, E., Moran, E.: Change detection techniques. Int. J. Remote Sens. 25, 2365–2401 (2004)CrossRef Lu, D., Mausel, P., Brondizio, E., Moran, E.: Change detection techniques. Int. J. Remote Sens. 25, 2365–2401 (2004)CrossRef
12.
go back to reference Coulter, L., Lippitt, C., Stow, D., McCreight, R.: Near real-time change detection for border monitoring. In: Proceedings from the ASPRS Annual Conference, pp. 1–5 (2011) Coulter, L., Lippitt, C., Stow, D., McCreight, R.: Near real-time change detection for border monitoring. In: Proceedings from the ASPRS Annual Conference, pp. 1–5 (2011)
13.
go back to reference Singh, A.: Review article digital change detection techniques using remotely-sensed data. Int. J. Remote Sens. 10, 989–1003 (1989)CrossRef Singh, A.: Review article digital change detection techniques using remotely-sensed data. Int. J. Remote Sens. 10, 989–1003 (1989)CrossRef
14.
go back to reference Aach, T., Kaup, A., Mester, R.: Statistical model-based change detection in moving video. Sig. Process. 31, 165–180 (1993)CrossRefMATH Aach, T., Kaup, A., Mester, R.: Statistical model-based change detection in moving video. Sig. Process. 31, 165–180 (1993)CrossRefMATH
15.
go back to reference Radke, R.J., Andra, S., Al-Kofahi, O., Roysam, B.: Image change detection algorithms: a systematic survey. IEEE Trans. Image Process. 14, 294–307 (2005)MathSciNetCrossRef Radke, R.J., Andra, S., Al-Kofahi, O., Roysam, B.: Image change detection algorithms: a systematic survey. IEEE Trans. Image Process. 14, 294–307 (2005)MathSciNetCrossRef
16.
go back to reference Lucieer, A., de Jong, S., Turner, D.: Mapping landslide displacements using structure from motion (SFM) and image correlation of multi-temporal UAV photography. Prog. Phys. Geogr. 38, 97–116 (2013). doi:10.1177/0309133313515293 CrossRef Lucieer, A., de Jong, S., Turner, D.: Mapping landslide displacements using structure from motion (SFM) and image correlation of multi-temporal UAV photography. Prog. Phys. Geogr. 38, 97–116 (2013). doi:10.​1177/​0309133313515293​ CrossRef
17.
go back to reference Wallace, L., Lucieer, A., Watson, C.: Assessing the feasibility of UAV-based lidar for high resolution forest change detection. Proc. ISPRS, Int. Archives Photogramm., Remote Sens. Spat. Inf. Sci. 38, B7 (2012) Wallace, L., Lucieer, A., Watson, C.: Assessing the feasibility of UAV-based lidar for high resolution forest change detection. Proc. ISPRS, Int. Archives Photogramm., Remote Sens. Spat. Inf. Sci. 38, B7 (2012)
18.
go back to reference Xiao, W., Vallet, B., Paparoditis, N.: Change detection in 3D point clouds acquired by a mobile mapping system. ISPRS Ann. Photogramm., Remote Sens. Spat. Inf. Sci. 1, 331–336 (2013)CrossRef Xiao, W., Vallet, B., Paparoditis, N.: Change detection in 3D point clouds acquired by a mobile mapping system. ISPRS Ann. Photogramm., Remote Sens. Spat. Inf. Sci. 1, 331–336 (2013)CrossRef
19.
go back to reference Xiao, W.: Detecting changes in trees using multi-temporal airborne LiDAR point clouds. PhD thesis, Masters Thesis, University of Twente, Enschede, The Netherlands (2012) Xiao, W.: Detecting changes in trees using multi-temporal airborne LiDAR point clouds. PhD thesis, Masters Thesis, University of Twente, Enschede, The Netherlands (2012)
20.
go back to reference Hussain, M., Chen, D., Cheng, A., Wei, H., Stanley, D.: Change detection from remotely sensed images: from pixel-based to object-based approaches. ISPRS J. Photogramm. Remote Sens. 80, 91–106 (2013)CrossRef Hussain, M., Chen, D., Cheng, A., Wei, H., Stanley, D.: Change detection from remotely sensed images: from pixel-based to object-based approaches. ISPRS J. Photogramm. Remote Sens. 80, 91–106 (2013)CrossRef
21.
go back to reference Chen, G., Hay, G.J., Carvalho, L.M., Wulder, M.A.: Object-based change detection. Int. J. Remote Sens. 33, 4434–4457 (2012)CrossRef Chen, G., Hay, G.J., Carvalho, L.M., Wulder, M.A.: Object-based change detection. Int. J. Remote Sens. 33, 4434–4457 (2012)CrossRef
23.
go back to reference Bloesch, M., Omari, S., Hutter, M., Siegwart, R.: Robust visual inertial odometry using a direct EKF-based approach. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 298–304. IEEE (2015) Bloesch, M., Omari, S., Hutter, M., Siegwart, R.: Robust visual inertial odometry using a direct EKF-based approach. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 298–304. IEEE (2015)
24.
go back to reference Bircher, A., Alexis, K., Burri, M., Oettershagen, P., Omari, S., Mantel, T., Siegwart, R.: Structural inspection path planning via iterative viewpoint resampling with application to aerial robotics. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 6423–6430 (2015) Bircher, A., Alexis, K., Burri, M., Oettershagen, P., Omari, S., Mantel, T., Siegwart, R.: Structural inspection path planning via iterative viewpoint resampling with application to aerial robotics. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 6423–6430 (2015)
Metadata
Title
Change Detection and Object Recognition Using Aerial Robots
Authors
Shehryar Khattak
Christos Papachristos
Kostas Alexis
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-50835-1_52

Premium Partner