Skip to main content
Top

2017 | OriginalPaper | Chapter

Towards Visual Human Tracking of Quadcopter: A Survey

Authors : Ling Chen, Xinxing Pan, Aolei Yang, Yulin Xu

Published in: Advanced Computational Methods in Life System Modeling and Simulation

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In recent years, visual human tracking of quadcopter has become a topic of interest to many research institutions. To overview the recent research status of visual human tracking based on quadcopter, firstly, the problem of human tracking is divided into quadcopter control and vision based human tracking which are discussed separately. The present controlling means and the latest applications of quadcopter are summarized systematically. The advantages and disadvantages of each human tracking method are compared and the tracking strategies are summarized. Then, the difficult issues on visual human tracking are discussed specifically. Finally, the future research directions of visual human tracking based on quadcopter are prospected by summarizing related literatures.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Beard, R.W., Kingston, D., Quigley, M., Snyder, D., Christiansen, R., Johnson, W., Goodrich, M.: Autonomous vehicle technologies for small fixed-wing UAVs. J. Aerosp. Comput. Inf. Commun. 2(1), 92–108 (2005)CrossRef Beard, R.W., Kingston, D., Quigley, M., Snyder, D., Christiansen, R., Johnson, W., Goodrich, M.: Autonomous vehicle technologies for small fixed-wing UAVs. J. Aerosp. Comput. Inf. Commun. 2(1), 92–108 (2005)CrossRef
2.
go back to reference Goossen, E.: U.S. Patent No. 8,328,130. U.S. Patent and Trademark Office, Washington, DC (2012) Goossen, E.: U.S. Patent No. 8,328,130. U.S. Patent and Trademark Office, Washington, DC (2012)
3.
go back to reference Johnson, E., Kannan, S.: Adaptive flight control for an autonomous unmanned helicopter. In: AIAA Guidance, Navigation, and Control Conference and Exhibit, p. 4439, August 2002 Johnson, E., Kannan, S.: Adaptive flight control for an autonomous unmanned helicopter. In: AIAA Guidance, Navigation, and Control Conference and Exhibit, p. 4439, August 2002
4.
go back to reference Sámano, A., Castro, R., Lozano, R., Salazar, S.: Modeling and stabilization of a multi-rotor helicopter. J. Intell. Robot. Syst. 69, 161–169 (2013)CrossRef Sámano, A., Castro, R., Lozano, R., Salazar, S.: Modeling and stabilization of a multi-rotor helicopter. J. Intell. Robot. Syst. 69, 161–169 (2013)CrossRef
5.
go back to reference Luukkonen, T.: Modelling and control of quadcopter. Independent Research Project in Applied Mathematics, Espoo (2011) Luukkonen, T.: Modelling and control of quadcopter. Independent Research Project in Applied Mathematics, Espoo (2011)
6.
go back to reference Mellinger, D., Michael, N., Kumar, V.: Trajectory generation and control for precise aggressive maneuvers with quadrotors. Int. J. Robot. Res. 31(5), 664–674 (2012)CrossRef Mellinger, D., Michael, N., Kumar, V.: Trajectory generation and control for precise aggressive maneuvers with quadrotors. Int. J. Robot. Res. 31(5), 664–674 (2012)CrossRef
7.
go back to reference Sminchisescu, C., Triggs, B.: Kinematic jump processes for monocular 3D human tracking. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, p. I. IEEE, June 2003 Sminchisescu, C., Triggs, B.: Kinematic jump processes for monocular 3D human tracking. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, p. I. IEEE, June 2003
8.
go back to reference Zhou, J., Hoang, J.: Real time robust human detection and tracking system. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, CVPR Workshops, p. 149. IEEE, June 2005 Zhou, J., Hoang, J.: Real time robust human detection and tracking system. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, CVPR Workshops, p. 149. IEEE, June 2005
9.
go back to reference Khan, S., Javed, O., Rasheed, Z., Shah, M: Human tracking in multiple cameras. In: Proceedings of the Eighth IEEE International Conference on Computer Vision, ICCV, vol. 1, pp. 331–336. IEEE (2001) Khan, S., Javed, O., Rasheed, Z., Shah, M: Human tracking in multiple cameras. In: Proceedings of the Eighth IEEE International Conference on Computer Vision, ICCV, vol. 1, pp. 331–336. IEEE (2001)
10.
go back to reference Zhang, D., Xia, F., Yang, Z., Yao, L., Zhao, W.: Localization technologies for indoor human tracking. In: 5th International Conference on Future Information Technology (FutureTech), pp. 1–6. IEEE, May 2010 Zhang, D., Xia, F., Yang, Z., Yao, L., Zhao, W.: Localization technologies for indoor human tracking. In: 5th International Conference on Future Information Technology (FutureTech), pp. 1–6. IEEE, May 2010
11.
go back to reference Ji, S., Xu, W., Yang, M., Yu, K.: 3D convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 221–231 (2013)CrossRef Ji, S., Xu, W., Yang, M., Yu, K.: 3D convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 221–231 (2013)CrossRef
12.
go back to reference Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2411–2418 (2013) Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2411–2418 (2013)
13.
go back to reference Glas, D.F., Miyashita, T., Ishiguro, H., Hagita, N.: Laser tracking of human body motion using adaptive shape modeling. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, pp. 602–608. IEEE, October 2007 Glas, D.F., Miyashita, T., Ishiguro, H., Hagita, N.: Laser tracking of human body motion using adaptive shape modeling. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, pp. 602–608. IEEE, October 2007
14.
go back to reference Bristeau, P.J., Callou, F., Vissiere, D., Petit, N.: The navigation and control technology inside the AR. drone micro UAV. IFAC Proc. Vol. 44(1), 1477–1484 (2011)CrossRef Bristeau, P.J., Callou, F., Vissiere, D., Petit, N.: The navigation and control technology inside the AR. drone micro UAV. IFAC Proc. Vol. 44(1), 1477–1484 (2011)CrossRef
15.
go back to reference Krajník, T., Vonásek, V., Fišer, D., Faigl, J.: AR-drone as a platform for robotic research and education. In: Obdržálek, D., Gottscheber, A. (eds.) EUROBOT 2011. CCIS, vol. 161, pp. 172–186. Springer, Heidelberg (2011). doi:10.1007/978-3-642-21975-7_16 CrossRef Krajník, T., Vonásek, V., Fišer, D., Faigl, J.: AR-drone as a platform for robotic research and education. In: Obdržálek, D., Gottscheber, A. (eds.) EUROBOT 2011. CCIS, vol. 161, pp. 172–186. Springer, Heidelberg (2011). doi:10.​1007/​978-3-642-21975-7_​16 CrossRef
16.
go back to reference Bills, C., Chen, J., Saxena, A.: Autonomous MAV flight in indoor environments using single image perspective cues. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 5776–5783. IEEE, May 2011 Bills, C., Chen, J., Saxena, A.: Autonomous MAV flight in indoor environments using single image perspective cues. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 5776–5783. IEEE, May 2011
17.
go back to reference Engel, J., Sturm, J., Cremers, D.: Camera-based navigation of a low-cost quadrocopter. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2815–2821. IEEE, October 2012 Engel, J., Sturm, J., Cremers, D.: Camera-based navigation of a low-cost quadrocopter. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2815–2821. IEEE, October 2012
18.
go back to reference Ross, S., Melik-Barkhudarov, N., Shankar, K.S., Wendel, A., Dey, D., Bagnell, J.A., Hebert, M.: Learning monocular reactive uav control in cluttered natural environments. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1765–1772. IEEE, May 2013 Ross, S., Melik-Barkhudarov, N., Shankar, K.S., Wendel, A., Dey, D., Bagnell, J.A., Hebert, M.: Learning monocular reactive uav control in cluttered natural environments. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1765–1772. IEEE, May 2013
19.
go back to reference Pestana, J., Sanchez-Lopez, J.L., Saripalli, S., Campoy, P.: Computer vision based general object following for gps-denied multirotor unmanned vehicles. In: American Control Conference (ACC), pp. 1886–1891. IEEE, June 2014 Pestana, J., Sanchez-Lopez, J.L., Saripalli, S., Campoy, P.: Computer vision based general object following for gps-denied multirotor unmanned vehicles. In: American Control Conference (ACC), pp. 1886–1891. IEEE, June 2014
20.
go back to reference Horie, D.: U.S. Patent Application No. 10/413,662. (2003) Horie, D.: U.S. Patent Application No. 10/413,662. (2003)
21.
go back to reference Zhan, C., Duan, X., Xu, S., Song, Z., Luo, M.: An improved moving object detection algorithm based on frame difference and edge detection. In: Fourth International Conference on Image and Graphics, ICIG 2007, pp. 519–523. IEEE, August 2007 Zhan, C., Duan, X., Xu, S., Song, Z., Luo, M.: An improved moving object detection algorithm based on frame difference and edge detection. In: Fourth International Conference on Image and Graphics, ICIG 2007, pp. 519–523. IEEE, August 2007
22.
go back to reference Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. (CSUR) 38(4), 13 (2006)CrossRef Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. (CSUR) 38(4), 13 (2006)CrossRef
23.
go back to reference Chen, L., Wei, H., Ferryman, J.: A survey of human motion analysis using depth imagery. Pattern Recogn. Lett. 34(15), 1995–2006 (2013)CrossRef Chen, L., Wei, H., Ferryman, J.: A survey of human motion analysis using depth imagery. Pattern Recogn. Lett. 34(15), 1995–2006 (2013)CrossRef
24.
go back to reference Lao, W., Han, J., De With, P.H.: Automatic video-based human motion analyzer for consumer surveillance system. IEEE Trans. Consum. Electron. 55(2) (2009) Lao, W., Han, J., De With, P.H.: Automatic video-based human motion analyzer for consumer surveillance system. IEEE Trans. Consum. Electron. 55(2) (2009)
25.
go back to reference Ganapathi, V., Plagemann, C., Koller, D., Thrun, S.: Real time motion capture using a single time-of-flight camera. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 755–762. IEEE, June 2010 Ganapathi, V., Plagemann, C., Koller, D., Thrun, S.: Real time motion capture using a single time-of-flight camera. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 755–762. IEEE, June 2010
26.
go back to reference Ji, X., Liu, H.: Advances in view-invariant human motion analysis: a review. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 40(1), 13–24 (2010) Ji, X., Liu, H.: Advances in view-invariant human motion analysis: a review. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 40(1), 13–24 (2010)
27.
go back to reference Hasler, N., Rosenhahn, B., Thormahlen, T., Wand, M., Gall, J., Seidel, H.P.: Markerless motion capture with unsynchronized moving cameras. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 224–231. IEEE, June 2009 Hasler, N., Rosenhahn, B., Thormahlen, T., Wand, M., Gall, J., Seidel, H.P.: Markerless motion capture with unsynchronized moving cameras. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 224–231. IEEE, June 2009
28.
go back to reference Junior, J.C.S.J., Musse, S.R., Jung, C.R.: Crowd analysis using computer vision techniques. IEEE Sig. Process. Mag. 27(5), 66–77 (2010) Junior, J.C.S.J., Musse, S.R., Jung, C.R.: Crowd analysis using computer vision techniques. IEEE Sig. Process. Mag. 27(5), 66–77 (2010)
29.
go back to reference Moeslund, T.B., Hilton, A., Krüger, V.: A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 104(2), 90–126 (2006)CrossRef Moeslund, T.B., Hilton, A., Krüger, V.: A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 104(2), 90–126 (2006)CrossRef
30.
go back to reference Moeslund, T.B., Granum, E.: A survey of computer vision-based human motion capture. Comput. Vis. Image Underst. 81(3), 231–268 (2001)CrossRefMATH Moeslund, T.B., Granum, E.: A survey of computer vision-based human motion capture. Comput. Vis. Image Underst. 81(3), 231–268 (2001)CrossRefMATH
31.
go back to reference Hager, G.D., Belhumeur, P.N.: Efficient region tracking with parametric models of geometry and illumination. IEEE Trans. Pattern Anal. Mach. Intell. 20(10), 1025–1039 (1998)CrossRef Hager, G.D., Belhumeur, P.N.: Efficient region tracking with parametric models of geometry and illumination. IEEE Trans. Pattern Anal. Mach. Intell. 20(10), 1025–1039 (1998)CrossRef
32.
go back to reference Brox, T., Rosenhahn, B., Gall, J., Cremers, D.: Combined region and motion-based 3D tracking of rigid and articulated objects. IEEE Trans. Pattern Anal. Mach. Intell. 32(3), 402–415 (2010)CrossRef Brox, T., Rosenhahn, B., Gall, J., Cremers, D.: Combined region and motion-based 3D tracking of rigid and articulated objects. IEEE Trans. Pattern Anal. Mach. Intell. 32(3), 402–415 (2010)CrossRef
33.
go back to reference Theobalt, C., Magnor, M.A., Schüler, P., Seidel, H.P.: Combining 2D feature tracking and volume reconstruction for online video-based human motion capture. Int. J. Image Graph. 4(04), 563–583 (2004)CrossRef Theobalt, C., Magnor, M.A., Schüler, P., Seidel, H.P.: Combining 2D feature tracking and volume reconstruction for online video-based human motion capture. Int. J. Image Graph. 4(04), 563–583 (2004)CrossRef
34.
go back to reference Yilmaz, A., Li, X., Shah, M.: Contour-based object tracking with occlusion handling in video acquired using mobile cameras. IEEE Trans. Pattern Anal. Mach. Intell. 26(11), 1531–1536 (2004)CrossRef Yilmaz, A., Li, X., Shah, M.: Contour-based object tracking with occlusion handling in video acquired using mobile cameras. IEEE Trans. Pattern Anal. Mach. Intell. 26(11), 1531–1536 (2004)CrossRef
35.
go back to reference Fan, J., Xu, W., Wu, Y., Gong, Y.: Human tracking using convolutional neural networks. IEEE Trans. Neural Networks 21(10), 1610–1623 (2010)CrossRef Fan, J., Xu, W., Wu, Y., Gong, Y.: Human tracking using convolutional neural networks. IEEE Trans. Neural Networks 21(10), 1610–1623 (2010)CrossRef
36.
go back to reference Cao, Z., Simon, T., Wei, S.E., Sheikh, Y.: Realtime multi-person 2D pose estimation using part affinity fields. arXiv preprint arXiv:1611.08050 (2016) Cao, Z., Simon, T., Wei, S.E., Sheikh, Y.: Realtime multi-person 2D pose estimation using part affinity fields. arXiv preprint arXiv:​1611.​08050 (2016)
Metadata
Title
Towards Visual Human Tracking of Quadcopter: A Survey
Authors
Ling Chen
Xinxing Pan
Aolei Yang
Yulin Xu
Copyright Year
2017
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-6370-1_59

Premium Partner