Skip to main content

2016 | OriginalPaper | Buchkapitel

Real Time Dense Motion Estimation Using FPGA Based Omnidirectional Video Acquisition Device

verfasst von : Jan Kwiatkowski, Dawid Sobel, Artur Ryt, Mariusz Domżał, Karol Jędrasiak, Aleksander Nawrat

Erschienen in: Innovative Simulation Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

OVAD (Fraś et al. in Vision based systems for UAV applications, Springer International Publishing, pp. 123–136 [1]; Kwiatkowski et al. in Recent advances in electrical engineering and computer science, pp. 58–61 [2]) is a device, which is purposed for multi directional video acquisition. Further development of the device includes hardware implementation of time-absorbing calculations, connected with video stream processing, with utilization of FPGA (Field Programmable Gate Array). The paper presents the results of research on the problem of real time dense optical flow estimation. Furthermore, the described results are connected to the problem of parallel processing and hardware acceleration using FPGA. Proposed solution may be found as useful in many applications, both civilian and military and proves utility of FPGA based solutions in real time video processing.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Fraś, S., Jędrasiak, K., Kwiatkowski, J., Nawrat, A., Sobel, D.: Omnidirectional video acquisition device (OVAD). In: Vision Based Systems for UAV Applications, pp. 123–136. Springer International Publishing (2013) Fraś, S., Jędrasiak, K., Kwiatkowski, J., Nawrat, A., Sobel, D.: Omnidirectional video acquisition device (OVAD). In: Vision Based Systems for UAV Applications, pp. 123–136. Springer International Publishing (2013)
2.
Zurück zum Zitat Kwiatkowski, J., Sobel, D., Jędrasiak, K., Nawrat, A.: FPGA based omnidirectional video acquisition device (OVAD). In: Recent Advances in Electrical Engineering and Computer Science, pp. 58–61 Kwiatkowski, J., Sobel, D., Jędrasiak, K., Nawrat, A.: FPGA based omnidirectional video acquisition device (OVAD). In: Recent Advances in Electrical Engineering and Computer Science, pp. 58–61
3.
Zurück zum Zitat Grzejszczak, T., Mikulski, M., Szkodny, T., Jedrasiak, K.: Gesture based robot control, computer vision and graphics. Lecture Notes in Computer Science, Vol. 7594, pp. 407–413. Springer (2013) Grzejszczak, T., Mikulski, M., Szkodny, T., Jedrasiak, K.: Gesture based robot control, computer vision and graphics. Lecture Notes in Computer Science, Vol. 7594, pp. 407–413. Springer (2013)
4.
Zurück zum Zitat Jedrasiak, K., Nawrat, A.: Image recognition technique for unmanned aerial vehicles, computer vision and graphics. Lecture Notes in Computer Science, Vol. 5337, pp. 391–399. Springer (2009) Jedrasiak, K., Nawrat, A.: Image recognition technique for unmanned aerial vehicles, computer vision and graphics. Lecture Notes in Computer Science, Vol. 5337, pp. 391–399. Springer (2009)
5.
Zurück zum Zitat Nawrat, A., Jedrasiak, K.: SETh system spatio-temporal object tracking using combined color and motion features, In: 9th WSEAS International Conference on Robotics, Control and Manufacturing Technology, Hangzhou, China (2009) Nawrat, A., Jedrasiak, K.: SETh system spatio-temporal object tracking using combined color and motion features, In: 9th WSEAS International Conference on Robotics, Control and Manufacturing Technology, Hangzhou, China (2009)
6.
Zurück zum Zitat Barron, J., Fleet, D., Beauchemin, S.: Performance of optical flow techniques. Int. J. Comput. Vis. 12(1), 43–77 (1994) Barron, J., Fleet, D., Beauchemin, S.: Performance of optical flow techniques. Int. J. Comput. Vis. 12(1), 43–77 (1994)
7.
Zurück zum Zitat Jedrasiak, K., Nawrat, A., Daniec, K., Koteras, R., Mikulski, M., Grzejszczak, T.: A Prototype device for concealed weapon detection using IR and CMOS cameras fast image fusion, computer vision and graphics. Lecture Notes in Computer Science, Vol. 7594, pp. 423–432. Springer (2013) Jedrasiak, K., Nawrat, A., Daniec, K., Koteras, R., Mikulski, M., Grzejszczak, T.: A Prototype device for concealed weapon detection using IR and CMOS cameras fast image fusion, computer vision and graphics. Lecture Notes in Computer Science, Vol. 7594, pp. 423–432. Springer (2013)
8.
Zurück zum Zitat Jędrasiak, K., Nawrat, A.: The comparison of capabilities of low light camera, thermal imaging camera and depth map camera for night time surveillance applications. Advanced Technologies for Intelligent Systems of National Border Security, pp. 117–128 (2013) Jędrasiak, K., Nawrat, A.: The comparison of capabilities of low light camera, thermal imaging camera and depth map camera for night time surveillance applications. Advanced Technologies for Intelligent Systems of National Border Security, pp. 117–128 (2013)
9.
Zurück zum Zitat Sobel, D., Jędrasiak, K., Daniec, K., Wrona, J., Jurgaś, P., Nawrat, A.: Camera calibration for tracked vehicles augmented reality applications. In: Innovative Control Systems for Tracked Vehicle Platforms, pp. 147–162 (2014) Sobel, D., Jędrasiak, K., Daniec, K., Wrona, J., Jurgaś, P., Nawrat, A.: Camera calibration for tracked vehicles augmented reality applications. In: Innovative Control Systems for Tracked Vehicle Platforms, pp. 147–162 (2014)
10.
Zurück zum Zitat Kwiatkowski, J., Sobel, D., Jedrasiak, K.: FPGA based omnidirectional video acquisition device (OVAD). In: Recent Advances in Electrical Engineering and Computer Science, pp. 58–61. ISBN: 978-1-61804-249-1, 2014 Kwiatkowski, J., Sobel, D., Jedrasiak, K.: FPGA based omnidirectional video acquisition device (OVAD). In: Recent Advances in Electrical Engineering and Computer Science, pp. 58–61. ISBN: 978-1-61804-249-1, 2014
11.
Zurück zum Zitat Jin, S., Cho, J., Dai Pham, X., Lee, K.M., Park, S.K., Kim, M., Jeon, J.W.: FPGA design and implementation of a realtime stereo vision system. Circ. Syst. Video Technol. IEEE Trans. 20(1), 15–26 (2010)CrossRef Jin, S., Cho, J., Dai Pham, X., Lee, K.M., Park, S.K., Kim, M., Jeon, J.W.: FPGA design and implementation of a realtime stereo vision system. Circ. Syst. Video Technol. IEEE Trans. 20(1), 15–26 (2010)CrossRef
12.
Zurück zum Zitat Díaz, J., Ros, E., Pelayo, F., Ortigosa, E.M., Mota, S.: FPGA-based real-time optical-flow system. Circ. Syst. Video Technol. IEEE Trans. 16(2), 274–279 (2006) Díaz, J., Ros, E., Pelayo, F., Ortigosa, E.M., Mota, S.: FPGA-based real-time optical-flow system. Circ. Syst. Video Technol. IEEE Trans. 16(2), 274–279 (2006)
13.
Zurück zum Zitat Bailey, D.G.: Design for Embedded Image Processing on FPGAs. Wiley, Hoboken (2011) Bailey, D.G.: Design for Embedded Image Processing on FPGAs. Wiley, Hoboken (2011)
14.
Zurück zum Zitat Gałuszka, A., Skrzypczyk, K., Bereska, D., Pacholczyk, M.: Re-handling operations in small container terminal operated by reach stackers. World Acad. Sci. Eng. Technol. 70, 674–677 (2010) Gałuszka, A., Skrzypczyk, K., Bereska, D., Pacholczyk, M.: Re-handling operations in small container terminal operated by reach stackers. World Acad. Sci. Eng. Technol. 70, 674–677 (2010)
15.
Zurück zum Zitat Czapla, T., Wrona, J.: Technology development of military applications of unmanned ground vehicles. In: Vision Based Systems for UAV Applications, Studies in Computational Intelligence, Vol. 481, pp. 293–309. ISBN: 978-3-319-00368-9, 2013 Czapla, T., Wrona, J.: Technology development of military applications of unmanned ground vehicles. In: Vision Based Systems for UAV Applications, Studies in Computational Intelligence, Vol. 481, pp. 293–309. ISBN: 978-3-319-00368-9, 2013
16.
Zurück zum Zitat Johnston, C.T., Gribbon, K.T., Bailey, D.G.: Implementing image processing algorithms on FPGAs. In: Proceedings of the Eleventh Electronics New Zealand Conference, ENZCon’04, pp. 118–123 (2004) Johnston, C.T., Gribbon, K.T., Bailey, D.G.: Implementing image processing algorithms on FPGAs. In: Proceedings of the Eleventh Electronics New Zealand Conference, ENZCon’04, pp. 118–123 (2004)
17.
Zurück zum Zitat Majewski, J., Zbysiński, P.: Układy FPGA w przykładach. BTC (2007) Majewski, J., Zbysiński, P.: Układy FPGA w przykładach. BTC (2007)
22.
Zurück zum Zitat Szeliski, R.: Computer vision: algorithms and applications, Springer (2010) Szeliski, R.: Computer vision: algorithms and applications, Springer (2010)
23.
Zurück zum Zitat McCane, B., Novins, K., Crannitch, D., Galvin, B.: On benchmarking optical flow. Comput. Vis. Image Understand. 84(1), 126–143 (2001) McCane, B., Novins, K., Crannitch, D., Galvin, B.: On benchmarking optical flow. Comput. Vis. Image Understand. 84(1), 126–143 (2001)
28.
Zurück zum Zitat Baker, S., Scharstein, D., Lewis, J.P., Roth, S., Black, M.J., Szeliski, R.: A database and evaluation methodology for optical flow. Int. J. Comput. Vis. 92(1), 1–31 (2011)CrossRef Baker, S., Scharstein, D., Lewis, J.P., Roth, S., Black, M.J., Szeliski, R.: A database and evaluation methodology for optical flow. Int. J. Comput. Vis. 92(1), 1–31 (2011)CrossRef
29.
Zurück zum Zitat Iwaneczko, P., Jedrasiak, K., Daniec, K., Nawrat, A.: A prototype of unmanned aerial vehicle for image acquisition, computer vision and graphics. Lecture Notes in Computer Science, Vol. 7594, pp. 87–94. Springer (2013) Iwaneczko, P., Jedrasiak, K., Daniec, K., Nawrat, A.: A prototype of unmanned aerial vehicle for image acquisition, computer vision and graphics. Lecture Notes in Computer Science, Vol. 7594, pp. 87–94. Springer (2013)
30.
Zurück zum Zitat Antosz, P., Bereska, D., Gatys, K., Niedziela, T., Szota, P.: Multiłącznik IMPRESJA IQ-element instalacji inteligentnego budynku wykorzystującej magistralę CAN. Szybkobieżne Pojazdy Gąsienicowe 1, 99–106 (2011) Antosz, P., Bereska, D., Gatys, K., Niedziela, T., Szota, P.: Multiłącznik IMPRESJA IQ-element instalacji inteligentnego budynku wykorzystującej magistralę CAN. Szybkobieżne Pojazdy Gąsienicowe 1, 99–106 (2011)
31.
Zurück zum Zitat Babiarz, A., Jaskot, K., Koralewicz, P.: The control system for autonomous mobile platform. In: Advanced Technologies for Intelligent Systems of National Border Security, Studies in Computational Intelligence, vol. 440, pp. 15–28 (2013) Babiarz, A., Jaskot, K., Koralewicz, P.: The control system for autonomous mobile platform. In: Advanced Technologies for Intelligent Systems of National Border Security, Studies in Computational Intelligence, vol. 440, pp. 15–28 (2013)
32.
Zurück zum Zitat Bereska, D., Balcewicz, R., Garczyński, M.: Implementacja magistrali CAN i protokołu CANopen w robocie edukacyjnym. Szybkobieżne Pojazdy Gąsienicowe 1, 157–162 (2008) Bereska, D., Balcewicz, R., Garczyński, M.: Implementacja magistrali CAN i protokołu CANopen w robocie edukacyjnym. Szybkobieżne Pojazdy Gąsienicowe 1, 157–162 (2008)
33.
Zurück zum Zitat Campbell, J., Sukthankar, R., Illah, N.: Techniques for evaluating optical flow for visual odometry in extreme terrain. In: Proceedings 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2004), Vol. 4. IEEE (2004) Campbell, J., Sukthankar, R., Illah, N.: Techniques for evaluating optical flow for visual odometry in extreme terrain. In: Proceedings 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2004), Vol. 4. IEEE (2004)
34.
Zurück zum Zitat Bieszczad, G., Krupiński, M., Madura, H., & Sosnowski, T.: Thermal camera for autonomous mobile platforms. In: Vision Based Systems for UAV Applications, pp. 95–114. Springer International Publishing (2013) Bieszczad, G., Krupiński, M., Madura, H., & Sosnowski, T.: Thermal camera for autonomous mobile platforms. In: Vision Based Systems for UAV Applications, pp. 95–114. Springer International Publishing (2013)
Metadaten
Titel
Real Time Dense Motion Estimation Using FPGA Based Omnidirectional Video Acquisition Device
verfasst von
Jan Kwiatkowski
Dawid Sobel
Artur Ryt
Mariusz Domżał
Karol Jędrasiak
Aleksander Nawrat
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-21118-3_7