Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
Erschienen in:
Innovative Algorithms in Computer Vision Kapitel lesen Erstes Kapitel lesen

2018 | OriginalPaper | Buchkapitel

5. Development of Fast Parallel Algorithms Based on Visual and Audio Information in Motion Control Systems of Mobile Robots

verfasst von : Sn. Pleshkova, Al. Bekiarski

Erschienen in: Computer Vision in Control Systems-4

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Decision making for movement is one of the essential activities in motion control systems of mobile robots. It is based on methods and algorithms of data processing obtained from the mobile robot sensors, usually video and audio sensors, like video cameras and microphone arrays. After image processing, information about the objects and persons including their current positions in area of mobile robot observation can be obtained. The aim of methods and algorithms is to achieve the appropriate precision and effectiveness of mobile robot’s visual perception, as well as the detection and tracking of objects and persons applying the mobile robot motion path planning. The precision in special cases of visual speaking person’s detection and tracking can be augmented adding the information of sound arrival in order to receive and execute the voice commands. There exist algorithms using only visual perception and attention or also the joined audio perception and attention. These algorithms are usually tested in the most cases as simulations and cannot provide a real time tracking objects and people. Therefore, the goal in this chapter is to develop and test the fast parallel algorithms for decision making in the motion control systems of mobile robots. The depth analysis of the existing methods and algorithms was conducted, which provided the main ways to increase the speed of an algorithm, such as the optimization, simplification of calculations, applying high level programming languages, special libraries for image and audio signal processing based on the hybrid hardware and software implementations, using processors like Digital Signal Processor (DSP) and Field-Programmable Gate Array (FPGA). The high speed proposed algorithms were implemented in the parallel computing multiprocessor hardware structure and software platform using the well known NVIDIA GPU processor and GUDA platform, respectively. The experimental results with different parallel structures confirm the real time execution of algorithms for the objects and speaking person’s detection and tracking using the given mobile robot construction.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Vorheriges Kapitel Unscented RGB-D SLAM in Indoor Environment
Nächstes Kapitel Methods and Algorithms of Audio-Video Signal Processing for Analysis of Indoor Human Activity
Literatur
1.
Siegwart, R., Nourbakhsh, I.R.: Introduction to Autonomous Mobile Robots. The MIT Press (2004)
2.
Erdmann, M., Hsu, D., Overmars, M., Van der Stappen, A.F. (eds.): Algorithmic Foundations of Robotics VI. Springer, Heidelberg (2005)
3.
Siciliano, Br., Khatib, O. (eds.): Springer Handbook of Robotics. Springer, Heidelberg (2008)
4.
Dehkharghani, S.S., Bekiarski, A., Pleshkova, S.: Application of probabilistic methods in mobile robots audio visual motion control combined with laser range finder distance measurements. In: 11th WSEAS International Conference on Circuits, Systems, Electronics, Control & Signal Processing (CSECS’2012), pp. 91–98 (2012)
5.
Dehkharghani, S.S., Bekiarski, A., Pleshkova, S.: Method and algorithm for precise estimation of joined audio visual robot control. In: Iran’s 3rd International Conference on Industrial Automation (2013)
6.
Venkov, P., Bekiarski, Al., Dehkharghani, S.S., Pleshkova, Sn.: Search and tracking of targets with mobile robot by using audio-visual information. In: International Conference on Automation and Informatics (CAI’2010), pp. 463–469 (2010)
7.
Al, Bekiarski: Visual mobile robots perception for motion control. In: Kountchev, R., Nakamatsu, K. (eds.) Advances in Reasoning-Based Image Processing Intelligent Systems, ISRL, vol. 29, pp. 173–209. Springer, Berlin (2012)CrossRef
8.
Pleshkova, Sn., Bekiarski, Al.: Audio visual attention models in the mobile robots navigation. In: Kountchev, R., Nakamatsu, K. (eds.) New Approaches in Intelligent Image Analysis, ISRL, vol. 108, pp. 253–294. Springer International Publishing, Switzerland (2016)
9.
Dehkharghani, S.S., Pleshkova, S.: Geometric thermal infrared camera calibration for target tracking by a mobile robot. Comptes rendus de l’Academie bulgare des Sciences 67(1), 109–114 (2014)
10.
Bekiarski, Al., Pleshkova, Sn.: Microphone array beamforming for mobile robot. In: 8th WSEAS International Conference on Circuits, Systems, Electronics, Control & Signal Processing (CSECS’2009), pp. 146–149 (2009)
11.
Dehkharghani, S.S.: Development of methods and algorithms for audio-visual mobile robot motion control. Doctoral Thesis, Technical University, Sofia, Bulgaria (2013)
12.
13.
14.
Nukada, A., Matsuoka, S.: Auto-tuning 3-D FFT library for CUDA GPUs. In: Conference for High Performance Computing Networking, Storage and Analysis, pp. 30.1–30.10 (2009)
15.
Kijsipongse, E., U-ruekolan, S., Ngamphiw, C., Tongsima, S.: Efficient large Pearson correlation matrix computing using hybrid MPI/CUDA. In: Computer Science and Software Engineering (JCSSE’2011), pp. 237–241 (2011)
16.
17.
18.
Cypher, R., Sanz, J.L.C.: The SIMD Model of Parallel Computation. Springer Publishing Company, Incorporated (2011)
19.
20.
Sinha, R.S., Singh, S., Singh, S., Banga, V.K.: Accelerating genetic algorithm using general purpose GPU and CUDA. International Journal of Computer Graphics 7(1), 17–30 (2016)CrossRef
21.
22.
Ding, C., Karlsson, C., Liu, H., Davies, T., Chen, Z.: Matrix multiplication on GPUs with on-line fault tolerance. In: 9th IEEE Int Symposium Parallel and Distributed Processing with Applications, IEEE Compute Society, pp. 311–317 (2011)
23.
24.
Fatahalian, K., Sugerman, J., Hanrahan, P.: Understanding the Efficiency of GPU algorithms for matrix-matrix multiplication. In: Akenine-Möller, T., McCool, M. (eds.) Graphics Hardware: The Eurographics Association, Stanford University, pp. 1–5 (2004)
25.
26.
27.
28.
29.
30.
Gembris, D., Neeb, M., Gipp, M., Kugel, A., Männer, R.: Correlation analysis on GPU systems using NVIDIA’s CUDA. J. Real-Time Image Proc. 6(4), 275–280 (2011)CrossRef
31.
Papamakariosa, G., Rizosa, G., Pitsianisab, N.P., Sunb, X.: Fast computation of local correlation coefficients on graphics processing units. In: Luk, F.T., Schmalz, M.S., Ritter, G.X., Barrera, J., Astola, J.T. (eds.) Mathematics for Signal and Information Processing. Proceedings of SPIE, vol. 7444, pp. 12.1–12.8 (2010)
32.
33.
Iandola, F., Sheffield, D., Anderson, M., Phothilimthana, P.M., Keutzer, K.: Communication-minimizing 2D convolution in GPU registers. In: IEEE International Conference on Image Processing (ICIP’2013), pp. 2116–2120 (2013)
34.
35.
36.
Pomerleau, D.A. Neural Nertwork perception for mobile robot guidance. Springer Science+Business Media LLC (1993)
37.
Wang, Zh., Dissanayake, G., Huang, Sh.: Simultaneous Localization and Mapping: Exactly Sparse Information Filters. World Scientific Publishing Co. Pte. Ltd (2011)
38.
Liénard, J.S.: Variability, ambiguity and attention: a perception model based on analog induction. In: Cantoni, V., di Gesù, V., Setti, A., Tegolo, D. (eds.) Attention in Human and Machine Perception 2: Emergence, Attention, and Creativity. Springer Science+Business Media LLC, pp. 87–99 (1999)
39.
Levorato, R., Pagello, E.: DOA acoustic source localization in mobile robot sensor networks. IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC’2015), pp. 71–76 (2015)
40.
Chou, Y., Liu, J.: A robotic indoor 3D mapping system using a 2D laser range finder mounted on a rotating four-bar linkage of a mobile platform. Int. J. Adv. Rob. Syst. 10, 257–271 (2013)CrossRef
41.
Martínez-Gómez, J., Fernández-Caballero, A., García-Varea, I., Rodríguez, L., Romero-González, Cr.: A taxonomy of vision systems for ground mobile robots. Int. J. Adv. Robot. Syst. 11.1–11.11 (2014)
42.
Naminski, M.R.: An analysis of simultaneous localization and mapping (SLAM) algorithms. Macalester College, Honors Projects Mathematics, Statistics, and Computer Science (2013)
43.
Thrun, S., Burgar, W., Fox, D.: Probabilistic Robotics. Massachusetts Institute of Technology (2006)
44.
Michiel, H.: Jacobian. Encyclopedia of Mathematics. Springer, Berlin (2001)
45.
Dmochowski, Benesty, J.: Direction of arrival estimation using the parameterized spatial correlation matrix. IEEE Trans Audio Speech Lang. Process. 15(4), 1327–1339 (2007)CrossRef
46.
Chen, J., Huang, Y., Benesty, J.: Time delay estimation. Audio signal processing for next-generation multimedia communication systems. In: Huang, Y., Benesty, J. (eds.) Audio Signal Processing for Next-Generation Multimedia Communication Systems, pp. 197–227. Kluwer Academic Publishers (2004)
47.
Dvorkind, T., Gannot, S.: The time difference of arrival estimation of speech source in a noisy and reverberant environment. Sig. Process. 85(1), 177–204 (2005)CrossRefMATH
48.
Vonderschen, K., Wagner, H.: Detecting interaural time differences and remodeling their representation. Trends Neurosci. 37(5), 289–300 (2014)CrossRef
49.
Tashev, I.: Sound Capture and Processing. Wiley (2009)
50.
Dhull, S., Arya, S., Sahu, O.P.: Comparison of time-delay estimation techniques in acoustic environment. Int. J. Comput. Appl. 8(9), 29–31 (2010)
51.
Dmochowski, J., Benesty, J.: A generalized steered response power method for computationally viable source localization. Trans. Audio Speech Lang. Process. 15(8), 2510–2526 (2007)CrossRef
52.
DiBiase, J.H.: A high-accuracy, low-latency technique for talker localization in reverberant environments using microphone arrays. Ph.D. thesis, Brown University (2000)
53.
54.
55.
56.
57.
58.
59.
60.
61.
62.
63.
64.
Metadaten
Titel
Development of Fast Parallel Algorithms Based on Visual and Audio Information in Motion Control Systems of Mobile Robots
verfasst von
Sn. Pleshkova
Al. Bekiarski
Copyright-Jahr
2018
Buch
Computer Vision in Control Systems-4

Print ISBN: 978-3-319-67993-8

Electronic ISBN: 978-3-319-67994-5

Copyright-Jahr: 2018

DOI
https://doi.org/10.1007/978-3-319-67994-5_5