Skip to main content
Top

2020 | OriginalPaper | Chapter

Microcontrollers on the Edge – Is ESP32 with Camera Ready for Machine Learning?

Author : Kristian Dokic

Published in: Image and Signal Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

For most machine learning tasks big computing power is needed, but some tasks can be done with microcontrollers. In this paper well-known SoC ESP32 has been analyzed. It is usually used in IoT devices for data measurement, but some authors started to use simple machine learning algorithms with them. Generally, this paper will analyze the possibility of using ESP32 with a built-in camera for machine learning algorithms. Focus of research will be on durations of photographing and photograph processing, because that can be a bottleneck of a machine learning tasks.
For this purpose, logistic regression has been implemented on ESP32 with camera. It has been used to differentiate two handwritten letters on the greyscale pictures (“o” and “x”). Logistic regression weights have been calculated on the cloud, but then they have been transferred to an ESP32. The output results have been analyzed. The duration of photographing and processing were analyzed as well as the impact of implemented PSRAM memory on performances. It can be concluded that ESP32 with camera can be used for some simple machine learning tasks and for camera picture taking and preparing for other more powerful processors. Arduino IDE still does not provide enough level of optimization for implemented PSRAM memory.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Shi, W., et al.: Edge computing: vision and challenges. IEEE. Int. Things J. 3(5), 637–646 (2016)CrossRef Shi, W., et al.: Edge computing: vision and challenges. IEEE. Int. Things J. 3(5), 637–646 (2016)CrossRef
3.
go back to reference Lai, L., Suda, N., Chandra, I.V.: CMSIS-NN: efficient neural network kernels for arm cortex-M CPUs. Comput. Res. Repository.svez. abs/1801.06601 (2018) Lai, L., Suda, N., Chandra, I.V.: CMSIS-NN: efficient neural network kernels for arm cortex-M CPUs. Comput. Res. Repository.svez. abs/1801.06601 (2018)
6.
go back to reference Ivkovic, I.J., Ivkovic, L.: Analysis of the performance of the new generation of 32-bit microcontrollers for IoT and big data application. In: Proceedings of the International Conference on Information Society and Technology (ICIST 2017), Kopaonik (2017) Ivkovic, I.J., Ivkovic, L.: Analysis of the performance of the new generation of 32-bit microcontrollers for IoT and big data application. In: Proceedings of the International Conference on Information Society and Technology (ICIST 2017), Kopaonik (2017)
8.
go back to reference Kokoulin, A.N., Tur, A.I., Yuzhakov, A.A., Knyazev, I.A.I.: Hierarchical convolutional neural network architecture in distributed facial recognition system. In: 2019 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus), Saint Petersburg and Moscow (2019) Kokoulin, A.N., Tur, A.I., Yuzhakov, A.A., Knyazev, I.A.I.: Hierarchical convolutional neural network architecture in distributed facial recognition system. In: 2019 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus), Saint Petersburg and Moscow (2019)
11.
go back to reference Sandler, M., Howard, A., Zhu, M., Zhmoginov, I.L.A., Chen, C.: MobileNetV2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE Conference on computer vision and Pattern Recognition, Salt Lake City (2018) Sandler, M., Howard, A., Zhu, M., Zhmoginov, I.L.A., Chen, C.: MobileNetV2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE Conference on computer vision and Pattern Recognition, Salt Lake City (2018)
12.
go back to reference Zhang, K., Zhang, Z., Lii, Z., Qiao, Y.: Joint face detection and alignment using multi-task cascaded convolutional networks. IEEE. Sig. Proc. Lett. 23(10), 1499–1503 (2016)CrossRef Zhang, K., Zhang, Z., Lii, Z., Qiao, Y.: Joint face detection and alignment using multi-task cascaded convolutional networks. IEEE. Sig. Proc. Lett. 23(10), 1499–1503 (2016)CrossRef
13.
go back to reference Cox, D.: The regression analysis of binary sequences. J. Roy. Stat. Soc. Ser. B (Methodol.) 20(2), 215–242 (1958)MathSciNetMATH Cox, D.: The regression analysis of binary sequences. J. Roy. Stat. Soc. Ser. B (Methodol.) 20(2), 215–242 (1958)MathSciNetMATH
Metadata
Title
Microcontrollers on the Edge – Is ESP32 with Camera Ready for Machine Learning?
Author
Kristian Dokic
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-51935-3_23

Premium Partner