Top

Published in:

2019 | OriginalPaper | Chapter

14. MSER-in-Chip: An Efficient Vision Tool for IoT Devices

Authors : Andrzej Sluzek, Hani Saleh, Baker Mohammad, Mahmoud Al-Qutayri, Mohammed Ismail

Published in: The IoT Physical Layer

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

MSERs (maximally stable extremal regions) belong to the most popular local image features with a wide range of highly practical applications, e.g., (to name a few) in image search and retrieval, object detection and recognition, image stitching, tracking mobile objects, etc. Low complexity of MSER detectors (combined with a regular structure suitable for hardware implementation) makes MSER an attractive option for IoT devices which may require vision capabilities to analyze and interpret their environments. In this chapter, we briefly discuss theoretical, algorithmic, and technical aspects of using MSER for such purposes. The presented results have contributed to the system-on-chip implementation of MSER detector which is also overviewed in this chapter. Additionally, we discuss prospective hardware implementations of even more efficient feature detectors based on MSERs.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Efficient Algorithm for VT/VF Prediction for IoT SoCs

next chapter A Low-Power, High-Resolution ZCS Control for Inductor-Based Converters

J. Matas, O. Chum, M. Urban, T. Pajdla, Robust wide baseline stereo from maximally stable extremal regions, in 13th British Machine Vision Conference BMVC’02 (2002), pp. 384–393

D. Nistér, H. Stewénius, Linear time maximally stable extremal regions, in 10th European Conference on Computer Vision ECCV’08, vol.2 (2008), pp. 183–196

F. Kristensen, W. MacLean, Real-time extraction of maximally stable extremal regions on an FPGA, in 2007 IEEE International Symposium on Circuits and Systems ISCAS’07 (2007), pp. 165–168

E. Salahat, H. Saleh, A. Sluzek, M. Al-Qutayri, B. Mohammed, M. Ismail, A maximally stable extremal regions system-on-chip for real-time visual surveillance, in 41st IEEE Industrial Electronics Society Conference IECON’15 (2015), pp. 2812–2815

K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, L. Van Gool, A comparison of affine region detectors. Int. J. Comput. Vis. 65(1), 43–72 (2005)

A. Śluzek, Multi-distinctive MSER features and their Descriptors: a low-complexity tool for image matching, in 2015 International Conference on Advanced Concepts for Intelligent Vision Systems, Lecture Notes in Computer Science, vol. 9396 (2015)

R. Kimmel, C. Zhang, A.M. Bronstein, M.M. Bronstein, Are MSER features really interesting? IEEE Trans. PAMI 33(11), 2316–2320 (2011)

T. Tuytelaars, K. Mikolajczyk, Local invariant feature detector: a survey. Found. Trends Comput. Graphics Vis. 3(3), 177–280 (2007)

R. Szeliski, Image alignment and stitching: a tutorial. Found. Trends Comput. Graphics Vis. 2(1), 1–104 (2006)

10.

M. Donoser, C. Arth, H. Bischof, Detecting, tracking and recognizing license plates, in 8th Asian Conference on Computer Vision ACCV’07, vol. 2 (2007), pp. 447–456

11.

V. Lepetit, P. Fua, Monocular model-based 3D tracking of rigid objects. Found. Trends Comput. Graphics Vis. 1(1), 1–99 (2005)

12.

D. Meger, P.-E. Forssén, K. Lai, S. Helmer, S. McCann, T. Southey, M. Baumann, J.J. Little, D.G. Love, Curious George: an attentive semantic robot. Robot. Auton. Syst. 56(1), 43–72 (2005)

13.

J. Sivic, A. Zisserman, Video data mining using configurations of viewpoint invariant regions, in IEEE Conference on Computer Vision and Pattern Recognition CVPR’04 (2004), pp. I.488–I.495

14.

W. Zhao, Y.-G. Jiang, C.-W. Ngo, Keyframe retrieval by keypoints: can point-to-point matching help? in 5th International Conference CIVR’06 (2006), pp. 72–81

15.

M. Donoser, H. Bischof, M. Wiltsche, Color blob segmentation by MSER analysis, in IEEE International Conference on Image Processing ICIP’06 (2006)

16.

A. Śluzek, Zastosowanie metod momentowych do identyfikacji obiektow w cyfrowych systemach wizyjnych (in Polish) (WPW, Warszawa, 1990)

17.

A. Meijster, M.H. Wilkinson, A comparison of algorithms for connected set openings and closings. IEEE Trans. PAMI 24(4), 484–492 (2002)

18.

E. Salahat, Real-time extraction of maximally stable extremal regions on SoC for visual surveillance, MSc thesis, Khalifa University, ECE Department (2014)

19.

E. Salahat, H. Saleh, A. Sluzek, M. Al-Qutayri, B. Mohammed, M. Ismail, Architecture and method for real-time parallel detection and extraction of maximally stable extremal regions (MSERs). United States Patent no. 9,311,555 (2016)

20.

S. Alyammahi, E. Salahat, H. Saleh, A. Sluzek, A hardware accelerator for real-time extraction of the linear-time MSER algorithm, in 41st IEEE Industrial Electronics Society Conference IECON’15 (2015), pp. 65–69

21.

A. Śluzek, Improving performances of MSER features in matching and retrieval tasks, in 14th European Conference on Computer Vision ECCV’16, Lecture Notes in Computer Science, vol. 9915 (2016)

22.

T. Lindeberg, Scale-space theory: a basic tool for analyzing structures at different scales. J. Appl. Stat. 21(2), 224–270 (1994)

23.

A. Sluzek, H. Saleh, Algorithmic foundations for hardware implementation of scale-insensitive MSER features, in 59th IEEE Interantional Midwest Symposium on Circuits and Systems (MWSCAS’16) (2016)

24.

A. Smeulders, D. Chu, R. Cucchiara, S. Calderara, A. Dehghan, M. Shah, Visual tracking: an experimental survey. IEEE Trans. PAMI 36(7), 1442–1468 (2014)

25.

A. Śluzek, A. Alali, A. Alzaabi, A. Aljasmi, Visual target tracking using a low-cost methodology based on visual words, in 2015 International Conference on Computer Vision and Graphics ICCVG, Lecture Notes in Computer Science, vol. 9971 (2016)

26.

M.A. Fischler, R.C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, in 4th European Conference on Computer Vision ECCV’06 (1996), pp. 683–695

Title: MSER-in-Chip: An Efficient Vision Tool for IoT Devices
Authors: Andrzej Sluzek
Hani Saleh
Baker Mohammad
Mahmoud Al-Qutayri
Mohammed Ismail
Publisher: Springer International Publishing
Book: The IoT Physical Layer
Print ISBN: 978-3-319-93099-2

Electronic ISBN: 978-3-319-93100-5

Copyright Year: 2019
DOI: https://doi.org/10.1007/978-3-319-93100-5_14