Top

Pattern Recognition and Image Analysis

Published in:

01-10-2021 | APPLICATION PROBLEMS

Automatic Video Based Perception of Legitimate Persons Using Computer Vision Techniques

Authors: Ankit Kumar Sah, Nickolas Savarimuthu

Published in: Pattern Recognition and Image Analysis | Issue 4/2021

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The purpose of any surveillance investigation is to look for recurrent theft, vandalism, missing person searches, fraud, crime, etc. It is a general practice of observing a subject for documenting the whereabouts or interactions of the same. Physical observation though reasonable is hectic, exorbitant, and time consuming. The system must be able to distinguish between legitimates and strangers. Towards the same, an automatic detection system is developed to detect only the registered persons of the media lab. Two variants of YOLO viz., YOLOv3-Tiny, and YOLOv2 were utilized for fast identification, classification, and detection of registered persons on live stream video outputted by the network camera installed at the place. YOLOv2 achieved 96.25% mean average precision whereas YOLOv3-Tiny registered 95.05% with average detection times of 0.06 and 0.04 s per frame respectively. The models outperformed Faster R-CNN detection methodology with regards to mean average precision and detection time utilized for the same task. The achieved results were satisfactory and promising with reference to fast recognition, speed, and correctness.

previous article Reconstruction of the Volume of Affected Lymph Nodes on Positron Emission and Computed Tomography Images

next article Topological Chemograph Analysis Theory As a Promising Approach to the Simulation Modeling of the Quantum-Mechanical Properties of Molecules: Part I. On the Generation of Feature Descriptions of Molecules

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

V. A. Akpan, “Configuration, interfacing and networking of wireless IP-based camera for real-time security surveillance systems design,” Pac. J. Sci. Technol. 8 (2), 107–114 (2015).

J. Besada, J. Portillo, J. Garcia, J. M. Molina, A. Varona, and G. González, “Image-based automatic surveillance for airport surface,” in 4th Int. Conf. on Information Fusion, Montreal, Canada, 2001 (2001), pp. 11–18.

F. R. Castella, “Sliding window detection probabilities,” IEEE Trans. Aerosp. Electron. Syst. AES-12, pp. 815–819 (1976). https://doi.org/10.1109/TAES.1976.308363CrossRef

C. Clavel and T. Ehrette, “Fear-type emotion recognition and abnormal events detection for an audio-based surveillance system,” WIT Trans. Inf. Commun. Technol. 39, 471–479 (2008). https://doi.org/10.2495/RISK080461CrossRef

T. G. Emori, D. H. Culver, T. C. Horan, W. R. Jarvis, J. W. White, D. R. Olson, S. Banerjee, J. R. Edwards, W. J. Martone, R. P. Gaynes, and J. M. Hughes, “NatZorral nosocomial infections surveillance system (NNIS): Description of surveillance methods,” Am. J. Infection Control 19, 19–35 (1970). https://doi.org/10.1016/0196-6553(91)90157-8CrossRef

Dhiraj and D. K. Jain, “An evaluation of deep learning based object detection strategies for threat object detection in baggage security imagery,” Pattern Recognit. Lett. 120, 112–119 (2019). https://doi.org/10.1016/j.patrec.2019.01.014CrossRef

H. L. Eng, K. A. Toh, A. H. Kam, J. Wang, and W. Y. Yau, “An automatic drowning detection surveillance system for challenging outdoor pool environments,” in Proc. Ninth IEEE Int. Conf. on Computer Vision, Nice, France, 2003 (IEEE, 2003), pp. 532–539. https://doi.org/10.1109/iccv.2003.1238393

M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, “The pascal visual object classes (VOC) challenge,” Int. J. Comput. Vision 88, 303–338 (2010). https://doi.org/10.1007/s11263-009-0275-4CrossRef

L. Fei-Fei, J. Deng, and K. Li, “ImageNet: Constructing a large-scale image database,” J. Vis. 9, 1037–1037 (2010). https://doi.org/10.1167/9.8.1037CrossRef

10.

G. L. Foresti, C. Micheloni, and L. Snidaro, “Event classification for automatic visual-based surveillance of parking lots,” in Proc. 17th Int. Conf. Pattern Recognition, Cambridge, 2004 (IEEE, 2004), Vol. 3, pp. 314–317. https://doi.org/10.1109/ICPR.2004.1334530

11.

R. Girshick, “Fast R-CNN,” in IEEE Int. Conf. on Computer Vision (ICCV), Santiago, Chile, 2015 (IEEE, 2015), pp. 1440–1448. https://doi.org/10.1109/ICCV.2015.169

12.

R. Girshick, J. Donahue, T. Darrell, and J. Malik, “Rich feature hierarchies for accurate object detection and semantic segmentation,” in IEEE Conf. on Computer Vision and Pattern Recognition, Columbus, Ohio, 2014 (IEEE, 2014), pp. 580–587. https://doi.org/10.1109/CVPR.2014.81

13.

K. He, G. Gkioxari, P. Dollár, and R. Girshick, “Mask R-CNN,” IEEE Trans. Pattern Anal. Mach. Intell. 42, 386–397 (2020). https://doi.org/10.1109/TPAMI.2018.2844175CrossRef

14.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Las Vegas, 2016 (IEEE, 2016), pp. 770–778. https://doi.org/10.1109/CVPR.2016.90

15.

W. Lao, J. Han, and P. H. N. de With, “Automatic video-based human motion analyzer for consumer surveillance system,” IEEE Trans. Consum. Electron. 55, 591–598 (2009). https://doi.org/10.1109/TCE.2009.5174427CrossRef

16.

Y. LeCun, P. Haffner, L. Bottou, and Y. Bengio, “Object recognition with gradient-based learning,” in Shape, Contour and Grouping in Computer Vision, Lecture Notes Computer Science, vol. 1681 (Springer, Berlin, 1999), pp. 319–345. https://doi.org/10.1007/3-540-46805-6_19CrossRef

17.

T. Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick, “Microsoft COCO: Common objects in context,” in Computer Vision – ECCV 2014, Ed. by D. Fleet, T. Pajdla, B. Schiele, and T. Tuytelaars, Lecture Notes in Computer Science, vol. 8693 (Springer, Cham, 2014), pp. 740–755. https://doi.org/10.1007/978-3-319-10602-1_48CrossRef

18.

S. Lu, B. Wang, H. Wang, L. Chen, M. Linjian, and X. Zhang, “A real-time object detection algorithm for video,” Comput. Electr. Eng. 77, pp. 398–408 (2019). https://doi.org/10.1016/j.compeleceng.2019.05.009CrossRef

19.

S. Ntalampiras, I. Potamitis, and N. Fakotakis, “On acoustic surveillance of hazardous situations,” in IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Taipei, 2009 (IEEE, 2009), pp. 165–168. https://doi.org/10.1109/icassp.2009.4959546

20.

Q. Qin, J. Dou, and Z. Tu, “Deep ResNet based remote sensing image super-resolution reconstruction in discrete wavelet domain,” Pattern Recognit. Image Anal. 30, 541–550 (2020). https://doi.org/10.1134/S1054661820030232CrossRef

21.

A. D. Redlich, C. E. Kelly, and J. C. Miller, “The who, what, and why of human intelligence gathering: Self-reported measures of interrogation methods,” Appl. Cognit. Psychol. 28, 817–828 (2014). https://doi.org/10.1002/acp.3040CrossRef

22.

J. Redmon and A. Farhadi, “YOLO9000: Better, faster, stronger,” in IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, 2017 (IEEE, 2017), pp. 6517–6525. https://doi.org/10.1109/CVPR.2017.690

23.

J. Redmon and A. Farhadi, “YOLOv3: An incremental improvement.” arXiv:1804.02767 [cs.CV]

24.

S. Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: Towards real-time object detection with region proposal networks,” IEEE Trans. Pattern Anal. Mach. Intell. 39, 1137–1149 (2017). https://doi.org/10.1109/TPAMI.2016.2577031CrossRef

25.

M. J. Shaifee, B. Chywl, F. Li, and A. Wong, “Fast YOLO: A fast You Only Look Once system for real-time embedded object detection in video,” J. Comput. Vision Imaging Syst. 3 (2017). https://doi.org/10.15353/vsnl.v3i1.171

26.

S. Shinde, A. Kothari, and V. Gupta, “YOLO based human action recognition and localization,” Procedia Comput. Sci. 133, 831–838 (2018). https://doi.org/10.1016/j.procs.2018.07.112CrossRef

27.

K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” in 3rd Int. Conf. Learning Representations, San Diego, Calif., 2015 (2015), pp. 1–14. arXiv:1409.1556 [cs.CV]

28.

A. Sun and X. Chen, “Online education and its effective practice: A research review,” J. Inf. Technol. Educ. Res. 15, 157–190 (2016). https://doi.org/10.28945/3502CrossRef

29.

Y. Tian, G. Yang, Z. Wang, H. Wang, E. Li, and Z. Liang, “Apple detection during different growth stages in orchards using the improved YOLO-V3 model,” Comput. Electron. Agric. 157, 417–426 (2019). https://doi.org/10.1016/j.compag.2019.01.012CrossRef

30.

J. R. R. Uijlings, K. E. A. van de Sande, T. Gevers, and A. W. M. Smeulders, “Selective search for object recognition,” Int. J. Comput. Vision 104, 154–171 (2013). https://doi.org/10.1007/s11263-013-0620-5CrossRef

31.

P. Viola and M. Jones, “Rapid object detection using a boosted cascade of simple features,” in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, Kauai, Hawaii, 2001 (IEEE, 2001).https://doi.org/10.1109/cvpr.2001.990517

32.

P. Xu, M. Ye, L. Pei, Y. Dou, and H. Chen, “Fast object detection based on several samples by training voting space,”Pattern Recognit. Image Anal. 25, 565–576 (2015).https://doi.org/10.1134/S1054661815040227CrossRef

33.

Z. Yi, S. Yongliang, and Z. Jun, “An improved tiny-yolov3 pedestrian detection algorithm,” Optik 183, 17–23 (2019). https://doi.org/10.1016/j.ijleo.2019.02.038CrossRef

34.

W. Zhang, C. Witharana, A. K. Liljedahl, and M. Kanevskiy, “Deep convolutional neural networks for automated characterization of arctic ice-wedge polygons in very high spatial resolution aerial imagery,” Remote Sens. 10, 1487 (2018). https://doi.org/10.3390/rs10091487CrossRef

35.

Y. I. Zhuravlev, V. V. Ryazanov, L. H. Aslanyan, and H. A. Sahakyan, “On a classification method for a large number of classes,” Pattern Recognit. Image Anal. 29, 366–376 (2019). https://doi.org/10.1134/S1054661819030246CrossRef

Title: Automatic Video Based Perception of Legitimate Persons Using Computer Vision Techniques
Authors: Ankit Kumar Sah
Nickolas Savarimuthu
Publication date: 01-10-2021
Publisher: Pleiades Publishing
Published in: Pattern Recognition and Image Analysis / Issue 4/2021
Print ISSN: 1054-6618
Electronic ISSN: 1555-6212
DOI: https://doi.org/10.1134/S1054661821040192

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 4/2021

A Lightweight-Grouped Model for Complex Action Recognition

An Improved Non-Rigid Point Set Registration Algorithm by Preserving Local Topology

Multi-Scale Feature Fusion Network with Attention for Single Image Dehazing

Infrared Pedestrian Detection Method Based on Attention Model

Bayesian Cellular Automata Fusion Model Based on Dual-Stream Strategy for Video Anomaly Action Detection

A Probabilistic Clustering Approach for Detecting Linear Structures in Two-Dimensional Spaces

Premium Partner