Ahmed Al Maashri
ABSTRACT
Video analytics introduce new levels of intelligence to automated scene understanding. Neuromorphic algorithms, such as HMAX, are proposed as robust and accurate algorithms that mimic the processing in the visual cortex of the brain. HMAX, for instance, is a versatile algorithm that can be repurposed to target several visual recognition applications. This paper presents the design and evaluation of hardware accelerators for extracting visual features for universal recognition. The recognition applications include object recognition, face identification, facial expression recognition, and action recognition. These accelerators were validated on a multi-FPGA platform and significant performance enhancement and power efficiencies were demonstrated when compared to CMP and GPU platforms. Results demonstrate as much as 7.6X speedup and 12.8X more power-efficient performance when compared to those platforms.
- L. Itti, C. Koch, and E. Niebur, "A Model of Saliency-Based Visual Attention for Rapid Scene Analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1254--1259, Nov 1998. Google Scholar
Digital Library
- M. Riesenhuber and T. Poggio, "Hierarchical Models of Object Recognition in Cortex," Nature Neuroscience, vol. 2, no. 11, pp. 1019--1025, November 1999.Google ScholarCross Ref
- T. Serre et al., "Robust Object Recognition With Cortex-Like Mechanisms," IEEE PAMI, vol. 29, no. 3, March 2007. Google ScholarDigital Library
- E. Meyers and L. Wolf, "Using Biologically Inspired Features for Face Processing," International Journal of Computer Vision, vol. 76, no. 1, pp. 93--104, January 2008. Google ScholarDigital Library
- J Mutch, U Knoblich, and T Poggio, "CNS: A GPU-Based Framework for Simulating Cortically-Organized Networks," Massachusetts Institute of Technology, Cambridge, MA, MIT-CSAIL-TR-2010-013/CBCL-286 2010.Google Scholar
- H. Jhuang, T. Serre, L. Wolf, and T. Poggio, "A Biologically Inspired System for Action Recognition," in International Conference on Computer Vision (ICCV), 2007, pp. 1--8.Google Scholar
- J. Mutch and D. G. Lowe, "Object Class Recognition and Localization Using Sparse Features with Limited Receptive Fields," International Journal of Computer Vision (IJCV), vol. 80, no. 1, October 2008. Google ScholarDigital Library
- S. Park et al., "System-On-Chip for Biologically Inspired Vision Applications," Information Processing Society of Japan, 2012, {In Press}.Google Scholar
- L. Fei-Fei et al., "Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Tested on 101 Object Categories," in IEEE CVPR 2004, Workshop on Generative-Model Based Vision, 2004. Google ScholarDigital Library
- F. Samaria and A. Harter, "Parameterisation of a Stochastic Model for Human Face Identification," in 2nd IEEE Workshop on Applications of Computer Vision, 1994.Google Scholar
- P. J. Phillips et al., "The FERET Evaluation Methodology for Face Recognition Algorithms," Trans. of Pattern Analysis and Machine Intelligence, vol. 22, no. 10, October 2000. Google ScholarDigital Library
- M. Lyons et al., "Coding Facial Expressions with Gabor Wavelets," in Third IEEE International Conference on Autmatomatic Face and Gesture Recognition, 1998. Google ScholarDigital Library
- M. Blank et al., "Actions as Space-Time Shapes," in International Conference on Computer Vision, 2005. Google ScholarDigital Library
- Xilinx, "Virtex-5 Family Overview," DS100(v5.0) 2009.Google Scholar
- Nvidia. (2011) Tesla M2090 Board Specification. {Online}. http://www.nvidia.com/docs/IO/43395/Tesla-M2090-Board-Specification.pdfGoogle Scholar
- I. Kuon and J. Rose, "Measuring the Gap Between FPGAs and ASICs," IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, vol. 26, no. 2, pp. 203--215, February 2007. Google ScholarDigital Library
- J.-Y. Kim et al., "A 201.4 GOPS 496 mW Real-Time Multi-Object Recognition Processor With Bio-Inspired Neural Perception Engine," IEEE Journal of Solid-State Circuits, vol. 45, no. 1, pp. 32--45, Jan 2010.Google ScholarCross Ref
- C.-Y. Tsai et al., "A 1.0TOPS/W 36-Core Neocortical Computing Processor with 2.3Tb/s Kautz NoC for Universal Visual Recognition," in IEEE Int. Conference Digest of Technical Papers, San Francisco, 2012, pp. 480--482.Google Scholar
- C. Farabet et al., "Hardware Accelerated Convolutional Neural Networks for Synthetic Vision Systems," in ISCAS, Paris, 2010, pp. 257--260.Google Scholar
- R. Iyer et al., "CogniServe: Heterogeneous Server Architecture for Large-Scale Recognition," IEEE Micro, vol. 31, no. 3, pp. 20--31, May-June 2011. Google ScholarDigital Library
- J. Clemons et al., "EFFEX: An Embedded Processor for Computer Vision Based Feature Extraction," in The 48th ACM/EDAC/IEEE DAC, San Diego, 2011, pp. 1020--1024. Google ScholarDigital Library
- S. Chakradhar et al., "A Dynamically Configurable Coprocessor for Convolutional Neural Networks," in ISCA, 2010, pp. 247--257. Google ScholarDigital Library
Index Terms
- Accelerating neuromorphic vision algorithms for recognition
Recommendations
Hardware Acceleration for Neuromorphic Vision Algorithms
Neuromorphic vision algorithms are biologically inspired models that follow the processing that takes place in the primate visual cortex. Despite their efficiency and robustness, the complexity of these algorithms results in reduced performance when ...
Face Recognition Based Person Specific Identification for Video Surveillance Applications
WCI '15: Proceedings of the Third International Symposium on Women in Computing and InformaticsFace detection is an important aspect for applications like biometrics, video surveillance and human computer interaction. Videos provide abundant information and also that can be leveraged by temporal variations in pose, expression changes and ...
On the efficiency of the accelerated processing unit for scientific computing
HPC '16: Proceedings of the 24th High Performance Computing SymposiumThe AMD APU (Accelerated Processing Unit) architecture, which combines CPU and GPU cores on the same die at a low power budget, promises a significant advent in GPU computing, in particular to applications which performance is bottlenecked by the low ...
Comments