Skip to main content
Top

2017 | OriginalPaper | Chapter

Automatic Detection and Recognition of Individuals in Patterned Species

Authors : Gullal Singh Cheema, Saket Anand

Published in: Machine Learning and Knowledge Discovery in Databases

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Visual animal biometrics is rapidly gaining popularity as it enables a non-invasive and cost-effective approach for wildlife monitoring applications. Widespread usage of camera traps has led to large volumes of collected images, making manual processing of visual content hard to manage. In this work, we develop a framework for automatic detection and recognition of individuals in different patterned species like tigers, zebras and jaguars. Most existing systems primarily rely on manual input for localizing the animal, which does not scale well to large datasets. In order to automate the detection process while retaining robustness to blur, partial occlusion, illumination and pose variations, we use the recently proposed Faster-RCNN object detection framework to efficiently detect animals in images. We further extract features from AlexNet of the animal’s flank and train a logistic regression (or Linear SVM) classifier to recognize the individuals. We primarily test and evaluate our framework on a camera trap tiger image dataset that contains images that vary in overall image quality, animal pose, scale and lighting. We also evaluate our recognition system on zebra and jaguar images to show generalization to other patterned species. Our framework gives perfect detection results in camera trapped tiger images and a similar or better individual recognition performance when compared with state-of-the-art recognition techniques.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE TPAMI 28(12), 2037–2041 (2006)CrossRefMATH Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE TPAMI 28(12), 2037–2041 (2006)CrossRefMATH
2.
go back to reference Bolger, D.T., Morrison, T.A., Vance, B., Lee, D., Farid, H.: A computer-assisted system for photographic mark-recapture analysis. Methods Ecol. Evol. 3(5), 813–822 (2012)CrossRef Bolger, D.T., Morrison, T.A., Vance, B., Lee, D., Farid, H.: A computer-assisted system for photographic mark-recapture analysis. Methods Ecol. Evol. 3(5), 813–822 (2012)CrossRef
3.
go back to reference Burghardt, T., Calic, J.: Real-time face detection and tracking of animals. In: Neural Network Applications in Electrical Engineering, pp. 27–32. IEEE (2006) Burghardt, T., Calic, J.: Real-time face detection and tracking of animals. In: Neural Network Applications in Electrical Engineering, pp. 27–32. IEEE (2006)
4.
go back to reference Burghardt, T., Calic, J., Thomas, B.T.: Tracking animals in wildlife videos using face detection. In: EWIMT (2004) Burghardt, T., Calic, J., Thomas, B.T.: Tracking animals in wildlife videos using face detection. In: EWIMT (2004)
5.
go back to reference Cohen, I., et al.: Facial expression recognition from video sequences: temporal and static modeling. CVIU 91(1), 160–187 (2003) Cohen, I., et al.: Facial expression recognition from video sequences: temporal and static modeling. CVIU 91(1), 160–187 (2003)
6.
go back to reference Crall, J.P., et al.: Hotspotter - patterned species instance recognition. In: WACV, pp. 230–237. IEEE (2013) Crall, J.P., et al.: Hotspotter - patterned species instance recognition. In: WACV, pp. 230–237. IEEE (2013)
7.
go back to reference Daugman, J.: How iris recognition works. IEEE Trans. Circuits Syst. Video Technol. 14(1), 21–30 (2004)CrossRef Daugman, J.: How iris recognition works. IEEE Trans. Circuits Syst. Video Technol. 14(1), 21–30 (2004)CrossRef
8.
go back to reference Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE TPAMI 32(9), 1627–1645 (2010)CrossRef Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE TPAMI 32(9), 1627–1645 (2010)CrossRef
9.
10.
go back to reference Girshick, R.: Fast R-CNN. In: ICCV, pp. 1440–1448 (2015) Girshick, R.: Fast R-CNN. In: ICCV, pp. 1440–1448 (2015)
11.
go back to reference He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. CVPR, 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. CVPR, 770–778 (2016)
12.
go back to reference Hiby, L., Lovell, P., Patil, N., Kumar, N.S., Gopalaswamy, A.M., Karanth, K.U.: A tiger cannot change its stripes: using a three-dimensional model to match images of living tigers and tiger skins. Biol. Lett. 5(3), 383–386 (2009)CrossRef Hiby, L., Lovell, P., Patil, N., Kumar, N.S., Gopalaswamy, A.M., Karanth, K.U.: A tiger cannot change its stripes: using a three-dimensional model to match images of living tigers and tiger skins. Biol. Lett. 5(3), 383–386 (2009)CrossRef
13.
go back to reference Jain, A.K., Prabhakar, S., Hong, L., Pankanti, S.: Filterbank-based fingerprint matching. IEEE Trans. Image Process. 9(5), 846–859 (2000)CrossRef Jain, A.K., Prabhakar, S., Hong, L., Pankanti, S.: Filterbank-based fingerprint matching. IEEE Trans. Image Process. 9(5), 846–859 (2000)CrossRef
14.
go back to reference Jiang, X., Yau, W.Y.: Fingerprint minutiae matching based on the local and global structures. In: ICPR, vol. 2, pp. 1038–1041. IEEE (2000) Jiang, X., Yau, W.Y.: Fingerprint minutiae matching based on the local and global structures. In: ICPR, vol. 2, pp. 1038–1041. IEEE (2000)
15.
go back to reference Klingel, A.: Social organization and behavior of grevy’s zebra (Equus grevyi). Z. Tierpsychol. 36, 37–70 (1974)CrossRef Klingel, A.: Social organization and behavior of grevy’s zebra (Equus grevyi). Z. Tierpsychol. 36, 37–70 (1974)CrossRef
16.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS, pp. 1097–1105 (2012)
17.
go back to reference Lahiri, M., Tantipathananandh, C., Warungu, R., Rubenstein, D.I., Berger-Wolf, T.Y.: Biometric animal databases from field photographs: identification of individual zebra in the wild. In: International Conference on Multimedia Retrieval, p. 6. ACM (2011) Lahiri, M., Tantipathananandh, C., Warungu, R., Rubenstein, D.I., Berger-Wolf, T.Y.: Biometric animal databases from field photographs: identification of individual zebra in the wild. In: International Conference on Multimedia Retrieval, p. 6. ACM (2011)
18.
go back to reference Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)CrossRef
19.
go back to reference Mizroch, S.A., Harkness, S.A.: A test of computer-assisted matching using the North Pacific humpback whale, Megaptera novaeangliae, tail flukes photograph collection. Mar. Fisheries Rev. 65(3), 25–37 (2003) Mizroch, S.A., Harkness, S.A.: A test of computer-assisted matching using the North Pacific humpback whale, Megaptera novaeangliae, tail flukes photograph collection. Mar. Fisheries Rev. 65(3), 25–37 (2003)
20.
go back to reference Norouzzadeh, M.S., Nguyen, A., Kosmala, M., Swanson, A., Packer, C., Clune, J.: Automatically identifying wild animals in camera trap images with deep learning. arXiv preprint arXiv:1703.05830 (2017) Norouzzadeh, M.S., Nguyen, A., Kosmala, M., Swanson, A., Packer, C., Clune, J.: Automatically identifying wild animals in camera trap images with deep learning. arXiv preprint arXiv:​1703.​05830 (2017)
21.
go back to reference Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Object retrieval with large vocabularies and fast spatial matching. In: CVPR, pp. 1–8. IEEE (2007) Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Object retrieval with large vocabularies and fast spatial matching. In: CVPR, pp. 1–8. IEEE (2007)
22.
go back to reference Prodger, P.: Darwin’s Camera: Art and Photography in the Theory of Evolution. Oxford University Press, New York (2009) Prodger, P.: Darwin’s Camera: Art and Photography in the Theory of Evolution. Oxford University Press, New York (2009)
23.
go back to reference Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: NIPS, pp. 91–99 (2015) Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: NIPS, pp. 91–99 (2015)
24.
go back to reference Scott, D.K.: 17 identification of individual Bewick’s swans by bill patterns. Recognition Marking of Animals in Research, p. 160 (1978) Scott, D.K.: 17 identification of individual Bewick’s swans by bill patterns. Recognition Marking of Animals in Research, p. 160 (1978)
25.
go back to reference Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:​1409.​1556 (2014)
26.
go back to reference Swanson, A., Kosmala, M., Lintott, C., Simpson, R., Smith, A., Packer, C.: Snapshot serengeti, high-frequency annotated camera trap images of 40 mammalian species in an African Savanna. Sci. Data 2, 150026 (2015)CrossRef Swanson, A., Kosmala, M., Lintott, C., Simpson, R., Smith, A., Packer, C.: Snapshot serengeti, high-frequency annotated camera trap images of 40 mammalian species in an African Savanna. Sci. Data 2, 150026 (2015)CrossRef
27.
go back to reference Tisse, C.l., Martin, L., Torres, L., Robert, M., et al.: Person identification technique using human iris recognition. In: Proceedings of Vision Interface, pp. 294–299 (2002) Tisse, C.l., Martin, L., Torres, L., Robert, M., et al.: Person identification technique using human iris recognition. In: Proceedings of Vision Interface, pp. 294–299 (2002)
28.
go back to reference Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: CVPR, pp. 586–591. IEEE (1991) Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: CVPR, pp. 586–591. IEEE (1991)
30.
31.
go back to reference Zhu, X., Ramanan, D.: Face detection, pose estimation, and landmark localization in the wild. In: CVPR, pp. 2879–2886. IEEE (2012) Zhu, X., Ramanan, D.: Face detection, pose estimation, and landmark localization in the wild. In: CVPR, pp. 2879–2886. IEEE (2012)
Metadata
Title
Automatic Detection and Recognition of Individuals in Patterned Species
Authors
Gullal Singh Cheema
Saket Anand
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-71273-4_3

Premium Partner