Skip to main content

2016 | OriginalPaper | Buchkapitel

Feature Correspondence in Low Quality CCTV Videos

verfasst von : Craig Henderson, Ebroul Izquierdo

Erschienen in: Emerging Trends and Advanced Technologies for Computational Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Closed-circuit television cameras are used extensively to monitor streets for the security of the public. Whether passively recording day-to-day life, or actively monitoring a developing situation such as public disorder, the videos recorded have proven invaluable to police forces world wide to trace suspects and victims alike. The volume of video produced from the array of camera covering even a small area is large, and growing in modern society, and post-event analysis of collected video is a time consuming problem for police forces that is increasing. Automated computer vision analysis is desirable, but current systems are unable to reliably process videos from CCTV cameras. The video quality is low, and computer vision algorithms are unable to perform sufficiently to achieve usable results. In this chapter, we describe some of the reasons for the failure of contemporary algorithms and focus on the fundamental task of feature correspondence between frames of video—a well-studied and often considered solved problem in high quality videos, but still a challenge in low quality imagery. We present solutions to some of the problems that we acknowledge, and provide a comprehensive analysis where we demonstrate feature matching using a 138-dimensional descriptor that improves the matching performance of a state-of-the-art 384-dimension colour descriptor with just \(36\,\%\) of the storage requirements.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Anjulan, A., Canagarajah, N.: A unified framework for object retrieval and mining. IEEE Trans. Circuits Syst. Video Technol. 19(1), 63–76 (2009)CrossRef Anjulan, A., Canagarajah, N.: A unified framework for object retrieval and mining. IEEE Trans. Circuits Syst. Video Technol. 19(1), 63–76 (2009)CrossRef
2.
Zurück zum Zitat Arandjelović, R.: Advancing Large Scale Object Retrieval. PhD thesis, University of Oxford (2013) Arandjelović, R.: Advancing Large Scale Object Retrieval. PhD thesis, University of Oxford (2013)
3.
Zurück zum Zitat Arandjelović, R., Zisserman, A.: Three things everyone should know to improve object retrieval. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2911–2918. IEEE (2012) Arandjelović, R., Zisserman, A.: Three things everyone should know to improve object retrieval. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2911–2918. IEEE (2012)
4.
Zurück zum Zitat Asghar, M.M.N., Hussain, F., Manton, R.: Video indexing: a survey. Int. J. Comput. Inf. Technol. 3(1), 148–169 (2014) Asghar, M.M.N., Hussain, F., Manton, R.: Video indexing: a survey. Int. J. Comput. Inf. Technol. 3(1), 148–169 (2014)
5.
Zurück zum Zitat Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRef Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRef
6.
Zurück zum Zitat Bhattacharyya, A.: On a measure of divergence between two statistical populations defined by their probability distributions. Bull. Calcutta Math. Soc. 35, 99–109 (1943)MathSciNetMATH Bhattacharyya, A.: On a measure of divergence between two statistical populations defined by their probability distributions. Bull. Calcutta Math. Soc. 35, 99–109 (1943)MathSciNetMATH
7.
Zurück zum Zitat Bordwell, D.: The Way Hollywood Tells It: Story and Style in Modern Movies. University of California Press, ISBN 978-0520246225 (2006) Bordwell, D.: The Way Hollywood Tells It: Story and Style in Modern Movies. University of California Press, ISBN 978-0520246225 (2006)
8.
Zurück zum Zitat Buckland, M., Gey, F.: The relationship between recall and precision. J. Am. Soc. Inf. Sci. 45(1), 12–19 (1994)CrossRef Buckland, M., Gey, F.: The relationship between recall and precision. J. Am. Soc. Inf. Sci. 45(1), 12–19 (1994)CrossRef
9.
Zurück zum Zitat Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)CrossRef Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)CrossRef
10.
Zurück zum Zitat Carpineto, C., Romano, G.: A survey of automatic query expansion in information retrieval. ACM Comput. Surv. 44(1), 1–50 (2012)CrossRefMATH Carpineto, C., Romano, G.: A survey of automatic query expansion in information retrieval. ACM Comput. Surv. 44(1), 1–50 (2012)CrossRefMATH
11.
Zurück zum Zitat Dash, R., Majhi, B.: Motion blur parameters estimation for image restoration. Opt. Int. J. Light Electron Opt. 125(5), pp. 1634–1640 (2014) Dash, R., Majhi, B.: Motion blur parameters estimation for image restoration. Opt. Int. J. Light Electron Opt. 125(5), pp. 1634–1640 (2014)
12.
Zurück zum Zitat Edelman, G., Bijhold, J.: Tracking people and cars using 3D modeling and CCTV. Forensic Sci. Int. 202(1–3), 26–35 (2010)CrossRef Edelman, G., Bijhold, J.: Tracking people and cars using 3D modeling and CCTV. Forensic Sci. Int. 202(1–3), 26–35 (2010)CrossRef
13.
Zurück zum Zitat Forssén, P.E.: Maximally stable colour regions for recognition and matching. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007) Forssén, P.E.: Maximally stable colour regions for recognition and matching. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
14.
Zurück zum Zitat Forssén, P.E., Lowe, D.G.: Shape descriptors for maximally stable extremal regions. In: Proceedings of IEEE International Conference on Computer Vision, pp. 1–8 (2007) Forssén, P.E., Lowe, D.G.: Shape descriptors for maximally stable extremal regions. In: Proceedings of IEEE International Conference on Computer Vision, pp. 1–8 (2007)
15.
Zurück zum Zitat Harris, C., Stephens, M.: A combined corner and edge detector. In: Proceedings Alvey Vision Conference, pp. 147–151. Alvey Vision Club (1988) Harris, C., Stephens, M.: A combined corner and edge detector. In: Proceedings Alvey Vision Conference, pp. 147–151. Alvey Vision Club (1988)
16.
Zurück zum Zitat Henderson, C., Izquierdo, E.: Robust Feature matching in the wild. In: Science and Information Conference, pp. 628–637 IEEE, London (2015) Henderson, C., Izquierdo, E.: Robust Feature matching in the wild. In: Science and Information Conference, pp. 628–637 IEEE, London (2015)
17.
Zurück zum Zitat Henderson, C., Blasi, S.G., Sobhani, F., Izquierdo, E.: On the impurity of street-scene video footage. In: International Conference on Imaging for Crime Detection and Prevention. IEEE, London (2015) Henderson, C., Blasi, S.G., Sobhani, F., Izquierdo, E.: On the impurity of street-scene video footage. In: International Conference on Imaging for Crime Detection and Prevention. IEEE, London (2015)
18.
Zurück zum Zitat Hripcsak, G.: Agreement, the F-measure, and reliability in information retrieval. J. Am. Med. Inform. Assoc. 12(3), 296–298 (2005)CrossRef Hripcsak, G.: Agreement, the F-measure, and reliability in information retrieval. J. Am. Med. Inform. Assoc. 12(3), 296–298 (2005)CrossRef
19.
Zurück zum Zitat Jiang, Y.G., Ngo, C.W., Yang, J.: Towards optimal bag-of-features for object categorization and semantic video retrieval. Proceedings of the 6th ACM International Conference on Image and Video Retrieval—CIVR ’07, pp. 494–501 (2007) Jiang, Y.G., Ngo, C.W., Yang, J.: Towards optimal bag-of-features for object categorization and semantic video retrieval. Proceedings of the 6th ACM International Conference on Image and Video Retrieval—CIVR ’07, pp. 494–501 (2007)
20.
Zurück zum Zitat Liu, H.L.H., Setiono, R.: Chi2: feature selection and discretization of numeric attributes. In: Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence, pp. 388–391 (1995) Liu, H.L.H., Setiono, R.: Chi2: feature selection and discretization of numeric attributes. In: Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence, pp. 388–391 (1995)
21.
Zurück zum Zitat Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
22.
Zurück zum Zitat Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)CrossRef Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)CrossRef
23.
Zurück zum Zitat Noble, J.A.: Finding corners. Image Vis. Comput. 6(2), 121–128 (1988)CrossRef Noble, J.A.: Finding corners. Image Vis. Comput. 6(2), 121–128 (1988)CrossRef
24.
Zurück zum Zitat Park, U., Jain, A., Kitahara, I., Kogure, K., Hagita, N.: ViSE: visual search engine using multiple networked cameras. In: 18th International Conference on Pattern Recognition, vol. 3, pp. 1204–1207. IEEE (2006) Park, U., Jain, A., Kitahara, I., Kogure, K., Hagita, N.: ViSE: visual search engine using multiple networked cameras. In: 18th International Conference on Pattern Recognition, vol. 3, pp. 1204–1207. IEEE (2006)
25.
Zurück zum Zitat Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Object retrieval with large vocabularies and fast spatial matching. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007) Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Object retrieval with large vocabularies and fast spatial matching. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
26.
Zurück zum Zitat Powers, D.: Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation. J. Mach. Learn. Technol. 2(1), 37–63 (2011)MathSciNet Powers, D.: Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation. J. Mach. Learn. Technol. 2(1), 37–63 (2011)MathSciNet
27.
Zurück zum Zitat Rubner, Y., Tomasi, C., Guibas, L.J.: Earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)CrossRefMATH Rubner, Y., Tomasi, C., Guibas, L.J.: Earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)CrossRefMATH
28.
Zurück zum Zitat Schuler, C., Hirsch, M.: Learning to Deblur. In: NIPS 2014 Deep Learn. Represent. Learn. Workshop, Montreal (2014) Schuler, C., Hirsch, M.: Learning to Deblur. In: NIPS 2014 Deep Learn. Represent. Learn. Workshop, Montreal (2014)
29.
Zurück zum Zitat Shekhar, R., Jawahar, C.: Word image retrieval using bag of visual words. In: 2012 10th IAPR International Workshop on Document Analysis. Systems, pp. 297–301. IEEE (2012) Shekhar, R., Jawahar, C.: Word image retrieval using bag of visual words. In: 2012 10th IAPR International Workshop on Document Analysis. Systems, pp. 297–301. IEEE (2012)
30.
Zurück zum Zitat Sivic, J., Zisserman, A.: Video Google: a text retrieval approach to object matching in videos. In: Proceedings Ninth IEEE International Conference on Computer Vision, vol. 2, pp. 1470–1477 (2003) Sivic, J., Zisserman, A.: Video Google: a text retrieval approach to object matching in videos. In: Proceedings Ninth IEEE International Conference on Computer Vision, vol. 2, pp. 1470–1477 (2003)
31.
Zurück zum Zitat Sivic, J., Zisserman, A.: Video data mining using configurations of viewpoint invariant regions. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 1, pp. 488–495. IEEE (2004) Sivic, J., Zisserman, A.: Video data mining using configurations of viewpoint invariant regions. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 1, pp. 488–495. IEEE (2004)
32.
Zurück zum Zitat Sivic, J., Zisserman, A.: Efficient visual search of videos cast as text retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 31(4), 591–606 (2009)CrossRef Sivic, J., Zisserman, A.: Efficient visual search of videos cast as text retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 31(4), 591–606 (2009)CrossRef
33.
Zurück zum Zitat Sivic, J., Schaffalitzky, F., Zisserman, A.: Efficient object retrieval from videos. In: Proceedings of 12th European Signal Processing Conference EUSIPCO 04, pp. 36–39, Vienna, Austria (2004) Sivic, J., Schaffalitzky, F., Zisserman, A.: Efficient object retrieval from videos. In: Proceedings of 12th European Signal Processing Conference EUSIPCO 04, pp. 36–39, Vienna, Austria (2004)
34.
Zurück zum Zitat Sivic, J., Schaffalitzky, F., Zisserman, A.: Object level grouping for video shots. Int. J. Comput. Vis. 67, 189–210 (2006)CrossRefMATH Sivic, J., Schaffalitzky, F., Zisserman, A.: Object level grouping for video shots. Int. J. Comput. Vis. 67, 189–210 (2006)CrossRefMATH
35.
Zurück zum Zitat Stokman, H., Gevers, T.: Selection and fusion of color models for feature Detection.pdf. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 560–565. IEEE (2005) Stokman, H., Gevers, T.: Selection and fusion of color models for feature Detection.pdf. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 560–565. IEEE (2005)
36.
Zurück zum Zitat Swain, M.J., Ballard, D.H.: Color indexing. Int. J. Comput. Vis. 7(1), 11–32 (1991)CrossRef Swain, M.J., Ballard, D.H.: Color indexing. Int. J. Comput. Vis. 7(1), 11–32 (1991)CrossRef
37.
Zurück zum Zitat Van De Sande, K.E., Gevers, T., Snoek, C.: Evaluating color descriptors for object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1582–1596 (2010)CrossRef Van De Sande, K.E., Gevers, T., Snoek, C.: Evaluating color descriptors for object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1582–1596 (2010)CrossRef
38.
Zurück zum Zitat van de Weijer, J., Schmid, C.: Coloring local feature extraction. In: 9th European Conference on Computer Vision, vol. 3952, pp. 334–348 (2006) van de Weijer, J., Schmid, C.: Coloring local feature extraction. In: 9th European Conference on Computer Vision, vol. 3952, pp. 334–348 (2006)
39.
Zurück zum Zitat Yuan, J., Wang, H., Xiao, L., Zheng, W., Li, J., Lin, F., Zhang, B.: A formal study of shot boundary detection. IEEE Trans. Circuits Syst. Video Technol. 17(2), 168–186 (2007)CrossRef Yuan, J., Wang, H., Xiao, L., Zheng, W., Li, J., Lin, F., Zhang, B.: A formal study of shot boundary detection. IEEE Trans. Circuits Syst. Video Technol. 17(2), 168–186 (2007)CrossRef
Metadaten
Titel
Feature Correspondence in Low Quality CCTV Videos
verfasst von
Craig Henderson
Ebroul Izquierdo
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-33353-3_14

Premium Partner