Skip to main content
Top

2018 | OriginalPaper | Chapter

Budget-Constrained Online Video Summarisation of Egocentric Video Using Control Charts

Authors : Paria Yousefi, Clare E. Matthews, Ludmila I. Kuncheva

Published in: Advances in Visual Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Despite the existence of a large number of approaches for generating summaries from egocentric video, online video summarisation has not been fully explored yet. We present an online video summarisation algorithm to generate keyframe summaries during video capture. Event boundaries are identified using control charts and a keyframe is subsequently selected for each event. The number of keyframes is restricted from above which requires a constant review and possible reduction of the cumulatively built summary. The new method was compared against a baseline and a state-of-the-art online video summarisation methods. The evaluation was done on an egocentric video database (Activity of Daily Living (ADL)). Semantic content of the frames in the video was used to evaluate matches with ground truth. The summaries generated by the proposed method outperform those generated by the two competitors.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Abd-Almageed, W.: Online, simultaneous shot boundary detection and key frame extraction for sports videos using rank tracing. In: IEEE 15th International Conference on Image Processing (ICIP 2008), pp. 3200–3203, October 2008 Abd-Almageed, W.: Online, simultaneous shot boundary detection and key frame extraction for sports videos using rank tracing. In: IEEE 15th International Conference on Image Processing (ICIP 2008), pp. 3200–3203, October 2008
2.
go back to reference Almeida, J., Leite, N.J., Torres, R.d.S.: Vison: video summarization for online applications. Pattern Recognit. Lett. 33(4), 397–409 (2012)CrossRef Almeida, J., Leite, N.J., Torres, R.d.S.: Vison: video summarization for online applications. Pattern Recognit. Lett. 33(4), 397–409 (2012)CrossRef
3.
go back to reference Anirudh, R., Masroor, A., Turaga, P.: Diversity promoting online sampling for streaming video summarization. In: IEEE International Conference on Image Processing (ICIP2016), pp. 3329–3333, September 2016 Anirudh, R., Masroor, A., Turaga, P.: Diversity promoting online sampling for streaming video summarization. In: IEEE International Conference on Image Processing (ICIP2016), pp. 3329–3333, September 2016
4.
go back to reference de Avila, S.E.F., Lopes, A.P.B., da Luz, A., Araújo, A.d.A.: VSUMM: a mechanism designed to produce static video summaries and a novel evaluation method. Pattern Recognit. Lett. 32(1), 56–68 (2011) de Avila, S.E.F., Lopes, A.P.B., da Luz, A., Araújo, A.d.A.: VSUMM: a mechanism designed to produce static video summaries and a novel evaluation method. Pattern Recognit. Lett. 32(1), 56–68 (2011)
5.
go back to reference del Molino, A.G., Tan, C., Lim, J.-H., Tan, A.-H.: Summarization of egocentric videos: a comprehensive survey. IEEE Trans. Hum. Mach. Syst. 47(1), 65–76 (2017) del Molino, A.G., Tan, C., Lim, J.-H., Tan, A.-H.: Summarization of egocentric videos: a comprehensive survey. IEEE Trans. Hum. Mach. Syst. 47(1), 65–76 (2017)
6.
go back to reference Elhamifar, E., Kaluza, M.C.D.P.: Online summarization via submodular and convex optimization. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR2017), pp. 1818–1826, July 2017 Elhamifar, E., Kaluza, M.C.D.P.: Online summarization via submodular and convex optimization. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR2017), pp. 1818–1826, July 2017
8.
go back to reference Kerr, J., et al.: Using the sensecam to improve classifications of sedentary behavior in free-living settings. Am. J. Prev. Med. 44(3), 290–296 (2013)CrossRef Kerr, J., et al.: Using the sensecam to improve classifications of sedentary behavior in free-living settings. Am. J. Prev. Med. 44(3), 290–296 (2013)CrossRef
9.
go back to reference Le, H.V., Clinch, S., Sas, C., Dingler, T., Henze, N., Davies, N.: Impact of video summary viewing on episodic memory recall: design guidelines for video summarizations. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing System (CHI 2016), New York, USA, pp. 4793–4805. ACM, May 2016 Le, H.V., Clinch, S., Sas, C., Dingler, T., Henze, N., Davies, N.: Impact of video summary viewing on episodic memory recall: design guidelines for video summarizations. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing System (CHI 2016), New York, USA, pp. 4793–4805. ACM, May 2016
10.
go back to reference Lee, M.L., Dey, A.K.: Lifelogging memory appliance for people with episodic memory impairment. In: Proceedings of the 10th International Conference on Ubiquitous Computing, UbiComp 2008, New York, USA, pp. 44–53. ACM (2008) Lee, M.L., Dey, A.K.: Lifelogging memory appliance for people with episodic memory impairment. In: Proceedings of the 10th International Conference on Ubiquitous Computing, UbiComp 2008, New York, USA, pp. 44–53. ACM (2008)
11.
go back to reference Matthews, C.E., Kuncheva, L.I., Yousefi, P.: Classification and comparison of on-line video summarisation methods. Machine Vision and Applications (2018, Submitted) Matthews, C.E., Kuncheva, L.I., Yousefi, P.: Classification and comparison of on-line video summarisation methods. Machine Vision and Applications (2018, Submitted)
12.
go back to reference Matthews, C.E., Yousefi, P., Kuncheva, L.I.: Using control charts for on-line video summarisation. In: International Joint Conference on Computer Vision and Pattern Recognition (CCVPR 2018) (2018, Submitted) Matthews, C.E., Yousefi, P., Kuncheva, L.I.: Using control charts for on-line video summarisation. In: International Joint Conference on Computer Vision and Pattern Recognition (CCVPR 2018) (2018, Submitted)
13.
go back to reference Mei, S., Guan, G., Wang, Z., Wan, S., He, M., Feng, D.D.: Video summarization via minimum sparse reconstruction. Pattern Recognit. 48(2), 522–533 (2015)CrossRef Mei, S., Guan, G., Wang, Z., Wan, S., He, M., Feng, D.D.: Video summarization via minimum sparse reconstruction. Pattern Recognit. 48(2), 522–533 (2015)CrossRef
14.
go back to reference Monekosso, D.N., Remagnino, P.: Behavior analysis for assisted living. IEEE Trans. Autom. Sci. Eng. 7(4), 879–886 (2010)CrossRef Monekosso, D.N., Remagnino, P.: Behavior analysis for assisted living. IEEE Trans. Autom. Sci. Eng. 7(4), 879–886 (2010)CrossRef
15.
go back to reference O’Loughlin, G., et al.: Using a wearable camera to increase the accuracy of dietary analysis. Am. J. Prev. Med. 44(3), 297–301 (2013)CrossRef O’Loughlin, G., et al.: Using a wearable camera to increase the accuracy of dietary analysis. Am. J. Prev. Med. 44(3), 297–301 (2013)CrossRef
16.
go back to reference Ou, S.-H., Lee, C.-H., Somayazulu, V.S., Chen, Y.-K., Chien, S.-Y.: On-line multi-view video summarization for wireless video sensor network. IEEE J. Sel. Top. Signal Process. 9(1), 165–179 (2015)CrossRef Ou, S.-H., Lee, C.-H., Somayazulu, V.S., Chen, Y.-K., Chien, S.-Y.: On-line multi-view video summarization for wireless video sensor network. IEEE J. Sel. Top. Signal Process. 9(1), 165–179 (2015)CrossRef
17.
go back to reference Pirsiavash, H., Ramanan, D.: Detecting activities of daily living in first-person camera views. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2012), pp. 2847–2854. IEEE , June 2012 Pirsiavash, H., Ramanan, D.: Detecting activities of daily living in first-person camera views. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2012), pp. 2847–2854. IEEE , June 2012
18.
go back to reference Plummer, B.A., Brown, M., Lazebnik, S.: Enhancing video summarization via vision-language embedding. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), pp. 1052–1060, July 2017 Plummer, B.A., Brown, M., Lazebnik, S.: Enhancing video summarization via vision-language embedding. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), pp. 1052–1060, July 2017
19.
go back to reference Rasheed, Z., Shah, M.: Scene detection in Hollywood movies and TV shows. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2003), vol. 2, p. 343. IEEE, June 2003 Rasheed, Z., Shah, M.: Scene detection in Hollywood movies and TV shows. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2003), vol. 2, p. 343. IEEE, June 2003
20.
go back to reference Shewhart, W.A.: Economic Control of Quality of Manufactured Product. Van Nostrand Company, New York (1931) Shewhart, W.A.: Economic Control of Quality of Manufactured Product. Van Nostrand Company, New York (1931)
21.
go back to reference Song, M., Wang, H.: Highly efficient incremental estimation of Gaussian mixture models for online data stream clustering. In: Intelligent Computing: Theory and Applications III, SPIE, vol. 5803, pp. 174–184 (2005) Song, M., Wang, H.: Highly efficient incremental estimation of Gaussian mixture models for online data stream clustering. In: Intelligent Computing: Theory and Applications III, SPIE, vol. 5803, pp. 174–184 (2005)
22.
go back to reference Truong, B.T., Venkatesh, S.: Video abstraction: a systematic review and classification. ACM Trans. Multimed. Comput. Commun. Appl. (TOMM) 3(1), 3 (2007)CrossRef Truong, B.T., Venkatesh, S.: Video abstraction: a systematic review and classification. ACM Trans. Multimed. Comput. Commun. Appl. (TOMM) 3(1), 3 (2007)CrossRef
23.
go back to reference Woodberry, E., Browne, G., Hodges, S., Watson, P., Kapur, N., Woodberry, K.: The use of a wearable camera improves autobiographical memory in patients with Alzheimer’s disease. Memory 23(3), 340–349 (2015)CrossRef Woodberry, E., Browne, G., Hodges, S., Watson, P., Kapur, N., Woodberry, K.: The use of a wearable camera improves autobiographical memory in patients with Alzheimer’s disease. Memory 23(3), 340–349 (2015)CrossRef
24.
Metadata
Title
Budget-Constrained Online Video Summarisation of Egocentric Video Using Control Charts
Authors
Paria Yousefi
Clare E. Matthews
Ludmila I. Kuncheva
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-03801-4_56

Premium Partner