Skip to main content
Top

2019 | OriginalPaper | Chapter

Motion Segmentation Based on Structure-Texture Decomposition and Improved Three Frame Differencing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Motion segmentation from the video datasets has several important applications like traffic monitoring, action recognition, visual object tracking, and video surveillance. The proposed technique combines the structure-texture decomposition and the improved three frames differencing for motion segmentation. First, the Osher and Vese approach is employed to decompose the video frame into two components, viz., structure and texture/noise. Now, to eliminate the noise, only the structure components are employed for further steps. Subsequently, the difference between (i) the current frame and the previous frame as well as (ii) the current frame and the next frame are estimated. Next, both the difference frames are combined using pixel-wise maximum operation. Each combined difference frame is then partitioned into non-overlapping blocks, and the intensity sum as well as median of each block is computed. Successively, target objects are detected with the help of threshold and intensity median. Finally, post-processing in the form of morphology operation and connected component analysis is carried out to accurately find the foreground. Our technique has been formulated, implemented and tested on publicly available standard benchmark datasets and it is proved from performance analysis that our technique exhibit efficient outcomes than existing approaches.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Elharrouss, O., Moujahid, D., Tairi, H.: Motion detection based on the combining of the background subtraction and the structure-texture decomposition. Optik-Int. J. Light Electron Opt. 126(24), 5992–5997 (2015)CrossRef Elharrouss, O., Moujahid, D., Tairi, H.: Motion detection based on the combining of the background subtraction and the structure-texture decomposition. Optik-Int. J. Light Electron Opt. 126(24), 5992–5997 (2015)CrossRef
2.
go back to reference Sengar, S.S., Mukhopadhyay, S.: Detection of moving objects based on enhancement of optical flow. Optik-Int. J. Light Electron Opt. 145, 130–141 (2017)CrossRef Sengar, S.S., Mukhopadhyay, S.: Detection of moving objects based on enhancement of optical flow. Optik-Int. J. Light Electron Opt. 145, 130–141 (2017)CrossRef
3.
go back to reference Fei, M., Li, J., Liu, H.: Visual tracking based on improved foreground detection and perceptual hashing. Neurocomputing 152, 413–428 (2015)CrossRef Fei, M., Li, J., Liu, H.: Visual tracking based on improved foreground detection and perceptual hashing. Neurocomputing 152, 413–428 (2015)CrossRef
4.
go back to reference Sengar, S.S., Mukhopadhyay, S.: A novel method for moving object detection based on block based frame differencing. In: 3rd International Conference on Recent Advances in Information Technology, pp. 462–472. IEEE (2016) Sengar, S.S., Mukhopadhyay, S.: A novel method for moving object detection based on block based frame differencing. In: 3rd International Conference on Recent Advances in Information Technology, pp. 462–472. IEEE (2016)
5.
go back to reference Sengar, S.S., Mukhopadhyay, S.: Motion detection using block based bi-directional optical flow method. J. Vis. Commun. Image Represent. 49, 89–103 (2017)CrossRef Sengar, S.S., Mukhopadhyay, S.: Motion detection using block based bi-directional optical flow method. J. Vis. Commun. Image Represent. 49, 89–103 (2017)CrossRef
6.
go back to reference Sahoo, P.K., Kanungo, P., Mishra, S.: A fast valley-based segmentation for detection of slowly moving objects. Signal Image Video Process. 12, 1–8 (2018)CrossRef Sahoo, P.K., Kanungo, P., Mishra, S.: A fast valley-based segmentation for detection of slowly moving objects. Signal Image Video Process. 12, 1–8 (2018)CrossRef
7.
go back to reference Bouwmans, T., Sobral, A., Javed, S., Jung, S.K., Zahzah, E.H.: Decomposition into low-rank plus additive matrices for background/foreground separation: a review for a comparative evaluation with a large-scale dataset. Comput. Sci. Rev. 23, 1–71 (2016)MATHCrossRef Bouwmans, T., Sobral, A., Javed, S., Jung, S.K., Zahzah, E.H.: Decomposition into low-rank plus additive matrices for background/foreground separation: a review for a comparative evaluation with a large-scale dataset. Comput. Sci. Rev. 23, 1–71 (2016)MATHCrossRef
8.
go back to reference Sengar, S.S., Mukhopadhyay, S.: Moving object tracking using Laplacian-DCT based perceptual hash. In: International Conference on Wireless Communications, Signal Processing and Networking, pp. 2345–2349. IEEE (2016) Sengar, S.S., Mukhopadhyay, S.: Moving object tracking using Laplacian-DCT based perceptual hash. In: International Conference on Wireless Communications, Signal Processing and Networking, pp. 2345–2349. IEEE (2016)
9.
go back to reference Sandberg, B., Chan, T., Vese, L.: A level-set and Gabor-based active contour algorithm for segmenting textured images. In: UCLA Department of Mathematics CAM Report. Citeseer (2002) Sandberg, B., Chan, T., Vese, L.: A level-set and Gabor-based active contour algorithm for segmenting textured images. In: UCLA Department of Mathematics CAM Report. Citeseer (2002)
10.
go back to reference Ono, S., Miyata, T., Yamada, I.: Cartoon-texture image decomposition using blockwise low-rank texture characterization. IEEE Trans. Image Process. 23(3), 1128–1142 (2014)MathSciNetMATHCrossRef Ono, S., Miyata, T., Yamada, I.: Cartoon-texture image decomposition using blockwise low-rank texture characterization. IEEE Trans. Image Process. 23(3), 1128–1142 (2014)MathSciNetMATHCrossRef
12.
go back to reference Wells, W.M., Grimson, W.E.L., Kikinis, R., Jolesz, F.A.: Adaptive segmentation of MRI data. IEEE Trans. Med. Imag. 15(4), 429–442 (1996)CrossRef Wells, W.M., Grimson, W.E.L., Kikinis, R., Jolesz, F.A.: Adaptive segmentation of MRI data. IEEE Trans. Med. Imag. 15(4), 429–442 (1996)CrossRef
13.
go back to reference Malgouyres, F.: Mathematical analysis of a model which combines total variation and wavelet for image restoration. J. Inf. Process. 2(1), 1–10 (2002)MathSciNet Malgouyres, F.: Mathematical analysis of a model which combines total variation and wavelet for image restoration. J. Inf. Process. 2(1), 1–10 (2002)MathSciNet
14.
go back to reference Malgouyres, F.: Combining total variation and wavelet packet approaches for image deblurring. In: IEEE Workshop on Variational and Level Set Methods in Computer Vision, Proceedings, pp. 57–64. IEEE (2001) Malgouyres, F.: Combining total variation and wavelet packet approaches for image deblurring. In: IEEE Workshop on Variational and Level Set Methods in Computer Vision, Proceedings, pp. 57–64. IEEE (2001)
15.
go back to reference Candès, E.J., Guo, F.: New multiscale transforms, minimum total variation synthesis: applications to edge-preserving image reconstruction. Signal Process. 82(11), 1519–1543 (2002)MATHCrossRef Candès, E.J., Guo, F.: New multiscale transforms, minimum total variation synthesis: applications to edge-preserving image reconstruction. Signal Process. 82(11), 1519–1543 (2002)MATHCrossRef
17.
go back to reference Zhu, S.C., Wu, Y., Mumford, D.: Filters, random fields and maximum entropy (frame): towards a unified theory for texture modeling. Int. J. Comput. Vis. 27(2), 107–126 (1998)CrossRef Zhu, S.C., Wu, Y., Mumford, D.: Filters, random fields and maximum entropy (frame): towards a unified theory for texture modeling. Int. J. Comput. Vis. 27(2), 107–126 (1998)CrossRef
18.
go back to reference Halidou, A., You, X., Hamidine, M., Etoundi, R.A., Diakite, L.H.: Fast pedestrian detection based on region of interest and multi-block local binary pattern descriptors. Comput. Electr. Eng. 40(8), 375–389 (2014)CrossRef Halidou, A., You, X., Hamidine, M., Etoundi, R.A., Diakite, L.H.: Fast pedestrian detection based on region of interest and multi-block local binary pattern descriptors. Comput. Electr. Eng. 40(8), 375–389 (2014)CrossRef
19.
go back to reference Foresti, G.L., Micheloni, C., Piciarelli, C.: Detecting moving people in video streams. Pattern Recogn. Lett. 26(14), 2232–2243 (2005)CrossRef Foresti, G.L., Micheloni, C., Piciarelli, C.: Detecting moving people in video streams. Pattern Recogn. Lett. 26(14), 2232–2243 (2005)CrossRef
20.
go back to reference Caballero, A.F., Castillo, J.C., Cantos, J.M., Tomas, R.M.: Optical flow or image subtraction in human detection from infrared camera on mobile robot. J. Rob. Auton. Syst. 58, 1273–1281 (2010)CrossRef Caballero, A.F., Castillo, J.C., Cantos, J.M., Tomas, R.M.: Optical flow or image subtraction in human detection from infrared camera on mobile robot. J. Rob. Auton. Syst. 58, 1273–1281 (2010)CrossRef
21.
go back to reference Bouguet, J.Y.: Pyramidal implementation of the affine Lucas kanade feature tracker description of the algorithm. Intel Corporation 5, 1–10 (2001) Bouguet, J.Y.: Pyramidal implementation of the affine Lucas kanade feature tracker description of the algorithm. Intel Corporation 5, 1–10 (2001)
22.
go back to reference Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: International Conference On Computer Vision and Pattern Recognition. IEEE (1999) Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: International Conference On Computer Vision and Pattern Recognition. IEEE (1999)
23.
go back to reference Sengar, S.S., Mukhopadhyay, S.: Moving object detection based on frame difference and W4. Signal Image Video Process. 11(7), 1357–1364 (2017)CrossRef Sengar, S.S., Mukhopadhyay, S.: Moving object detection based on frame difference and W4. Signal Image Video Process. 11(7), 1357–1364 (2017)CrossRef
24.
go back to reference Maddalena, L., Petrosino, A.: The SOBS algorithm: what are the limits? In: Workshop on Computer Vision and Pattern Recognition, pp. 21–26. IEEE (2012) Maddalena, L., Petrosino, A.: The SOBS algorithm: what are the limits? In: Workshop on Computer Vision and Pattern Recognition, pp. 21–26. IEEE (2012)
25.
go back to reference Oliver, N.M., Rosario, B., Pentland, A.P.: Bayesian computer vision system for modeling human interactions. IEEE Trans. Pattern Anal. Mach. Intell. 22, 831–843 (2000)CrossRef Oliver, N.M., Rosario, B., Pentland, A.P.: Bayesian computer vision system for modeling human interactions. IEEE Trans. Pattern Anal. Mach. Intell. 22, 831–843 (2000)CrossRef
26.
go back to reference Sengar, S.S., Mukhopadhyay, S.: Foreground detection via background subtraction and improved three-frame differencing. Arab. J. Sci. Eng. 42(8), 3621–3633 (2017)CrossRef Sengar, S.S., Mukhopadhyay, S.: Foreground detection via background subtraction and improved three-frame differencing. Arab. J. Sci. Eng. 42(8), 3621–3633 (2017)CrossRef
27.
go back to reference Chen, E., Xu, X., Yang, X., Zhang, W.: Quaternion based optical flow estimation for robust object tracking. J. Digit. Signal Proc. 23, 118–125 (2013)MathSciNetCrossRef Chen, E., Xu, X., Yang, X., Zhang, W.: Quaternion based optical flow estimation for robust object tracking. J. Digit. Signal Proc. 23, 118–125 (2013)MathSciNetCrossRef
28.
go back to reference Schwarz, L.A., Mkhitaryan, A., Mateus, D., Navab, N.: Human skeleton tracking from depth data using geodesic distances and optical flow. J. Image Vis. Comput. 30, 217–226 (2012)CrossRef Schwarz, L.A., Mkhitaryan, A., Mateus, D., Navab, N.: Human skeleton tracking from depth data using geodesic distances and optical flow. J. Image Vis. Comput. 30, 217–226 (2012)CrossRef
29.
go back to reference Sengar, S.S., Mukhopadhyay, S.: Moving object area detection using normalized self adaptive optical flow. Optik-Int. J. Light Electron Opt. 127(16), 6258–6267 (2016)CrossRef Sengar, S.S., Mukhopadhyay, S.: Moving object area detection using normalized self adaptive optical flow. Optik-Int. J. Light Electron Opt. 127(16), 6258–6267 (2016)CrossRef
30.
go back to reference Liu, D., Yu, J.: Otsu method and k-means. In: 9th International Conference on Hybrid Intelligent Systems, pp. 344–349. IEEE (2009) Liu, D., Yu, J.: Otsu method and k-means. In: 9th International Conference on Hybrid Intelligent Systems, pp. 344–349. IEEE (2009)
31.
go back to reference Liao, P., Chen, T., Chung, P.: A fast algorithm for level thresholding. J. Inf. Sci. Eng. 17, 713–727 (2001) Liao, P., Chen, T., Chung, P.: A fast algorithm for level thresholding. J. Inf. Sci. Eng. 17, 713–727 (2001)
32.
go back to reference Luminita, A.V., Stanley, J.O.: Modeling textures with total variation minimization and oscillating patterns in image processing. J. Sci. Comput. 19(1–3), 553–572 (2003)MathSciNetMATH Luminita, A.V., Stanley, J.O.: Modeling textures with total variation minimization and oscillating patterns in image processing. J. Sci. Comput. 19(1–3), 553–572 (2003)MathSciNetMATH
33.
go back to reference Sukumaran, A.N., Sankararajan, R., Swaminathan, M.: Compressed sensing based foreground detection vector for object detection in wireless visual sensor networks. AEU-Int. J. Electron. Commun. 72, 216–224 (2017)CrossRef Sukumaran, A.N., Sankararajan, R., Swaminathan, M.: Compressed sensing based foreground detection vector for object detection in wireless visual sensor networks. AEU-Int. J. Electron. Commun. 72, 216–224 (2017)CrossRef
34.
go back to reference Yin, J., Liu, L., Li, H., Liu, Q.: The infrared moving object detection and security detection related algorithms based on W4 and frame difference. Infrared Phys. Technol. 77, 302–315 (2016)CrossRef Yin, J., Liu, L., Li, H., Liu, Q.: The infrared moving object detection and security detection related algorithms based on W4 and frame difference. Infrared Phys. Technol. 77, 302–315 (2016)CrossRef
35.
go back to reference Dougherty, E.R., Lotufo, R.A.: Hands-on Morphological Image Processing, vol. 71. SPIE Optical Engineering Press, Washington (2003)CrossRef Dougherty, E.R., Lotufo, R.A.: Hands-on Morphological Image Processing, vol. 71. SPIE Optical Engineering Press, Washington (2003)CrossRef
Metadata
Title
Motion Segmentation Based on Structure-Texture Decomposition and Improved Three Frame Differencing
Author
Sandeep Singh Sengar
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-19823-7_51

Premium Partner