Skip to main content
Top
Published in: Pattern Analysis and Applications 3/2018

27-12-2017 | Industrial and Commercial Application

Accurate image segmentation using Gaussian mixture model with saliency map

Authors: Hui Bi, Hui Tang, Guanyu Yang, Huazhong Shu, Jean-Louis Dillenseger

Published in: Pattern Analysis and Applications | Issue 3/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Gaussian mixture model (GMM) is a flexible tool for image segmentation and image classification. However, one main limitation of GMM is that it does not consider spatial information. Some authors introduced global spatial information from neighbor pixels into GMM without taking the image content into account. The technique of saliency map, which is based on the human visual system, enhances the image regions with high perceptive information. In this paper, we propose a new model, which incorporates the image content-based spatial information extracted from saliency map into the conventional GMM. The proposed method has several advantages: It is easy to implement into the expectation–maximization algorithm for parameters estimation, and therefore, there is only little impact in computational cost. Experimental results performed on the public Berkeley database show that the proposed method outperforms the state-of-the-art methods in terms of accuracy and computational time.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Sonka M, Hlavac V, Boyle R (2014) Image processing, analysis, and machine vision. Cengage Learning, Boston Sonka M, Hlavac V, Boyle R (2014) Image processing, analysis, and machine vision. Cengage Learning, Boston
2.
go back to reference McLachlan G, Peel D (2004) Finite mixture models. Wiley, New YorkMATH McLachlan G, Peel D (2004) Finite mixture models. Wiley, New YorkMATH
3.
go back to reference Bishop CM (2006) Pattern recognition and machine Learning 128 Bishop CM (2006) Pattern recognition and machine Learning 128
4.
go back to reference Bouguila N (2011) Count data modeling and classification using finite mixtures of distributions. IEEE Trans Neural Netw 22(2):186–198CrossRef Bouguila N (2011) Count data modeling and classification using finite mixtures of distributions. IEEE Trans Neural Netw 22(2):186–198CrossRef
5.
go back to reference Yuksel SE, Wilson JN, Gader PD (2012) Twenty years of mixture of experts. IEEE Trans Neural Netw Learn Syst 23(8):1177–1193CrossRef Yuksel SE, Wilson JN, Gader PD (2012) Twenty years of mixture of experts. IEEE Trans Neural Netw Learn Syst 23(8):1177–1193CrossRef
6.
go back to reference Allili MS, Bouguila N, Ziou D (2007) A robust video foreground segmentation by using generalized gaussian mixture modeling. In: Fourth Canadian conference on computer and robot vision, 2007. CRV’07. IEEE, pp 503–509 Allili MS, Bouguila N, Ziou D (2007) A robust video foreground segmentation by using generalized gaussian mixture modeling. In: Fourth Canadian conference on computer and robot vision, 2007. CRV’07. IEEE, pp 503–509
7.
go back to reference Allili MS, Bouguila N, Ziou D (2007) Finite generalized Gaussian mixture modeling and applications to image and video foreground segmentation. In: Fourth Canadian conference on computer and robot vision, 2007. CRV’07. IEEE, pp 183–190 Allili MS, Bouguila N, Ziou D (2007) Finite generalized Gaussian mixture modeling and applications to image and video foreground segmentation. In: Fourth Canadian conference on computer and robot vision, 2007. CRV’07. IEEE, pp 183–190
8.
go back to reference Bouwmans T, El Baf F, Vachon B (2008) Background modeling using mixture of gaussians for foreground detection-a survey. Recent Patents Comput Sci 1(3):219–237CrossRef Bouwmans T, El Baf F, Vachon B (2008) Background modeling using mixture of gaussians for foreground detection-a survey. Recent Patents Comput Sci 1(3):219–237CrossRef
9.
go back to reference El Baf F, Bouwmans T, Vachon B (2008) Type-2 fuzzy mixture of Gaussians model: application to background modeling. In: International symposium on visual computing. Springer, pp 772–781 El Baf F, Bouwmans T, Vachon B (2008) Type-2 fuzzy mixture of Gaussians model: application to background modeling. In: International symposium on visual computing. Springer, pp 772–781
10.
go back to reference Shah M, Deng J, Woodford B (2012) Illumination invariant background model using mixture of Gaussians and SURF features. In: Asian Conference on Computer Vision. Springer, pp 308–314 Shah M, Deng J, Woodford B (2012) Illumination invariant background model using mixture of Gaussians and SURF features. In: Asian Conference on Computer Vision. Springer, pp 308–314
11.
go back to reference Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc Ser B (Methodolog) 39:1–38MathSciNetMATH Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc Ser B (Methodolog) 39:1–38MathSciNetMATH
12.
go back to reference Bilmes JA (1998) A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models. Int Comput Sci Inst 4(510):126 Bilmes JA (1998) A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models. Int Comput Sci Inst 4(510):126
14.
go back to reference McLachlan G, Krishnan T (2007) The EM algorithm and extensions, vol 382. Wiley, New YorkMATH McLachlan G, Krishnan T (2007) The EM algorithm and extensions, vol 382. Wiley, New YorkMATH
15.
go back to reference Figueiredo MAT, Jain AK (2002) Unsupervised learning of finite mixture models. IEEE Trans Pattern Anal Mach Intell 24(3):381–396CrossRef Figueiredo MAT, Jain AK (2002) Unsupervised learning of finite mixture models. IEEE Trans Pattern Anal Mach Intell 24(3):381–396CrossRef
16.
go back to reference Blekas K, Likas A, Galatsanos NP, Lagaris IE (2005) A spatially constrained mixture model for image segmentation. IEEE Trans Neural Netw 16(2):494–498CrossRef Blekas K, Likas A, Galatsanos NP, Lagaris IE (2005) A spatially constrained mixture model for image segmentation. IEEE Trans Neural Netw 16(2):494–498CrossRef
17.
go back to reference Nguyen TM, Wu QJ (2012) Gaussian-mixture-model-based spatial neighborhood relationships for pixel labeling problem. IEEE Trans Syst Man Cybern Part B (Cybernetics) 42(1):193–202CrossRef Nguyen TM, Wu QJ (2012) Gaussian-mixture-model-based spatial neighborhood relationships for pixel labeling problem. IEEE Trans Syst Man Cybern Part B (Cybernetics) 42(1):193–202CrossRef
18.
go back to reference Chatzis SP, Varvarigou TA (2008) A fuzzy clustering approach toward hidden Markov random field models for enhanced spatially constrained image segmentation. IEEE Trans Fuzzy Syst 16(5):1351–1361CrossRef Chatzis SP, Varvarigou TA (2008) A fuzzy clustering approach toward hidden Markov random field models for enhanced spatially constrained image segmentation. IEEE Trans Fuzzy Syst 16(5):1351–1361CrossRef
19.
go back to reference Diplaros A, Vlassis N, Gevers T (2007) A spatially constrained generative model and an EM algorithm for image segmentation. IEEE Trans Neural Netw 18(3):798–808CrossRef Diplaros A, Vlassis N, Gevers T (2007) A spatially constrained generative model and an EM algorithm for image segmentation. IEEE Trans Neural Netw 18(3):798–808CrossRef
20.
go back to reference Sanjay-Gopal S, Hebert TJ (1998) Bayesian pixel classification using spatially variant finite mixtures and the generalized EM algorithm. IEEE Trans Image Process 7(7):1014–1028CrossRef Sanjay-Gopal S, Hebert TJ (1998) Bayesian pixel classification using spatially variant finite mixtures and the generalized EM algorithm. IEEE Trans Image Process 7(7):1014–1028CrossRef
21.
go back to reference Tang H, Dillenseger J-L, Bao XD, Luo LM (2009) A vectorial image soft segmentation method based on neighborhood weighted Gaussian mixture model. Comput Med Imaging Graph 33(8):644–650CrossRef Tang H, Dillenseger J-L, Bao XD, Luo LM (2009) A vectorial image soft segmentation method based on neighborhood weighted Gaussian mixture model. Comput Med Imaging Graph 33(8):644–650CrossRef
22.
go back to reference Zhang H, Wu QJ, Nguyen TM (2013) Image segmentation by a robust modified gaussian mixture model. In: 2013 IEEE international conference on acoustics, speech and signal processing. IEEE, pp 1478–1482 Zhang H, Wu QJ, Nguyen TM (2013) Image segmentation by a robust modified gaussian mixture model. In: 2013 IEEE international conference on acoustics, speech and signal processing. IEEE, pp 1478–1482
23.
go back to reference Zhang H, Wu QJ, Nguyen TM (2013) Incorporating mean template into finite mixture model for image segmentation. IEEE Trans Neural Netw Learn Syst 24(2):328–335CrossRef Zhang H, Wu QJ, Nguyen TM (2013) Incorporating mean template into finite mixture model for image segmentation. IEEE Trans Neural Netw Learn Syst 24(2):328–335CrossRef
24.
go back to reference Treisman AM, Gelade G (1980) A feature-integration theory of attention. Cogn Psychol 12(1):97–136CrossRef Treisman AM, Gelade G (1980) A feature-integration theory of attention. Cogn Psychol 12(1):97–136CrossRef
25.
go back to reference Cheng M-M, Mitra NJ, Huang X, Torr PH, Hu S-M (2015) Global contrast based salient region detection. IEEE Trans Pattern Anal Mach Intell 37(3):569–582CrossRef Cheng M-M, Mitra NJ, Huang X, Torr PH, Hu S-M (2015) Global contrast based salient region detection. IEEE Trans Pattern Anal Mach Intell 37(3):569–582CrossRef
26.
go back to reference Rensink RA, O’Regan JK, Clark JJ (1997) To see or not to see: the need for attention to perceive changes in scenes. Psychol Sci 8(5):368–373CrossRef Rensink RA, O’Regan JK, Clark JJ (1997) To see or not to see: the need for attention to perceive changes in scenes. Psychol Sci 8(5):368–373CrossRef
27.
go back to reference Rensink RA, Enns JT (1995) Preemption effects in visual search: evidence for low-level grouping. Psychol Rev 102(1):101CrossRef Rensink RA, Enns JT (1995) Preemption effects in visual search: evidence for low-level grouping. Psychol Rev 102(1):101CrossRef
28.
go back to reference Rensink RA (2000) Seeing, sensing, and scrutinizing. Vision Res 40(10):1469–1487CrossRef Rensink RA (2000) Seeing, sensing, and scrutinizing. Vision Res 40(10):1469–1487CrossRef
29.
go back to reference Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259CrossRef Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259CrossRef
30.
go back to reference Borji A, Itti L (2013) State-of-the-art in visual attention modeling. IEEE Trans Pattern Anal Mach Intell 35(1):185–207CrossRef Borji A, Itti L (2013) State-of-the-art in visual attention modeling. IEEE Trans Pattern Anal Mach Intell 35(1):185–207CrossRef
31.
go back to reference Walther D, Itti L, Riesenhuber M, Poggio T, Koch C (2002) Attentional selection for object recognition—a gentle way. In: International workshop on biologically motivated computer vision. Springer, pp 472–479 Walther D, Itti L, Riesenhuber M, Poggio T, Koch C (2002) Attentional selection for object recognition—a gentle way. In: International workshop on biologically motivated computer vision. Springer, pp 472–479
32.
go back to reference Hou X, Zhang L (2007) Saliency detection: a spectral residual approach. In: 2007 IEEE conference on computer vision and pattern recognition. IEEE, pp 1–8 Hou X, Zhang L (2007) Saliency detection: a spectral residual approach. In: 2007 IEEE conference on computer vision and pattern recognition. IEEE, pp 1–8
33.
go back to reference Ruderman DL (1994) The statistics of natural images. Netw Comput Neural Syst 5(4):517–548CrossRefMATH Ruderman DL (1994) The statistics of natural images. Netw Comput Neural Syst 5(4):517–548CrossRefMATH
34.
go back to reference Srivastava A, Lee AB, Simoncelli EP, Zhu S-C (2003) On advances in statistical modeling of natural images. J Math Imag Vis 18(1):17–33MathSciNetCrossRefMATH Srivastava A, Lee AB, Simoncelli EP, Zhu S-C (2003) On advances in statistical modeling of natural images. J Math Imag Vis 18(1):17–33MathSciNetCrossRefMATH
35.
go back to reference Krinidis S, Chatzis V (2010) A robust fuzzy local information C-means clustering algorithm. IEEE Trans Image Process 19(5):1328–1337MathSciNetCrossRefMATH Krinidis S, Chatzis V (2010) A robust fuzzy local information C-means clustering algorithm. IEEE Trans Image Process 19(5):1328–1337MathSciNetCrossRefMATH
36.
go back to reference Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of eighth IEEE international conference on computer vision, 2001. ICCV 2001. IEEE, pp 416–423 Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of eighth IEEE international conference on computer vision, 2001. ICCV 2001. IEEE, pp 416–423
37.
go back to reference Unnikrishnan R, Pantofaru C, Hebert M (2007) Toward objective evaluation of image segmentation algorithms. IEEE Trans Pattern Anal Mach Intell 29(6):929–944CrossRef Unnikrishnan R, Pantofaru C, Hebert M (2007) Toward objective evaluation of image segmentation algorithms. IEEE Trans Pattern Anal Mach Intell 29(6):929–944CrossRef
Metadata
Title
Accurate image segmentation using Gaussian mixture model with saliency map
Authors
Hui Bi
Hui Tang
Guanyu Yang
Huazhong Shu
Jean-Louis Dillenseger
Publication date
27-12-2017
Publisher
Springer London
Published in
Pattern Analysis and Applications / Issue 3/2018
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-017-0672-1

Other articles of this Issue 3/2018

Pattern Analysis and Applications 3/2018 Go to the issue

Premium Partner