Skip to main content
Top
Published in: Neural Processing Letters 3/2016

01-12-2016

A Multiple Graph Label Propagation Integration Framework for Salient Object Detection

Authors: Jingbo Zhou, Yongfeng Ren, Yunyang Yan, Li Pan

Published in: Neural Processing Letters | Issue 3/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Saliency prediction typically relies on multiple features that are combined in the ways of weighted summation or multiplication to form a saliency map, which is heuristic and hard for generalization. In this paper, a novel multiple graph label propagation integration framework for saliency object detection algorithm is proposed. The proposed algorithm is divided into four steps. First, an input image is segmented into superpixels which are represented as nodes in a graph and transformed from RGB color space into CIE L*a*b* color space. Second, combined by texture features, we measure the similarity of two adjacent superpixels for each feature, which is represented as an affinity matrix. Then, to generate the salient seeds, we adopt the color boosting Harris points as salient points to catch the corners or marginal points of visual salient region in color image. The saliency points provide us a coarse location of the salient areas. In the last step, the graphs are combined into label propagation framework to obtain the saliency maps. We propose efficient optimization algorithms for the proposed approach, which generate sparse weighted coefficients that allow identifying the graphs which are important or not for salient object detection easily. Experiments on four benchmark databases demonstrate the proposed method performs well when it violates the state-of-the-art methods in terms of accuracy and robustness.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Santella A, Agrawala M, DeCarlo D, Salesin D, Cohen M (2006) Gaze-based interaction for semi-automatic photo cropping. In: Proceedings of the SIGCHI conference human factors in computing systems, pp. 771–780 Santella A, Agrawala M, DeCarlo D, Salesin D, Cohen M (2006) Gaze-based interaction for semi-automatic photo cropping. In: Proceedings of the SIGCHI conference human factors in computing systems, pp. 771–780
2.
go back to reference Chen L, Xie X, Fan X et al (2003) A visual attention model for adapting images on small displays. Multimed Syst 9(4):353–364CrossRef Chen L, Xie X, Fan X et al (2003) A visual attention model for adapting images on small displays. Multimed Syst 9(4):353–364CrossRef
3.
go back to reference Guo C, Zhang L (2010) A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans Image Process 19(1):185–198MathSciNetCrossRef Guo C, Zhang L (2010) A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans Image Process 19(1):185–198MathSciNetCrossRef
4.
go back to reference Navalpakkam V, Itti L (2006) An integrated model of top-down and bottom-up attention for optimizing detection speed. In: Proceedings of the international conference on computer vision and pattern recognition, vol. 2, pp. 2049–2056 Navalpakkam V, Itti L (2006) An integrated model of top-down and bottom-up attention for optimizing detection speed. In: Proceedings of the international conference on computer vision and pattern recognition, vol. 2, pp. 2049–2056
5.
go back to reference Rutishauser U, Walther D, Koch C, Perona P (2004) Is bottom-up attention useful for object recognition? In: Proceedings of the international conference on computer vision and pattern recognition, vol. 2, pp. 37–44 Rutishauser U, Walther D, Koch C, Perona P (2004) Is bottom-up attention useful for object recognition? In: Proceedings of the international conference on computer vision and pattern recognition, vol. 2, pp. 37–44
6.
go back to reference Itti L (2000) Models of bottom-up and top-down visual attention. PhD thesis, California Institute of Technology Pasadena Itti L (2000) Models of bottom-up and top-down visual attention. PhD thesis, California Institute of Technology Pasadena
7.
go back to reference Kanan C, Tong MH, Zhang L, Cottrell GW (2009) SUN: top-down saliency using natural statistics. Vis Cognit 17(6):979–1003CrossRef Kanan C, Tong MH, Zhang L, Cottrell GW (2009) SUN: top-down saliency using natural statistics. Vis Cognit 17(6):979–1003CrossRef
8.
go back to reference Lu Z, Lin W, Yang X, Ong E, Yao S (2005) Modeling visual attention’s modulatory aftereffects on visual sensitivity and quality evaluation. IEEE Trans Image Process 14(11):1928–1942CrossRef Lu Z, Lin W, Yang X, Ong E, Yao S (2005) Modeling visual attention’s modulatory aftereffects on visual sensitivity and quality evaluation. IEEE Trans Image Process 14(11):1928–1942CrossRef
9.
go back to reference Yan Q, Xu L, Shi J, Jia J (2013) Hierarchical saliency detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1155–1162 Yan Q, Xu L, Shi J, Jia J (2013) Hierarchical saliency detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1155–1162
10.
go back to reference Zhou J, Jin Z (2013) A new framework for multiscale saliency detection based on image patches. Neural Process Lett 38(3):361–374CrossRef Zhou J, Jin Z (2013) A new framework for multiscale saliency detection based on image patches. Neural Process Lett 38(3):361–374CrossRef
11.
go back to reference Yang C, Zhang L, Lu H, Ruan X, Yang MH (2013) Saliency detection via graph-based manifold ranking. In: Proceedings of the international conference on computer vision and pattern recognition Yang C, Zhang L, Lu H, Ruan X, Yang MH (2013) Saliency detection via graph-based manifold ranking. In: Proceedings of the international conference on computer vision and pattern recognition
12.
go back to reference Zhou J, Jin Z, Yang J (2012) Multiscale saliency detection using principle component analysis. In: Proceedings of the joint international conference on neural networks (IJCNN), pp. 1–6 Zhou J, Jin Z, Yang J (2012) Multiscale saliency detection using principle component analysis. In: Proceedings of the joint international conference on neural networks (IJCNN), pp. 1–6
13.
go back to reference Gopalakrishnan V, Hu Y, Rajan D (2010) Random walks on graphs for salient object detection in images. IEEE Trans Image Process 19(12):3232–3242MathSciNetCrossRef Gopalakrishnan V, Hu Y, Rajan D (2010) Random walks on graphs for salient object detection in images. IEEE Trans Image Process 19(12):3232–3242MathSciNetCrossRef
14.
go back to reference Chang KY, Liu TL, Chen HT, Lai, SH (2011) Fusing generic objectness and visual saliency for salient object detection. In; 13th IEEE international conference on computer vision (ICCV), pp. 914–921 Chang KY, Liu TL, Chen HT, Lai, SH (2011) Fusing generic objectness and visual saliency for salient object detection. In; 13th IEEE international conference on computer vision (ICCV), pp. 914–921
15.
go back to reference Liu T, Yuan Z, Sun J et al (2011) Learning to detect a salient object. IEEE Trans Pattern Anal Mach Intell 33(2):353–367CrossRef Liu T, Yuan Z, Sun J et al (2011) Learning to detect a salient object. IEEE Trans Pattern Anal Mach Intell 33(2):353–367CrossRef
16.
go back to reference Lu S, Mahadevan V, Vasconcelos N (2014) Learning optimal features for salient object detection. In: Proceedings of the international conference on computer vision and pattern recognition Lu S, Mahadevan V, Vasconcelos N (2014) Learning optimal features for salient object detection. In: Proceedings of the international conference on computer vision and pattern recognition
17.
go back to reference Achanta R, Estrada F, Wils P, Süsstrunk S (2008) Salient region detection and segmentation. In: Proceedings of the 6th international conference on computer vision systems, pp. 66–75 Achanta R, Estrada F, Wils P, Süsstrunk S (2008) Salient region detection and segmentation. In: Proceedings of the 6th international conference on computer vision systems, pp. 66–75
18.
go back to reference Xie Y, Lu H, Yang M (2013) Bayesian saliency via low and mid-level cues. IEEE Trans Image Process 22(5):1689–1698MathSciNetCrossRef Xie Y, Lu H, Yang M (2013) Bayesian saliency via low and mid-level cues. IEEE Trans Image Process 22(5):1689–1698MathSciNetCrossRef
19.
go back to reference Margolin R, Tal A, Zelnik-Manor L (2013) What makes a patch distinct? In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1139–1146 Margolin R, Tal A, Zelnik-Manor L (2013) What makes a patch distinct? In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1139–1146
20.
go back to reference Borji A, Itti L (2013) State-of-the-art in visual attention modeling. IEEE Trans Pattern Anal Mach Intell 35(1):185–207MathSciNetCrossRef Borji A, Itti L (2013) State-of-the-art in visual attention modeling. IEEE Trans Pattern Anal Mach Intell 35(1):185–207MathSciNetCrossRef
21.
go back to reference Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259CrossRef Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259CrossRef
22.
go back to reference Bruce N, Tsotsos J (2006) Saliency based on information maximization. In: Advances in neural information processing systems, pp. 155–162 Bruce N, Tsotsos J (2006) Saliency based on information maximization. In: Advances in neural information processing systems, pp. 155–162
23.
go back to reference Oliva A, Torralba A, Castelhano M, Henderso J (2003) Top-down control of visual attention in object detection. In: Proceedings of international conference on image processing, pp. 253–256 Oliva A, Torralba A, Castelhano M, Henderso J (2003) Top-down control of visual attention in object detection. In: Proceedings of international conference on image processing, pp. 253–256
24.
go back to reference Zhang L, Tong M, Marks T, Shan H, Cottrell G (2008) SUN: A Bayesian framework for saliency using natural statistics. J Vis 8(7):1–20CrossRef Zhang L, Tong M, Marks T, Shan H, Cottrell G (2008) SUN: A Bayesian framework for saliency using natural statistics. J Vis 8(7):1–20CrossRef
25.
go back to reference Gao D, Mahadevan V, Vasconcelos N (2008) On the plausibility of the discriminant center-surround hypothesis for visual saliency. J Vis 8(7):1–18 13CrossRef Gao D, Mahadevan V, Vasconcelos N (2008) On the plausibility of the discriminant center-surround hypothesis for visual saliency. J Vis 8(7):1–18 13CrossRef
26.
go back to reference Guo C, Ma Q, Zhang L (2008) Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1–8 Guo C, Ma Q, Zhang L (2008) Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1–8
27.
go back to reference Hou X, Harel J, Koch C (2012) Image signature: highlighting sparse salient regions. IEEE Trans Pattern Anal Mach Intell 34(1):194–201CrossRef Hou X, Harel J, Koch C (2012) Image signature: highlighting sparse salient regions. IEEE Trans Pattern Anal Mach Intell 34(1):194–201CrossRef
28.
go back to reference Achanta R, Hemami S, Estrada F, Susstrunk S (2009) Frequency-tuned salient region detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1597–1604 Achanta R, Hemami S, Estrada F, Susstrunk S (2009) Frequency-tuned salient region detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1597–1604
29.
go back to reference Cheng M et al. (2011) Global contrast based salient region detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 409–416 Cheng M et al. (2011) Global contrast based salient region detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 409–416
30.
go back to reference Goferman S, Zelnik-Manor L, Tal A (2012) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34(10):1915–1926CrossRef Goferman S, Zelnik-Manor L, Tal A (2012) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34(10):1915–1926CrossRef
31.
go back to reference Gao D, Han S, Vasconcelos N (2009) Discriminant saliency, the detection of suspicious coincidences, and applications to visual recognition. IEEE Trans Pattern Anal Mach Intell 31(6):989–1005CrossRef Gao D, Han S, Vasconcelos N (2009) Discriminant saliency, the detection of suspicious coincidences, and applications to visual recognition. IEEE Trans Pattern Anal Mach Intell 31(6):989–1005CrossRef
32.
go back to reference Judd T, Ehinger K, Durand F, Torralba A (2009) Learning to predict where humans look. In: 12th IEEE international conference on computer vision (ICCV), pp. 2106–2113 Judd T, Ehinger K, Durand F, Torralba A (2009) Learning to predict where humans look. In: 12th IEEE international conference on computer vision (ICCV), pp. 2106–2113
33.
go back to reference Jiang H, Wang J, Yuan Z, Wu Y, Zheng N, Li S (2013) Salient object detection: a discriminative regional feature integration approach. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 2083–2090 Jiang H, Wang J, Yuan Z, Wu Y, Zheng N, Li S (2013) Salient object detection: a discriminative regional feature integration approach. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 2083–2090
34.
go back to reference Christian S, Alexander W, Khalil F, David C, John Z (2013) Statistical textural distinctiveness for salient region detection in natural images. In: Proceedings of the international conference on computer vision and pattern recognition Christian S, Alexander W, Khalil F, David C, John Z (2013) Statistical textural distinctiveness for salient region detection in natural images. In: Proceedings of the international conference on computer vision and pattern recognition
35.
go back to reference Shen X, Wu Y (2012) A unified approach to salient object detection via low rank matrix recovery. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 853–860 Shen X, Wu Y (2012) A unified approach to salient object detection via low rank matrix recovery. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 853–860
36.
go back to reference Mai L, Niu Y, Liu F (2013) Saliency aggregation: a data-driven approach. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1131–1138 Mai L, Niu Y, Liu F (2013) Saliency aggregation: a data-driven approach. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1131–1138
37.
go back to reference Jiang Z, Davis L (2013) Submodular salient region detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 2043–2050 Jiang Z, Davis L (2013) Submodular salient region detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 2043–2050
38.
go back to reference Zhou D, Bousquet O, Lal TN, Weston J, Schölkopf B (2004) Learning with local and global consistency. In: Advances in neural information processing systems, vol 16 Zhou D, Bousquet O, Lal TN, Weston J, Schölkopf B (2004) Learning with local and global consistency. In: Advances in neural information processing systems, vol 16
39.
go back to reference Bengio Y, Delalleau O, Le Roux N (2006) Label propagation and quadratic criterion. In: semi-supervised learning, pp. 193–216 Bengio Y, Delalleau O, Le Roux N (2006) Label propagation and quadratic criterion. In: semi-supervised learning, pp. 193–216
40.
go back to reference Achanta R, Shaji A, Smith K et al (2010) SLIC superpixels. Technical report, EPFL. Tech. Rep. 149300 Achanta R, Shaji A, Smith K et al (2010) SLIC superpixels. Technical report, EPFL. Tech. Rep. 149300
41.
go back to reference Toet A (2011) Computational versus psychophysical bottom-up image saliency: a comparative evaluation study. IEEE Trans Pattern Anal Mach Intell 33(11):2131–2146CrossRef Toet A (2011) Computational versus psychophysical bottom-up image saliency: a comparative evaluation study. IEEE Trans Pattern Anal Mach Intell 33(11):2131–2146CrossRef
42.
go back to reference Song L, Mahadevan V, Vasconcelos N (2014) Learning optimal seeds for diffusion-based salient object detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 2790–2797 Song L, Mahadevan V, Vasconcelos N (2014) Learning optimal seeds for diffusion-based salient object detection. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 2790–2797
43.
go back to reference Harel J, Koch C, Perona P (2006) Graph-based visual saliency. In: Advances in neural information processing systems, pp. 545–552 Harel J, Koch C, Perona P (2006) Graph-based visual saliency. In: Advances in neural information processing systems, pp. 545–552
44.
go back to reference Weijer JVD, Gevers T, Bagdanov AD (2006) Boosting color saliency in image feature detection. IEEE Trans Pattern Anal Mach Intell 28(1):150–156CrossRef Weijer JVD, Gevers T, Bagdanov AD (2006) Boosting color saliency in image feature detection. IEEE Trans Pattern Anal Mach Intell 28(1):150–156CrossRef
45.
go back to reference Wang M, Hua X, Hong R et al (2009) Unified video annotation via multigraph learning. IEEE Trans Circuits Syst Video Technol 19(5):733–746CrossRef Wang M, Hua X, Hong R et al (2009) Unified video annotation via multigraph learning. IEEE Trans Circuits Syst Video Technol 19(5):733–746CrossRef
46.
go back to reference Lanckriet GRG, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2002) Learning the kernel matrix with semidefinite programming. J Mach Learn Res 5(1):27–72MathSciNetMATH Lanckriet GRG, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2002) Learning the kernel matrix with semidefinite programming. J Mach Learn Res 5(1):27–72MathSciNetMATH
47.
48.
go back to reference Alexe B, Deselaers T, Ferrari V (2010) What is an object? In: Proceedings of the international conference on computer vision and pattern recognition, pp. 73–80 Alexe B, Deselaers T, Ferrari V (2010) What is an object? In: Proceedings of the international conference on computer vision and pattern recognition, pp. 73–80
49.
go back to reference Alpert S, Galun M, Basri R, Brandt A (2007) Image segmentation by probabilistic bottom-up aggregation and cue integration. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1–8 Alpert S, Galun M, Basri R, Brandt A (2007) Image segmentation by probabilistic bottom-up aggregation and cue integration. In: Proceedings of the international conference on computer vision and pattern recognition, pp. 1–8
50.
go back to reference Lu Y, Zhang W, Lu H, Xue X (2011) Salient object detection using concavity context. In: 13th IEEE international conference on computer vision (ICCV), Barcelona, Spain Lu Y, Zhang W, Lu H, Xue X (2011) Salient object detection using concavity context. In: 13th IEEE international conference on computer vision (ICCV), Barcelona, Spain
51.
go back to reference Lu Y, Zhang W, Jin C, Xue X (2012) Learning attention map from images. In: Proceedings of the international conference computer vision and pattern recognition, Providence, USA Lu Y, Zhang W, Jin C, Xue X (2012) Learning attention map from images. In: Proceedings of the international conference computer vision and pattern recognition, Providence, USA
Metadata
Title
A Multiple Graph Label Propagation Integration Framework for Salient Object Detection
Authors
Jingbo Zhou
Yongfeng Ren
Yunyang Yan
Li Pan
Publication date
01-12-2016
Publisher
Springer US
Published in
Neural Processing Letters / Issue 3/2016
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-015-9488-4

Other articles of this Issue 3/2016

Neural Processing Letters 3/2016 Go to the issue