Skip to main content
Top
Published in: Soft Computing 9/2011

01-09-2011 | Focus

Particle swarm optimisation based AdaBoost for object detection

Authors: Ammar Mohemmed, Mark Johnston, Mengjie Zhang

Published in: Soft Computing | Issue 9/2011

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper proposes a new approach to using particle swarm optimisation (PSO) within an AdaBoost framework for object detection. Instead of using exhaustive search for finding good features to be used for constructing weak classifiers in AdaBoost, we propose two methods based on PSO. The first uses PSO to evolve and select good features only, and the weak classifiers use a simple decision stump. The second uses PSO for both selecting good features and evolving weak classifiers in parallel. These two methods are examined and compared on two challenging object detection tasks in images: detection of individual pasta pieces and detection of a face. The experimental results suggest that both approaches can successfully detect object positions and that using PSO for selecting good individual features and evolving associated weak classifiers in AdaBoost is more effective than for selecting features only. We also show that PSO can evolve and select meaningful features in the face detection task.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Abramson Y, Moutarde F, Steux B, Stanciulescu B (2006) Combining adaboost with a hill-climbing evolutionary feature-search for efficient training of performant visual object detectors. In: 7th International FLINS conference on applied artificial intelligence (FLINS’06), Genova, Italy, pp 737–744 Abramson Y, Moutarde F, Steux B, Stanciulescu B (2006) Combining adaboost with a hill-climbing evolutionary feature-search for efficient training of performant visual object detectors. In: 7th International FLINS conference on applied artificial intelligence (FLINS’06), Genova, Italy, pp 737–744
go back to reference Bargeron D, Viola P, Simard P (2005) Boosting-based transductive learning for text detection. In: Eighth international conference on document analysis and recognition, vol 2, pp 1166–1171 Bargeron D, Viola P, Simard P (2005) Boosting-based transductive learning for text detection. In: Eighth international conference on document analysis and recognition, vol 2, pp 1166–1171
go back to reference Bartlett MS, Littlewort G, Fasel I, Movellan JR (2003) Real time face detection and facial expression recognition: development and application to human computer interaction. In: CVPR workshop on computer vision and pattern recognition for human–computer interaction, pp 139–157 Bartlett MS, Littlewort G, Fasel I, Movellan JR (2003) Real time face detection and facial expression recognition: development and application to human computer interaction. In: CVPR workshop on computer vision and pattern recognition for human–computer interaction, pp 139–157
go back to reference Bradski G, Kaehler A, Pisarevsky V (2005) Learning-based computer vision with Intel’s open source computer vision library. Intel Technol J 9(2):119–130 Bradski G, Kaehler A, Pisarevsky V (2005) Learning-based computer vision with Intel’s open source computer vision library. Intel Technol J 9(2):119–130
go back to reference Brown G, Wyatt J, Harris R, Yao X (2005) Diversity creation methods: A survey and categorisation. J Inf Fusion (Special issue on Diversity in Multiple Classifer Systems) 6:5–20 Brown G, Wyatt J, Harris R, Yao X (2005) Diversity creation methods: A survey and categorisation. J Inf Fusion (Special issue on Diversity in Multiple Classifer Systems) 6:5–20
go back to reference Cagnoni S, Mordonini M, Sartori J (2007) Particle swarm optimization for object detection and segmentation. In Giacobini M, Brabazon A, Cagnoni S, Caro GD, Drechsler R, Farooq M, Fink A, Lutton E, Machado P, Minner S, O’Neill M, Romero J, Rothlauf F, Squillero G, Takagi H, Uyar S, Yang S (eds) EvoWorkshops. Lecture Notes in Computer Science, vol 4448, Springer, Berlin, pp 241–250 Cagnoni S, Mordonini M, Sartori J (2007) Particle swarm optimization for object detection and segmentation. In Giacobini M, Brabazon A, Cagnoni S, Caro GD, Drechsler R, Farooq M, Fink A, Lutton E, Machado P, Minner S, O’Neill M, Romero J, Rothlauf F, Squillero G, Takagi H, Uyar S, Yang S (eds) EvoWorkshops. Lecture Notes in Computer Science, vol 4448, Springer, Berlin, pp 241–250
go back to reference Freund Y, Schapire RE (1996) Experiments with a new boosting algorithm. In: Proceedings of international conference on machine learning, pp 148–156 Freund Y, Schapire RE (1996) Experiments with a new boosting algorithm. In: Proceedings of international conference on machine learning, pp 148–156
go back to reference Garcia C, Delakis M (2004) Convolutional face finder: a neural architecture for fast and robust face detection. IEEE Trans Pattern Anal Mach Intell 26(11):1408–1423CrossRef Garcia C, Delakis M (2004) Convolutional face finder: a neural architecture for fast and robust face detection. IEEE Trans Pattern Anal Mach Intell 26(11):1408–1423CrossRef
go back to reference Goldberg D (1989) Genetic algorithms in search, optimisation and machine learning. Addison Wesley, Reading, MA Goldberg D (1989) Genetic algorithms in search, optimisation and machine learning. Addison Wesley, Reading, MA
go back to reference Hidaka A, Kurita T (2008) Fast training algorithm by particle swarm optimization and random candidate selection for rectangular feature based boosted detector. In: Proceedings of 2008 IEEE international joint conference on neural networks, pp 1163–1169 Hidaka A, Kurita T (2008) Fast training algorithm by particle swarm optimization and random candidate selection for rectangular feature based boosted detector. In: Proceedings of 2008 IEEE international joint conference on neural networks, pp 1163–1169
go back to reference Huang LL, Shimizu A, Kobatake H (2005) Robust face detection using gabor filter features. Pattern Recognit Lett 26:1614–1649 Huang LL, Shimizu A, Kobatake H (2005) Robust face detection using gabor filter features. Pattern Recognit Lett 26:1614–1649
go back to reference Ji C, Ma S (1997) Combinations of weak classifiers. IEEE Trans Neural Netw 8:32–42CrossRef Ji C, Ma S (1997) Combinations of weak classifiers. IEEE Trans Neural Netw 8:32–42CrossRef
go back to reference Jian W, Xue YC, Qian JX (2004) An improved particle swarm optimization algorithm with neighborhoods topologies. In: Proceedings of 2004 international conference on machine learning and cybernetics, vol 4, pp 2332–2337 Jian W, Xue YC, Qian JX (2004) An improved particle swarm optimization algorithm with neighborhoods topologies. In: Proceedings of 2004 international conference on machine learning and cybernetics, vol 4, pp 2332–2337
go back to reference Kearns MJ, Valiant LG (1994) Cryptographic limitations on learning boolean formulae and finite automata. J ACM 1:67–95MathSciNetCrossRef Kearns MJ, Valiant LG (1994) Cryptographic limitations on learning boolean formulae and finite automata. J ACM 1:67–95MathSciNetCrossRef
go back to reference Kearns MJ, Valiant LG (2003) The boosting approach to machine learning: an overview. In: Nonlinear estimation and classification. Springer, Heidelberg Kearns MJ, Valiant LG (2003) The boosting approach to machine learning: an overview. In: Nonlinear estimation and classification. Springer, Heidelberg
go back to reference Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, Piscataway, NJ, pp 1942–1948 Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, Piscataway, NJ, pp 1942–1948
go back to reference Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge, MAMATH Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge, MAMATH
go back to reference Krogh A, Vedelsby J (1995) Neural network ensembles, cross validation, and active learning. Adv Neural Inf Process Syst 7:231–238 Krogh A, Vedelsby J (1995) Neural network ensembles, cross validation, and active learning. Adv Neural Inf Process Syst 7:231–238
go back to reference Li S, Zhang Z (2004) Floatboost learning and statistical face detection. IEEE Trans Pattern Anal Mach Intell 26(9):1112–1123CrossRef Li S, Zhang Z (2004) Floatboost learning and statistical face detection. IEEE Trans Pattern Anal Mach Intell 26(9):1112–1123CrossRef
go back to reference Li X, Wang L, Sung E (2005) A study of adaboost with svm based weak learners. In: Proceedings of 2005 IEEE international joint conference on neural networks, vol 1, pp 196–201 Li X, Wang L, Sung E (2005) A study of adaboost with svm based weak learners. In: Proceedings of 2005 IEEE international joint conference on neural networks, vol 1, pp 196–201
go back to reference Maurice C (1999) The swarm and queen: towards a deterministic and adaptive particle swarm optimization. In: IEEE congress on evolutionary computation, vol 2, pp 1951–1957 Maurice C (1999) The swarm and queen: towards a deterministic and adaptive particle swarm optimization. In: IEEE congress on evolutionary computation, vol 2, pp 1951–1957
go back to reference Metz CE (1986) ROC methodology in radiologic imaging. Invest Radiol 21(9):720–732CrossRef Metz CE (1986) ROC methodology in radiologic imaging. Invest Radiol 21(9):720–732CrossRef
go back to reference McCane B, Novins K (2003) On training cascade face detectors. In: Image and vision computing, pp 239–244 McCane B, Novins K (2003) On training cascade face detectors. In: Image and vision computing, pp 239–244
go back to reference Omran MG, Engelbrecht AP, Salman AA (2006) Particle swarm optimization for pattern recognition and image processing. In Abraham A, Grosan C, Ramos V (eds) Swarm intelligence in data mining. Studies in computational intelligence, vol 34, Springer, pp 125–151 Omran MG, Engelbrecht AP, Salman AA (2006) Particle swarm optimization for pattern recognition and image processing. In Abraham A, Grosan C, Ramos V (eds) Swarm intelligence in data mining. Studies in computational intelligence, vol 34, Springer, pp 125–151
go back to reference Opitz D, Maclin R (1999) Popular ensemble methods: an empirical study. J Artif Intell Res 11:169–198MATH Opitz D, Maclin R (1999) Popular ensemble methods: an empirical study. J Artif Intell Res 11:169–198MATH
go back to reference Poli R (2008) Analysis of the publications on the applications of particle swarm optimisation. J Artif Evol Appl 2008:1–10 Poli R (2008) Analysis of the publications on the applications of particle swarm optimisation. J Artif Evol Appl 2008:1–10
go back to reference Rasolzadeh B, Petersson L, Pettersson N (2006) Response binning: improved weak classifiers for boosting. In: IEEE intelligent vehicles symposium (IV2006), pp 344–349 Rasolzadeh B, Petersson L, Pettersson N (2006) Response binning: improved weak classifiers for boosting. In: IEEE intelligent vehicles symposium (IV2006), pp 344–349
go back to reference Rowley H, Baluja S, Kanade T (1996) Neural network-based face detection. In: Proceedings of 1996 IEEE computer society conference on computer vision and pattern recognition (CVPR’96), pp 203–208 Rowley H, Baluja S, Kanade T (1996) Neural network-based face detection. In: Proceedings of 1996 IEEE computer society conference on computer vision and pattern recognition (CVPR’96), pp 203–208
go back to reference Sierra A, Echeverria A (2006) Evolutionary discriminant analysis. IEEE Trans Evol Comput 10(1):81–92CrossRef Sierra A, Echeverria A (2006) Evolutionary discriminant analysis. IEEE Trans Evol Comput 10(1):81–92CrossRef
go back to reference Sung KK, Poggio T (1998) Example-based learning for view-based human face detection. IEEE Trans Pattern Anal Mach Intell 20(1):39–51CrossRef Sung KK, Poggio T (1998) Example-based learning for view-based human face detection. IEEE Trans Pattern Anal Mach Intell 20(1):39–51CrossRef
go back to reference Tanwani AK, Afridi J, Shafiq MZ, Farooq M (2009) Guidelines to select machine learning scheme for classification of biomedical datasets. In: Pizzuti C, Ritchie MD, Giacobini M (eds) EvoBIO. Lecture Notes in Computer Science, vol 5483, Springer, pp 128–139 Tanwani AK, Afridi J, Shafiq MZ, Farooq M (2009) Guidelines to select machine learning scheme for classification of biomedical datasets. In: Pizzuti C, Ritchie MD, Giacobini M (eds) EvoBIO. Lecture Notes in Computer Science, vol 5483, Springer, pp 128–139
go back to reference Treptow A, Zell A (2004) Combining adaboost learning and evolutionary search to select features for real-time object detection. In: Congress on evolutionary computation, vol 2, pp 19–23 Treptow A, Zell A (2004) Combining adaboost learning and evolutionary search to select features for real-time object detection. In: Congress on evolutionary computation, vol 2, pp 19–23
go back to reference Valentini G, Masulli F (2002) Ensembles of learning machines. In: Proceedings of the 13th Italian workshop on neural nets (Lecture Notes in Computer Science) vol 2468. pp 3–19 Valentini G, Masulli F (2002) Ensembles of learning machines. In: Proceedings of the 13th Italian workshop on neural nets (Lecture Notes in Computer Science) vol 2468. pp 3–19
go back to reference Verschae R, del Solar JR, Correa M (2006) Gender classification of faces using adaboost. Lecture Notes in Computer Science, vol 4225. pp 68–78 Verschae R, del Solar JR, Correa M (2006) Gender classification of faces using adaboost. Lecture Notes in Computer Science, vol 4225. pp 68–78
go back to reference Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: IEEE computer society conference on computer vision and pattern recognition (CVPR), vol 1, pp 511–518 Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: IEEE computer society conference on computer vision and pattern recognition (CVPR), vol 1, pp 511–518
go back to reference Viola P, Jones M, Snow D (2003) Detecting pedestrians using pattern of motion and appearance. In: ICCV, pp 734–741 Viola P, Jones M, Snow D (2003) Detecting pedestrians using pattern of motion and appearance. In: ICCV, pp 734–741
go back to reference Yang MH, Kriegman D, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24(1):34–58CrossRef Yang MH, Kriegman D, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24(1):34–58CrossRef
Metadata
Title
Particle swarm optimisation based AdaBoost for object detection
Authors
Ammar Mohemmed
Mark Johnston
Mengjie Zhang
Publication date
01-09-2011
Publisher
Springer-Verlag
Published in
Soft Computing / Issue 9/2011
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-010-0615-x

Other articles of this Issue 9/2011

Soft Computing 9/2011 Go to the issue

Premium Partner