Skip to main content
Top

2012 | OriginalPaper | Chapter

13. Optimizing Feature Calculation in Adaptive Machine Vision Systems

Authors : Christian Eitzinger, Stefan Thumfart

Published in: Learning in Non-Stationary Environments

Publisher: Springer New York

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

A classifier’s accuracy substantially depends on the features that are utilized to characterize an input sample. The selection of a representative and—ideally—small set of features that yields high discriminative power is an important step in setting up a classification system. The features are a set of functions that transform the raw input data (an image in the case of machine vision systems) into a vector of real numbers. This transformation may be a quite complex algorithm, with lots of parameters to tune and consequently with much room for optimization. In order to efficiently use this additional room for optimizing the features, we propose an integrated optimization step that adapts the feature parameters in such a way that the separation of the classes in feature space is improved, thus reducing the number of misclassifications. Furthermore, these optimization techniques may be used to “shape” the decision boundary in such a way that it can be easily modeled by a classifier. After covering the relevant elements of the theory behind this automatic feature optimization process, we will demonstrate and assess the performance on two typical machine vision applications. The first one is a quality control task, where different types of defects need to be distinguished, and the second example is a texture classification problem as it appears in image segmentation tasks. We will show how the optimization process can be successfully applied in morphological and textural features that both offer a number of parameters to tune and select.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Azimi-Sadjadi, M.R.D.Y., Dobeck, G.J.: Adaptive feature mapping for underwater target classification. In: IJCNN ’99. International Joint Conference on Neural Networks, vol. 5, pp. 3221–3224 (1999) Azimi-Sadjadi, M.R.D.Y., Dobeck, G.J.: Adaptive feature mapping for underwater target classification. In: IJCNN ’99. International Joint Conference on Neural Networks, vol. 5, pp. 3221–3224 (1999)
3.
go back to reference Brodatz, P.: A Photographic Album for Artists and Designers. Dover Publications, New York (1966) Brodatz, P.: A Photographic Album for Artists and Designers. Dover Publications, New York (1966)
4.
go back to reference Cardie, C.: Using decision trees to improve case-based learning. In: Proceedings of 10th International Conference on Machine Learning, pp. 25–32 (1993) Cardie, C.: Using decision trees to improve case-based learning. In: Proceedings of 10th International Conference on Machine Learning, pp. 25–32 (1993)
5.
go back to reference Chen, H.T., Liu, T.L., Fuh, C.S.: Probabilistic tracking with adaptive feature selection. In: 17th International Conference on Pattern Recognition (ICPR’04), volume 2, pp. 736–739 (2004) Chen, H.T., Liu, T.L., Fuh, C.S.: Probabilistic tracking with adaptive feature selection. In: 17th International Conference on Pattern Recognition (ICPR’04), volume 2, pp. 736–739 (2004)
6.
go back to reference Collins, R., Liu, Y.: On-line selection of discriminative tracking features. In: Proc. of the 2003 International Conference of Computer Vision (ICCV 03), pp. 346–352 (2003) Collins, R., Liu, Y.: On-line selection of discriminative tracking features. In: Proc. of the 2003 International Conference of Computer Vision (ICCV 03), pp. 346–352 (2003)
7.
go back to reference Costanza, C.M., Afifi, A.A.: Comparison of stopping rules in forward stepwise discriminant analysis. Journal Amer. Statist. Assoc. 74, 777–785 (1979)MATH Costanza, C.M., Afifi, A.A.: Comparison of stopping rules in forward stepwise discriminant analysis. Journal Amer. Statist. Assoc. 74, 777–785 (1979)MATH
8.
go back to reference Dash, M., Liu, H.: Feature selection for classification. International Journal of Intelligent Data Analysis 1, 131–156 (1997)CrossRef Dash, M., Liu, H.: Feature selection for classification. International Journal of Intelligent Data Analysis 1, 131–156 (1997)CrossRef
9.
go back to reference Demant, C., Streicher-Abel, B., Waszkewitz, P.: Industrielle Bildverarbeitung. Springer-Verlag, Berlin Heidelberg New York (1998) Demant, C., Streicher-Abel, B., Waszkewitz, P.: Industrielle Bildverarbeitung. Springer-Verlag, Berlin Heidelberg New York (1998)
10.
go back to reference Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edition. John Wiley & Sons, New York (2001)MATH Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edition. John Wiley & Sons, New York (2001)MATH
11.
go back to reference Dunn, D., Higgins, W., Wakeley, J.: Texture segmentation using 2-d Gabor elementary functions. Pattern Analysis and Machine Intelligence, IEEE Transactions on 16(2), 130 –149 (1994). DOI 10.1109/34.273736CrossRef Dunn, D., Higgins, W., Wakeley, J.: Texture segmentation using 2-d Gabor elementary functions. Pattern Analysis and Machine Intelligence, IEEE Transactions on 16(2), 130 –149 (1994). DOI 10.1109/34.273736CrossRef
12.
go back to reference Eitzinger, C., Gmainer, M., Heidl, W., Lughofer, E.: Increasing classification performance with adaptive features. In: A. Gasteratos, M. Vincze, J. Tsotsos (eds.) Proceedings of ICVS 2008, LNCS, vol. 5008, pp. 445–453. Springer, Santorini Island, Greece (2008) Eitzinger, C., Gmainer, M., Heidl, W., Lughofer, E.: Increasing classification performance with adaptive features. In: A. Gasteratos, M. Vincze, J. Tsotsos (eds.) Proceedings of ICVS 2008, LNCS, vol. 5008, pp. 445–453. Springer, Santorini Island, Greece (2008)
13.
go back to reference Grigorescu, S.E., Petkov, N., Kruizinga, P.: Comparison of texture features based on gabor filters. In: IEEE Trans. on Image Process., vol. 11, pp. 1160–1167 (2002)MathSciNetCrossRef Grigorescu, S.E., Petkov, N., Kruizinga, P.: Comparison of texture features based on gabor filters. In: IEEE Trans. on Image Process., vol. 11, pp. 1160–1167 (2002)MathSciNetCrossRef
14.
go back to reference Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. Journal of Machine Learning Research 3, 1157–1182 (2003)MATH Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. Journal of Machine Learning Research 3, 1157–1182 (2003)MATH
15.
go back to reference Hand, D.J.: Discrimination and classification. Wiley Series in Probability and Mathematical Statistics, Wiley, Chichester, UK (1981)MATH Hand, D.J.: Discrimination and classification. Wiley Series in Probability and Mathematical Statistics, Wiley, Chichester, UK (1981)MATH
17.
go back to reference Kim, M., Park, C., Koo, K.: Natural / man-made object classification based on gabor characteristics. In: W.K. Leow, M. Lew, T.S. Chua, W.Y. Ma, L. Chaisorn, E. Bakker (eds.) Image and Video Retrieval, Lecture Notes in Computer Science, vol. 3568, pp. 550–559. Springer Berlin / Heidelberg (2005) Kim, M., Park, C., Koo, K.: Natural / man-made object classification based on gabor characteristics. In: W.K. Leow, M. Lew, T.S. Chua, W.Y. Ma, L. Chaisorn, E. Bakker (eds.) Image and Video Retrieval, Lecture Notes in Computer Science, vol. 3568, pp. 550–559. Springer Berlin / Heidelberg (2005)
18.
go back to reference Kohavi, R., John, G.: Wrappers for feature subset selection. Artificial Intelligence 97(1–2), 273–324 (1997)MATHCrossRef Kohavi, R., John, G.: Wrappers for feature subset selection. Artificial Intelligence 97(1–2), 273–324 (1997)MATHCrossRef
19.
go back to reference Kononenko, I.: Estimating attributes: Analysis and extensions of relief. In: Proceedings of ECML-94, pp. 171–182. Springer Verlag, Catania, Sicily (1994) Kononenko, I.: Estimating attributes: Analysis and extensions of relief. In: Proceedings of ECML-94, pp. 171–182. Springer Verlag, Catania, Sicily (1994)
20.
go back to reference Krishnapuram, B., Hartemink, A.J., Carin, L., Figueiredo, M.A.T.: A Bayesian approach to joint feature selection and classifier design. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(9), 1105–1111 (2004)CrossRef Krishnapuram, B., Hartemink, A.J., Carin, L., Figueiredo, M.A.T.: A Bayesian approach to joint feature selection and classifier design. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(9), 1105–1111 (2004)CrossRef
21.
go back to reference Lee, T.S.: Image representation using 2d gabor wavelets. Pattern Analysis and Machine Intelligence, IEEE Transactions on 18(10), 959–971 (1996). DOI 10.1109/34. 541406CrossRef Lee, T.S.: Image representation using 2d gabor wavelets. Pattern Analysis and Machine Intelligence, IEEE Transactions on 18(10), 959–971 (1996). DOI 10.1109/34. 541406CrossRef
22.
go back to reference Li, M., Staunton, R.: Optimum gabor filter design and local binary patterns for texture segmentation. Pattern Recognition Letters 29(5), 664–672 (2008). DOI 10. 1016/j.patrec.2007.12.001CrossRef Li, M., Staunton, R.: Optimum gabor filter design and local binary patterns for texture segmentation. Pattern Recognition Letters 29(5), 664–672 (2008). DOI 10. 1016/j.patrec.2007.12.001CrossRef
24.
go back to reference Molina, L.C., Belanche, L., Nebot, A.: Feature selection algorithms: A survey and experimental evaluation. In: ICDM ’02: Proceedings of the 2002 IEEE International Conference on Data Mining, pp. 306–311. Maebashi City, Japan (2002) Molina, L.C., Belanche, L., Nebot, A.: Feature selection algorithms: A survey and experimental evaluation. In: ICDM ’02: Proceedings of the 2002 IEEE International Conference on Data Mining, pp. 306–311. Maebashi City, Japan (2002)
25.
go back to reference Narendra, P., Fukunaga, K.: A branch and bound algorithm for feature subset selection. IEEE Transactions on Computer 26(9), 917–922 (1977)MATHCrossRef Narendra, P., Fukunaga, K.: A branch and bound algorithm for feature subset selection. IEEE Transactions on Computer 26(9), 917–922 (1977)MATHCrossRef
27.
go back to reference Rao, C.R.: Linear statistical inference and its applications. John Wiley & Sons, Inc., NY, U.S.A. (1965) Rao, C.R.: Linear statistical inference and its applications. John Wiley & Sons, Inc., NY, U.S.A. (1965)
28.
go back to reference Reisert, M., Burkhardt, H.: Feature selection for retrieval purposes. In: Proceedings of the ICIAR’06, Vol. 1, pp. 661–672. Pavoa do Varzim, Portugal (2006) Reisert, M., Burkhardt, H.: Feature selection for retrieval purposes. In: Proceedings of the ICIAR’06, Vol. 1, pp. 661–672. Pavoa do Varzim, Portugal (2006)
29.
go back to reference Sandler, R., Lindenbaum, M.: Optimizing gabor filter design for texture edge detection andclassification. International Journal of Computer Vision 84, 308–324 (2009). DOI 10.1007/s11263-009-0237-xCrossRef Sandler, R., Lindenbaum, M.: Optimizing gabor filter design for texture edge detection andclassification. International Journal of Computer Vision 84, 308–324 (2009). DOI 10.1007/s11263-009-0237-xCrossRef
31.
go back to reference Thumfart, S., Heidl, W., Scharinger, J., Eitzinger, C.: A quantitative evaluation of texture feature robustness and interpolation behaviour. In: X. Jiang, N. Petkov (eds.) Computer Analysis of Images and Patterns, Lecture Notes in Computer Science, vol. 5702, pp. 1154–1161. Springer Berlin / Heidelberg (2009) Thumfart, S., Heidl, W., Scharinger, J., Eitzinger, C.: A quantitative evaluation of texture feature robustness and interpolation behaviour. In: X. Jiang, N. Petkov (eds.) Computer Analysis of Images and Patterns, Lecture Notes in Computer Science, vol. 5702, pp. 1154–1161. Springer Berlin / Heidelberg (2009)
Metadata
Title
Optimizing Feature Calculation in Adaptive Machine Vision Systems
Authors
Christian Eitzinger
Stefan Thumfart
Copyright Year
2012
Publisher
Springer New York
DOI
https://doi.org/10.1007/978-1-4419-8020-5_13

Premium Partner