Skip to main content
Top

2010 | OriginalPaper | Chapter

10. Correntropy for Random Variables: Properties and Applications in Statistical Inference

Authors : Weifeng Liu, Puskal Pokharel, Jianwu Xu, Sohan Seth

Published in: Information Theoretic Learning

Publisher: Springer New York

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Similarity is a key concept to quantify temporal signals or static measurements. Similarity is difficult to define mathematically, however, one never really thinks too much about this difficulty and naturally translates similarity by correlation. This is one more example of how engrained second-order moment descriptors of the probability density function really are in scientific thinking. Successful engineering or pattern recognition solutions from these methodologies rely heavily on the Gaussianity and linearity assumptions, exactly for the same reasons discussed in Chapter 3.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
7.
go back to reference Aronszajn N., The theory of reproducing kernels and their applications, Cambridge Philos. Soc. Proc., vol. 39:133–153, 1943.CrossRefMathSciNet Aronszajn N., The theory of reproducing kernels and their applications, Cambridge Philos. Soc. Proc., vol. 39:133–153, 1943.CrossRefMathSciNet
12.
go back to reference Bach F., Jordan M., Kernel independent component analysis, J. Mach. Learn. Res., 3:1–48, 2002.MathSciNet Bach F., Jordan M., Kernel independent component analysis, J. Mach. Learn. Res., 3:1–48, 2002.MathSciNet
94.
go back to reference Erdogmus D., Agrawal R., Principe J., A mutual information extension to the matched filter, Signal Process., 85(5):927–935, May 2005.CrossRefMATH Erdogmus D., Agrawal R., Principe J., A mutual information extension to the matched filter, Signal Process., 85(5):927–935, May 2005.CrossRefMATH
107.
go back to reference Fukumizu K., Gretton A., Sun X., Scholkopf B., Kernel measures of conditional dependence. In Platt, Koller, Singer, and Roweis Eds., Advances in Neural Information Processing Systems 20, pp. 489–496. MIT Press, Cambridge, MA, 2008. Fukumizu K., Gretton A., Sun X., Scholkopf B., Kernel measures of conditional dependence. In Platt, Koller, Singer, and Roweis Eds., Advances in Neural Information Processing Systems 20, pp. 489–496. MIT Press, Cambridge, MA, 2008.
119.
go back to reference Granger C., Maasoumi E., and Racine J., A dependence metric for possibly nonlinear processes. J. Time Series Anal., 25(5):649–669, 2004.CrossRefMATHMathSciNet Granger C., Maasoumi E., and Racine J., A dependence metric for possibly nonlinear processes. J. Time Series Anal., 25(5):649–669, 2004.CrossRefMATHMathSciNet
123.
go back to reference Gretton, A., Herbrich R., Smola A., Bousquet O., Schölkopf B., Kernel Methods for Measuring Independence,” J. Mach. Learn. Res., 6:2075–2129, 2005.MATHMathSciNet Gretton, A., Herbrich R., Smola A., Bousquet O., Schölkopf B., Kernel Methods for Measuring Independence,” J. Mach. Learn. Res., 6:2075–2129, 2005.MATHMathSciNet
201.
go back to reference Liu W., Pokharel P., Principe J., Correntropy: Properties and applications in non Gaussian signal processing, IEEE Trans. Sig. Proc., 55(11):5286–5298, 2007.CrossRefMathSciNet Liu W., Pokharel P., Principe J., Correntropy: Properties and applications in non Gaussian signal processing, IEEE Trans. Sig. Proc., 55(11):5286–5298, 2007.CrossRefMathSciNet
212.
215.
go back to reference McCulloch J., Financial applications of stable distributions. In G. S. Madala and C.R. Rao (Eds.), Handbook of Statistics, vol. 14, pages 393–425. Elsevier, Amsterdam, 1996. McCulloch J., Financial applications of stable distributions. In G. S. Madala and C.R. Rao (Eds.), Handbook of Statistics, vol. 14, pages 393–425. Elsevier, Amsterdam, 1996.
217.
go back to reference Mercer J., Functions of positive and negative type, and their connection with the theory of integral equations, Philosoph. Trans. Roy. Soc. Lond., 209:415–446, 1909.CrossRefMATH Mercer J., Functions of positive and negative type, and their connection with the theory of integral equations, Philosoph. Trans. Roy. Soc. Lond., 209:415–446, 1909.CrossRefMATH
218.
231.
go back to reference Nikias C. Shao M., Signal Processing with Alpha-Stable Distributions and Applications. John Wiley and Sons, New York, 1995. Nikias C. Shao M., Signal Processing with Alpha-Stable Distributions and Applications. John Wiley and Sons, New York, 1995.
241.
249.
go back to reference Pokharel P., Liu W., Principe J., A low complexity robust detector in impulsive noise, Signal Process., 89(10):1902–1909, 2009.CrossRefMATH Pokharel P., Liu W., Principe J., A low complexity robust detector in impulsive noise, Signal Process., 89(10):1902–1909, 2009.CrossRefMATH
250.
go back to reference Prichard, D., Theiler, J. (1994). Generating surrogate data for time series with several simultaneously measured variables. Phys. Rev. Lett., 73(7):951–954.CrossRef Prichard, D., Theiler, J. (1994). Generating surrogate data for time series with several simultaneously measured variables. Phys. Rev. Lett., 73(7):951–954.CrossRef
261.
go back to reference Rao M., Xu J., Seth S., Chen Y., Tagare M., Principe J., Correntropy dependence measure, submitted to IEEE Trans. Signal Processing. Rao M., Xu J., Seth S., Chen Y., Tagare M., Principe J., Correntropy dependence measure, submitted to IEEE Trans. Signal Processing.
282.
go back to reference Santamaría I., Pokharel P., Principe J, Generalized correlation function: Definition, properties and application to blind equalization, IEEE Trans. Signal Process., 54(6):2187–2197, 2006.CrossRef Santamaría I., Pokharel P., Principe J, Generalized correlation function: Definition, properties and application to blind equalization, IEEE Trans. Signal Process., 54(6):2187–2197, 2006.CrossRef
300.
go back to reference Silverman B., Density Estimation for Statistics and Data Analysis, Chapman and Hall, London, 1986.CrossRefMATH Silverman B., Density Estimation for Statistics and Data Analysis, Chapman and Hall, London, 1986.CrossRefMATH
344.
go back to reference Xu J., Bakardjian H., Cichocki A., Principe J., A new nonlinear similarity measure for multichannel signals, Neural Netw. (invited paper), 21(2–3):222–231, 2008.CrossRefMATH Xu J., Bakardjian H., Cichocki A., Principe J., A new nonlinear similarity measure for multichannel signals, Neural Netw. (invited paper), 21(2–3):222–231, 2008.CrossRefMATH
Metadata
Title
Correntropy for Random Variables: Properties and Applications in Statistical Inference
Authors
Weifeng Liu
Puskal Pokharel
Jianwu Xu
Sohan Seth
Copyright Year
2010
Publisher
Springer New York
DOI
https://doi.org/10.1007/978-1-4419-1570-2_10

Premium Partner