Skip to main content
Top

2015 | OriginalPaper | Chapter

Blind Nonparametric Determined and Underdetermined Signal Extraction Algorithm for Dependent Source Mixtures

Authors : Fasong Wang, Rui Li, Zhongyong Wang, Xiangchuan Gao

Published in: Intelligent Computing Theories and Methodologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Blind extraction or separation statistically independent source signals from linear mixtures have been well studied in the last two decades by searching for local extrema of certain objective functions, such as nonGaussianity (NG) measure. Blind source extraction (BSE) algorithm from underdetermined linear mixtures of the statistically dependent source signals is derived using nonparametric NG measure in this paper. After showing that maximization of the NG measure can also separate or extract the statistically weak dependent source signals, the nonparametric NG measure is defined by statistical distances between different source signals distributions based on the cumulative density function (CDF) instead of traditional probability density function (PDF), which can be estimated by the quantiles and order statistics using the \( L^{2} \) norm efficiently. The nonparametric NG measure can be optimized by a deflation procedure to extract or separate the dependent source signals. Simulation results for synthesis and real world data show that the proposed nonparametric extraction algorithm can extract the dependent signals and yield ideal performance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Comon, P., Jutten, C.: Handbook of Blind Source Separation: Independent Component Analysis and Applications. Elsevier, Oxford (2010) Comon, P., Jutten, C.: Handbook of Blind Source Separation: Independent Component Analysis and Applications. Elsevier, Oxford (2010)
2.
go back to reference Cichocki, A., Amari, S.: Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. Wiley, New York (2003) Cichocki, A., Amari, S.: Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. Wiley, New York (2003)
3.
4.
go back to reference Cardoso, J.: Blind signal separation: statistical principles. Proc. IEEE 86(10), 2009–2025 (1998)CrossRef Cardoso, J.: Blind signal separation: statistical principles. Proc. IEEE 86(10), 2009–2025 (1998)CrossRef
5.
go back to reference Särelä, J., Valpola, H.: Denoising source separation. J. Mach. Learn. Res. 6, 233–272 (2005)MathSciNet Särelä, J., Valpola, H.: Denoising source separation. J. Mach. Learn. Res. 6, 233–272 (2005)MathSciNet
6.
7.
go back to reference Deville, Y., Hosseini, S.: Recurrent networks for separating extractable-target nonlinear mixtures. Part I: Non-blind Configurations. Signal Process. 89(4), 378–393 (2009) Deville, Y., Hosseini, S.: Recurrent networks for separating extractable-target nonlinear mixtures. Part I: Non-blind Configurations. Signal Process. 89(4), 378–393 (2009)
8.
go back to reference Bell, A.J., Sejnowski, T.J.: An information-maximisation approach to blind separation and blind deconvolution. Neural Comput. 7(6), 1129–1159 (1995)CrossRef Bell, A.J., Sejnowski, T.J.: An information-maximisation approach to blind separation and blind deconvolution. Neural Comput. 7(6), 1129–1159 (1995)CrossRef
9.
go back to reference Amari, S., Cichocki, A., Yang, H.: A new learning algorithm for blind signal separation. In: Advances in Neural Information Processing Systems, pp. 757−763. MIT Press, Cambridge (1996) Amari, S., Cichocki, A., Yang, H.: A new learning algorithm for blind signal separation. In: Advances in Neural Information Processing Systems, pp. 757−763. MIT Press, Cambridge (1996)
10.
go back to reference Bloemendal, B., Laar, J., Sommen, P.: A single stage approach to blind source extraction based on second order statistics. Signal Process. 93(2), 432–444 (2013)CrossRef Bloemendal, B., Laar, J., Sommen, P.: A single stage approach to blind source extraction based on second order statistics. Signal Process. 93(2), 432–444 (2013)CrossRef
11.
go back to reference Cardoso, J.F.: Multidimensional independent component analysis. In: ICASSP 1998, Seattle, WA, USA, pp. 1941–1944. IEEE (1998) Cardoso, J.F.: Multidimensional independent component analysis. In: ICASSP 1998, Seattle, WA, USA, pp. 1941–1944. IEEE (1998)
12.
go back to reference Lahat, D., Cardoso, J.F., Messer, H.: Second-order multidimensional ica: performance analysis. IEEE Trans. Signal Process. 60(9), 4598–4610 (2012)MathSciNetCrossRef Lahat, D., Cardoso, J.F., Messer, H.: Second-order multidimensional ica: performance analysis. IEEE Trans. Signal Process. 60(9), 4598–4610 (2012)MathSciNetCrossRef
13.
go back to reference Gutch, H.W., Theis, F.J.: Uniqueness of linear factorizations into independent subspaces. J. Multivar. Anal. 112, 48–62 (2012)MathSciNetCrossRef Gutch, H.W., Theis, F.J.: Uniqueness of linear factorizations into independent subspaces. J. Multivar. Anal. 112, 48–62 (2012)MathSciNetCrossRef
14.
go back to reference Kawanabe, M., Muller, K.R.: Estimating functions for blind separation when sources have variance dependencies. J. Mach. Learn. Res. 6, 453–482 (2005)MathSciNet Kawanabe, M., Muller, K.R.: Estimating functions for blind separation when sources have variance dependencies. J. Mach. Learn. Res. 6, 453–482 (2005)MathSciNet
15.
go back to reference Hyvarinen, A., Hoyer, P.O., Inki, M.: Topographic independent component analysis. Neural Comput. 13(7), 1527–1558 (2001)CrossRef Hyvarinen, A., Hoyer, P.O., Inki, M.: Topographic independent component analysis. Neural Comput. 13(7), 1527–1558 (2001)CrossRef
16.
go back to reference Bach, F.R., Jordan, M.I.: Kernel independent component analysis. J. Mach. Learn. Res. 3, 1–48 (2002)MathSciNet Bach, F.R., Jordan, M.I.: Kernel independent component analysis. J. Mach. Learn. Res. 3, 1–48 (2002)MathSciNet
17.
18.
go back to reference Wang, F.S., Li, H., Li, R.: Novel nongaussianity measure based bss algorithm for dependent signals. In: Dong, G., Lin, X., Wang, W., Yang, Y., Yu, J.X. (eds.) APWeb/WAIM 2007. LNCS, vol. 4505, pp. 837–844. Springer, Heidelberg (2007)CrossRef Wang, F.S., Li, H., Li, R.: Novel nongaussianity measure based bss algorithm for dependent signals. In: Dong, G., Lin, X., Wang, W., Yang, Y., Yu, J.X. (eds.) APWeb/WAIM 2007. LNCS, vol. 4505, pp. 837–844. Springer, Heidelberg (2007)CrossRef
19.
go back to reference Caiafa, C.: On the conditions for valid objective functions in blind separation of independent and dependent sources. EURASIP J. Adv. Signal Process. 2012, 255 (2012)CrossRef Caiafa, C.: On the conditions for valid objective functions in blind separation of independent and dependent sources. EURASIP J. Adv. Signal Process. 2012, 255 (2012)CrossRef
20.
go back to reference Aghabozorgi, M.R., Doost-Hoseini, A.M.: Blind separation of jointly stationary correlated sources. Signal Process. 84(2), 317–325 (2004)CrossRef Aghabozorgi, M.R., Doost-Hoseini, A.M.: Blind separation of jointly stationary correlated sources. Signal Process. 84(2), 317–325 (2004)CrossRef
21.
go back to reference Abrard, F., Deville, Y.: A time-frequency blind signal separation method applicable to underdetermined mixtures of dependent sources. Signal Process. 85(7), 1389–1403 (2005)CrossRef Abrard, F., Deville, Y.: A time-frequency blind signal separation method applicable to underdetermined mixtures of dependent sources. Signal Process. 85(7), 1389–1403 (2005)CrossRef
22.
go back to reference Kopriva, I., Jeric, I., Brkljacic, L.: Nonlinear mixture-wise expansion approach to underdetermined blind separation of nonnegative dependent sources. J. Chemom. 27(1), 189–197 (2013)CrossRef Kopriva, I., Jeric, I., Brkljacic, L.: Nonlinear mixture-wise expansion approach to underdetermined blind separation of nonnegative dependent sources. J. Chemom. 27(1), 189–197 (2013)CrossRef
23.
go back to reference Cruces, S.: Bounded component analysis of linear mixtures: a criterion for minimum convex perimeter. IEEE Trans. Signal Process. 58(4), 2141–2154 (2010)MathSciNetCrossRef Cruces, S.: Bounded component analysis of linear mixtures: a criterion for minimum convex perimeter. IEEE Trans. Signal Process. 58(4), 2141–2154 (2010)MathSciNetCrossRef
24.
go back to reference Erdogan, A.T.: A class of bounded component analysis algorithms for the separation of both independent and dependent sources. IEEE Trans. Signal Process. 61(22), 5730–5743 (2013)MathSciNetCrossRef Erdogan, A.T.: A class of bounded component analysis algorithms for the separation of both independent and dependent sources. IEEE Trans. Signal Process. 61(22), 5730–5743 (2013)MathSciNetCrossRef
25.
go back to reference Li, Y., Amari, S.I., Cichocki, A.: Underdetermined blind source separation based on sparse representation. IEEE Trans. Signal Process. 54(2), 423–437 (2006)CrossRef Li, Y., Amari, S.I., Cichocki, A.: Underdetermined blind source separation based on sparse representation. IEEE Trans. Signal Process. 54(2), 423–437 (2006)CrossRef
26.
go back to reference Almeida, A., Luciani, X., Stegeman, A., Comon, P.: CONFAC decomposition approach to blind identification of underdetermined mixtures based on generating function derivatives. IEEE Trans. Signal Process. 60(11), 5698–5713 (2012)MathSciNetCrossRef Almeida, A., Luciani, X., Stegeman, A., Comon, P.: CONFAC decomposition approach to blind identification of underdetermined mixtures based on generating function derivatives. IEEE Trans. Signal Process. 60(11), 5698–5713 (2012)MathSciNetCrossRef
27.
go back to reference Cardoso, J.F.: Dependence, correlation and gaussianity in independent component analysis. J. Mach. Learn. Res. 4, 1177–1203 (2003)MathSciNet Cardoso, J.F.: Dependence, correlation and gaussianity in independent component analysis. J. Mach. Learn. Res. 4, 1177–1203 (2003)MathSciNet
28.
go back to reference Cichocki, A., Thawonmas, R.: On-line algorithm for blind signal extraction of arbitrarily distributed, but temporally correlated sources using second order statistics. Neural Process. Lett. 12(1), 91–98 (2000)CrossRef Cichocki, A., Thawonmas, R.: On-line algorithm for blind signal extraction of arbitrarily distributed, but temporally correlated sources using second order statistics. Neural Process. Lett. 12(1), 91–98 (2000)CrossRef
29.
go back to reference Barros, A.K., Cichocki, A.: Extraction of specific signals with temporal structure. Neural Comput. 13(9), 1995–2003 (2001)CrossRef Barros, A.K., Cichocki, A.: Extraction of specific signals with temporal structure. Neural Comput. 13(9), 1995–2003 (2001)CrossRef
30.
go back to reference Anderson, M., Adali, T., Li, X.L.: Joint blind source separation with multivariate gaussian model: algorithms and performance analysis. IEEE Trans. Signal Process. 60(4), 1672–1683 (2012)MathSciNetCrossRef Anderson, M., Adali, T., Li, X.L.: Joint blind source separation with multivariate gaussian model: algorithms and performance analysis. IEEE Trans. Signal Process. 60(4), 1672–1683 (2012)MathSciNetCrossRef
31.
go back to reference Zibulevsky, M., Zeevi, Y.Y.: Extraction of a source from multichannel data using sparse decomposition. Neurocomputing 49(1–4), 163–173 (2002)CrossRef Zibulevsky, M., Zeevi, Y.Y.: Extraction of a source from multichannel data using sparse decomposition. Neurocomputing 49(1–4), 163–173 (2002)CrossRef
32.
go back to reference Zhang, Z.L.: Morphologically constrained ICA for extracting weak temporally correlated signals. Neurocomputing 71, 1669–1679 (2008)CrossRef Zhang, Z.L.: Morphologically constrained ICA for extracting weak temporally correlated signals. Neurocomputing 71, 1669–1679 (2008)CrossRef
33.
go back to reference Caiafa, C.F., Proto, A.N.: Separation of statistically dependent sources using an l2 distance non-gaussianity measure. Signal Process. 86(11), 3404–3420 (2006)CrossRef Caiafa, C.F., Proto, A.N.: Separation of statistically dependent sources using an l2 distance non-gaussianity measure. Signal Process. 86(11), 3404–3420 (2006)CrossRef
34.
go back to reference Hyvarinen, A.: Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Networks 10(3), 626–634 (1999)CrossRef Hyvarinen, A.: Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Networks 10(3), 626–634 (1999)CrossRef
35.
go back to reference Friedman, J.H.: Exploratory projection pursuit. J. Am. Stat. Assoc. 82(397), 249–266 (1987)CrossRef Friedman, J.H.: Exploratory projection pursuit. J. Am. Stat. Assoc. 82(397), 249–266 (1987)CrossRef
36.
go back to reference Blanco, Y., Zazo, S.: New gaussianity measures based on order statistics: application to ica. Neurocomputing. 51, 303–320 (2003)CrossRef Blanco, Y., Zazo, S.: New gaussianity measures based on order statistics: application to ica. Neurocomputing. 51, 303–320 (2003)CrossRef
38.
go back to reference Vincent, E., Araki, S., Theis, F.J., Nolte, G., Bofill, P., et al.: The signal separation evaluation campaign (2007-2010): achievements and remaining challenges. Sig. Process. 92, 1928–1936 (2012)CrossRef Vincent, E., Araki, S., Theis, F.J., Nolte, G., Bofill, P., et al.: The signal separation evaluation campaign (2007-2010): achievements and remaining challenges. Sig. Process. 92, 1928–1936 (2012)CrossRef
Metadata
Title
Blind Nonparametric Determined and Underdetermined Signal Extraction Algorithm for Dependent Source Mixtures
Authors
Fasong Wang
Rui Li
Zhongyong Wang
Xiangchuan Gao
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-22180-9_5

Premium Partner