Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Cluster Computing
Published in: Cluster Computing 2/2017

24-03-2017

A multilayer FOCUSS approach for sparse representation

Authors: Kan Xie, Min Shi, Peitao Wang, Jie Xu, Yue Lai

Published in: Cluster Computing | Issue 2/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Focal Underdetermined System Solver (FOCUSS) is a powerful method for sparse representation, in which the Lp-norm like cost function is very often used. However, this cost function is not only nondifferentiable but also can be very ill-conditioned in some situations. The local minima problem of FOCUSS is discussed in this paper. Moreover, to solve this problem, we first extend the Lp-norm like cost function to its corresponding Lp-approximation. After this, we analyze the nonconvexity of the new cost function, which results in that FOCUSS algorithm gets stuck in the local minima in many situations, especially when the hidden sources are not very sparse. To reduce the number of the local minima, a multilayer FOCUSS is developed in this paper. Comparing with the conventional FOCUSS, the experiments inclusing MRI reconstruction demonstrate that multilayer FOCUSS can significantly improve the performance. Even for some very challenging cases, where the conventional FOCUSS fails, multilayer FOCUSS still works well.
previous article A novel DBSCAN with entropy and probability for mixed data
next article Second-order continuous characteristic model based adaptive control for a class of linear systems

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Appendix
Available only for authorised users
Literature
1.
2.
He, Z.S., Xie, S.L., Fu, Y.L.: Sparse representation and blind source separation of Ill-posed mixtures. Sci. China F 49(5), 639–652 (2006)MathSciNetCrossRef
3.
He, Z.S., Cichocki, A., Zdunek, R., Cao, J.T.: CG-M-FOCUSS and Its Application to Distributed Compressed Sensing. Lecture Notes in Computer Science 5263, 237–245 (2008)
4.
Xie, K., He, Z., Cichocki, A.: Convergence analysis of the FOCUSS algorithm. IEEE Trans. Neural Netw. Learn. Syst. 26(3), 601–613 (2015)MathSciNetCrossRef
5.
6.
Aharon, M., Elad, M., Bruckstein, A.M.: The k-SVD: an algorithm for designing of overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process. 54(11), 4311–4322 (2006)CrossRefMATH
7.
Bofill, P., Zibulevsky, M.: Underdetermined blind source separation using sparse representations. Signal Process. 81, 2353–2362 (2001)CrossRefMATH
8.
9.
Cichocki, A., Amari, S.: Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. Wiley, New York (2003)
10.
Cotter, S.F., Rao, B.D., Engan, K., Kreutz-Delgado, K.: Sparse solutions to linear inverse problems with multiple measurement vectors. IEEE Trans. Signal Process. 53(7), 2477–2488 (2005)MathSciNetCrossRefMATH
11.
Donoho, D.L., Elad, M.: Maximal sparsity representation via \(L\)1 minimization. Proc. Natl. Acad. Sci. 100, 2197–2202 (2003)CrossRefMATH
12.
Georgiev, P., Theis, F., Cichocki, A.: Sparse component analysis and blind source separation of underdetermined mixtures. IEEE Trans. Neural Netw. 16(4), 992–996 (2005)CrossRef
13.
Gorodnitsky, I.F., Rao, B.D.: Sparse signal reconstruction from limited data using FOCUSS: a recursive weighted minimum norm algorithm. IEEE Trans. Signal Process. 45(3), 600–616 (1997)CrossRef
14.
Kreutz-Delgado, K., Murry, J.F., Rao, B.D., et al.: Dictionary learning algorithms for sparse representation. Neural Comput. 15, 349–396 (2003)CrossRefMATH
15.
Li, Y.Q., Amari, S., Cichocki, A., Ho, D.W.C., Xie, S.L.: Underdetermined blind source separation based on sparse representation. IEEE Trans. Signal Process. 54(2), 423–437 (2006)CrossRefMATH
16.
Li, Y.Q., Cichocki, A., Amari, S.: Analysis of sparse representation and blind source separation. Neural Comput. 16, 1193–1234 (2004)CrossRefMATH
17.
Olshausen, B.A., Field, D.J.: Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381(6583), 607–609 (1996)CrossRef
18.
Rao, B.D.: Signal processing with the sparseness constraint. In: Proceedings of the ICASSP, vol. III, pp. 1861–1864. Seattle, WA (1998)
19.
Rao, B.D., Gorodnitsky, I.F.: An affine scaling methodology for best basis selection. IEEE Trans. Signal Process. 47(1), 187–200 (1999)MathSciNetCrossRef
20.
Rao, B.D., Rngan, K., Cotter, S.F., Palmer, J., Kreutz-Delgado, K.: Subset selection in noise based on diversity measure minimization. IEEE Trans. Signal Process. 51(3), 760–770 (2003)CrossRef
21.
Saab, R., Yilmaz, O., Mckeown, M.J., Abugharbieh, R.: Underdetermined anechoic blind source separation via Lq-basis-pursuit. IEEE Trans. Signal Process. 55(8), 4004–4017 (2007)MathSciNetCrossRef
22.
Takigawa, I., Kudo, M., Toyama, J.: Performance analysis of minimum \(L\)1-norm solutions for underdetermined source separation. IEEE Trans. Signal Process. 52(3), 582–591 (2004)MathSciNetCrossRefMATH
23.
Zhou, G., Cichocki, A., Zhang, Y., Mandic, D.: Group component analysis from multi-block data: common and individual feature extraction. IEEE Trans. Neural Netw. Learn. Syst. doi:10.​1109/​TNNLS.​2015.​2487364
24.
25.
Zhou, G., Zhao, Q., Zhang, Y., Adali, T., Xie, S., et al.: Linked component analysis from matrices to high-order tensors: applications to biomedical data. Proc. IEEE 104(2), 310–331 (2016)CrossRef
26.
Chen, C., Liu, Z., Zhang, Y., Philip Chen, C.L., Xie, S.:. Asymptotic fuzzy tracking control for a class of stochastic strict-feedback systems. IEEE Trans Fuzzy Syst. doi:10.​1109/​TFUZZ.​2016.​2566807
27.
Chen, C., Liu, Z., Zhang, Y., Xie, S.: Coordinated motion/force control of humanoid robot with unknown sensor nonlinearity and manipulated object’s uncertainty. IEEE Trans. Syst. Man Cybern. doi:10.​1109/​TSMC.​2016.​2557219
28.
Liu, Y., Pan, M., Yu, R., Zhang, Y., Xie, S.: SD-MAC: spectrum database-driven MAC protocol for cognitive machine-to-machine networks. IEEE Trans. Veh. Technol. doi:10.​1109/​TVT.​2016.​2555084
29.
Liu, Y., Yuen, C., Yu, R., Zhang, Y., Xie, S.: Queuing-based energy consumption management for heterogeneous residential demands in smart grid. IEEE Transa. Smart Grid 7(3), 1650–1659 (2016)CrossRef
30.
Majumdar, Angshul: FOCUSS based Schatten-p norm minimization for real-time reconstruction of dynamic contrast enhanced MRI. IEEE Signal Process. Lett. 19(5), 315–318 (2012)CrossRef
31.
Kim, S.J., Koh, K., Lustig, M., Boyd, S., Gorinevsky, D.: An interiorpoint method for large-scale L1-regularized least squares. IEEE J. Sel. Topics Signal Process. 1(4), 606–617 (2007)CrossRef
32.
Gorodnitsky, I.F., George, J., Rao, B.D.: Neuromagnetic source imaging with FOCUSS: a recursive weighted minimum norm algorithm. Electroencephalogr. Clin. Neurophysiol. 95(4), 231–251 (1995)CrossRef
33.
Xu, P., Tian, Y., Chen, H.F., Yao, D.Z.: Lp norm iterative sparse solution for EEG source localization. IEEE Trans. Biomed. Eng. 54(3), 400–409 (2007)CrossRef
34.
Rao, B.D., Engan, K., Cotter, S.F., Palmer, J., Kreutz-Delgado, K.: Subset selection in noise based on diversity measure minimization. IEEE Trans. Signal Process. 51(3), 760–770 (2003)CrossRef
35.
Chen, J., Huo, X.M.: Theoretical results on sparse representations of multiple-measurement vectors. IEEE Trans. Signal Process. 54(12), 4634–4643 (2006)CrossRefMATH
36.
He, Z.S., Xie, S.L., Ding, S.X., Cichocki, A.: Convolutive blind source separation in frequency domain based on sparse representation. IEEE Trans. Audio Speech Lang. Process. 15(5), 1551–1563 (2007)CrossRef
37.
He, Z.S., Xie, S.L., Zhang, L.Q., Cichocki, A.: A note on Lewicki–Sejnowski Gradient for learning overcomplete representation. Neural Comput. 20(3), 636–643 (2008)MathSciNetCrossRefMATH
38.
He, Z.S., Cichocki, A., Zdunek, R., Xie, S.L.: Improved FOCUSS method with conjugate gradient (CG) iterations. IEEE Trans. Signal Process. 57(1), 399–404 (2009)MathSciNetCrossRef
Metadata
Title
A multilayer FOCUSS approach for sparse representation
Authors
Kan Xie
Min Shi
Peitao Wang
Jie Xu
Yue Lai
Publication date
24-03-2017
Publisher
Springer US
Published in
Cluster Computing / Issue 2/2017
Print ISSN: 1386-7857
Electronic ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-0823-6

Other articles of this Issue 2/2017

Cluster Computing 2/2017 Go to the issue

OriginalPaper

Designing, building and evaluating a social news curation environment using the action design research methodology

OriginalPaper

Optimized combinatorial clustering for stochastic processes

OriginalPaper

The invariant measure and stationary probability density computing model based analysis of the governor system

OriginalPaper

Energy-efficient sustainable cluster based neighbor discovery technique for wireless networks with directional antennas

OriginalPaper

JarvSis: a distributed scheduler for IoT applications

OriginalPaper

A user behavior prediction model based on parallel neural network and k-nearest neighbor algorithms

Premium Partner

    Image Credits