Skip to main content

Tipp

Weitere Artikel dieser Ausgabe durch Wischen aufrufen

09.09.2023 | Regular Paper

A new robust bootstrapped singular value decomposition algorithm using the sample myriad estimate

verfasst von: Chisimkwuo John, Emmanuel J. Ekpenyong, Charles Chinedu Nworu, Chukwuemeka O. Omekara

Erschienen in: International Journal of Data Science and Analytics

Einloggen

Abstract

Singular value decomposition (SVD) of rectangular datasets has proved to be a useful multivariate data decomposition approach because of its ability to decompose both square and rectangular matrices. A variant of SVD approach utilizes the median as a robust location estimate other than the mean estimate used in the ordinary SVD. Since insufficient dataset and in addition, inefficiency of the median estimate seems to be a major setback of the existing robust SVD systems, this study envisaged an integrated algorithm that incorporated the Bootstrapped SVD and the sample myriad estimate in cropping a new SVD system, the Robust Bootstrapped SVD (RobBootSVD). The new RobBootSVD was appraised alongside the existing ones using the Principal Component Analysis biplot quality measures and the new RobBootSVD T2 measure. Applications on tobacco process datasets with both short and long runs and simulated datasets with various percentages of outliers showcase the viability of the new approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Campbell, N.A.: Robust procedures in multivariate analysis I: robust covariance estimation. J. R. Stat. Soc. Ser. C Appl. Stat. 29(3), 231–237 (1980) MATH Campbell, N.A.: Robust procedures in multivariate analysis I: robust covariance estimation. J. R. Stat. Soc. Ser. C Appl. Stat. 29(3), 231–237 (1980) MATH
2.
Zurück zum Zitat Choi, Y.S., Huh, M.H.: Resistant singular value decomposition and its statistical application. J. Korean Stat. Soc. 25, 9–66 (1996) MathSciNet Choi, Y.S., Huh, M.H.: Resistant singular value decomposition and its statistical application. J. Korean Stat. Soc. 25, 9–66 (1996) MathSciNet
3.
Zurück zum Zitat Cox, T.F., Cox, M.A.A.: Multidimensional scaling, 2nd edition, Chapman & Hall/CRC, Boca Raton, New York (2001) Cox, T.F., Cox, M.A.A.: Multidimensional scaling, 2nd edition, Chapman & Hall/CRC, Boca Raton, New York (2001)
4.
Zurück zum Zitat Durrett, R.: Brownian Motion and Martingales in Analysis. Wadsworth Inc, Belmont (1984) MATH Durrett, R.: Brownian Motion and Martingales in Analysis. Wadsworth Inc, Belmont (1984) MATH
5.
Zurück zum Zitat Eckart, C., Young, G.: The approximation of one matrix by another of lower rank. Psychometrika 1, 211–218 (1936) CrossRefMATH Eckart, C., Young, G.: The approximation of one matrix by another of lower rank. Psychometrika 1, 211–218 (1936) CrossRefMATH
6.
Zurück zum Zitat Efron, B., Tibshirani, R.: An introduction to the Bootstrap Monographs on Statistics and Applied Probability, No. 57. Chapman and Hall, London (1993) CrossRef Efron, B., Tibshirani, R.: An introduction to the Bootstrap Monographs on Statistics and Applied Probability, No. 57. Chapman and Hall, London (1993) CrossRef
7.
Zurück zum Zitat Fisher, A.J., Caffo, B., Schwartz, B., Zipunnikov, V.: Fast, exact bootstrap principal component analysis for p > 1 million. ASA J. TM 111, 846–860 (2016) MathSciNet Fisher, A.J., Caffo, B., Schwartz, B., Zipunnikov, V.: Fast, exact bootstrap principal component analysis for p > 1 million. ASA J. TM 111, 846–860 (2016) MathSciNet
8.
Zurück zum Zitat Gabriel, K.R., Zamir, S.: Lower rank approximation of matrices by least squares with any choice of weights. Technometrics 21, 489–498 (1979) CrossRefMATH Gabriel, K.R., Zamir, S.: Lower rank approximation of matrices by least squares with any choice of weights. Technometrics 21, 489–498 (1979) CrossRefMATH
9.
Zurück zum Zitat Gardner-Lubbe, S.: Extensions of Biplot Methodology to Discriminant Analysis with Applications of Nonparametric Principal Components. Unpublished thesis, University of Stellenbosch (2001) Gardner-Lubbe, S.: Extensions of Biplot Methodology to Discriminant Analysis with Applications of Nonparametric Principal Components. Unpublished thesis, University of Stellenbosch (2001)
10.
Zurück zum Zitat Gonzalez, J.G., Arce, G.R.: Optimality of the myriad filter in practical impulsive-noise environments. IEEE Trans. Signal Proc. 2, 438–441 (2001) CrossRef Gonzalez, J.G., Arce, G.R.: Optimality of the myriad filter in practical impulsive-noise environments. IEEE Trans. Signal Proc. 2, 438–441 (2001) CrossRef
11.
Zurück zum Zitat Gower, J.C., Hand, D.J.: Biplots. Monographs on Statistics and Applied Probability. Chapman & Hall, London (1996) Gower, J.C., Hand, D.J.: Biplots. Monographs on Statistics and Applied Probability. Chapman & Hall, London (1996)
12.
Zurück zum Zitat Gower, J.C., Lubbe, S., Le Roux, N.J.: Understanding Biplots. Wiley, Chichester (2011) CrossRef Gower, J.C., Lubbe, S., Le Roux, N.J.: Understanding Biplots. Wiley, Chichester (2011) CrossRef
13.
Zurück zum Zitat Hawkins, D.M., Olive, D.J.: Improved feasible solution algorithms for high breakdown estimation. Comput. Stat. Data Anal. 30, 1–11 (1999) MathSciNetCrossRefMATH Hawkins, D.M., Olive, D.J.: Improved feasible solution algorithms for high breakdown estimation. Comput. Stat. Data Anal. 30, 1–11 (1999) MathSciNetCrossRefMATH
14.
Zurück zum Zitat Hawkins, D.M., Liu, L., Young, S.S.: Robust Singular Value Decomposition. National Institute of Statistical Sciences, Durham (2001) Hawkins, D.M., Liu, L., Young, S.S.: Robust Singular Value Decomposition. National Institute of Statistical Sciences, Durham (2001)
15.
Zurück zum Zitat Hoteling, H.: The generalization of student’s ratio. Ann. Math. Stat. 2, 360–378 (1931) CrossRef Hoteling, H.: The generalization of student’s ratio. Ann. Math. Stat. 2, 360–378 (1931) CrossRef
16.
Zurück zum Zitat Hubert, M., Rousseeuw, P.J., Verboven, S.: A fast method for robust principal components with applications to chemometrics. Chemom. Intell. Lab. Syst. 60, 101–111 (2002) CrossRef Hubert, M., Rousseeuw, P.J., Verboven, S.: A fast method for robust principal components with applications to chemometrics. Chemom. Intell. Lab. Syst. 60, 101–111 (2002) CrossRef
17.
Zurück zum Zitat John, C.: Detecting atypical runs using the beta distributed hoteling in phase I process data—the tobacco data case study. J. Natl. Assoc. Math. Phys. 50(3), 57–62 (2019) MathSciNet John, C.: Detecting atypical runs using the beta distributed hoteling in phase I process data—the tobacco data case study. J. Natl. Assoc. Math. Phys. 50(3), 57–62 (2019) MathSciNet
18.
Zurück zum Zitat John, C.: A Modified Robust Multivariate Monitoring Design Using the Principal Component Analysis Biplot, Unpublished thesis, Michael Okpara University of Agriculture, Umudike (2021) John, C.: A Modified Robust Multivariate Monitoring Design Using the Principal Component Analysis Biplot, Unpublished thesis, Michael Okpara University of Agriculture, Umudike (2021)
19.
Zurück zum Zitat Johnson, R.A., Wichern, D.W.: Applied Multivariate Statistical Analysis, 6th edn. Pearson International Edition, Upper Saddle River (2007) MATH Johnson, R.A., Wichern, D.W.: Applied Multivariate Statistical Analysis, 6th edn. Pearson International Edition, Upper Saddle River (2007) MATH
20.
Zurück zum Zitat Lancaster, T.: A note on bootstraps and robustness. The Institute for Fiscal Studies Department of Economics, UCL Cemmap working paper CWP04/06 (2003) Lancaster, T.: A note on bootstraps and robustness. The Institute for Fiscal Studies Department of Economics, UCL Cemmap working paper CWP04/06 (2003)
21.
Zurück zum Zitat Mason, R.L., Young, J.C.: Multivariate Statistical Process Control with Industrial Applications. ASA-SIAM, Alexandria (2001) MATH Mason, R.L., Young, J.C.: Multivariate Statistical Process Control with Industrial Applications. ASA-SIAM, Alexandria (2001) MATH
22.
Zurück zum Zitat Montgomery, D.C.: Statistical Quality Control: A Modern Introduction, 6th edn. Wiley, New York (2009) MATH Montgomery, D.C.: Statistical Quality Control: A Modern Introduction, 6th edn. Wiley, New York (2009) MATH
23.
Zurück zum Zitat McCulloch, J.H.: Simple consistent estimators of stable distribution parameters. Commun. Stat. Simul. Comput. 4, 1109–1136 (1986) MathSciNetCrossRefMATH McCulloch, J.H.: Simple consistent estimators of stable distribution parameters. Commun. Stat. Simul. Comput. 4, 1109–1136 (1986) MathSciNetCrossRefMATH
24.
Zurück zum Zitat MacGregor, J.F., Kourti, T.: Statistical process control of multivariable processes. Control Eng. Pract. 3, 403–414 (1995) CrossRef MacGregor, J.F., Kourti, T.: Statistical process control of multivariable processes. Control Eng. Pract. 3, 403–414 (1995) CrossRef
25.
Zurück zum Zitat Podosinnikova1, A., Setzer, S., Hein, M.: Reconstruction error over the Stiefelanifold. INRIA - Sierra Project Team, Ecole Normale Superrieure, Paris, France (2014) Podosinnikova1, A., Setzer, S., Hein, M.: Reconstruction error over the Stiefelanifold. INRIA - Sierra Project Team, Ecole Normale Superrieure, Paris, France (2014)
26.
Zurück zum Zitat Rossouw, R.F.: Multivariate statistical process evaluation and monitoring for Complex Chemical Processes, Ph.D Thesis, University of Stellenbosch (2015) Rossouw, R.F.: Multivariate statistical process evaluation and monitoring for Complex Chemical Processes, Ph.D Thesis, University of Stellenbosch (2015)
28.
Zurück zum Zitat Rousseeuw, P.J., Driessen, D.K.: A fast algorithm for the minimum covariance determinant estimator. Technometrics 41, 212–223 (1999) CrossRef Rousseeuw, P.J., Driessen, D.K.: A fast algorithm for the minimum covariance determinant estimator. Technometrics 41, 212–223 (1999) CrossRef
29.
Zurück zum Zitat Russell, E.L., Chiang, L.H., Braatz, R.D.: Fault detection in industrial processes using canonical variate analysis and dynamic principal component analysis. Chemom. Intell. Lab. Syst. 51(1), 81–93 (2000) CrossRef Russell, E.L., Chiang, L.H., Braatz, R.D.: Fault detection in industrial processes using canonical variate analysis and dynamic principal component analysis. Chemom. Intell. Lab. Syst. 51(1), 81–93 (2000) CrossRef
30.
Zurück zum Zitat Stefatos, G., Hamza, A.B.: Statistical process control using kernel PCA. In: Mediterranean conference on control and automation (2007) Stefatos, G., Hamza, A.B.: Statistical process control using kernel PCA. In: Mediterranean conference on control and automation (2007)
31.
Zurück zum Zitat Venables, W., Ripley, N.: Modern Applied Statistics with S. Springer, New York (1999) CrossRefMATH Venables, W., Ripley, N.: Modern Applied Statistics with S. Springer, New York (1999) CrossRefMATH
32.
Zurück zum Zitat Wang, D.: Adjustable robust singular value decomposition: design analysis and application to finance. MDPI Basel, Switzerland (2017) Wang, D.: Adjustable robust singular value decomposition: design analysis and application to finance. MDPI Basel, Switzerland (2017)
33.
Zurück zum Zitat Wedlake, R.: Robust principal component analysis biplots. Master’s thesis, University of Stellenbosch (2008) Wedlake, R.: Robust principal component analysis biplots. Master’s thesis, University of Stellenbosch (2008)
Metadaten
Titel
A new robust bootstrapped singular value decomposition algorithm using the sample myriad estimate
verfasst von
Chisimkwuo John
Emmanuel J. Ekpenyong
Charles Chinedu Nworu
Chukwuemeka O. Omekara
Publikationsdatum
09.09.2023
Verlag
Springer International Publishing
Erschienen in
International Journal of Data Science and Analytics
Print ISSN: 2364-415X
Elektronische ISSN: 2364-4168
DOI
https://doi.org/10.1007/s41060-023-00444-2