Skip to main content

2021 | OriginalPaper | Buchkapitel

Rapid Detection of Hot-Spot by Tensor Decomposition with Application to Weekly Gonorrhea Data

verfasst von : Yujie Zhao, Hao Yan, Sarah E. Holte, Roxanne P. Kerani, Yajun Mei

Erschienen in: Frontiers in Statistical Quality Control 13

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In many bio-surveillance and healthcare applications, data sources are measured from many spatial locations repeatedly over time, say, daily/weekly/monthly. In these applications, we are typically interested in detecting hot-spots, which are defined as some structured outliers that are sparse over the spatial domain but persistent over time. In this paper, we propose a tensor decomposition method to detect when and where the hot-spots occur. Our proposed methods represent the observed raw data as a three-dimensional tensor including a circular time dimension for daily/weekly/monthly patterns, and then decompose the tensor into three components: smooth global trend, local hot-spots, and residuals. A combination of LASSO and fused LASSO is used to estimate the model parameters, and a CUSUM procedure is applied to detect when and where the hot-spots might occur. The usefulness of our proposed methodology is validated through numerical simulation and a real-world dataset in the weekly number of gonorrhea cases from 2006 to 2018 for 50 states in the United States.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Beck, A., & Teboulle, M. (2009). A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2(1), 183–202.MathSciNetCrossRef Beck, A., & Teboulle, M. (2009). A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2(1), 183–202.MathSciNetCrossRef
Zurück zum Zitat Call, M. A., & Voss, P. R. (2016). Spatio-temporal dimensions of child poverty in America, 1990–2010. Environment and Planning A, 48(1), 172–191.CrossRef Call, M. A., & Voss, P. R. (2016). Spatio-temporal dimensions of child poverty in America, 1990–2010. Environment and Planning A, 48(1), 172–191.CrossRef
Zurück zum Zitat Daubechies, I., Defrise, M., & De Mol, C. (2004). An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Communications on Pure and Applied Mathematics: A Journal Issued by the Courant Institute of Mathematical Sciences, 57(11), 1413–1457.MathSciNetCrossRef Daubechies, I., Defrise, M., & De Mol, C. (2004). An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Communications on Pure and Applied Mathematics: A Journal Issued by the Courant Institute of Mathematical Sciences, 57(11), 1413–1457.MathSciNetCrossRef
Zurück zum Zitat De Ketelaere, B., Hubert, M., & Schmitt, E. (2015). Overview of pca-based statistical process-monitoring methods for time-dependent, high-dimensional data. Journal of Quality Technology, 47(4), 318–335.CrossRef De Ketelaere, B., Hubert, M., & Schmitt, E. (2015). Overview of pca-based statistical process-monitoring methods for time-dependent, high-dimensional data. Journal of Quality Technology, 47(4), 318–335.CrossRef
Zurück zum Zitat Diggle, P. J. (2013). Statistical analysis of spatial and spatio-temporal point patterns. New York: CRC Press.CrossRef Diggle, P. J. (2013). Statistical analysis of spatial and spatio-temporal point patterns. New York: CRC Press.CrossRef
Zurück zum Zitat Elhorst, J. P. (2014). Spatial panel data models. In: Spatial Econometrics, Springer (pp. 37–93) Elhorst, J. P. (2014). Spatial panel data models. In: Spatial Econometrics, Springer (pp. 37–93)
Zurück zum Zitat Friedman, J., Hastie, T., & Tibshirani, R. (2010). Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software, 33(1), 1.CrossRef Friedman, J., Hastie, T., & Tibshirani, R. (2010). Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software, 33(1), 1.CrossRef
Zurück zum Zitat Hamilton, J. D. (1994). Time series analysis (Vol. 2). Princeton: Princeton University Press.CrossRef Hamilton, J. D. (1994). Time series analysis (Vol. 2). Princeton: Princeton University Press.CrossRef
Zurück zum Zitat Hannan, E. J., & Quinn, B. G. (1979). The determination of the order of an autoregression. Journal of the Royal Statistical Society Series B (Methodological), 41(2), 190–195.MathSciNetCrossRef Hannan, E. J., & Quinn, B. G. (1979). The determination of the order of an autoregression. Journal of the Royal Statistical Society Series B (Methodological), 41(2), 190–195.MathSciNetCrossRef
Zurück zum Zitat Hawkins, D. M. (1993). Regression adjustment for variables in multivariate quality control. Journal of Quality Technology, 25(3), 170–182.CrossRef Hawkins, D. M. (1993). Regression adjustment for variables in multivariate quality control. Journal of Quality Technology, 25(3), 170–182.CrossRef
Zurück zum Zitat Hu, K., & Yuan, J. (2009). Batch process monitoring with tensor factorization. Journal of Process Control, 19(2), 288–296.CrossRef Hu, K., & Yuan, J. (2009). Batch process monitoring with tensor factorization. Journal of Process Control, 19(2), 288–296.CrossRef
Zurück zum Zitat Lai, T. L., Lim, J. (2015). Asymptotically efficient parameter estimation in hidden markov spatio-temporal random fields. Statistica Sinica pp. 403–421 Lai, T. L., Lim, J. (2015). Asymptotically efficient parameter estimation in hidden markov spatio-temporal random fields. Statistica Sinica pp. 403–421
Zurück zum Zitat Lan, H., Zhou, C., Wang, L., Zhang, H., & Li, R. (2004). Landslide hazard spatial analysis and prediction using gis in the xiaojiang watershed, yunnan, china. Engineering Geology, 76(1–2), 109–128.CrossRef Lan, H., Zhou, C., Wang, L., Zhang, H., & Li, R. (2004). Landslide hazard spatial analysis and prediction using gis in the xiaojiang watershed, yunnan, china. Engineering Geology, 76(1–2), 109–128.CrossRef
Zurück zum Zitat Lichstein, J. W., Simons, T. R., Shriner, S. A., & Franzreb, K. E. (2002). Spatial autocorrelation and autoregressive models in ecology. Ecological Monographs, 72(3), 445–463.CrossRef Lichstein, J. W., Simons, T. R., Shriner, S. A., & Franzreb, K. E. (2002). Spatial autocorrelation and autoregressive models in ecology. Ecological Monographs, 72(3), 445–463.CrossRef
Zurück zum Zitat Liu, J., Yuan, L., Ye, J. (2010). An efficient algorithm for a class of fused lasso problems. In: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM (pp. 323–332). Liu, J., Yuan, L., Ye, J. (2010). An efficient algorithm for a class of fused lasso problems. In: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM (pp. 323–332).
Zurück zum Zitat Louwerse, D., & Smilde, A. (2000). Multivariate statistical process control of batch processes based on three-way models. Chemical Engineering Science, 55(7), 1225–1235.CrossRef Louwerse, D., & Smilde, A. (2000). Multivariate statistical process control of batch processes based on three-way models. Chemical Engineering Science, 55(7), 1225–1235.CrossRef
Zurück zum Zitat Qiu, P. (2013). Introduction to statistical process control. New York: Chapman and Hall/CRC.CrossRef Qiu, P. (2013). Introduction to statistical process control. New York: Chapman and Hall/CRC.CrossRef
Zurück zum Zitat Reinsel, G. C. (2003). Elements of multivariate time series analysis. Berlin: Springer Science & Business Media.MATH Reinsel, G. C. (2003). Elements of multivariate time series analysis. Berlin: Springer Science & Business Media.MATH
Zurück zum Zitat Reynolds, K., & Madden, L. (1988). Analysis of epidemics using spatio-temporal autocorrelation. Phytopathology, 78(2), 240–246.CrossRef Reynolds, K., & Madden, L. (1988). Analysis of epidemics using spatio-temporal autocorrelation. Phytopathology, 78(2), 240–246.CrossRef
Zurück zum Zitat Šaltytė Benth, J., & Šaltytė, L. (2011). Spatial-temporal model for wind speed in lithuania. Journal of Applied Statistics, 38(6), 1151–1168.MathSciNetCrossRef Šaltytė Benth, J., & Šaltytė, L. (2011). Spatial-temporal model for wind speed in lithuania. Journal of Applied Statistics, 38(6), 1151–1168.MathSciNetCrossRef
Zurück zum Zitat Tibshirani, R., Saunders, M., Rosset, S., Zhu, J., & Knight, K. (2005). Sparsity and smoothness via the fused lasso. Journal of the Royal Statistical Society Series B (Methodological), 67(1), 91–108.MathSciNetCrossRef Tibshirani, R., Saunders, M., Rosset, S., Zhu, J., & Knight, K. (2005). Sparsity and smoothness via the fused lasso. Journal of the Royal Statistical Society Series B (Methodological), 67(1), 91–108.MathSciNetCrossRef
Zurück zum Zitat Tran, L., Navasca, C., Luo, J. (2012). Video detection anomaly via low-rank and sparse decompositions. In: 2012 Western New York Image Processing Workshop, IEEE (pp. 17–20). Tran, L., Navasca, C., Luo, J. (2012). Video detection anomaly via low-rank and sparse decompositions. In: 2012 Western New York Image Processing Workshop, IEEE (pp. 17–20).
Zurück zum Zitat Tsay, R. S. (2013). Multivariate time series analysis: With R and financial applications. New York: Wiley. Tsay, R. S. (2013). Multivariate time series analysis: With R and financial applications. New York: Wiley.
Zurück zum Zitat Yan, H., Paynabar, K., & Shi, J. (2017). Anomaly detection in images with smooth background via smooth-sparse decomposition. Technometrics, 59(1), 102–114.MathSciNetCrossRef Yan, H., Paynabar, K., & Shi, J. (2017). Anomaly detection in images with smooth background via smooth-sparse decomposition. Technometrics, 59(1), 102–114.MathSciNetCrossRef
Zurück zum Zitat Yan, H., Paynabar, K., & Shi, J. (2018). Real-time monitoring of high-dimensional functional data streams via spatio-temporal smooth sparse decomposition. Technometrics, 60(2), 181–197.MathSciNetCrossRef Yan, H., Paynabar, K., & Shi, J. (2018). Real-time monitoring of high-dimensional functional data streams via spatio-temporal smooth sparse decomposition. Technometrics, 60(2), 181–197.MathSciNetCrossRef
Zurück zum Zitat Zhu, J., Huang, H. C., & Wu, J. (2005). Modeling spatial-temporal binary data using markov random fields. Journal of Agricultural, Biological, and Environmental Statistics, 10(2), 212.CrossRef Zhu, J., Huang, H. C., & Wu, J. (2005). Modeling spatial-temporal binary data using markov random fields. Journal of Agricultural, Biological, and Environmental Statistics, 10(2), 212.CrossRef
Zurück zum Zitat Zou, C., & Qiu, P. (2009). Multivariate statistical process control using lasso. Journal of the American Statistical Association, 104(488), 1586–1596.MathSciNetCrossRef Zou, C., & Qiu, P. (2009). Multivariate statistical process control using lasso. Journal of the American Statistical Association, 104(488), 1586–1596.MathSciNetCrossRef
Zurück zum Zitat Zou, C., Ning, X., & Tsung, F. (2012). Lasso-based multivariate linear profile monitoring. Annals of Operations Research, 192(1), 3–19.MathSciNetCrossRef Zou, C., Ning, X., & Tsung, F. (2012). Lasso-based multivariate linear profile monitoring. Annals of Operations Research, 192(1), 3–19.MathSciNetCrossRef
Metadaten
Titel
Rapid Detection of Hot-Spot by Tensor Decomposition with Application to Weekly Gonorrhea Data
verfasst von
Yujie Zhao
Hao Yan
Sarah E. Holte
Roxanne P. Kerani
Yajun Mei
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-67856-2_15