Skip to main content

2016 | OriginalPaper | Buchkapitel

10. Non-Parametric Spectral Methods

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter deals with obtaining a good estimate of the power spectrum of a random signal on the basis of a finite number of samples of a typical realization of the underlying random process—one among the infinite sequences that the process can generate when we measure it. The simplest approach to spectral estimation, i.e., the periodogram, turns out to perform poorly: the variance of the estimate is high and does not decrease with increasing length of the data record—it is not a consistent estimate of the power spectrum. The search for a stable and consistent spectral estimate leads to the methods of Bartlett and Welch, and to the Blackman-Tukey method. We will also present statistical tests used judge the significance of any peak detected in a spectrum. A description of the multitaper method (MTM) and a brief account of the estimation of the cross-spectrum of two random signals will be followed by a discussion about the use of FFT for practical computation of spectral estimates and about the different normalization schemes adopted in literature for the power spectrum.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
In this frame we use the two terms indifferently, even if the triangular window and the Bartlett window are actually two different sequences: the former has no zeros at its edges, while the latter includes two zero samples at the beginning and end. In the present case, there must be no zeros at the edges; therefore in principle we should call this a “triangular window”.
 
2
Note that the terms “input” and “output” here refer to a power spectrum estimation algorithm: a signal having a given \(\mathrm {SNR}_{\mathrm {i}}\) enters the algorithm; in the spectral estimate, the signal-to-noise ratio is modified by a factor depending on the shape and length of the taper and is transformed into \(\mathrm {SNR}_{\mathrm {o}}\). Looking at the latter, we can evaluate the capability of the estimator to detect the imprint of the sinusoid/complex exponential buried in noise.
 
3
For \(N\rightarrow \infty \) the spectral window would become a periodic impulse train, i.e., a train of Dirac \(\delta \), but for a finite N the bias can vanish only asymptotically.
 
4
Note that this choice for defining resolution is coherent with what we stated about the periodogram: there we talked about the possibility of defining resolution through the bandwith of the spectral window \(W_{B,2N-1}\) at 6 dB, but since \(w_{B, 2N-1}[n]=(1/N) w_{R,N}[n] *w_{R,N}[n]\), so that \(W_{B,2N-1}(\mathrm {e}^{\mathrm {j}\omega })\propto \left| W_R(\mathrm {e}^{\mathrm {j}\omega })_{B,N}\right| ^2\), this is equivalent to using for the periodogram the bandwidth at 3 dB for \(W_R(\mathrm {e}^{\mathrm {j}\omega })\).
 
5
Recall that here we are speaking of non-causal windows, having a real transform. Note that Fig. 5.​5 shows transform squared magnitudes and therefore does not allow to verify the above statement.
 
6
The convolution with a Dirac \(\delta \) would leave the function unaltered.
 
7
It may be more intuitive to refer to the discrete trigonometric expansion of a signal (Sect. 3.​7): the two Gaussian variables in this case are the expansion coefficients \(a_k\) and \(b_k\); the former is related to a cosine of \(\omega _k n\) and the latter to a sine, and sine and cosine are mutually in phase quadrature. Therefore \(a_k^2+b_k^2= \left| X[k]\right| ^2\) has a \(\chi ^2\) distribution with \(\nu =2\). Note that this conclusion is independent of the sequence length, because the sinusoidal sequences used as the expansion basis are infinitely long.
 
8
The data is seasonal climatic anomalies of sea surface temperature (SST) in \(^{\circ }\)C, spatially averaged over the so-called NINO3 region of the Pacific Ocean. This region is comprised between latitudes of 50\(^{\circ }\) South and 50\(^{\circ }\) North and between longitudes of 90\(^{\circ }\) West and 150\(^{\circ }\) West, and is particularly representative for the study of climatic variability at interannual time scale, and more precisely for the study of the El Niño—La Niña phenomena. The data used here spans the years 1871–2012 and were drawn from monthly NINO3 data available at http://​www.​esrl.​noaa.​gov/​psd/​gcos_​wgsp/​Timeseries/​Data/​nino3.​long.​data.
The term “climatic anomalies” means that the data has been centered by subtracting from each seasonal sample the mean value of the corresponding season, computed over the whole record; for instance: spring of 1900 minus average over all springs. This makes the data free from the annual temperature cycle, the dominant presence of which in the spectrum would obscure weaker cyclicities.
 
9
The Rayleigh-Ritz method is a classical variational method for finding approximate solutions of differential equations, whose exact solutions are hard to find. The method was first used by Lord Rayleigh in 1870 to solve the vibration problem of organ pipes closed on one end and open at the other. However, the approach did not receive much recognition by the scientific community. Nearly 40 years later, due to the publication of two papers by Ritz, the method came to be called the Ritz method. To recognize the contributions of both authors, the theory was later renamed the Rayleigh-Ritz method.
 
10
The median is the numerical value separating the higher half of a data sample, a population, or a probability distribution, from the lower half. The median smoothing filter computes the median of PSD values falling inside a small frequency bin centered on a given frequency and assigns the result to this central frequency.
 
Literatur
Zurück zum Zitat Allen, M.R., Smith, L.A.: Monte Carlo SSA: detecting irregular oscillations in the presence of colored noise. J. Clim. 9, 3373–3404 (1996)CrossRef Allen, M.R., Smith, L.A.: Monte Carlo SSA: detecting irregular oscillations in the presence of colored noise. J. Clim. 9, 3373–3404 (1996)CrossRef
Zurück zum Zitat Bartlett, M.S.: Smoothing periodograms from time series with continuous spectra. Nature 161, 686–687 (1948)CrossRef Bartlett, M.S.: Smoothing periodograms from time series with continuous spectra. Nature 161, 686–687 (1948)CrossRef
Zurück zum Zitat Blackman, R.B., Tukey, J.W.: The Measurement of Power Spectra from the Point of View of Communication Engineering. Dover, New York (1958)MATH Blackman, R.B., Tukey, J.W.: The Measurement of Power Spectra from the Point of View of Communication Engineering. Dover, New York (1958)MATH
Zurück zum Zitat Chatfield, C.: The Analysis of Time Series: An Introduction. Chapman and Hall, New York (1975)MATH Chatfield, C.: The Analysis of Time Series: An Introduction. Chapman and Hall, New York (1975)MATH
Zurück zum Zitat Daniell, P.J.: Discussion on symposium on autocorrelation in time series. J. R. Stat. Soc. B 8, 88–90 (1946) Daniell, P.J.: Discussion on symposium on autocorrelation in time series. J. R. Stat. Soc. B 8, 88–90 (1946)
Zurück zum Zitat Hayes, M.H.: Statistical Digital Signal Processing and Modeling. Wiley, New York (1996) Hayes, M.H.: Statistical Digital Signal Processing and Modeling. Wiley, New York (1996)
Zurück zum Zitat Hess, G.D., Iwata, S.: Measuring and comparing business-cycle features. J. Bus. Econ. Stat. 15(4), 43244 (1997) Hess, G.D., Iwata, S.: Measuring and comparing business-cycle features. J. Bus. Econ. Stat. 15(4), 43244 (1997)
Zurück zum Zitat Jenkins, G.M., Watts, D.G.: Spectral Analysis and its Applications. Holden-Day, San Francisco (1968)MATH Jenkins, G.M., Watts, D.G.: Spectral Analysis and its Applications. Holden-Day, San Francisco (1968)MATH
Zurück zum Zitat Kay, S.M.: Modern Spectral Estimation: Theory and Applications. Prentice-Hall, Englewood Cliffs (1988)MATH Kay, S.M.: Modern Spectral Estimation: Theory and Applications. Prentice-Hall, Englewood Cliffs (1988)MATH
Zurück zum Zitat McConnell, M.M., Perez-Quiros, G.: Output fluctuations in the United States: what has changed since the early 1980? Am. Econ. Rev. 90(5), 1464–1476 (2000)CrossRef McConnell, M.M., Perez-Quiros, G.: Output fluctuations in the United States: what has changed since the early 1980? Am. Econ. Rev. 90(5), 1464–1476 (2000)CrossRef
Zurück zum Zitat Mac Lane, S., Birkhoff, G.: Algebra. AMS Chelsea Publishing, New York, NY, USA (1999) Mac Lane, S., Birkhoff, G.: Algebra. AMS Chelsea Publishing, New York, NY, USA (1999)
Zurück zum Zitat Mann, M.E., Lees, J.M.: Robust estimation of background noise and signal detection in climatic time series. Clim. Change 33(3), 409–445 (1996)CrossRef Mann, M.E., Lees, J.M.: Robust estimation of background noise and signal detection in climatic time series. Clim. Change 33(3), 409–445 (1996)CrossRef
Zurück zum Zitat Marple, S.L.: Digital Spectral Analysis: With Applications. Prentice-Hall, Upper Saddle River (1987) Marple, S.L.: Digital Spectral Analysis: With Applications. Prentice-Hall, Upper Saddle River (1987)
Zurück zum Zitat MacDonald, G.J.: Spectral analysis of time series generated by nonlinear processes. Rev. Geophys. 27, 449–469 (1989)CrossRef MacDonald, G.J.: Spectral analysis of time series generated by nonlinear processes. Rev. Geophys. 27, 449–469 (1989)CrossRef
Zurück zum Zitat Meltzer, J.A., Zaveri, H.P., Goncharova, I.I., Distasio, M.M., Papademetris, X., Spencer, S.S., Spencer, D.D., Constable, R.T.: Effects of working memory load on oscillatory power in human intracranial EEG. Cereb. Cortex 18, 1843–1855 (2008)CrossRef Meltzer, J.A., Zaveri, H.P., Goncharova, I.I., Distasio, M.M., Papademetris, X., Spencer, S.S., Spencer, D.D., Constable, R.T.: Effects of working memory load on oscillatory power in human intracranial EEG. Cereb. Cortex 18, 1843–1855 (2008)CrossRef
Zurück zum Zitat Percival, D.B., Walden, A.T.: Spectral Analysis for Physical Applications. Cambridge University Press, Cambridge (1993)CrossRefMATH Percival, D.B., Walden, A.T.: Spectral Analysis for Physical Applications. Cambridge University Press, Cambridge (1993)CrossRefMATH
Zurück zum Zitat Richiardone, R., Alessio, S., Canavero, F., Einaudi, F., Longhetto, A.: Experimental study of atmospheric gravity waves and visibility oscillations in a fog episode. Nuovo Cimento C 18(6), 647–662 (1995)CrossRef Richiardone, R., Alessio, S., Canavero, F., Einaudi, F., Longhetto, A.: Experimental study of atmospheric gravity waves and visibility oscillations in a fog episode. Nuovo Cimento C 18(6), 647–662 (1995)CrossRef
Zurück zum Zitat Schmidt, R.O.: Multiple emitter location and signal parameter estimation. IEEE Trans. Antennas Propag. 34, 276–280 (1986) Schmidt, R.O.: Multiple emitter location and signal parameter estimation. IEEE Trans. Antennas Propag. 34, 276–280 (1986)
Zurück zum Zitat Schuster, S.A.: On the investigation of hidden periodicities. Terr. Mag. 3, 13–41 (1898)CrossRef Schuster, S.A.: On the investigation of hidden periodicities. Terr. Mag. 3, 13–41 (1898)CrossRef
Zurück zum Zitat Sella, L., Vivaldo, G., Groth, A., Ghil, M.: Economic Cycles and Their Synchronization: A Survey of Spectral Properties. Working Paper 105.2013, Fondazione ENI Enrico Mattei (FEEM), Milan, Italy (2013) Sella, L., Vivaldo, G., Groth, A., Ghil, M.: Economic Cycles and Their Synchronization: A Survey of Spectral Properties. Working Paper 105.2013, Fondazione ENI Enrico Mattei (FEEM), Milan, Italy (2013)
Zurück zum Zitat Slepian, D.: Prolate spheroidal wave functions, fourier analysis, and uncertainty V: the discrete case. AT&T Tech. J. 57, 1371–1430 (1978)MATH Slepian, D.: Prolate spheroidal wave functions, fourier analysis, and uncertainty V: the discrete case. AT&T Tech. J. 57, 1371–1430 (1978)MATH
Zurück zum Zitat Stoica, P., Moses, R.L.: Spectral Analysis of Signals. Prentice Hall, Upper Saddle River (2005) Stoica, P., Moses, R.L.: Spectral Analysis of Signals. Prentice Hall, Upper Saddle River (2005)
Zurück zum Zitat Stuart, A.: Kendall’s Advanced Theory of Statistics. Wiley, New York (2010) Stuart, A.: Kendall’s Advanced Theory of Statistics. Wiley, New York (2010)
Zurück zum Zitat Thomson, D.J.: Spectrum estimation and harmonic analysis. Proc. IEEE 70, 1055–1096 (1982)CrossRef Thomson, D.J.: Spectrum estimation and harmonic analysis. Proc. IEEE 70, 1055–1096 (1982)CrossRef
Zurück zum Zitat Thomson, D.J.: Time series analysis of Holocene climate data. Phil. Trans. R. Soc. Lond. A 330, 601–616 (1990a)CrossRef Thomson, D.J.: Time series analysis of Holocene climate data. Phil. Trans. R. Soc. Lond. A 330, 601–616 (1990a)CrossRef
Zurück zum Zitat Thomson, D.J.: Quadratic-inverse spectrum estimates: applications to palaeoclimatology. Phil. Trans. R. Soc. Lond. A 332, 539–597 (1990b)MathSciNetCrossRefMATH Thomson, D.J.: Quadratic-inverse spectrum estimates: applications to palaeoclimatology. Phil. Trans. R. Soc. Lond. A 332, 539–597 (1990b)MathSciNetCrossRefMATH
Zurück zum Zitat Trefethen, L., Bau, D.: Numerical Linear Algebra. SIAM—Society for Industrial and Applied Mathematics, Philadelphia (1997)CrossRefMATH Trefethen, L., Bau, D.: Numerical Linear Algebra. SIAM—Society for Industrial and Applied Mathematics, Philadelphia (1997)CrossRefMATH
Zurück zum Zitat Vautard, R., Yiou, P., Ghil, M.: Singular-spectrum analysis: a toolkit for short, noisy, chaotic signals. Phys. D 58, 95–126 (1992)CrossRef Vautard, R., Yiou, P., Ghil, M.: Singular-spectrum analysis: a toolkit for short, noisy, chaotic signals. Phys. D 58, 95–126 (1992)CrossRef
Zurück zum Zitat Welch, P.D.: The use of fast fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. AU-15, 70–73 (1967) Welch, P.D.: The use of fast fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. AU-15, 70–73 (1967)
Metadaten
Titel
Non-Parametric Spectral Methods
verfasst von
Silvia Maria Alessio
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-25468-5_10

Neuer Inhalt