Skip to main content
Top

2016 | OriginalPaper | Chapter

10. Non-Parametric Spectral Methods

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter deals with obtaining a good estimate of the power spectrum of a random signal on the basis of a finite number of samples of a typical realization of the underlying random process—one among the infinite sequences that the process can generate when we measure it. The simplest approach to spectral estimation, i.e., the periodogram, turns out to perform poorly: the variance of the estimate is high and does not decrease with increasing length of the data record—it is not a consistent estimate of the power spectrum. The search for a stable and consistent spectral estimate leads to the methods of Bartlett and Welch, and to the Blackman-Tukey method. We will also present statistical tests used judge the significance of any peak detected in a spectrum. A description of the multitaper method (MTM) and a brief account of the estimation of the cross-spectrum of two random signals will be followed by a discussion about the use of FFT for practical computation of spectral estimates and about the different normalization schemes adopted in literature for the power spectrum.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
In this frame we use the two terms indifferently, even if the triangular window and the Bartlett window are actually two different sequences: the former has no zeros at its edges, while the latter includes two zero samples at the beginning and end. In the present case, there must be no zeros at the edges; therefore in principle we should call this a “triangular window”.
 
2
Note that the terms “input” and “output” here refer to a power spectrum estimation algorithm: a signal having a given \(\mathrm {SNR}_{\mathrm {i}}\) enters the algorithm; in the spectral estimate, the signal-to-noise ratio is modified by a factor depending on the shape and length of the taper and is transformed into \(\mathrm {SNR}_{\mathrm {o}}\). Looking at the latter, we can evaluate the capability of the estimator to detect the imprint of the sinusoid/complex exponential buried in noise.
 
3
For \(N\rightarrow \infty \) the spectral window would become a periodic impulse train, i.e., a train of Dirac \(\delta \), but for a finite N the bias can vanish only asymptotically.
 
4
Note that this choice for defining resolution is coherent with what we stated about the periodogram: there we talked about the possibility of defining resolution through the bandwith of the spectral window \(W_{B,2N-1}\) at 6 dB, but since \(w_{B, 2N-1}[n]=(1/N) w_{R,N}[n] *w_{R,N}[n]\), so that \(W_{B,2N-1}(\mathrm {e}^{\mathrm {j}\omega })\propto \left| W_R(\mathrm {e}^{\mathrm {j}\omega })_{B,N}\right| ^2\), this is equivalent to using for the periodogram the bandwidth at 3 dB for \(W_R(\mathrm {e}^{\mathrm {j}\omega })\).
 
5
Recall that here we are speaking of non-causal windows, having a real transform. Note that Fig. 5.​5 shows transform squared magnitudes and therefore does not allow to verify the above statement.
 
6
The convolution with a Dirac \(\delta \) would leave the function unaltered.
 
7
It may be more intuitive to refer to the discrete trigonometric expansion of a signal (Sect. 3.​7): the two Gaussian variables in this case are the expansion coefficients \(a_k\) and \(b_k\); the former is related to a cosine of \(\omega _k n\) and the latter to a sine, and sine and cosine are mutually in phase quadrature. Therefore \(a_k^2+b_k^2= \left| X[k]\right| ^2\) has a \(\chi ^2\) distribution with \(\nu =2\). Note that this conclusion is independent of the sequence length, because the sinusoidal sequences used as the expansion basis are infinitely long.
 
8
The data is seasonal climatic anomalies of sea surface temperature (SST) in \(^{\circ }\)C, spatially averaged over the so-called NINO3 region of the Pacific Ocean. This region is comprised between latitudes of 50\(^{\circ }\) South and 50\(^{\circ }\) North and between longitudes of 90\(^{\circ }\) West and 150\(^{\circ }\) West, and is particularly representative for the study of climatic variability at interannual time scale, and more precisely for the study of the El Niño—La Niña phenomena. The data used here spans the years 1871–2012 and were drawn from monthly NINO3 data available at http://​www.​esrl.​noaa.​gov/​psd/​gcos_​wgsp/​Timeseries/​Data/​nino3.​long.​data.
The term “climatic anomalies” means that the data has been centered by subtracting from each seasonal sample the mean value of the corresponding season, computed over the whole record; for instance: spring of 1900 minus average over all springs. This makes the data free from the annual temperature cycle, the dominant presence of which in the spectrum would obscure weaker cyclicities.
 
9
The Rayleigh-Ritz method is a classical variational method for finding approximate solutions of differential equations, whose exact solutions are hard to find. The method was first used by Lord Rayleigh in 1870 to solve the vibration problem of organ pipes closed on one end and open at the other. However, the approach did not receive much recognition by the scientific community. Nearly 40 years later, due to the publication of two papers by Ritz, the method came to be called the Ritz method. To recognize the contributions of both authors, the theory was later renamed the Rayleigh-Ritz method.
 
10
The median is the numerical value separating the higher half of a data sample, a population, or a probability distribution, from the lower half. The median smoothing filter computes the median of PSD values falling inside a small frequency bin centered on a given frequency and assigns the result to this central frequency.
 
Literature
go back to reference Allen, M.R., Smith, L.A.: Monte Carlo SSA: detecting irregular oscillations in the presence of colored noise. J. Clim. 9, 3373–3404 (1996)CrossRef Allen, M.R., Smith, L.A.: Monte Carlo SSA: detecting irregular oscillations in the presence of colored noise. J. Clim. 9, 3373–3404 (1996)CrossRef
go back to reference Bartlett, M.S.: Smoothing periodograms from time series with continuous spectra. Nature 161, 686–687 (1948)CrossRef Bartlett, M.S.: Smoothing periodograms from time series with continuous spectra. Nature 161, 686–687 (1948)CrossRef
go back to reference Blackman, R.B., Tukey, J.W.: The Measurement of Power Spectra from the Point of View of Communication Engineering. Dover, New York (1958)MATH Blackman, R.B., Tukey, J.W.: The Measurement of Power Spectra from the Point of View of Communication Engineering. Dover, New York (1958)MATH
go back to reference Chatfield, C.: The Analysis of Time Series: An Introduction. Chapman and Hall, New York (1975)MATH Chatfield, C.: The Analysis of Time Series: An Introduction. Chapman and Hall, New York (1975)MATH
go back to reference Daniell, P.J.: Discussion on symposium on autocorrelation in time series. J. R. Stat. Soc. B 8, 88–90 (1946) Daniell, P.J.: Discussion on symposium on autocorrelation in time series. J. R. Stat. Soc. B 8, 88–90 (1946)
go back to reference Hayes, M.H.: Statistical Digital Signal Processing and Modeling. Wiley, New York (1996) Hayes, M.H.: Statistical Digital Signal Processing and Modeling. Wiley, New York (1996)
go back to reference Hess, G.D., Iwata, S.: Measuring and comparing business-cycle features. J. Bus. Econ. Stat. 15(4), 43244 (1997) Hess, G.D., Iwata, S.: Measuring and comparing business-cycle features. J. Bus. Econ. Stat. 15(4), 43244 (1997)
go back to reference Jenkins, G.M., Watts, D.G.: Spectral Analysis and its Applications. Holden-Day, San Francisco (1968)MATH Jenkins, G.M., Watts, D.G.: Spectral Analysis and its Applications. Holden-Day, San Francisco (1968)MATH
go back to reference Kay, S.M.: Modern Spectral Estimation: Theory and Applications. Prentice-Hall, Englewood Cliffs (1988)MATH Kay, S.M.: Modern Spectral Estimation: Theory and Applications. Prentice-Hall, Englewood Cliffs (1988)MATH
go back to reference McConnell, M.M., Perez-Quiros, G.: Output fluctuations in the United States: what has changed since the early 1980? Am. Econ. Rev. 90(5), 1464–1476 (2000)CrossRef McConnell, M.M., Perez-Quiros, G.: Output fluctuations in the United States: what has changed since the early 1980? Am. Econ. Rev. 90(5), 1464–1476 (2000)CrossRef
go back to reference Mac Lane, S., Birkhoff, G.: Algebra. AMS Chelsea Publishing, New York, NY, USA (1999) Mac Lane, S., Birkhoff, G.: Algebra. AMS Chelsea Publishing, New York, NY, USA (1999)
go back to reference Mann, M.E., Lees, J.M.: Robust estimation of background noise and signal detection in climatic time series. Clim. Change 33(3), 409–445 (1996)CrossRef Mann, M.E., Lees, J.M.: Robust estimation of background noise and signal detection in climatic time series. Clim. Change 33(3), 409–445 (1996)CrossRef
go back to reference Marple, S.L.: Digital Spectral Analysis: With Applications. Prentice-Hall, Upper Saddle River (1987) Marple, S.L.: Digital Spectral Analysis: With Applications. Prentice-Hall, Upper Saddle River (1987)
go back to reference MacDonald, G.J.: Spectral analysis of time series generated by nonlinear processes. Rev. Geophys. 27, 449–469 (1989)CrossRef MacDonald, G.J.: Spectral analysis of time series generated by nonlinear processes. Rev. Geophys. 27, 449–469 (1989)CrossRef
go back to reference Meltzer, J.A., Zaveri, H.P., Goncharova, I.I., Distasio, M.M., Papademetris, X., Spencer, S.S., Spencer, D.D., Constable, R.T.: Effects of working memory load on oscillatory power in human intracranial EEG. Cereb. Cortex 18, 1843–1855 (2008)CrossRef Meltzer, J.A., Zaveri, H.P., Goncharova, I.I., Distasio, M.M., Papademetris, X., Spencer, S.S., Spencer, D.D., Constable, R.T.: Effects of working memory load on oscillatory power in human intracranial EEG. Cereb. Cortex 18, 1843–1855 (2008)CrossRef
go back to reference Percival, D.B., Walden, A.T.: Spectral Analysis for Physical Applications. Cambridge University Press, Cambridge (1993)CrossRefMATH Percival, D.B., Walden, A.T.: Spectral Analysis for Physical Applications. Cambridge University Press, Cambridge (1993)CrossRefMATH
go back to reference Richiardone, R., Alessio, S., Canavero, F., Einaudi, F., Longhetto, A.: Experimental study of atmospheric gravity waves and visibility oscillations in a fog episode. Nuovo Cimento C 18(6), 647–662 (1995)CrossRef Richiardone, R., Alessio, S., Canavero, F., Einaudi, F., Longhetto, A.: Experimental study of atmospheric gravity waves and visibility oscillations in a fog episode. Nuovo Cimento C 18(6), 647–662 (1995)CrossRef
go back to reference Schmidt, R.O.: Multiple emitter location and signal parameter estimation. IEEE Trans. Antennas Propag. 34, 276–280 (1986) Schmidt, R.O.: Multiple emitter location and signal parameter estimation. IEEE Trans. Antennas Propag. 34, 276–280 (1986)
go back to reference Schuster, S.A.: On the investigation of hidden periodicities. Terr. Mag. 3, 13–41 (1898)CrossRef Schuster, S.A.: On the investigation of hidden periodicities. Terr. Mag. 3, 13–41 (1898)CrossRef
go back to reference Sella, L., Vivaldo, G., Groth, A., Ghil, M.: Economic Cycles and Their Synchronization: A Survey of Spectral Properties. Working Paper 105.2013, Fondazione ENI Enrico Mattei (FEEM), Milan, Italy (2013) Sella, L., Vivaldo, G., Groth, A., Ghil, M.: Economic Cycles and Their Synchronization: A Survey of Spectral Properties. Working Paper 105.2013, Fondazione ENI Enrico Mattei (FEEM), Milan, Italy (2013)
go back to reference Slepian, D.: Prolate spheroidal wave functions, fourier analysis, and uncertainty V: the discrete case. AT&T Tech. J. 57, 1371–1430 (1978)MATH Slepian, D.: Prolate spheroidal wave functions, fourier analysis, and uncertainty V: the discrete case. AT&T Tech. J. 57, 1371–1430 (1978)MATH
go back to reference Stoica, P., Moses, R.L.: Spectral Analysis of Signals. Prentice Hall, Upper Saddle River (2005) Stoica, P., Moses, R.L.: Spectral Analysis of Signals. Prentice Hall, Upper Saddle River (2005)
go back to reference Stuart, A.: Kendall’s Advanced Theory of Statistics. Wiley, New York (2010) Stuart, A.: Kendall’s Advanced Theory of Statistics. Wiley, New York (2010)
go back to reference Thomson, D.J.: Spectrum estimation and harmonic analysis. Proc. IEEE 70, 1055–1096 (1982)CrossRef Thomson, D.J.: Spectrum estimation and harmonic analysis. Proc. IEEE 70, 1055–1096 (1982)CrossRef
go back to reference Thomson, D.J.: Time series analysis of Holocene climate data. Phil. Trans. R. Soc. Lond. A 330, 601–616 (1990a)CrossRef Thomson, D.J.: Time series analysis of Holocene climate data. Phil. Trans. R. Soc. Lond. A 330, 601–616 (1990a)CrossRef
go back to reference Thomson, D.J.: Quadratic-inverse spectrum estimates: applications to palaeoclimatology. Phil. Trans. R. Soc. Lond. A 332, 539–597 (1990b)MathSciNetCrossRefMATH Thomson, D.J.: Quadratic-inverse spectrum estimates: applications to palaeoclimatology. Phil. Trans. R. Soc. Lond. A 332, 539–597 (1990b)MathSciNetCrossRefMATH
go back to reference Trefethen, L., Bau, D.: Numerical Linear Algebra. SIAM—Society for Industrial and Applied Mathematics, Philadelphia (1997)CrossRefMATH Trefethen, L., Bau, D.: Numerical Linear Algebra. SIAM—Society for Industrial and Applied Mathematics, Philadelphia (1997)CrossRefMATH
go back to reference Vautard, R., Yiou, P., Ghil, M.: Singular-spectrum analysis: a toolkit for short, noisy, chaotic signals. Phys. D 58, 95–126 (1992)CrossRef Vautard, R., Yiou, P., Ghil, M.: Singular-spectrum analysis: a toolkit for short, noisy, chaotic signals. Phys. D 58, 95–126 (1992)CrossRef
go back to reference Welch, P.D.: The use of fast fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. AU-15, 70–73 (1967) Welch, P.D.: The use of fast fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. AU-15, 70–73 (1967)
Metadata
Title
Non-Parametric Spectral Methods
Author
Silvia Maria Alessio
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-25468-5_10