Skip to main content
Top

2014 | OriginalPaper | Chapter

2. Performance Evaluation of Gibbs Sampling for Bayesian Extracting Sinusoids

Authors : M. Cevri, D. Üstündag

Published in: Computational Problems in Engineering

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter involves problems of estimating parameters of sinusoids from white noisy data by using Gibbs sampling (GS) in a Bayesian inferential framework which allows us to incorporate prior knowledge about the nature of sinusoidal data into the model. Modifications of its algorithm is tested on data generated from synthetic signals and its performance is compared with conventional estimators such as Maximum Likelihood (ML) and Discrete Fourier Transform (DFT) under a variety of signal to noise ratio (SNR) conditions and different lengths of data sampling (N), regarding to Cramér–Rao lower bound (CRLB) that is a limit on the best possible performance achievable by an unbiased estimator given a dataset. All simulation results show its effectiveness in frequency and amplitude estimation of noisy sinusoids.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Andreiu C, Doucet A (1999) Joint Bayesian model selection and estimation of noisy sinusoids via reversible jump MCMC, IEEE Transactions on Signal Processing, 47: 2667–2676CrossRef Andreiu C, Doucet A (1999) Joint Bayesian model selection and estimation of noisy sinusoids via reversible jump MCMC, IEEE Transactions on Signal Processing, 47: 2667–2676CrossRef
2.
go back to reference Bernardo JM, Smith AFM (2000) Bayesian theory, Willey Series in Probability and Statistics New York Bernardo JM, Smith AFM (2000) Bayesian theory, Willey Series in Probability and Statistics New York
3.
go back to reference Box GEP, Tiao C (1992) Bayesian inference in statistical analysis, New York Box GEP, Tiao C (1992) Bayesian inference in statistical analysis, New York
4.
go back to reference Bretthorst GL (1997) Bayesian spectrum analysis and parameter estimation, Lecture Notes in Statistics, Springer-Verlag Berlin Heidelberg New York Bretthorst GL (1997) Bayesian spectrum analysis and parameter estimation, Lecture Notes in Statistics, Springer-Verlag Berlin Heidelberg New York
5.
go back to reference Brooks SP, Gelman A (1997) General methods for monitoring convergence of iterative simulations, Journal of Computational and Graphical Statistics, 7: 434–455MathSciNet Brooks SP, Gelman A (1997) General methods for monitoring convergence of iterative simulations, Journal of Computational and Graphical Statistics, 7: 434–455MathSciNet
6.
go back to reference Cevri M, Ustundag D (2012) Bayesian recovery of sinusoids from noisy data with parallel tempering, IET Signal Process., 6 (7): 673–683 Cevri M, Ustundag D (2012) Bayesian recovery of sinusoids from noisy data with parallel tempering, IET Signal Process., 6 (7): 673–683
7.
go back to reference Cevri M, Ustundag D (2013) Performance analysis of Gibbs sampling for Bayesian extracting sinusoids, Proceedings of the 2013 International Conference on Systems, Control, Signal Processing and Informatics, Rhodes Island, Greece, 128–134 Cevri M, Ustundag D (2013) Performance analysis of Gibbs sampling for Bayesian extracting sinusoids, Proceedings of the 2013 International Conference on Systems, Control, Signal Processing and Informatics, Rhodes Island, Greece, 128–134
8.
go back to reference Cooley JW, Tukey, JW (1965) An algorithm for the machine calculation of complex Fourier series, Mathematics of Computation, 19: 297–301CrossRefMATHMathSciNet Cooley JW, Tukey, JW (1965) An algorithm for the machine calculation of complex Fourier series, Mathematics of Computation, 19: 297–301CrossRefMATHMathSciNet
10.
go back to reference Diaconis P, Khare K, Coste LS (2008) Gibbs sampling, exponential families and orthogonal polynomials, Statistical Science, 23(2): 151–178CrossRefMathSciNet Diaconis P, Khare K, Coste LS (2008) Gibbs sampling, exponential families and orthogonal polynomials, Statistical Science, 23(2): 151–178CrossRefMathSciNet
11.
go back to reference Dou L, Hodgson RJW (1995a) Bayesian inference and Gibbs sampling in spectral analysis and parameter estimation I, Inverse Problem, 11:1069–1085CrossRefMATHMathSciNet Dou L, Hodgson RJW (1995a) Bayesian inference and Gibbs sampling in spectral analysis and parameter estimation I, Inverse Problem, 11:1069–1085CrossRefMATHMathSciNet
12.
go back to reference Dou L, Hodgson RJW (1995b) Bayesian inference and Gibbs sampling in spectral analysis and parameter estimation II, Inverse Problem, 11:121–137CrossRef Dou L, Hodgson RJW (1995b) Bayesian inference and Gibbs sampling in spectral analysis and parameter estimation II, Inverse Problem, 11:121–137CrossRef
13.
14.
go back to reference Gelman AB, Stern HS, Rubin DB (1995) Bayesian data analysis, Chapman & Hall/CRC Gelman AB, Stern HS, Rubin DB (1995) Bayesian data analysis, Chapman & Hall/CRC
15.
go back to reference Geman S, Geman D (1984) Stochastic relaxation, Gibbs distribution and Bayesian restoration of images. IEE Transactions on Pattern Analysis and machine Intelligence, 6:721–741MATH Geman S, Geman D (1984) Stochastic relaxation, Gibbs distribution and Bayesian restoration of images. IEE Transactions on Pattern Analysis and machine Intelligence, 6:721–741MATH
16.
go back to reference Gregory P (2005) Bayesian logical data analysis for the physical science, Cambridge University Press, United Kingdom Gregory P (2005) Bayesian logical data analysis for the physical science, Cambridge University Press, United Kingdom
17.
go back to reference Händel P (2008) Parameter estimation employing a dual-channel sine-wave model under a Gaussian assumption, IEEE Transactions on Instrumentation and Measurement, 57(8): 1661–1669 Händel P (2008) Parameter estimation employing a dual-channel sine-wave model under a Gaussian assumption, IEEE Transactions on Instrumentation and Measurement, 57(8): 1661–1669
18.
go back to reference Harney HL (2003) Bayesian inference: Parameter estimation and decisions, Springer-Verlag, Berlin Heidelberg Harney HL (2003) Bayesian inference: Parameter estimation and decisions, Springer-Verlag, Berlin Heidelberg
19.
go back to reference Hastings, W K (1970) Monte carlo sampling methods using Markov chains, and their applications, Biometrika, 57:97–109CrossRefMATH Hastings, W K (1970) Monte carlo sampling methods using Markov chains, and their applications, Biometrika, 57:97–109CrossRefMATH
20.
go back to reference Jackman S (2000) American journal of political science, 44(2):375–404 Jackman S (2000) American journal of political science, 44(2):375–404
21.
go back to reference Jaynes ET (1987) Bayesian Spectrum and Chirp Analysis, In Proceedings of the Third Workshop on Maximum Entropy and Bayesian Methods, Ed. C. Ray Smith and D. Reidel, Boston, pp. 1–37 Jaynes ET (1987) Bayesian Spectrum and Chirp Analysis, In Proceedings of the Third Workshop on Maximum Entropy and Bayesian Methods, Ed. C. Ray Smith and D. Reidel, Boston, pp. 1–37
22.
go back to reference Jaynes ET (2003) Probability theory: The logic of science, Cambridge University Press, United KingdomCrossRef Jaynes ET (2003) Probability theory: The logic of science, Cambridge University Press, United KingdomCrossRef
23.
go back to reference Kay SM (1984) Accurate frequency estimation at low signal-to-noise ratio, IEEE Trans. Acoust., Speech, Signal Processing, ASSP-32, pp. 540–547 Kay SM (1984) Accurate frequency estimation at low signal-to-noise ratio, IEEE Trans. Acoust., Speech, Signal Processing, ASSP-32, pp. 540–547
24.
go back to reference Kay SM (1993) Fundamentals of statistical signal processing: Estimation theory, Prentice-Hall, Englewood Cliffs, NJ, pp. 56–57 Kay SM (1993) Fundamentals of statistical signal processing: Estimation theory, Prentice-Hall, Englewood Cliffs, NJ, pp. 56–57
25.
go back to reference Kenefic RJ, Nuttall AH (1987) Maximum likelihood estimation of the parameters of tone using real discrete data, IEEE J. Oceanic Eng., 12 (1): 279–280 Kenefic RJ, Nuttall AH (1987) Maximum likelihood estimation of the parameters of tone using real discrete data, IEEE J. Oceanic Eng., 12 (1): 279–280
26.
go back to reference MacKay D (2003) Information theory, inference and learning algorithms, Cambridge University Press MacKay D (2003) Information theory, inference and learning algorithms, Cambridge University Press
27.
go back to reference Metropolis N, Rosenbluth A, Rosenbluth, M, Teller A, Teller E (1953) Equation of states calculations by fast computing machines, Journal of chemical physics, 21: 1087–1092 Metropolis N, Rosenbluth A, Rosenbluth, M, Teller A, Teller E (1953) Equation of states calculations by fast computing machines, Journal of chemical physics, 21: 1087–1092
28.
go back to reference Michalopouloua ZH, Picarelli M (2005) Gibbs sampling for time-delay-and amplitude estimation in underwater acoustics, J. Acoust. Soc. Am., 117:799–808CrossRef Michalopouloua ZH, Picarelli M (2005) Gibbs sampling for time-delay-and amplitude estimation in underwater acoustics, J. Acoust. Soc. Am., 117:799–808CrossRef
29.
go back to reference Quinn BG (1994) Estimating frequency by interpolation using Fourier coefficients, IEEE Trans. Signal Process., 42 (5): 1264–1268 Quinn BG (1994) Estimating frequency by interpolation using Fourier coefficients, IEEE Trans. Signal Process., 42 (5): 1264–1268
30.
go back to reference Rife DC, Boorstyn RR (1974) Single-tone parameter estimation from discrete-time observations, IEEE Transactions on Information Theory, 20:591–598CrossRefMATH Rife DC, Boorstyn RR (1974) Single-tone parameter estimation from discrete-time observations, IEEE Transactions on Information Theory, 20:591–598CrossRefMATH
31.
go back to reference Ristic B, Arulampalam S, Gordon N (2004) Beyond the Kalman filter particle filters for tracking applications, Artech House, London Ristic B, Arulampalam S, Gordon N (2004) Beyond the Kalman filter particle filters for tracking applications, Artech House, London
32.
go back to reference Stoica P, Moses RL (2005) Spectral analysis of signals, Prentice Hall Stoica P, Moses RL (2005) Spectral analysis of signals, Prentice Hall
33.
go back to reference Swendsen RH, Wang JS (1986) Physical review of letters, 57:2607–2609 Swendsen RH, Wang JS (1986) Physical review of letters, 57:2607–2609
34.
35.
go back to reference Tanner M, Wong W (1987) The calculation of posterior distributions by data augmentation (with discussion), J. Amer. Statist. Assoc., 82:528–550CrossRefMATHMathSciNet Tanner M, Wong W (1987) The calculation of posterior distributions by data augmentation (with discussion), J. Amer. Statist. Assoc., 82:528–550CrossRefMATHMathSciNet
36.
go back to reference Üstündağ D, Cevri M (2008) Estimating parameters of sinusoids from noisy data using Bayesian inference with simulated annealing, Wseas Transactions On Signal Processing, 7: 432–441 Üstündağ D, Cevri M (2008) Estimating parameters of sinusoids from noisy data using Bayesian inference with simulated annealing, Wseas Transactions On Signal Processing, 7: 432–441
37.
go back to reference Üstündağ D, Cevri M (2011) Recovering sinusoids from noisy data using Bayesian inference with simulated annealing, Mathematical & Computational Applications, 16(2): 382–391 Üstündağ D, Cevri M (2011) Recovering sinusoids from noisy data using Bayesian inference with simulated annealing, Mathematical & Computational Applications, 16(2): 382–391
38.
go back to reference Ustundag D, Cevri M (2012) Simulated annealing—advances, applications and hybridizations, In Tech, Croatia, ISBN: 978-953-51-0710-1. pp. 67–90 Ustundag D, Cevri M (2012) Simulated annealing—advances, applications and hybridizations, In Tech, Croatia, ISBN: 978-953-51-0710-1. pp. 67–90
39.
go back to reference Ustundag D, Cevri M (2013) Comparison of Bayesian methods for recovering sinusoids, Proceedings of the 2013 International Conference on Systems, Control, Signal Processing and Informatics, Rhodes Island, Greece, 120–127 Ustundag D, Cevri M (2013) Comparison of Bayesian methods for recovering sinusoids, Proceedings of the 2013 International Conference on Systems, Control, Signal Processing and Informatics, Rhodes Island, Greece, 120–127
Metadata
Title
Performance Evaluation of Gibbs Sampling for Bayesian Extracting Sinusoids
Authors
M. Cevri
D. Üstündag
Copyright Year
2014
DOI
https://doi.org/10.1007/978-3-319-03967-1_2

Premium Partners