Skip to main content

2016 | OriginalPaper | Buchkapitel

9. Statistical and Physical Models

verfasst von : William Briggs

Erschienen in: Uncertainty

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Statistical models are probability models and physical models are causal or deterministic or mixed causal-deterministic-probability models applied to observable propositions. It is observations which turn probability into statistics. Statistical and physical models are thus verifiable, and all use statistics in their verification. All models should be verified, but most aren’t. Classical modeling emphasizes hypothesis or “significance” testing and estimation. No hypothesis test, Bayesian or frequentist, should ever be used. Death to all p-values or Bayes factors! Hypothesis testing does not prove or show cause; therefore, embedded in every test used to claim cause is a fallacy. If cause is known, probability isn’t needed. Neither should parameter-centric (estimation, etc.) methods be used. Instead, use only probability, make probabilistic predictions of observables given observations and other premises, then verify these predictions. Measures of model goodness and observational relevance are given in a language which requires no sophisticated mathematical training to understand. Speak only in terms of observables and match models to measurement. Hypothesis-testing and parameter estimation are responsible for a pandemic of over-certainty in the sciences. Decisions are not probability, a fact with many consequences.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The simplest example is a test for differences in proportion from two groups, where \(n_{1} = n_{2} = 1\) and where \(x_{1} = 1,x_{2} = 0\), or \(x_{1} = 0,x_{2} = 1\). Small “samples” frequently bust frequentist methods.
 
2
The data is available at http:\\wmbriggs.com\public\sat.csv.
 
Literatur
6.
Zurück zum Zitat Ando, T.: Bayesian predictive information criterion for the evaluation of hierarchical Bayesian and empirical Bayesian models. Biometrika 94, 443–458 (2007)MathSciNetCrossRefMATH Ando, T.: Bayesian predictive information criterion for the evaluation of hierarchical Bayesian and empirical Bayesian models. Biometrika 94, 443–458 (2007)MathSciNetCrossRefMATH
8.
Zurück zum Zitat Arjas, E., Andreev, A.: Predictive inference, causal reasoning, and model assessment in nonparametric Bayesian analysis. Lifetime Data Anal. 6, 187–205 (2000)MathSciNetCrossRefMATH Arjas, E., Andreev, A.: Predictive inference, causal reasoning, and model assessment in nonparametric Bayesian analysis. Lifetime Data Anal. 6, 187–205 (2000)MathSciNetCrossRefMATH
9.
Zurück zum Zitat Armstrong, J.S.: Significance testing harms progress in forecasting (with discussion). Int. J. Forecast. 23, 321–327 (2007)CrossRef Armstrong, J.S.: Significance testing harms progress in forecasting (with discussion). Int. J. Forecast. 23, 321–327 (2007)CrossRef
18.
Zurück zum Zitat Berger, J.: Statistical Decision Theory and Bayesian Analysis, 2nd edn. Springer, New York (2010) Berger, J.: Statistical Decision Theory and Bayesian Analysis, 2nd edn. Springer, New York (2010)
19.
Zurück zum Zitat Berger, J.O., Selke, T.: Testing a point null hypothesis: the irreconcilability of p-values and evidence. JASA 33, 112–122 (1987)MathSciNetMATH Berger, J.O., Selke, T.: Testing a point null hypothesis: the irreconcilability of p-values and evidence. JASA 33, 112–122 (1987)MathSciNetMATH
21.
Zurück zum Zitat Bernardo, J.M., Smith, A.F.M.: Bayesian Theory. Wiley, New York (2000)MATH Bernardo, J.M., Smith, A.F.M.: Bayesian Theory. Wiley, New York (2000)MATH
23.
Zurück zum Zitat Blackwell, D., Girshick, M.: Theory of Games and Statistical Decisions. Dover, Mineola (1954)MATH Blackwell, D., Girshick, M.: Theory of Games and Statistical Decisions. Dover, Mineola (1954)MATH
26.
Zurück zum Zitat Briggs, W.M.: On probability leakage. arxiv.org/abs/1201.3611 (2013) Briggs, W.M.: On probability leakage. arxiv.org/abs/1201.3611 (2013)
29.
Zurück zum Zitat Briggs, W.M.: The third way of probability & statistics: beyond testing and estimation to importance, relevance, and skill. arxiv.org/abs/1508.02384 (2015) Briggs, W.M.: The third way of probability & statistics: beyond testing and estimation to importance, relevance, and skill. arxiv.org/abs/1508.02384 (2015)
31.
Zurück zum Zitat Briggs, W.M., Zaretzki, R.A.: The skill plot: a graphical technique for evaluating continuous diagnostic tests. Biometrics 64, 250–263 (2008, with discussion) Briggs, W.M., Zaretzki, R.A.: The skill plot: a graphical technique for evaluating continuous diagnostic tests. Biometrics 64, 250–263 (2008, with discussion)
34.
Zurück zum Zitat Burnham, K.P., Anderson, D.R.: Model Selection and Multi-Model Inference: A Practical Information-Theoretic Approach, 2nd edn. Springer, New York (2002)MATH Burnham, K.P., Anderson, D.R.: Model Selection and Multi-Model Inference: A Practical Information-Theoretic Approach, 2nd edn. Springer, New York (2002)MATH
45.
Zurück zum Zitat Christensen, R., Utts, J.: Bayesian resolution of the exchange paradox. Am. Stat. 46, 274–276 (1992)MathSciNet Christensen, R., Utts, J.: Bayesian resolution of the exchange paradox. Am. Stat. 46, 274–276 (1992)MathSciNet
48.
Zurück zum Zitat Cohen, J.: The earth is round (p < . 05). Am. Psychol. 49, 997–1003 (1994) Cohen, J.: The earth is round (p < . 05). Am. Psychol. 49, 997–1003 (1994)
49.
Zurück zum Zitat Colquhoun, D.: An investigation of the false discovery rate and the misinterpretation of p-values. R. Soc. Open Sci. 1, 1–16 (2014)CrossRef Colquhoun, D.: An investigation of the false discovery rate and the misinterpretation of p-values. R. Soc. Open Sci. 1, 1–16 (2014)CrossRef
52.
Zurück zum Zitat Dawid, A.P.: Present position and potential developments: some personal views. J. R. Stat. Soc. A 147, 278–292 (1984)MathSciNetCrossRef Dawid, A.P.: Present position and potential developments: some personal views. J. R. Stat. Soc. A 147, 278–292 (1984)MathSciNetCrossRef
57.
68.
Zurück zum Zitat Ellis, G., Silk, J.: Scientific method: defend the integrity of physics. Nature 516, 321–323 (2014)CrossRef Ellis, G., Silk, J.: Scientific method: defend the integrity of physics. Nature 516, 321–323 (2014)CrossRef
75.
Zurück zum Zitat de Finetti, B.: Foresight: its logical laws, its subjective sources. In: Studies in Subjective Probability, 2nd edn. Krieger Publishing Company, Huntington (1980) de Finetti, B.: Foresight: its logical laws, its subjective sources. In: Studies in Subjective Probability, 2nd edn. Krieger Publishing Company, Huntington (1980)
76.
Zurück zum Zitat Fisher, R.: Statistical Methods for Research Workers, 14th edn. Oliver and Boyd, Edinburgh (1970)MATH Fisher, R.: Statistical Methods for Research Workers, 14th edn. Oliver and Boyd, Edinburgh (1970)MATH
88.
89.
94.
Zurück zum Zitat Gigerenzer, G.: Mindless statistics. J. Socio-Econ. 33, 587–606 (2004)CrossRef Gigerenzer, G.: Mindless statistics. J. Socio-Econ. 33, 587–606 (2004)CrossRef
95.
96.
Zurück zum Zitat Gneiting, T., Raftery, A.E., Balabdaoui, F.: Probabilistic forecasts, calibration and sharpness. J. R. Stat. Soc. Ser. B: Stat. Methodol. 69, 243–268 (2007)MathSciNetCrossRefMATH Gneiting, T., Raftery, A.E., Balabdaoui, F.: Probabilistic forecasts, calibration and sharpness. J. R. Stat. Soc. Ser. B: Stat. Methodol. 69, 243–268 (2007)MathSciNetCrossRefMATH
111.
Zurück zum Zitat Henricha, J., Heinea, S.J., Norenzayana, A.: The weirdest people in the world? Behav. Brain Sci. 33, 61–83 (2010)CrossRef Henricha, J., Heinea, S.J., Norenzayana, A.: The weirdest people in the world? Behav. Brain Sci. 33, 61–83 (2010)CrossRef
112.
Zurück zum Zitat Hersbach, H.: Decomposition of the continuous ranked probability score for ensemble prediction systems. Weather Forecast. 15, 559–570 (2000)CrossRef Hersbach, H.: Decomposition of the continuous ranked probability score for ensemble prediction systems. Weather Forecast. 15, 559–570 (2000)CrossRef
121.
Zurück zum Zitat Jaynes, E.T.: Making Decisions, 2nd edn. Wiley, New York (1985) Jaynes, E.T.: Making Decisions, 2nd edn. Wiley, New York (1985)
122.
Zurück zum Zitat Jaynes, E.T.: Probability Theory: The Logic of Science. Cambridge University Press, Cambridge (2003)CrossRefMATH Jaynes, E.T.: Probability Theory: The Logic of Science. Cambridge University Press, Cambridge (2003)CrossRefMATH
127.
Zurück zum Zitat Johnson, W.O.: Predictive influence in the log normal survival model. In: Modelling and Prediction: Honoring Seymour Geisser, pp. 104–121. Springer, New York (1996) Johnson, W.O.: Predictive influence in the log normal survival model. In: Modelling and Prediction: Honoring Seymour Geisser, pp. 104–121. Springer, New York (1996)
128.
Zurück zum Zitat Johnson, W.O., Geisser, S.: A predictive view of the detection and characterization of influence observations in regression analysis. JASA 78, 427–440 (1982) Johnson, W.O., Geisser, S.: A predictive view of the detection and characterization of influence observations in regression analysis. JASA 78, 427–440 (1982)
136.
Zurück zum Zitat Kullback, S.: Information Theory and Statistics. Dover, Mineola (1968)MATH Kullback, S.: Information Theory and Statistics. Dover, Mineola (1968)MATH
144.
Zurück zum Zitat Lee, J.C., Johnson, W.O., Zellner, A. (eds.): Modelling and Prediction: Honoring Seymour Geisser. Springer, New York (1996)MATH Lee, J.C., Johnson, W.O., Zellner, A. (eds.): Modelling and Prediction: Honoring Seymour Geisser. Springer, New York (1996)MATH
152.
Zurück zum Zitat MacCoun, R., Perlmutter, S.: Blind Analysis as a Correction for Confirmatory Bias in Physics and in Psychology. In: Psychological Science Under Scrutiny: Recent Challenges and Proposed Solutions, pp. 589–612. Wiley, New York (2016) MacCoun, R., Perlmutter, S.: Blind Analysis as a Correction for Confirmatory Bias in Physics and in Psychology. In: Psychological Science Under Scrutiny: Recent Challenges and Proposed Solutions, pp. 589–612. Wiley, New York (2016)
159.
Zurück zum Zitat Murphy, A.H.: Forecast verification: its complexity and dimensionality. Mon. Weather Rev. 119, 1590–1601 (1991)CrossRef Murphy, A.H.: Forecast verification: its complexity and dimensionality. Mon. Weather Rev. 119, 1590–1601 (1991)CrossRef
160.
Zurück zum Zitat Murphy, A.H., Winkler, R.L.: A general framework for forecast verification. Mon. Weather Rev. 115, 1330–1338 (1987)CrossRef Murphy, A.H., Winkler, R.L.: A general framework for forecast verification. Mon. Weather Rev. 115, 1330–1338 (1987)CrossRef
161.
Zurück zum Zitat Newman, J.H.C.: The Grammar of Ascent. Image Books, New York (1955) Newman, J.H.C.: The Grammar of Ascent. Image Books, New York (1955)
183.
Zurück zum Zitat Robert, C.: On the jeffreys-lindley’s paradox. arxiv.org/abs/stat.ME/1303.5973v3 (2013) Robert, C.: On the jeffreys-lindley’s paradox. arxiv.org/abs/stat.ME/1303.5973v3 (2013)
184.
Zurück zum Zitat Robert, C.P.: The Bayesian Choice, 2nd edn. Springer, New York (2001) Robert, C.P.: The Bayesian Choice, 2nd edn. Springer, New York (2001)
186.
Zurück zum Zitat Rucker, R.: Infinity and the Mind: The Science and Philosophy of the Infinite. Bantam, New York (1983)MATH Rucker, R.: Infinity and the Mind: The Science and Philosophy of the Infinite. Bantam, New York (1983)MATH
190.
Zurück zum Zitat Savage, L.: The Foundations of Statistics. Dover, Mineola (1972)MATH Savage, L.: The Foundations of Statistics. Dover, Mineola (1972)MATH
200.
Zurück zum Zitat Smith, R.L.: Bayesian and Frequentist Approaches to Parametric Predictive Inference (with Discussion). Bayesian Statistics, vol. 6, pp. 589–612. Oxford University Press, Oxford (1998) Smith, R.L.: Bayesian and Frequentist Approaches to Parametric Predictive Inference (with Discussion). Bayesian Statistics, vol. 6, pp. 589–612. Oxford University Press, Oxford (1998)
202.
Zurück zum Zitat Spiegelhalter, D.J., Best, N.G., Carlin, B.: Bayesian measures of model complexity and fit. Noûs 64, 583–639 (2002)MathSciNetMATH Spiegelhalter, D.J., Best, N.G., Carlin, B.: Bayesian measures of model complexity and fit. Noûs 64, 583–639 (2002)MathSciNetMATH
211.
Zurück zum Zitat Tetlock, P.E.: Expert Political Judgement. Princeton University Press, Princeton (2005) Tetlock, P.E.: Expert Political Judgement. Princeton University Press, Princeton (2005)
220.
223.
Zurück zum Zitat Wilks, D.S.: Statistical Methods in the Atmospheric Sciences, 2nd edn. Academic, New York (2006) Wilks, D.S.: Statistical Methods in the Atmospheric Sciences, 2nd edn. Academic, New York (2006)
225.
Zurück zum Zitat Williamson, J.: In Defense of Objective Bayesianism. Oxford University Press, Oxford (2010)CrossRefMATH Williamson, J.: In Defense of Objective Bayesianism. Oxford University Press, Oxford (2010)CrossRefMATH
230.
Zurück zum Zitat Ziliak, S.T., McCloskey, D.N.: The Cult of Statistical Significance. University of Michigan Press, Ann Arbor (2008)MATH Ziliak, S.T., McCloskey, D.N.: The Cult of Statistical Significance. University of Michigan Press, Ann Arbor (2008)MATH
Metadaten
Titel
Statistical and Physical Models
verfasst von
William Briggs
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-39756-6_9