Skip to main content
Top
Published in: AStA Wirtschafts- und Sozialstatistisches Archiv 3-4/2018

23-11-2018 | Originalveröffentlichung

Estimation of sample quantiles: challenges and issues in the context of income and wealth distributions

Author: Ann-Kristin Kreutzmann

Published in: AStA Wirtschafts- und Sozialstatistisches Archiv | Issue 3-4/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Means, quantiles and extreme values are common statistics for the description of distributions. However, estimating sample quantiles with the default definition in different software programs leads to unequal results. This is due to the fact that software programs use different quantile definitions. Since most practitioners are not aware of this fact and use different quantile definitions interchangeably, this work compares the default definitions in the software programs SPSS, R, SAS software, and Stata and additional quantile definitions that are suggested by the literature. The work especially focuses on how the quantile estimators perform in the context of describing the distribution of income and wealth. Furthermore, the possibilities of considering sampling weights in the quantile estimation and methods for producing variance estimates using the above-mentioned software are discussed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Alfons A, Templ M (2013) Estimation of social exclusion indicators from complex surveys: the R package laeken. J Stat Softw 54(15):1–25CrossRef Alfons A, Templ M (2013) Estimation of social exclusion indicators from complex surveys: the R package laeken. J Stat Softw 54(15):1–25CrossRef
go back to reference Bell WR, Basel WW, Maples JJ (2016) An overview of the U.S. Census Bureau’s small area income and poverty estimates program. In: Pratesi M (ed) Analysis of poverty data by small area estimation. John Wiley & Sons, Hoboken, pp 379–403 Bell WR, Basel WW, Maples JJ (2016) An overview of the U.S. Census Bureau’s small area income and poverty estimates program. In: Pratesi M (ed) Analysis of poverty data by small area estimation. John Wiley & Sons, Hoboken, pp 379–403
go back to reference Beste J, Grabka MM, Goebel J (2018) Armut in Deutschland. AStA Wirtsch Sozialstat Arch 12(1):27–62CrossRef Beste J, Grabka MM, Goebel J (2018) Armut in Deutschland. AStA Wirtsch Sozialstat Arch 12(1):27–62CrossRef
go back to reference Bhat CR (1994) Imputing a continuous income variable from grouped and missing income observations. Econ Lett 46(4):311–319MATHCrossRef Bhat CR (1994) Imputing a continuous income variable from grouped and missing income observations. Econ Lett 46(4):311–319MATHCrossRef
go back to reference Blom G (1958) Statistical estimates and transformed beta-variables. John Wiley & Sons, HobokenMATH Blom G (1958) Statistical estimates and transformed beta-variables. John Wiley & Sons, HobokenMATH
go back to reference Bundesinstitut für Bau‑, Stadt-, und Raumforschung (2017) Indikatoren und Karten zur Raum- und Stadtentwicklung. Datenlizenz Deutschland – Namensnennung – Version 2.0. http://www.inkar.de/. Accessed 12 Apr 2018 Bundesinstitut für Bau‑, Stadt-, und Raumforschung (2017) Indikatoren und Karten zur Raum- und Stadtentwicklung. Datenlizenz Deutschland – Namensnennung – Version 2.0. http://​www.​inkar.​de/​. Accessed 12 Apr 2018
go back to reference Cramér H (1946) Mathematical methods of statistics. Princeton University Press, PrincetonMATH Cramér H (1946) Mathematical methods of statistics. Princeton University Press, PrincetonMATH
go back to reference Datta GS, Lahiri P, Maiti T (2002) Empirical Bayes estimation of median income of four-person families by state using time series and cross-sectional data. J Stat Plan Inference 102(1):83–97MathSciNetMATHCrossRef Datta GS, Lahiri P, Maiti T (2002) Empirical Bayes estimation of median income of four-person families by state using time series and cross-sectional data. J Stat Plan Inference 102(1):83–97MathSciNetMATHCrossRef
go back to reference Deutsche Bundesbank (2016) Vermögen und Finanzen privater Haushalte in Deutschland: Ergebnisse der Vermögensbefragung 2014. Monatsbericht, Deutsche Bundesbank Deutsche Bundesbank (2016) Vermögen und Finanzen privater Haushalte in Deutschland: Ergebnisse der Vermögensbefragung 2014. Monatsbericht, Deutsche Bundesbank
go back to reference Dielmann T, Lowry C, Pfaffenberger R (1994) A comparison of quantile estimators. Commun Stat Simul Comput 23(2):355–371MATHCrossRef Dielmann T, Lowry C, Pfaffenberger R (1994) A comparison of quantile estimators. Commun Stat Simul Comput 23(2):355–371MATHCrossRef
go back to reference Edgeworth FY (1886) XLVI. Problems in probabilities. Lond Edinb Dublin Philos Mag J Sci 22(137):371–384MATHCrossRef Edgeworth FY (1886) XLVI. Problems in probabilities. Lond Edinb Dublin Philos Mag J Sci 22(137):371–384MATHCrossRef
go back to reference Eubank RL (2004) Quantiles. In: Kotz S, Read CB, Balakrishnan N, Vidakovic B, Johnson NL (eds) Encyclopedia of statistical sciences. John Wiley & Sons, Hoboken Eubank RL (2004) Quantiles. In: Kotz S, Read CB, Balakrishnan N, Vidakovic B, Johnson NL (eds) Encyclopedia of statistical sciences. John Wiley & Sons, Hoboken
go back to reference eurostat (2018b) Smarter, greener, more inclusive? Indicators to support the Europe 2020 strategy. Publications Office of the European Union, Luxembourg eurostat (2018b) Smarter, greener, more inclusive? Indicators to support the Europe 2020 strategy. Publications Office of the European Union, Luxembourg
go back to reference Fan J, Tang M, Tian M (2014) Kernel quantile estimator with ICI adaptive bandwidth selection technique. Acta Math Sin Engl Ser 30(4):710–722MathSciNetMATHCrossRef Fan J, Tang M, Tian M (2014) Kernel quantile estimator with ICI adaptive bandwidth selection technique. Acta Math Sin Engl Ser 30(4):710–722MathSciNetMATHCrossRef
go back to reference Genton MG, Ma Y, Parzen E (2006) Discussion of “Sur une limitation très générale de la dispersion de la médiane” by M. Fréchet. J Soc Fr Statistique (2009) 147(2):51–60MATH Genton MG, Ma Y, Parzen E (2006) Discussion of “Sur une limitation très générale de la dispersion de la médiane” by M. Fréchet. J Soc Fr Statistique (2009) 147(2):51–60MATH
go back to reference Geraci M (2016) Qtools: a collection of models and tools for quantile inference. R J 8(2):117–138CrossRef Geraci M (2016) Qtools: a collection of models and tools for quantile inference. R J 8(2):117–138CrossRef
go back to reference Graf M, Nedyalkova D (2014) Modeling of income and indicators of poverty and social exclusion using the generalized beta distribution of the second kind. Rev Income Wealth 60(4):821–842 Graf M, Nedyalkova D (2014) Modeling of income and indicators of poverty and social exclusion using the generalized beta distribution of the second kind. Rev Income Wealth 60(4):821–842
go back to reference Hazen A (1914) Storage to be provided in impounding reservoirs for municipal water supply. Trans Am Soc Civ Eng 77:1539–1641 Hazen A (1914) Storage to be provided in impounding reservoirs for municipal water supply. Trans Am Soc Civ Eng 77:1539–1641
go back to reference Hosking J (1990) L‑moments: analysis and estimation of distributions using linear combinations of order statistics. J R Stat Soc Series B Stat Methodol 52(1):105–124MathSciNetMATH Hosking J (1990) L‑moments: analysis and estimation of distributions using linear combinations of order statistics. J R Stat Soc Series B Stat Methodol 52(1):105–124MathSciNetMATH
go back to reference Hyndman R, Fan Y (1996) Sample quantiles in statistical packages. Am Stat 50(4):361–365 Hyndman R, Fan Y (1996) Sample quantiles in statistical packages. Am Stat 50(4):361–365
go back to reference IBM (2013) IBM SPSS statistics for Windows, version 25.0 IBM (2013) IBM SPSS statistics for Windows, version 25.0
go back to reference Johnson NL, Kotz S (1970) Continuous univariate distributions. Houghton Mifflin Harcourt, BostonMATH Johnson NL, Kotz S (1970) Continuous univariate distributions. Houghton Mifflin Harcourt, BostonMATH
go back to reference Juritz JM, Juritz JWF, Stephens M (1983) On the accuracy of simulated percentage points. J Am Stat Assoc 78(382):441–444MathSciNetCrossRef Juritz JM, Juritz JWF, Stephens M (1983) On the accuracy of simulated percentage points. J Am Stat Assoc 78(382):441–444MathSciNetCrossRef
go back to reference Kleiber C, Kotz S (2003) Statistical size distributions in economics and actuarial sciences. John Wiley & Sons, HobokenMATHCrossRef Kleiber C, Kotz S (2003) Statistical size distributions in economics and actuarial sciences. John Wiley & Sons, HobokenMATHCrossRef
go back to reference Knerr P, Aust F, Chudziak N, Gilberg R, Kleudgen M (2015) Methodenbericht – Private Haushalte und ihre Finanzen (PHF) 2. Erhebungswelle – Anonymisierte Fassung –. Methodenbericht, infas Institut für angewandte Sozialwissenschaft GmbH Knerr P, Aust F, Chudziak N, Gilberg R, Kleudgen M (2015) Methodenbericht – Private Haushalte und ihre Finanzen (PHF) 2. Erhebungswelle – Anonymisierte Fassung –. Methodenbericht, infas Institut für angewandte Sozialwissenschaft GmbH
go back to reference Kreutzmann AK, Pannier S, Rojas-Perilla N, Schmid T, Templ M, Tzavidis N (2019) The R package emdi for estimating and mapping regionally disaggregated indicators. J Stat Softw. Kreutzmann AK, Pannier S, Rojas-Perilla N, Schmid T, Templ M, Tzavidis N (2019) The R package emdi for estimating and mapping regionally disaggregated indicators. J Stat Softw.
go back to reference Langford E (2006) Quartiles in elementary statistics. J Stat Educ 50(4):361–365 Langford E (2006) Quartiles in elementary statistics. J Stat Educ 50(4):361–365
go back to reference Lavallée P, Beaumont JF (2015) Why we should put some weight on weights. Survey methods: insights from the field, pp 1–18 Lavallée P, Beaumont JF (2015) Why we should put some weight on weights. Survey methods: insights from the field, pp 1–18
go back to reference Lohr SL (2010) Sampling: design and analysis. Cengage Learning, BostonMATH Lohr SL (2010) Sampling: design and analysis. Cengage Learning, BostonMATH
go back to reference Longford N (2011) Small-sample estimators of the quantiles of the normal, log-normal and Pareto distributions. J Stat Comput Simul 82(9):1383–1395MathSciNetMATHCrossRef Longford N (2011) Small-sample estimators of the quantiles of the normal, log-normal and Pareto distributions. J Stat Comput Simul 82(9):1383–1395MathSciNetMATHCrossRef
go back to reference Lumley T (2004) Analysis of complex survey samples. J Stat Softw 9(8):1–19CrossRef Lumley T (2004) Analysis of complex survey samples. J Stat Softw 9(8):1–19CrossRef
go back to reference Ma Y, Genton MG, Parzen E (2011) Asymptotic properties of sample quantiles of discrete distributions. Ann Inst Stat Math 63(2):227–243MathSciNetMATHCrossRef Ma Y, Genton MG, Parzen E (2011) Asymptotic properties of sample quantiles of discrete distributions. Ann Inst Stat Math 63(2):227–243MathSciNetMATHCrossRef
go back to reference Majumder KL, Bhattacharjee GP (1973) Algorithm AS63: the incomplete beta integral. J R Stat Soc Ser C Appl Stat 22(3):409–411 Majumder KL, Bhattacharjee GP (1973) Algorithm AS63: the incomplete beta integral. J R Stat Soc Ser C Appl Stat 22(3):409–411
go back to reference Marchetti S, Giusti C, Pratesi M (2016) The use of Twitter data to improve small area estimates of households’ share of food consumption expenditure in Italy. AStA Wirtsch Sozialstat Arch 10(2-3):79–93CrossRef Marchetti S, Giusti C, Pratesi M (2016) The use of Twitter data to improve small area estimates of households’ share of food consumption expenditure in Italy. AStA Wirtsch Sozialstat Arch 10(2-3):79–93CrossRef
go back to reference Marchetti S, Beręsewicz M, Salvati N, Szymkowiak M, Wawrowski Ł (2018) The use of a three-level M‑quantile model to map poverty at local administrative unit 1 in Poland. J R Stat Soc Ser A 181(4):1–28MathSciNetCrossRef Marchetti S, Beręsewicz M, Salvati N, Szymkowiak M, Wawrowski Ł (2018) The use of a three-level M‑quantile model to map poverty at local administrative unit 1 in Poland. J R Stat Soc Ser A 181(4):1–28MathSciNetCrossRef
go back to reference McDonald J (1984) Some generalized functions for the size distribution of income. Econometrica 52(3):647–663MATHCrossRef McDonald J (1984) Some generalized functions for the size distribution of income. Econometrica 52(3):647–663MATHCrossRef
go back to reference McDonald J, Bordley R (1996) Something new, something old: parametric models for the size distribution of income. J Income Distrib 6(1):91–103 McDonald J, Bordley R (1996) Something new, something old: parametric models for the size distribution of income. J Income Distrib 6(1):91–103
go back to reference Münnich R, Burgard JP, Vogt M (2013) Small Area-Statistik: Methoden und Anwendungen. AStA Wirtsch Sozialstat Arch 6(3-4):149–191CrossRef Münnich R, Burgard JP, Vogt M (2013) Small Area-Statistik: Methoden und Anwendungen. AStA Wirtsch Sozialstat Arch 6(3-4):149–191CrossRef
go back to reference Okolewski A, Rychlik T (2001) Sharp distribution-free bounds on the bias in estimating quantiles via order statistics. Stat Probab Lett 52(2):207–213MathSciNetMATHCrossRef Okolewski A, Rychlik T (2001) Sharp distribution-free bounds on the bias in estimating quantiles via order statistics. Stat Probab Lett 52(2):207–213MathSciNetMATHCrossRef
go back to reference Parrish R (1990) Comparison of quantile estimators in normal sampling. Biometrics 46(1):247–257MATHCrossRef Parrish R (1990) Comparison of quantile estimators in normal sampling. Biometrics 46(1):247–257MATHCrossRef
go back to reference Phien H (1990) A note on the computation of the incomplete beta function. Adv Eng Softw 12(1):39–44CrossRef Phien H (1990) A note on the computation of the incomplete beta function. Adv Eng Softw 12(1):39–44CrossRef
go back to reference Rust KF, Rao JNK (1996) Variance estimation for complex surveys using replication techniques. Stat Methods Med Res 5(3):283–310CrossRef Rust KF, Rao JNK (1996) Variance estimation for complex surveys using replication techniques. Stat Methods Med Res 5(3):283–310CrossRef
go back to reference SAS Institute Inc (2018) Version 9.4 of the SAS system SAS Institute Inc (2018) Version 9.4 of the SAS system
go back to reference Schmid T, Bruckschen F, Salvati N, Zbiranski T (2017) Constructing sociodemographic indicators for national statistical institutes using mobile phone data: estimating literacy rates in Senegal. J R Stat Soc Ser A 180(4):1163–1190MathSciNetCrossRef Schmid T, Bruckschen F, Salvati N, Zbiranski T (2017) Constructing sociodemographic indicators for national statistical institutes using mobile phone data: estimating literacy rates in Senegal. J R Stat Soc Ser A 180(4):1163–1190MathSciNetCrossRef
go back to reference Schoonjans F, De Bacquer D, Schmid P (2011) Estimation of population percentiles. Epidemiology 22(5):750–751CrossRef Schoonjans F, De Bacquer D, Schmid P (2011) Estimation of population percentiles. Epidemiology 22(5):750–751CrossRef
go back to reference Shao J (1988) A note on bootstrap variance estimation. Technical report, Purdue UniversityCrossRef Shao J (1988) A note on bootstrap variance estimation. Technical report, Purdue UniversityCrossRef
go back to reference Shao J, Wu C (1992) Asymptotic properties of the balanced repeated replication method for sample quantiles. Ann Stat 20(3):1571–1593MathSciNetMATHCrossRef Shao J, Wu C (1992) Asymptotic properties of the balanced repeated replication method for sample quantiles. Ann Stat 20(3):1571–1593MathSciNetMATHCrossRef
go back to reference StataCorp (2015) Stata statistical software: release 15. StataCorp LLC, College Station StataCorp (2015) Stata statistical software: release 15. StataCorp LLC, College Station
go back to reference Steinhauer HW, Aßmann C, Zinn S, Goßmann S, Rässler S (2015) Sampling and weighting cohort samples in institutional contexts. AStA Wirtsch Sozialstat Arch 9(2):131–157CrossRef Steinhauer HW, Aßmann C, Zinn S, Goßmann S, Rässler S (2015) Sampling and weighting cohort samples in institutional contexts. AStA Wirtsch Sozialstat Arch 9(2):131–157CrossRef
go back to reference Tzavidis N, Zhang LC, Luna A, Schmid T, Rojas-Perilla N (2018) From start to finish: a framework for the production of small area official statistics. J R Stat Soc Ser A 181(4):927–979MathSciNetCrossRef Tzavidis N, Zhang LC, Luna A, Schmid T, Rojas-Perilla N (2018) From start to finish: a framework for the production of small area official statistics. J R Stat Soc Ser A 181(4):927–979MathSciNetCrossRef
go back to reference Vélez JI, Correa JC (2014) Should we think of a different median estimator? Comun Estad 7(1):11–17 Vélez JI, Correa JC (2014) Should we think of a different median estimator? Comun Estad 7(1):11–17
go back to reference Walker AM (1968) A note on the asymptotic distribution of sample quantiles. J R Stat Soc Series B Stat Methodol 30(3):570–575MathSciNetMATH Walker AM (1968) A note on the asymptotic distribution of sample quantiles. J R Stat Soc Series B Stat Methodol 30(3):570–575MathSciNetMATH
go back to reference Wei L, Wang D, Hutson A (2015) An investigation of quantile function estimators relative to quantile confidence interval coverage. Commun Stat Theory Methods 44(10):2107–2135MathSciNetMATHCrossRef Wei L, Wang D, Hutson A (2015) An investigation of quantile function estimators relative to quantile confidence interval coverage. Commun Stat Theory Methods 44(10):2107–2135MathSciNetMATHCrossRef
go back to reference Weibull W (1939) The phenomenon of rupture in solids. Ing Vetensk Akad Handl 17(153):1–55 Weibull W (1939) The phenomenon of rupture in solids. Ing Vetensk Akad Handl 17(153):1–55
go back to reference Wolter K (2007) Introduction to variance estimation. Springer, New YorkMATH Wolter K (2007) Introduction to variance estimation. Springer, New YorkMATH
go back to reference Yoshizawa C, Sen P, Davis E (1985) Asymptotic equivalence of the Harrel-Davis median estimator and the sample median. Commun Stat Theory Methods 14(9):2129–2136MATHCrossRef Yoshizawa C, Sen P, Davis E (1985) Asymptotic equivalence of the Harrel-Davis median estimator and the sample median. Commun Stat Theory Methods 14(9):2129–2136MATHCrossRef
Metadata
Title
Estimation of sample quantiles: challenges and issues in the context of income and wealth distributions
Author
Ann-Kristin Kreutzmann
Publication date
23-11-2018
Publisher
Springer Berlin Heidelberg
Published in
AStA Wirtschafts- und Sozialstatistisches Archiv / Issue 3-4/2018
Print ISSN: 1863-8155
Electronic ISSN: 1863-8163
DOI
https://doi.org/10.1007/s11943-018-0234-z

Other articles of this Issue 3-4/2018

AStA Wirtschafts- und Sozialstatistisches Archiv 3-4/2018 Go to the issue