Skip to main content
Log in

How to improve the performances of DEA/FDH estimators in the presence of noise?

  • Published:
Journal of Productivity Analysis Aims and scope Submit manuscript

Abstract

In frontier analysis, most nonparametric approaches (DEA, FDH) are based on envelopment ideas which assume that with probability one, all observed units belong to the attainable set. In these “deterministic” frontier models, statistical inference is now possible, by using bootstrap procedures. In the presence of noise, envelopment estimators could behave dramatically since they are very sensitive to extreme observations that might result only from noise. DEA/FDH techniques would provide estimators with an error of the order of the standard deviation of the noise. This paper adapts some recent results on detecting change points [Hall P, Simar L (2002) J Am Stat Assoc 97:523–534] to improve the performances of the classical DEA/FDH estimators in the presence of noise. We show by simulated examples that the procedure works well, and better than the standard DEA/FDH estimators, when the noise is of moderate size in term of signal to noise ratio. It turns out that the procedure is also robust to outliers. The paper can be seen as a first attempt to formalize stochastic DEA/FDH estimators.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aigner DJ, Lovell CAK, Schmidt P (1977) Formulation and estimation of stochastic frontier models. J Economet 6:21–37

    Article  Google Scholar 

  • Aitkinson SE, Primont D (2002) Stochastic estimation of firm technology, and productivity growth using shadow cost and distance function. J Economet 108:203–225

    Article  Google Scholar 

  • Banker RD (1993) Maximum likelihood, consistency and data envelopment analysis: a statistical foundation. Manage Sci 39(10):1265–1273

    Google Scholar 

  • Breiman L (1996) Bagging predictors. Machine Learn 26:123–140

    Google Scholar 

  • Cazals C, Florens JP, Simar L (2002) Nonparametric frontier estimation: a robust approach. J Economet 106:1–25

    Article  Google Scholar 

  • Charnes A, Cooper WW, Rhodes E (1978) Measuring the inefficiency of decision making units. Euro J Operat Res 2:429–444

    Article  Google Scholar 

  • Charnes A, Cooper WW, Rhodes E (1981) Evaluating program and managerial efficiency: an application of data envelopment analysis to program follow through. Manage Sci 27:668–697

    Google Scholar 

  • Cooper WW, Seiford LM, Tone K (2000) Data envelopment analysis: a comprehensive text with models, applications, references and DEA-Solver Software. Kluwer Academic Publishers, Boston

    Google Scholar 

  • Daouia A, Simar L (2004) Nonparametric efficiency analysis: a multivariate conditional quantile approach, Discussion paper 0419, Institut de Statistique, UCL, forthcoming in J Economet

  • Daraio C, Simar L (2005) Introducing environmental variables in nonparametric frontier models: a probabilistic approach. J Product Anal 24(1):93–121

    Article  Google Scholar 

  • Daraio C, Simar L (2007) Advanced robust and nonparametric methods in efficiency analysis. Methodology and applications, Springer-Verlag

  • Debreu G (1951) The coefficient of resource utilization, Econometrica 19(3):273–292

    Article  Google Scholar 

  • Deprins D, Simar L, Tulkens H (1984) Measuring labor inefficiency in post offices. In: Marchand M, Pestieau P, Tulkens H (eds) The performance of public enterprises: concepts and measurements. Amsterdam, North-Holland, pp 243–267

    Google Scholar 

  • Farrell MJ (1957) The measurement of productive efficiency. J Roy Stat Soc Ser A 120:253–281

    Article  Google Scholar 

  • Gijbels I, Mammen E, Park BU, Simar L (1996) On estimation of monotone and concave frontier functions. J Am Stat Assoc 94(445):220–228

    Article  Google Scholar 

  • Grosskopf S, Hayes K, Taylor L, Weber W (1997) Budget constrained frontier measures of fiscal equality and efficiency in schooling. Rev Econ Stat 79:116–124

    Article  Google Scholar 

  • Gstach D (1998) Another approach to Data Envelopment Analysis in noisy environments: DEA + . J Product Anal 9:161–176

    Article  Google Scholar 

  • Härdle W (1990) Applied nonparametric regression. Cambridge University Press, Cambridge

    Google Scholar 

  • Hall P, Simar L (2002) Estimating a changepoint, boundary or frontier in the presence of observation error. J Am Stat Assoc 97:523–534

    Article  Google Scholar 

  • Henderson DJ, Simar L (2005) A fully nonparametric stochastic frontier model for panel data, Discussion paper 0525, Institut de Statistique, UCL

  • Jeong SO, Simar L (2006) Linearly interpolated FDH efficiency score for nonconvex frontiers. J Multivariate Anal 97:2141–2161

    Article  Google Scholar 

  • Jondrow J, Lovell CAK, Materov IS, Schmidt P (1982) On the estimation of technical inefficiency in stochastic frontier production models. J Economet 19:233-238

    Article  Google Scholar 

  • Kneip A, Park BU, Simar L (1998) A note on the convergence of nonparametric DEA estimators for production efficiency scores. Econom Theory 14:783–793

    Article  Google Scholar 

  • Kneip A, Simar L (1996) A general framework for frontier estimation with panel data. J Product Anal 7:187–212

    Article  Google Scholar 

  • Kneip, A, Simar L, Wilson PW (2003) Asymptotics for DEA Estimators in Nonparametric Frontier Models, Discussion paper 0317, Institut de Statistique, UCL

  • Korostelev A, Simar L, Tsybakov AB (1995a) Efficient estimation of monotone boundaries. Annl Stat 23:476–489

    Google Scholar 

  • Korostelev A, Simar L, Tsybakov AB (1995b) On estimation of monotone and convex boundaries. Pub Inst Stat Univ Paris XXXIX 1:3–18

    Google Scholar 

  • Kumbhakar SC, Park BU, Simar L, Tsionas EG (2007) Nonparametric stochastic frontiers: a local likelihood approach. J Economet 137(1):1–27

    Article  Google Scholar 

  • Land KC, Lovell CAK, Thore S (1993) Chance-constrained data envelopment analysis. Manag Decision Econom 14(6):541–554

    Article  Google Scholar 

  • Lovell CAK (1993) Production frontiers and productive efficiency. In: Fried H, Lovell CAK, Schmidt SS (eds) The measurement of productive efficiency techniques and applications, Ch 1. Oxford Academic Press

  • Meeusen W, van den Broek J (1977) Efficiency estimation from Cobb-Douglas production function with composed error. Intl Econ Rev 8:435–444

    Article  Google Scholar 

  • Park B Simar L, Ch. Weiner (2000) The FDH estimator for productivity efficiency scores: asymptotic properties. Econom Theory 16:855–877

    Article  Google Scholar 

  • Petersen NC, Olesen OB (1995) Chance-constrained efficiency evaluation. Manage Sci 41: 442–457

    Google Scholar 

  • Racine J, Li Q (2004) Nonparametric estimation of regression functions with both categorical and continuous data. J Economet 119:99–130

    Article  Google Scholar 

  • Scott DW (1992) Multivariate density estimation: theory, practice, and visualization. John Wiley & Sons Inc, New York

    Google Scholar 

  • Seiford LM (1997) A bibliography for data envelopment analysis (1978–1996). Annl Operat Res 73:393–438

    Article  Google Scholar 

  • Shephard RW (1970) Theory of cost and production function. Princeton University Press, Princeton New-Jersey

    Google Scholar 

  • Silverman BW (1986) Density estimation for statistics and data analysis. Chapman and Hall, London

    Google Scholar 

  • Simar L (2003) Detecting outliers in frontiers models: a simple approach. J Product Anal 20:391–424

    Article  Google Scholar 

  • Simar L, Wilson P (1998) Sensitivity of efficiency scores: how to bootstrap in nonparametric frontier models. Manage Sci 44(1):49–61

    Article  Google Scholar 

  • Simar L, Wilson P (2000a) Statistical inference in nonparametric frontier models: the state of the art. J Product Anal 13:49–78

    Article  Google Scholar 

  • Simar L, Wilson P (2000b) A general methodology for bootstrapping in nonparametric frontier models. J Appl Stat 27(6):779–802

    Article  Google Scholar 

  • Simar L, Wilson PW (2005) Estimation and inference in cross-sectional stochastic frontier models. Discussion paper 0524, Institut de Statistique, UCL

  • Simar L, Wilson PW (2007) Statistical inference in nonparametric frontier models: recent developments and perspectives, forthcoming. In: Fried H, Knox Lovell CA, Schmidt S (eds) The measurement of productive efficiency, 2nd ed. Oxford University Press

  • Wilson PW (1993) Detecting outliers in deterministic nonparametric frontier models with multiple outputs. J Business Econ Stat 11:319–323

    Article  Google Scholar 

Download references

Acknowledgements

Research support from “Projet d’Actions de Recherche Concertées” (No. 98/03–217) and from the “Interuniversity Attraction Pole”, Phase V (P5/24) and Phase VI (P6/03) from the Belgian Government (Belgian Science Policy) are acknowledged. Constructive comments of two anonymous referees and of the Associate Editor on previous versions of the paper are also acknowledged.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Léopold Simar.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Simar, L. How to improve the performances of DEA/FDH estimators in the presence of noise?. J Prod Anal 28, 183–201 (2007). https://doi.org/10.1007/s11123-007-0057-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11123-007-0057-3

Keywords

JEL Classifications

Navigation