Skip to main content
Top

2014 | OriginalPaper | Chapter

2. Evaluating e-Government: A Comprehensive Methodological Framework to Assess Policy Impacts

Authors : Gianluca Misuraca, Alberto Savoldelli, Cristiano Codagnone

Published in: Government e-Strategic Planning and Management

Publisher: Springer New York

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The modernization of public services is high on the political agenda and the role of Information and Communication Technologies in this process has been increasingly recognized. In current practice, however, conventional services have just been “digitized” without any concern for their actual impact on society. After over 20 years of research and practical implementation it is now widely recognized by both the scientific and the practice communities that despite the potential of e-government, the evidence of its impact on society is still very limited and the promised productivity gains seem not having been achieved yet generating the so called “e-government paradox”. The chapter builds on recent work of the authors (Savoldelli et al. 2012) who have analysed which are the main barriers hindering the adoption of e-government services and suggested that, in most mature public administrations, the key barriers generating such paradox can be identified in an unstructured policy evaluation process and in the absence of effective stakeholders’ engagement mechanisms. Starting from these findings, the chapter explores the existing relationship between measurement and trust on e-government decision making processes. The methodological approach underpinning the analysis is based upon a critical review of the most known and adopted e-government measurement frameworks. As a result of the analysis a proposal of a new framework capable of measuring the public value of e-government is presented and its application in a real context of usage provided by the Informatics and Telematics plan of the last 3 years of the Emilia Romagna region in Italy is discussed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Alford, J. (2002). Defining the client in the public sector: A social exchange perspective. Public Administration Review, 62(3), 337–346.CrossRef Alford, J. (2002). Defining the client in the public sector: A social exchange perspective. Public Administration Review, 62(3), 337–346.CrossRef
go back to reference Andersen, K. V., & Henrisken, H. Z. (2006). E-government maturity model: Extension of the Layne and Lee model. In Government Information Quarterly, 23(2), 236–238.CrossRef Andersen, K. V., & Henrisken, H. Z. (2006). E-government maturity model: Extension of the Layne and Lee model. In Government Information Quarterly, 23(2), 236–238.CrossRef
go back to reference Arnaboldi, M., Azzone, G., & Savoldelli, A. (2004). Managing a public sector project: The case of the Italian treasury ministry. In. International Journal of Project Management, 22, 213–223.CrossRef Arnaboldi, M., Azzone, G., & Savoldelli, A. (2004). Managing a public sector project: The case of the Italian treasury ministry. In. International Journal of Project Management, 22, 213–223.CrossRef
go back to reference Atkinson, T. (2005). Atkinson review: Final report: Measurement of government output and productivity for the national accounts. London: Palgrave Macmillan. Atkinson, T. (2005). Atkinson review: Final report: Measurement of government output and productivity for the national accounts. London: Palgrave Macmillan.
go back to reference Bannister, F. (2007). The curse of the benchmark: An assessment of the validity and value of e-government comparisons. International Review of Administrative Sciences, 73(2), 612–631.CrossRef Bannister, F. (2007). The curse of the benchmark: An assessment of the validity and value of e-government comparisons. International Review of Administrative Sciences, 73(2), 612–631.CrossRef
go back to reference Belanger, F., & Carter, L. (2008). Trust and risk in e-government adoption. In Strategic Information Systems, 17, 165–176.CrossRef Belanger, F., & Carter, L. (2008). Trust and risk in e-government adoption. In Strategic Information Systems, 17, 165–176.CrossRef
go back to reference Bertot, J. C., & Jaeger, P. T. (2008). The e-Government paradox: Better customer service doesn’t necessarily cost less. In Government Information Quarterly, 25(2), 149–154.CrossRef Bertot, J. C., & Jaeger, P. T. (2008). The e-Government paradox: Better customer service doesn’t necessarily cost less. In Government Information Quarterly, 25(2), 149–154.CrossRef
go back to reference Best, J. (2001). Damned lies and statistics: Untangling numbers from the media, politicians, and activists. Berkeley: University of California Press. Best, J. (2001). Damned lies and statistics: Untangling numbers from the media, politicians, and activists. Berkeley: University of California Press.
go back to reference Bovaird, T. (2007). Beyond engagement and participation: User and community coproduction of public services. In Public Administration Review, 5, 846–860.CrossRef Bovaird, T. (2007). Beyond engagement and participation: User and community coproduction of public services. In Public Administration Review, 5, 846–860.CrossRef
go back to reference Bresnahan, T., Brynjolfsson, E., & Hitt, L. (2002). Information technology, workplace organization, and the demand for skilled labor: Firm-level evidence. The Quarterly Journal of Economics, 117(1), 339–376.CrossRef Bresnahan, T., Brynjolfsson, E., & Hitt, L. (2002). Information technology, workplace organization, and the demand for skilled labor: Firm-level evidence. The Quarterly Journal of Economics, 117(1), 339–376.CrossRef
go back to reference Capgemini. (2007). Online availability of public services: How is Europe progressing? European Commission, Brussels. Capgemini. (2007). Online availability of public services: How is Europe progressing? European Commission, Brussels.
go back to reference Capgemini, (2009). Smarter, faster, better e-government, 8th measurement. European Commission, Brussels. Capgemini, (2009). Smarter, faster, better e-government, 8th measurement. European Commission, Brussels.
go back to reference Capgemini, (2010). Digitizing public service in europe: Putting ambition into action, 9th benchmark measurement. European Commission, Brussels. Capgemini, (2010). Digitizing public service in europe: Putting ambition into action, 9th benchmark measurement. European Commission, Brussels.
go back to reference Castelnovo, W. (2010). Is there an e-government paradox? In D. O’Donnel (Ed.), 10th European e-government conference on e-government (pp. 90–98). Limerick: Academic Publishing. Castelnovo, W. (2010). Is there an e-government paradox? In D. O’Donnel (Ed.), 10th European e-government conference on e-government (pp. 90–98). Limerick: Academic Publishing.
go back to reference Castelnovo, W., & Simonetta, M. (2008). A public value evaluation of e-government policies. The Electronic Journal Information Systems Evaluation, 11(2), 61–72. Castelnovo, W., & Simonetta, M. (2008). A public value evaluation of e-government policies. The Electronic Journal Information Systems Evaluation, 11(2), 61–72.
go back to reference Codagnone, C., & Cilli, V. (2006). eGEP expenditure study. EC: Brussels. Codagnone, C., & Cilli, V. (2006). eGEP expenditure study. EC: Brussels.
go back to reference Codagnone, C., & Undheim, T. (2008). Government efficiency and effectiveness: The theory and practice of evaluation and measurment. European Journal of ePractice 1(4), 1–15. Codagnone, C., & Undheim, T. (2008). Government efficiency and effectiveness: The theory and practice of evaluation and measurment. European Journal of ePractice 1(4), 1–15.
go back to reference Cordella, A., & Bonina, C. M. (2012). A public value perspective for ICT enabled public sector reforms: A theoretical reflection. Government Information Quarterly, 29(4), 512–520. Cordella, A., & Bonina, C. M. (2012). A public value perspective for ICT enabled public sector reforms: A theoretical reflection. Government Information Quarterly, 29(4), 512–520.
go back to reference Dawes, & Pardo, T. (2002). Building collaborative digital government system. In W. J. McIver, & A. K. Elmagarmid (Eds.), Advances in digital government. technology, human factors and policy. Norwell: Kluwer Academic Publisher. Dawes, & Pardo, T. (2002). Building collaborative digital government system. In W. J. McIver, & A. K. Elmagarmid (Eds.), Advances in digital government. technology, human factors and policy. Norwell: Kluwer Academic Publisher.
go back to reference Dawes Sharon, S. (2008). An exploratory framework for future e-government research investments. Proceedings of the 41 st Hawaii International Conference on Systems Science. Dawes Sharon, S. (2008). An exploratory framework for future e-government research investments. Proceedings of the 41 st Hawaii International Conference on Systems Science.
go back to reference Esteves, J., & Rhoda, C. J. (2008). A comprehensive framework for the assessment of e-government projects. Governmnet Information Quarterly, 25, 118–132.CrossRef Esteves, J., & Rhoda, C. J. (2008). A comprehensive framework for the assessment of e-government projects. Governmnet Information Quarterly, 25, 118–132.CrossRef
go back to reference Etzioni, A., & Lehman, E. (1967). Some dangers in ‘valid’ social measurements: Preliminary notes. The Annals of the American Academy of Political and Social Science, 373(1), 1–15.CrossRef Etzioni, A., & Lehman, E. (1967). Some dangers in ‘valid’ social measurements: Preliminary notes. The Annals of the American Academy of Political and Social Science, 373(1), 1–15.CrossRef
go back to reference Fernández-i-Marín, X. (2011). The impact of e-government promotion in Europe: Internet dependence and critical mass. Policy and Internet, 3(4), 0. Fernández-i-Marín, X. (2011). The impact of e-government promotion in Europe: Internet dependence and critical mass. Policy and Internet, 3(4), 0.
go back to reference Foley, K. (2006). Using the value measuring methodology to evaluate government initiatives. Proceedings of the 2006 Crystal Ball User Conference. May 1–3. Denver. Foley, K. (2006). Using the value measuring methodology to evaluate government initiatives. Proceedings of the 2006 Crystal Ball User Conference. May 1–3. Denver.
go back to reference Gil-Garcia, J. R., & Pardo, T. A. (2005). E-government success factors: Mapping practical tool to theoretical foundations. Government Information Quarterly, 22(2), 187–216.CrossRef Gil-Garcia, J. R., & Pardo, T. A. (2005). E-government success factors: Mapping practical tool to theoretical foundations. Government Information Quarterly, 22(2), 187–216.CrossRef
go back to reference Guida, J., & Crow, M. (2008). E-government and e-governance. In T. Unvin (Ed.), ICT4D – Information and communication technologies for development. Cambridge: Cambridge University Press. Retrieved January 18, 2012 from http://books.google.com. Guida, J., & Crow, M. (2008). E-government and e-governance. In T. Unvin (Ed.), ICT4D – Information and communication technologies for development. Cambridge: Cambridge University Press. Retrieved January 18, 2012 from http://​books.​google.​com.
go back to reference Heeks, R. (2006). Understanding and measuring e-government: International benchmarking studies. Paper prepared for UNDESA workshop on eParticipation and e-government: Understanding the present and creating the future. 27–28 July, Budapest. Heeks, R. (2006). Understanding and measuring e-government: International benchmarking studies. Paper prepared for UNDESA workshop on eParticipation and e-government: Understanding the present and creating the future. 27–28 July, Budapest.
go back to reference Kelly, G., Mulgan, G., & Muers, S. (2002). Creating public value: An analytical framework for public service reform. London: Strategy Unit, Cabinet Office. Kelly, G., Mulgan, G., & Muers, S. (2002). Creating public value: An analytical framework for public service reform. London: Strategy Unit, Cabinet Office.
go back to reference Kunstelj, M., & Vintar, M. (2004). Evaluating the progress of e-government development: A critical analysis. Information Policy, 9(3–4), 131–148. Kunstelj, M., & Vintar, M. (2004). Evaluating the progress of e-government development: A critical analysis. Information Policy, 9(3–4), 131–148.
go back to reference Layne, K., & Lee, J. W. (2001). Developing fully functional e-government: A four stage model. Government Information Quarterly, 9(2), 122–136. Layne, K., & Lee, J. W. (2001). Developing fully functional e-government: A four stage model. Government Information Quarterly, 9(2), 122–136.
go back to reference Magoutas, B., Halaris, C., & Mentzas, G. (2007). An ontology for the multi-perspective evaluation of quality in e-government services. Electronic Government, Proceedings, 4656, 318–329.CrossRef Magoutas, B., Halaris, C., & Mentzas, G. (2007). An ontology for the multi-perspective evaluation of quality in e-government services. Electronic Government, Proceedings, 4656, 318–329.CrossRef
go back to reference Misuraca, G. (2012). Assessing ICT-enabled Innovation for Governance and Policy Making. PhD Thesis, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, 2013. Misuraca, G. (2012). Assessing ICT-enabled Innovation for Governance and Policy Making. PhD Thesis, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, 2013.
go back to reference Misuraca, G., Codagnone, C., & Rossel, P. (2013). From practice to theory and back to practice: Reflexivity in measurement and evaluation for evidence-based policy making in the information society, Government Information Quarterly, (Suppl 2), Jan 2013 (pp. S68–S82). Misuraca, G., Codagnone, C., & Rossel, P. (2013). From practice to theory and back to practice: Reflexivity in measurement and evaluation for evidence-based policy making in the information society, Government Information Quarterly, (Suppl 2), Jan 2013 (pp. S68–S82).
go back to reference Misuraca, G., & Rossel, P. (2011). Reflexivity, modelling and weak signals of transformational tracks to support both micro- and macro-measuring of Information society services. In Proceedings of the 5th International Conference on Theory and Practice of Electronic Governance (ICEGOV2011), Tallinn, Estonia, 26–28 September 2011 - ACM International Conference Proceedings Series, ACM Press. Misuraca, G., & Rossel, P. (2011). Reflexivity, modelling and weak signals of transformational tracks to support both micro- and macro-measuring of Information society services. In Proceedings of the 5th International Conference on Theory and Practice of Electronic Governance (ICEGOV2011), Tallinn, Estonia, 26–28 September 2011 - ACM International Conference Proceedings Series, ACM Press.
go back to reference Moore, M. (1995). Creating public value strategic management in government. Cambridge: Harvard University Press. Moore, M. (1995). Creating public value strategic management in government. Cambridge: Harvard University Press.
go back to reference Moore, M., & Khagram, S. (2004). On creating public value: What business can learn from government about strategic management. A working paper of the Corporate Social Responsibility Initiative. Harvard University. Moore, M., & Khagram, S. (2004). On creating public value: What business can learn from government about strategic management. A working paper of the Corporate Social Responsibility Initiative. Harvard University.
go back to reference OECD. (2009). Implementation guidelines on evaluation and capacity building for local and micro regional level – “the Hungary case”. OECD, Paris. . OECD. (2009). Implementation guidelines on evaluation and capacity building for local and micro regional level“the Hungary case”. OECD, Paris. .
go back to reference Perrin, B. (2006). Moving from outputs to outcomes: Practical advice from governments around the world. Managing for performances and results series. Report sponsored by World Bank and the IBM Center for the Business of Government. Perrin, B. (2006). Moving from outputs to outcomes: Practical advice from governments around the world. Managing for performances and results series. Report sponsored by World Bank and the IBM Center for the Business of Government.
go back to reference Petricek, V., Escher, T., Cox, I., & Margetts, H. (2006). The web structure of e-government - developing a methodology for quantitative evaluation. Paper presented at the Proceedings of the 15th International Conference on World Wide Web. Petricek, V., Escher, T., Cox, I., & Margetts, H. (2006). The web structure of e-government - developing a methodology for quantitative evaluation. Paper presented at the Proceedings of the 15th International Conference on World Wide Web.
go back to reference Papadopulos Y., & Warin, P. (2007). Are innovative participatory and deliberative procedures in policy making democratic and effective? European Journal of Political Research. 46, 445–462. Papadopulos Y., & Warin, P. (2007). Are innovative participatory and deliberative procedures in policy making democratic and effective? European Journal of Political Research. 46, 445–462.
go back to reference Reddick, C. G. (2005). Citizen interaction with e-government: From the streets to servers? Government Information Quarterly, 22(1), 38–57.CrossRef Reddick, C. G. (2005). Citizen interaction with e-government: From the streets to servers? Government Information Quarterly, 22(1), 38–57.CrossRef
go back to reference Salem, S. (2008). Benchmarking the e-government bulldozer: Beyond measuring the tread marks. Measuring Business Excellence, 11(4), 9–22. Salem, S. (2008). Benchmarking the e-government bulldozer: Beyond measuring the tread marks. Measuring Business Excellence, 11(4), 9–22.
go back to reference Savoldelli, A. (2012, October). La valutazione dei Progetti ICT per lo sviluppo della società dell′informazione. Paper presented in the “Bologna Smart City Workshop - SmartER”, Bologna. Savoldelli, A. (2012, October). La valutazione dei Progetti ICT per lo sviluppo della società dell′informazione. Paper presented in the “Bologna Smart City Workshop - SmartER”, Bologna.
go back to reference Savoldelli, A., Codagnone, C., & Misuraca, G. (2012, October). Explaining the e-government paradox: An analysis of two decades of evidence from scientific literature and practice on barriers to e-government. Paper presented in: ICEGOV 2012, New York. Savoldelli, A., Codagnone, C., & Misuraca, G. (2012, October). Explaining the e-government paradox: An analysis of two decades of evidence from scientific literature and practice on barriers to e-government. Paper presented in: ICEGOV 2012, New York.
go back to reference Savoldelli, A., Codagnone, C., & Misuraca, G. (2013). Assessing the impacts of ICT-enabled services in the public sector: A participatory evaluation process to overcome the eGovernment paradox. Paper presented to the 2nd International EIBURS-TAIPS Conference: Innovation in the Public Sector and the Development of E-services, April 18–19, 2013, Urbino. Savoldelli, A., Codagnone, C., & Misuraca, G. (2013). Assessing the impacts of ICT-enabled services in the public sector: A participatory evaluation process to overcome the eGovernment paradox. Paper presented to the 2nd International EIBURS-TAIPS Conference: Innovation in the Public Sector and the Development of E-services, April 18–19, 2013, Urbino.
go back to reference Van Dooren, W. (2009). A politico-administrative agenda for progress in social measurement: Reforming the calculation of government’s contribution to GDP. Journal of Comparative Policy Analysis: Research and Practice, 11(3), 309–326.CrossRef Van Dooren, W. (2009). A politico-administrative agenda for progress in social measurement: Reforming the calculation of government’s contribution to GDP. Journal of Comparative Policy Analysis: Research and Practice, 11(3), 309–326.CrossRef
go back to reference Van Ryzin, G. (2009). Outcome, process and citizens′ trust of the civil services. Paper prepared for the 10th national management research conference, October 1–4. Ohio State University, John Glenn School of Public Affairs, Columbus. Van Ryzin, G. (2009). Outcome, process and citizens′ trust of the civil services. Paper prepared for the 10th national management research conference, October 1–4. Ohio State University, John Glenn School of Public Affairs, Columbus.
Metadata
Title
Evaluating e-Government: A Comprehensive Methodological Framework to Assess Policy Impacts
Authors
Gianluca Misuraca
Alberto Savoldelli
Cristiano Codagnone
Copyright Year
2014
Publisher
Springer New York
DOI
https://doi.org/10.1007/978-1-4614-8462-2_2