Skip to main content
Top

2019 | OriginalPaper | Chapter

Rethinking ICT4D Impact Assessments: Reflections from the Siyakhula Living Lab in South Africa

Authors : Hafeni Mthoko, Caroline Khene

Published in: Locally Relevant ICT Research

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The approach to outcome and impact assessments of ICTD has often relied solely on identifying project effects in relation to project baseline data; however, such an approach limits the potential learning that could be occurring throughout a project’s lifecycle. Impact assessments should be conducted in a comprehensive manner, taking into account the evaluation data that has been captured from the initiation of the project through to its implementation, and beyond. This study sought to reflect on the implementation of an impact assessment framework that is based on a comprehensive approach to evaluation. The framework was implemented in the Siyakhula Living Lab to assess for its outcomes and impacts on the community. A pragmatic approach was applied through a reflective process, to assess the utility of the framework within this context. Semi-structured interviews with project stakeholders were conducted to further gain insight into the comprehensive approach to conducting impact assessments. It was found that a comprehensive approach to assessing impacts provided a meaningful way to understand the effects of the ICTD initiative, and provided an overview of project areas that required improvement. However, it was found that the proposed assessment framework required a customisation component in order to modify it to better suit the project context. The way in which future impact assessments are conducted can draw on the lessons gained from following a more comprehensive approach to evaluation, and thus improve learning over time.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Heeks, R.: Information and Communication Technology for Development (ICT4D). Routledge, London (2018) Heeks, R.: Information and Communication Technology for Development (ICT4D). Routledge, London (2018)
2.
go back to reference Walsham, G.: ICT4D research: reflections on history and future agenda. Inf. Technol. Dev. 23(1), 1–24 (2017)CrossRef Walsham, G.: ICT4D research: reflections on history and future agenda. Inf. Technol. Dev. 23(1), 1–24 (2017)CrossRef
3.
go back to reference Gomez, R., Pather, S.: ICT evaluation: are we asking the right questions? Electron. J. Inf. Syst. Dev. Ctries. 50, 1–14 (2012) Gomez, R., Pather, S.: ICT evaluation: are we asking the right questions? Electron. J. Inf. Syst. Dev. Ctries. 50, 1–14 (2012)
4.
go back to reference Heeks, R., Molla, A.: Impact Assessment of ICT-for-Development Projects: A Compendium of Approaches (2009) Heeks, R., Molla, A.: Impact Assessment of ICT-for-Development Projects: A Compendium of Approaches (2009)
6.
go back to reference Pade-Khene, C., Sewry, D.: Towards a Comprehensive Evaluation Framework for ICT for Development Evaluation – An Analysis of Evaluation Frameworks. Presented at the (2011) Pade-Khene, C., Sewry, D.: Towards a Comprehensive Evaluation Framework for ICT for Development Evaluation – An Analysis of Evaluation Frameworks. Presented at the (2011)
8.
go back to reference Pade-Khene, C., Lannon, J.: Learning to be Sustainable in ICT for Development: A Citizen Engagement Initiative in South Africa. Presented at the (2017)CrossRef Pade-Khene, C., Lannon, J.: Learning to be Sustainable in ICT for Development: A Citizen Engagement Initiative in South Africa. Presented at the (2017)CrossRef
9.
go back to reference Toyama, K.: Geek Heresy: Rescuing Social Change from the Cult of Technology. Public Affairs, New York (2015) Toyama, K.: Geek Heresy: Rescuing Social Change from the Cult of Technology. Public Affairs, New York (2015)
10.
go back to reference Dodson, L., Sterling, S.R., Bennett, J.K.: Considering failure: eight years of ITID research. In: Proceedings of the Fifth International Conference on Information and Communication Technologies and Development, pp. 56–64. Georgia (2012) Dodson, L., Sterling, S.R., Bennett, J.K.: Considering failure: eight years of ITID research. In: Proceedings of the Fifth International Conference on Information and Communication Technologies and Development, pp. 56–64. Georgia (2012)
11.
go back to reference Pade-Khene, C., Sewry, D.: Proposed stages of a rural ICT comprehensive evaluation framework in ICT for rural development projects. In: Proceedings of the South African Institute of Computer Scientists and Information Technologists Conference on Knowledge, Innovation and Leadership in a Diverse, Multidisciplinary Environment, SAICSIT 2011, p. 326 (2011). https://doi.org/10.1145/2072221.2072269 Pade-Khene, C., Sewry, D.: Proposed stages of a rural ICT comprehensive evaluation framework in ICT for rural development projects. In: Proceedings of the South African Institute of Computer Scientists and Information Technologists Conference on Knowledge, Innovation and Leadership in a Diverse, Multidisciplinary Environment, SAICSIT 2011, p. 326 (2011). https://​doi.​org/​10.​1145/​2072221.​2072269
12.
go back to reference Rossi, P.H., Lipsey, M.W., Freeman, H.E.: Evaluation: A Systematic Approach. Sage Publications, London (2004) Rossi, P.H., Lipsey, M.W., Freeman, H.E.: Evaluation: A Systematic Approach. Sage Publications, London (2004)
13.
go back to reference Weick, K.E.: What theory is not, theorizing is. Adm. Sci. Q. 40, 385–390 (1995)CrossRef Weick, K.E.: What theory is not, theorizing is. Adm. Sci. Q. 40, 385–390 (1995)CrossRef
14.
go back to reference Gigler, B.S.: Including the excluded: can ICTs empower poor communities? Towards an alternative evaluation framework based on the capability approach. Presented at the (2004) Gigler, B.S.: Including the excluded: can ICTs empower poor communities? Towards an alternative evaluation framework based on the capability approach. Presented at the (2004)
15.
go back to reference Mansell, R.: Power and interests in information and communication and development: exogenous and endogenous discourses in contention. J. Int. Dev. 26, 109–127 (2011)CrossRef Mansell, R.: Power and interests in information and communication and development: exogenous and endogenous discourses in contention. J. Int. Dev. 26, 109–127 (2011)CrossRef
16.
go back to reference Brydon, L.: Ethical practices in doing development research. In: Doing Development Research, pp. 25–33. Sage Publications, London (2006) Brydon, L.: Ethical practices in doing development research. In: Doing Development Research, pp. 25–33. Sage Publications, London (2006)
17.
go back to reference Grunfeld, H.: Framework for evaluating contributions of ICT to capabilities, empowerment and sustainability in disadvantaged communities. In: CPRSouth2 (Communication Policy Research) Conference, “Empowering Rural Communities Through ICT Policy and Research, Madras (2007) Grunfeld, H.: Framework for evaluating contributions of ICT to capabilities, empowerment and sustainability in disadvantaged communities. In: CPRSouth2 (Communication Policy Research) Conference, “Empowering Rural Communities Through ICT Policy and Research, Madras (2007)
18.
go back to reference Krauss, K.: Ethical research practice for community entry: using ICT4D in a deep rural context. In: 3rd International IDIA Development Informatics Conference, Kruger National Park (2009) Krauss, K.: Ethical research practice for community entry: using ICT4D in a deep rural context. In: 3rd International IDIA Development Informatics Conference, Kruger National Park (2009)
19.
go back to reference Brunet, P., Tiemtore, O., Vettraino-Soulard, M.C.: Ethics and the Internet in West Africa: Toward an Ethical Model of Integration. IDRC, Ottawa (2004) Brunet, P., Tiemtore, O., Vettraino-Soulard, M.C.: Ethics and the Internet in West Africa: Toward an Ethical Model of Integration. IDRC, Ottawa (2004)
20.
go back to reference McNamara, K.S.: Information and Communication Technologies, Poverty and Development: Learning from Experience. InfoDev, Geneva (2003) McNamara, K.S.: Information and Communication Technologies, Poverty and Development: Learning from Experience. InfoDev, Geneva (2003)
22.
go back to reference Hallikainen, P., Chen, L.: A holistic framework on information systems evaluation with a case analysis. Electron. J. Inf. Syst. Eval. 9, 57–64 (2005) Hallikainen, P., Chen, L.: A holistic framework on information systems evaluation with a case analysis. Electron. J. Inf. Syst. Eval. 9, 57–64 (2005)
23.
go back to reference Hamel, J.: ICT4D and the human development and capabilities approach: the potentials of information and communication technology. United Nations Development Programme, New York (2010) Hamel, J.: ICT4D and the human development and capabilities approach: the potentials of information and communication technology. United Nations Development Programme, New York (2010)
24.
go back to reference Batchelor, S., Norrish, P.: Framework for Assessment of ICT Pilot Projects: Beyond Monitoring and Evaluation to Applied Research. InfoDev, The World Bank, Washington D.C (2006) Batchelor, S., Norrish, P.: Framework for Assessment of ICT Pilot Projects: Beyond Monitoring and Evaluation to Applied Research. InfoDev, The World Bank, Washington D.C (2006)
25.
go back to reference Rabaya, K.S.: Economic and social empowerment of women through information and communication technology: a case study of palestine. J. Commun. Inform. 5 Rabaya, K.S.: Economic and social empowerment of women through information and communication technology: a case study of palestine. J. Commun. Inform. 5
26.
go back to reference Wieman, A., Gast, L., Hagen, I., Van Der Krogt, S.: Monitoring and Evaluation at IICD: An Instrument to Assess Development Impact and Effectiveness. International Institute for Communication and Development (IICD), The Hague (2001) Wieman, A., Gast, L., Hagen, I., Van Der Krogt, S.: Monitoring and Evaluation at IICD: An Instrument to Assess Development Impact and Effectiveness. International Institute for Communication and Development (IICD), The Hague (2001)
27.
go back to reference The World Bank: ICT for Greater Development Impact-Information and Communication Technology. The World Bank, Washington D.C (2012) The World Bank: ICT for Greater Development Impact-Information and Communication Technology. The World Bank, Washington D.C (2012)
28.
go back to reference Alsop, R., Bertelsen, M.F., Holland, J.: Empowerment in Practice: From Analysis to Implementation. The World Bank, Washington D.C (2006) Alsop, R., Bertelsen, M.F., Holland, J.: Empowerment in Practice: From Analysis to Implementation. The World Bank, Washington D.C (2006)
29.
go back to reference Parkinson, S., Ramirez, R.: Using a sustainable livelihoods approach to assessing the impact of ICTs in development. Commun. Inform. 2, 116–127 (2006) Parkinson, S., Ramirez, R.: Using a sustainable livelihoods approach to assessing the impact of ICTs in development. Commun. Inform. 2, 116–127 (2006)
30.
go back to reference Duncombe, R.: Using the livelihoods framework to analyse ICT applications for poverty reduction through microenterprise. Inf. Technol. Int. Dev. 3, 81–100 (2006)CrossRef Duncombe, R.: Using the livelihoods framework to analyse ICT applications for poverty reduction through microenterprise. Inf. Technol. Int. Dev. 3, 81–100 (2006)CrossRef
31.
go back to reference Marais, M., Meyer, I.: Design for sustainability: countering the drivers of unsustainability in development projects. J. Commun. Inform. 11, 1–13 (2015) Marais, M., Meyer, I.: Design for sustainability: countering the drivers of unsustainability in development projects. J. Commun. Inform. 11, 1–13 (2015)
32.
go back to reference Souter, D.: ICTS, the Internet and Sustainability: A Discussion Paper. International Institute for Sustainable Development, Winnipeg (2012) Souter, D.: ICTS, the Internet and Sustainability: A Discussion Paper. International Institute for Sustainable Development, Winnipeg (2012)
34.
go back to reference Ali, M., Bailur, S.: The Challenge of “Sustainability” in ICT4D - Is Bricolage the Answer? Presented at the (2007) Ali, M., Bailur, S.: The Challenge of “Sustainability” in ICT4D - Is Bricolage the Answer? Presented at the (2007)
35.
go back to reference Unwin, T.: ICT4D: Information and Communication Technology for Development. Cambridge University Press, Cambridge (2009) Unwin, T.: ICT4D: Information and Communication Technology for Development. Cambridge University Press, Cambridge (2009)
36.
go back to reference Goldkuhl, G.: Pragmatism vs interpretivism in qualitative information systems research. Eur. J. Inf. Syst. 21, 135–146 (2012)CrossRef Goldkuhl, G.: Pragmatism vs interpretivism in qualitative information systems research. Eur. J. Inf. Syst. 21, 135–146 (2012)CrossRef
37.
go back to reference Feilzer, M.Y.: Doing mixed methods research pragmatically: implications for the rediscovery of pragmatism as a research paradigm. J. Mix. Methods Res. 4, 6–16 (2010)CrossRef Feilzer, M.Y.: Doing mixed methods research pragmatically: implications for the rediscovery of pragmatism as a research paradigm. J. Mix. Methods Res. 4, 6–16 (2010)CrossRef
39.
go back to reference Yin, R.K.: Case Study Research: Design and Methods. SAGE Publications, Thousand Oaks (2009) Yin, R.K.: Case Study Research: Design and Methods. SAGE Publications, Thousand Oaks (2009)
40.
go back to reference O’Neill, D.: Assessing community informatics: a review of methodological approaches for evaluating community networks and community technology centers. Internet Res. Electron. Netw. Appl. Policy 12, 76–102 (2002)CrossRef O’Neill, D.: Assessing community informatics: a review of methodological approaches for evaluating community networks and community technology centers. Internet Res. Electron. Netw. Appl. Policy 12, 76–102 (2002)CrossRef
41.
go back to reference Rogers, P., et al.: IE4D – Impact Evaluation for Development: Principles for Action (2011) Rogers, P., et al.: IE4D – Impact Evaluation for Development: Principles for Action (2011)
42.
go back to reference Patton, M.Q.: Utilization-Focused Evaluation Checklist (U-FE). SAGE Publications, London (2012) Patton, M.Q.: Utilization-Focused Evaluation Checklist (U-FE). SAGE Publications, London (2012)
43.
go back to reference Maxwell, S.: The Meaning and Measurement of Poverty. Overseas Development Institute (ODI), London (1999) Maxwell, S.: The Meaning and Measurement of Poverty. Overseas Development Institute (ODI), London (1999)
44.
go back to reference Markey, S., Connelly, S., Roseland, M.: Back of the envelope: pragmatic planning for sustainable rural community development. Plan. Pract. Res. 25, 1–23 (2010)CrossRef Markey, S., Connelly, S., Roseland, M.: Back of the envelope: pragmatic planning for sustainable rural community development. Plan. Pract. Res. 25, 1–23 (2010)CrossRef
45.
go back to reference Henry, G.T., Mark, M.M.: Beyond use: understanding evaluation’s influence on attitudes and actions. Am. J. Eval. 24, 293–314 (2003) Henry, G.T., Mark, M.M.: Beyond use: understanding evaluation’s influence on attitudes and actions. Am. J. Eval. 24, 293–314 (2003)
46.
go back to reference Myers, M.: Monitoring and Evaluating Information and Communication for Development (ICD) Programmes: Guidelines. Department for International Development (DFID), London (2005) Myers, M.: Monitoring and Evaluating Information and Communication for Development (ICD) Programmes: Guidelines. Department for International Development (DFID), London (2005)
47.
go back to reference Pfeffer, J., Sutton, R.I.: The Knowing-Doing Gap. Harvard Business School Press, Boston (2000) Pfeffer, J., Sutton, R.I.: The Knowing-Doing Gap. Harvard Business School Press, Boston (2000)
48.
go back to reference Tabassum, G., Yeo, A.W.: Measurement of tangible and intangible impacts of telecentres on rural communities. Presented at the (2015) Tabassum, G., Yeo, A.W.: Measurement of tangible and intangible impacts of telecentres on rural communities. Presented at the (2015)
49.
go back to reference Atkinson, R.: The life story interview. In: Handbook of Interview Research: Context and Method, pp. 120–140. Thousand Oaks, CA (2001) Atkinson, R.: The life story interview. In: Handbook of Interview Research: Context and Method, pp. 120–140. Thousand Oaks, CA (2001)
50.
go back to reference Hosman, L., Fife, E.: Improving the prospects for sustainable ICT projects in the developing world. Int. J. Media Cult. Polit. 4, 51–69 (2008)CrossRef Hosman, L., Fife, E.: Improving the prospects for sustainable ICT projects in the developing world. Int. J. Media Cult. Polit. 4, 51–69 (2008)CrossRef
Metadata
Title
Rethinking ICT4D Impact Assessments: Reflections from the Siyakhula Living Lab in South Africa
Authors
Hafeni Mthoko
Caroline Khene
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-11235-6_4

Premium Partner