Skip to main content

A Holistic Framework for Evaluation of Arts Engagement

  • Chapter

Part of the book series: New Directions in Cultural Policy Research ((NDCPR))

Abstract

The emerging professional field of cultural development — that is, funded cultural activity led by individual artists, arts organisations and government — is increasingly undertaken to contribute to community wellbeing. Arts engagement, both receptive (in which participants receive the artistic process as audiences or consumers) and creative (in which participants actively make art), is a major aspect of this work. Host organisations and funders are progressively more concerned to understand the impact of this work they lead or support. Yet, arts leaders and those who manage their programmes experience a range of challenges in elucidating outcomes of this work comprehensively and with clarity. These challenges include the fact that outcomes are often categorised as either intrinsic or instrumental, with intrinsic outcomes frequently seen as problematic because they are considered immeasurable. Evaluation approaches largely focus on either social or economic outcomes (often identified as instrumental outcomes), rather than taking a more holistic perspective, in which all aspects of human experience and the natural world are considered equally important and inter-connected. Assessments of outcomes most often involve assumptions that activity is beneficial, with little regard given to the possibility of neutral or negative outcomes, or the proportion of benefit to costs. The perspectives of different stakeholders are frequently not reflected in the evaluation process.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • ALGA (Australian Local Government Association (1993) A Guide to Integrated Planning (ACT: ALGA). Available from: http://alga.asn.au/site/misc/alga/downloads/publications/A_guide_to_intergrated_local_area_planning.pdf.

    Google Scholar 

  • Australia Council for the Arts (2014) Community Partnerships (Sydney: Australia Council for the Arts). Available at: http://www.australiacouncil.gov.au/.

    Google Scholar 

  • Barraket, Jo (2005) Putting people in the picture? The role of the arts in social inclusion. (Melbourne: Brotherhood of St Laurence). Retrieved from http://www.bsl.org.au/pdfs/barraket_arts_social_inclusion_1.pdf.

    Google Scholar 

  • Barraket, Jo and Kaiser, Alex (2007) Evaluating the Mental Health and Wellbeing Impacts of Community-based Festivals: Awakenings Festival and Braybrook’s Big Day Out. (Melbourne: VicHealth).

    Google Scholar 

  • Blomkamp, Emma (2014) ‘Meanings and Measures of Urban Cultural Policy: Local Government, Art and Community Wellbeing in Australia and New Zealand’, Unpublished PhD thesis (Auckland and Melbourne: University of Auckland and University of Melbourne).

    Google Scholar 

  • Blomkamp, Emma (2011) Comparing the Uncertain Terrain of Local Cultural Governance in Australia and New Zealand, Conference Paper, Australian Political Science Association Conference, Canberra, 28 September.

    Google Scholar 

  • Brown, Alan, and Rebecca Ratzkin (2012) Understanding the Intrinsic Impact of Live Theatre. Accessed 20 October, 2013. Available at: http://www.intrinsicimpact.org/resources.

    Google Scholar 

  • Carnwath, John, and Alan Brown (2014) Understanding the Value and Impacts of Cultural Experiences: A Literature Review (London: Arts Council England).

    Google Scholar 

  • CIV (Community Indicators Victoria) (2014) Community Indicators Victoria Data Framework. Accessed 16 October 2014. Available at: http://www.communityindicators.net.au/.

    Google Scholar 

  • Cooper, Trudi, Susanne Bahn and Margaret Giles (2012) Investigating the Social Welfare Indicators of Aboriginal Regional Art Centres: A Pilot Study (Joondalup: Edith Cowan University)

    Google Scholar 

  • CultureCounts (2014) CultureCounts. Accessed 14 August 2014. Available at: http://culturecounts.cc/.

    Google Scholar 

  • CMC-SWG (Cultural Ministers Council Statistics Working Group) (2010) Vital Signs: Cultural Indicators for Australia (Canberra: Cultural Ministers Council).

    Google Scholar 

  • Davies, Rick, and Jess Dart (2005) The ‘Most Significant Change’ (MSC) Technique (London: Care International).

    Google Scholar 

  • Deci, Edward, and Richard M. Ryan (2000) ‘The “what” and “why” of goal pursuits: human needs and the self-determination of behaviour’, Psychological Inquiry, 11, 227–268.

    Article  Google Scholar 

  • Dunphy, Kim (2015) Holistic Framework for Evaluation of Arts Engagement (Melbourne: Cultural Development Network). Available at: http://www.culturaldevelopment.net.au.

    Google Scholar 

  • Dunphy, Kim (2011) ‘Evaluating The Scared Cool project: Understanding peacemaking through creativity and personal development in Timor-Leste’, UNESCO Observatory Multi-Disciplinary Research in the Arts, 2(2).

    Google Scholar 

  • Dunphy, Kim, and Vicki-Ann Ware (forthcoming, 2015) ‘Evaluation practices in participatory arts in international development: findings of a systematic literature review’, in Polly Stupples and Katarina Teaiwa (eds) Contemporary Perspectives in Art and International Development (London: Routledge).

    Google Scholar 

  • Etherton, Michael and Tim Prentki (2006) ‘Drama for change? Prove it!’, Research in Drama Education, 11(2), 139–155.

    Article  Google Scholar 

  • Farris, Paul, Neil Bendle, Phillip Pfeifer and David Reibstein (2010) Marketing Metrics: The Definitive Guide to Measuring Marketing Performance. (New Jersey: Pearson).

    Google Scholar 

  • Galloway, Susan (2009) ‘Theory-based evaluation and the social impact of the arts’, Cultural Trends, 18(2), 125–148.

    Article  Google Scholar 

  • Giles, Margaret (2009) ‘Cost benefit analysis’, in Philip O’Hara (ed.) International Encyclopedia of Public Policy (Volume 2: Economic Policy) (Perth: GPERU), 113–124.

    Google Scholar 

  • GCCP (Global Compact Cities Program) (2013) Circles of Sustainability’ Urban Profile Process. Accessed 14 April 2014. Available at: http://citiesprogramme.com/.

    Google Scholar 

  • Groth-Marnat, Gary. (2009) Handbook of Psychological Assessment (5th ed.) (New Jersey: John Wiley & Sons.)

    Google Scholar 

  • Hamilton, C., Hinks, S., and Petticrew, M. (2003) ‘Arts for health: Still searching for the holy grail’, Journal of Epidemiology and Community Health, 57, 401–02.

    Article  Google Scholar 

  • Hawkes, Jon (2010) ‘Making sense together’, Keynote Address, My city’s still breathing: a symposium exploring the arts, artists and the city, Winnipeg Art Gallery, 4 November.

    Google Scholar 

  • Hawkes, Jon (2001) The Fourth Pillar of Sustainability: Culture’s Essential Role in Public Planning (Melbourne: Common Ground Publishing).

    Google Scholar 

  • Holden, John (2006) Cultural Value and the Crisis of Legitimacy: Why Culture Needs a Democratic Mandate (London: Demos).

    Google Scholar 

  • Ife, Jim (2002) Community Development: Community-based Alternatives in an Age of Globalisation, 2nd edn (Frenchs Forest: Pearson Education).

    Google Scholar 

  • Ixia (2014) Public Art: A Guide to Evaluation, 4th edn (Birmingham: ixia).

    Google Scholar 

  • Johnson, Victoria, and Janet Stanley (2007) ‘Capturing the contribution of community arts to health and wellbeing’, International Journal of Mental Health Promotion, 9(2), 28–35.

    Article  Google Scholar 

  • Jupp, Dee, Sohel Ali and Carlos Barahona (2010) Measuring Empowerment. Sida Studies in Evaluation (Stockholm: Sida)

    Google Scholar 

  • Kelaher, Margaret, Naomi Berman, Lindy Joubert, Steve Curry, Richard Jones, Janet Stanley and Victoria Johnson (2007) ‘Methodological approaches to evaluating the impact of community arts on health’, UNESCO Observatory e-Journal, 1(1), 1–20.

    Google Scholar 

  • Laidlaw Foundation (2010) Most Significant Change. Accessed 1 November 2012. Available at: http://www.laidlawfdn.org/most-significant-change.

    Google Scholar 

  • Matarasso, François (1996) Defining Values: Evaluating Arts Programs (London: Comedia).

    Google Scholar 

  • McCarthy, Kevin, Elizabeth Ondaatje, Laura Zakaras and Arthur Brooks (2004 ) Gifts of the Muse: Reframing the Debate about the Benefits of the Arts (Santa Monica: RAND Corporation).

    Google Scholar 

  • McGillivray, Mark (2009) The United Nations Development Programme (UNDP) Human Development Index and Measuring Wellbeing across Nations, lecture, Deakin University, 19 June.

    Google Scholar 

  • McQueen-Thomson, Douglas, Paul James and Chris Ziguras (2004) Promoting Mental Health and Wellbeing through Community and Cultural Development (Melbourne: VicHealth).

    Google Scholar 

  • McQueen-Thompson, Douglas, and Chris Ziguras (2002) Promoting Mental Health and Wellbeing through Community and Cultural Development: A Review of Literature Focusing on Community Arts Practice (Melbourne: Globalism Institute and VicHealth).

    Google Scholar 

  • Mills, Deborah, Paul Brown, and Australia Council (2004) Art and wellbeing (Surry Hills: Australia Council).

    Google Scholar 

  • Morra-Imas, Linda and Ray Rist (2009) The Road to Results: Designing and Conducting Effective Development Evaluations (Washington, DC: World Bank).

    Book  Google Scholar 

  • Mulligan, Martin, and Pia Smith (2010) Art, Governance and the Turn to Community (Melbourne: RMIT University).

    Google Scholar 

  • NEA (National Endowment for the Arts) (2014) Grants for Organizations. Accessed 16 October 2014. Available at: http://arts.gov/grants/.

    Google Scholar 

  • Nicholls, Jeremy, Ellis Lawlor, Eva Neitzert and Tim Goodspeed for the Scottish Office of the Third Sector (2009) A Guide to Social Return on Investment (United Kingdom: New Economics Foundation).

    Google Scholar 

  • O’Brien, Dave (2010) Measuring the Value of Culture: A Report to the Department for Culture, Media and Sport (London: Department for Culture, Media and Sport).

    Google Scholar 

  • O’Toole, Linda (2014) Learning for Well-being (Brussels: Learning for Wellbeing Foundation). Available at: http://www.learningforwellbeing.org/sites/default/files/L4WB_TheEssentials%20-%20Brochure.pdf.

    Google Scholar 

  • Pope, Jeanette (2011) Indicators of Community Strength in Victoria: Framework and Evidence. Why Social Capital can build More Resilient Families and Communities (Melbourne: Victorian Department of Planning and Community Development).

    Google Scholar 

  • Radbourne, Jennifer, Katya Johanson and Hilary Glow (2010) ‘Empowering audiences to measure quality’, Participations: Journal of Audience & Reception Studies, 7 ( 2), 360–379.

    Google Scholar 

  • Rosenberg, Michael (2008) ‘The evaluation game: determining the benefits of arts engagement on health’, in Andrea Lewis and David Doyle (eds) Proving the Practice: Evidencing the Effects of Community Arts Programs on Mental Health (Perth: DADAA Publishing), 122–131.

    Google Scholar 

  • Scott, Carol, and Barbara Soren (2009) ‘Introduction to the special issue — exploring the value of museums’, Museum Management and Curatorship, 24 (3), 189–193.

    Article  Google Scholar 

  • Seligman, Martin (2011) Flourish: A Visionary New Understanding of Happiness and Wellbeing (New York: Simon & Schuster)

    Google Scholar 

  • South, Jane (2004) Community-based Arts for Health (Leeds: Metropolitan University).

    Google Scholar 

  • Stern, Mark, and Susan Seifert (2009) Civic Engagement and the Arts: Issues of Conceptualization and Measurement. (Pennsylvania: Animating Democracy).

    Google Scholar 

  • Throsby, David (2001) Economics and Culture (Cambridge: Cambridge University Press).

    Google Scholar 

  • Treasure, Wilfred (2011) Diagnosis and risk management in primary care: words that count, numbers that speak (Oxford: Radcliffe).

    Google Scholar 

  • UCLG (United Cities and Local Governments) (2010) Culture: The Fourth Pillar of Sustainable Development (Barcelona: UCLG).

    Google Scholar 

  • UNESCO (2014) Culture for Development Indicators (Paris: UNESCO).

    Google Scholar 

  • UNESCO (2009) Framework for Cultural Statistics (Montreal: UNESCO).

    Google Scholar 

  • Ware, Colin (2012) Information Visualization: Perception for Design (Massachusetts: Elsevier).

    Google Scholar 

  • West, Sue, and Di Cox (2009) A Local Government Reporting Framework for the 21st Century (Melbourne: Community Indicators Victoria).

    Google Scholar 

  • WolfBrown (2014) Intrinsicimpact.org: measure what matters, website. Accessed 12 June 2014. Available at: https://dashboard.intrinsicimpact.org/demo.

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Copyright information

© 2015 Kim Dunphy

About this chapter

Cite this chapter

Dunphy, K. (2015). A Holistic Framework for Evaluation of Arts Engagement. In: MacDowall, L., Badham, M., Blomkamp, E., Dunphy, K. (eds) Making Culture Count. New Directions in Cultural Policy Research. Palgrave Macmillan, London. https://doi.org/10.1007/978-1-137-46458-3_16

Download citation

Publish with us

Policies and ethics