Abstract
The emerging professional field of cultural development — that is, funded cultural activity led by individual artists, arts organisations and government — is increasingly undertaken to contribute to community wellbeing. Arts engagement, both receptive (in which participants receive the artistic process as audiences or consumers) and creative (in which participants actively make art), is a major aspect of this work. Host organisations and funders are progressively more concerned to understand the impact of this work they lead or support. Yet, arts leaders and those who manage their programmes experience a range of challenges in elucidating outcomes of this work comprehensively and with clarity. These challenges include the fact that outcomes are often categorised as either intrinsic or instrumental, with intrinsic outcomes frequently seen as problematic because they are considered immeasurable. Evaluation approaches largely focus on either social or economic outcomes (often identified as instrumental outcomes), rather than taking a more holistic perspective, in which all aspects of human experience and the natural world are considered equally important and inter-connected. Assessments of outcomes most often involve assumptions that activity is beneficial, with little regard given to the possibility of neutral or negative outcomes, or the proportion of benefit to costs. The perspectives of different stakeholders are frequently not reflected in the evaluation process.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
ALGA (Australian Local Government Association (1993) A Guide to Integrated Planning (ACT: ALGA). Available from: http://alga.asn.au/site/misc/alga/downloads/publications/A_guide_to_intergrated_local_area_planning.pdf.
Australia Council for the Arts (2014) Community Partnerships (Sydney: Australia Council for the Arts). Available at: http://www.australiacouncil.gov.au/.
Barraket, Jo (2005) Putting people in the picture? The role of the arts in social inclusion. (Melbourne: Brotherhood of St Laurence). Retrieved from http://www.bsl.org.au/pdfs/barraket_arts_social_inclusion_1.pdf.
Barraket, Jo and Kaiser, Alex (2007) Evaluating the Mental Health and Wellbeing Impacts of Community-based Festivals: Awakenings Festival and Braybrook’s Big Day Out. (Melbourne: VicHealth).
Blomkamp, Emma (2014) ‘Meanings and Measures of Urban Cultural Policy: Local Government, Art and Community Wellbeing in Australia and New Zealand’, Unpublished PhD thesis (Auckland and Melbourne: University of Auckland and University of Melbourne).
Blomkamp, Emma (2011) Comparing the Uncertain Terrain of Local Cultural Governance in Australia and New Zealand, Conference Paper, Australian Political Science Association Conference, Canberra, 28 September.
Brown, Alan, and Rebecca Ratzkin (2012) Understanding the Intrinsic Impact of Live Theatre. Accessed 20 October, 2013. Available at: http://www.intrinsicimpact.org/resources.
Carnwath, John, and Alan Brown (2014) Understanding the Value and Impacts of Cultural Experiences: A Literature Review (London: Arts Council England).
CIV (Community Indicators Victoria) (2014) Community Indicators Victoria Data Framework. Accessed 16 October 2014. Available at: http://www.communityindicators.net.au/.
Cooper, Trudi, Susanne Bahn and Margaret Giles (2012) Investigating the Social Welfare Indicators of Aboriginal Regional Art Centres: A Pilot Study (Joondalup: Edith Cowan University)
CultureCounts (2014) CultureCounts. Accessed 14 August 2014. Available at: http://culturecounts.cc/.
CMC-SWG (Cultural Ministers Council Statistics Working Group) (2010) Vital Signs: Cultural Indicators for Australia (Canberra: Cultural Ministers Council).
Davies, Rick, and Jess Dart (2005) The ‘Most Significant Change’ (MSC) Technique (London: Care International).
Deci, Edward, and Richard M. Ryan (2000) ‘The “what” and “why” of goal pursuits: human needs and the self-determination of behaviour’, Psychological Inquiry, 11, 227–268.
Dunphy, Kim (2015) Holistic Framework for Evaluation of Arts Engagement (Melbourne: Cultural Development Network). Available at: http://www.culturaldevelopment.net.au.
Dunphy, Kim (2011) ‘Evaluating The Scared Cool project: Understanding peacemaking through creativity and personal development in Timor-Leste’, UNESCO Observatory Multi-Disciplinary Research in the Arts, 2(2).
Dunphy, Kim, and Vicki-Ann Ware (forthcoming, 2015) ‘Evaluation practices in participatory arts in international development: findings of a systematic literature review’, in Polly Stupples and Katarina Teaiwa (eds) Contemporary Perspectives in Art and International Development (London: Routledge).
Etherton, Michael and Tim Prentki (2006) ‘Drama for change? Prove it!’, Research in Drama Education, 11(2), 139–155.
Farris, Paul, Neil Bendle, Phillip Pfeifer and David Reibstein (2010) Marketing Metrics: The Definitive Guide to Measuring Marketing Performance. (New Jersey: Pearson).
Galloway, Susan (2009) ‘Theory-based evaluation and the social impact of the arts’, Cultural Trends, 18(2), 125–148.
Giles, Margaret (2009) ‘Cost benefit analysis’, in Philip O’Hara (ed.) International Encyclopedia of Public Policy (Volume 2: Economic Policy) (Perth: GPERU), 113–124.
GCCP (Global Compact Cities Program) (2013) Circles of Sustainability’ Urban Profile Process. Accessed 14 April 2014. Available at: http://citiesprogramme.com/.
Groth-Marnat, Gary. (2009) Handbook of Psychological Assessment (5th ed.) (New Jersey: John Wiley & Sons.)
Hamilton, C., Hinks, S., and Petticrew, M. (2003) ‘Arts for health: Still searching for the holy grail’, Journal of Epidemiology and Community Health, 57, 401–02.
Hawkes, Jon (2010) ‘Making sense together’, Keynote Address, My city’s still breathing: a symposium exploring the arts, artists and the city, Winnipeg Art Gallery, 4 November.
Hawkes, Jon (2001) The Fourth Pillar of Sustainability: Culture’s Essential Role in Public Planning (Melbourne: Common Ground Publishing).
Holden, John (2006) Cultural Value and the Crisis of Legitimacy: Why Culture Needs a Democratic Mandate (London: Demos).
Ife, Jim (2002) Community Development: Community-based Alternatives in an Age of Globalisation, 2nd edn (Frenchs Forest: Pearson Education).
Ixia (2014) Public Art: A Guide to Evaluation, 4th edn (Birmingham: ixia).
Johnson, Victoria, and Janet Stanley (2007) ‘Capturing the contribution of community arts to health and wellbeing’, International Journal of Mental Health Promotion, 9(2), 28–35.
Jupp, Dee, Sohel Ali and Carlos Barahona (2010) Measuring Empowerment. Sida Studies in Evaluation (Stockholm: Sida)
Kelaher, Margaret, Naomi Berman, Lindy Joubert, Steve Curry, Richard Jones, Janet Stanley and Victoria Johnson (2007) ‘Methodological approaches to evaluating the impact of community arts on health’, UNESCO Observatory e-Journal, 1(1), 1–20.
Laidlaw Foundation (2010) Most Significant Change. Accessed 1 November 2012. Available at: http://www.laidlawfdn.org/most-significant-change.
Matarasso, François (1996) Defining Values: Evaluating Arts Programs (London: Comedia).
McCarthy, Kevin, Elizabeth Ondaatje, Laura Zakaras and Arthur Brooks (2004 ) Gifts of the Muse: Reframing the Debate about the Benefits of the Arts (Santa Monica: RAND Corporation).
McGillivray, Mark (2009) The United Nations Development Programme (UNDP) Human Development Index and Measuring Wellbeing across Nations, lecture, Deakin University, 19 June.
McQueen-Thomson, Douglas, Paul James and Chris Ziguras (2004) Promoting Mental Health and Wellbeing through Community and Cultural Development (Melbourne: VicHealth).
McQueen-Thompson, Douglas, and Chris Ziguras (2002) Promoting Mental Health and Wellbeing through Community and Cultural Development: A Review of Literature Focusing on Community Arts Practice (Melbourne: Globalism Institute and VicHealth).
Mills, Deborah, Paul Brown, and Australia Council (2004) Art and wellbeing (Surry Hills: Australia Council).
Morra-Imas, Linda and Ray Rist (2009) The Road to Results: Designing and Conducting Effective Development Evaluations (Washington, DC: World Bank).
Mulligan, Martin, and Pia Smith (2010) Art, Governance and the Turn to Community (Melbourne: RMIT University).
NEA (National Endowment for the Arts) (2014) Grants for Organizations. Accessed 16 October 2014. Available at: http://arts.gov/grants/.
Nicholls, Jeremy, Ellis Lawlor, Eva Neitzert and Tim Goodspeed for the Scottish Office of the Third Sector (2009) A Guide to Social Return on Investment (United Kingdom: New Economics Foundation).
O’Brien, Dave (2010) Measuring the Value of Culture: A Report to the Department for Culture, Media and Sport (London: Department for Culture, Media and Sport).
O’Toole, Linda (2014) Learning for Well-being (Brussels: Learning for Wellbeing Foundation). Available at: http://www.learningforwellbeing.org/sites/default/files/L4WB_TheEssentials%20-%20Brochure.pdf.
Pope, Jeanette (2011) Indicators of Community Strength in Victoria: Framework and Evidence. Why Social Capital can build More Resilient Families and Communities (Melbourne: Victorian Department of Planning and Community Development).
Radbourne, Jennifer, Katya Johanson and Hilary Glow (2010) ‘Empowering audiences to measure quality’, Participations: Journal of Audience & Reception Studies, 7 ( 2), 360–379.
Rosenberg, Michael (2008) ‘The evaluation game: determining the benefits of arts engagement on health’, in Andrea Lewis and David Doyle (eds) Proving the Practice: Evidencing the Effects of Community Arts Programs on Mental Health (Perth: DADAA Publishing), 122–131.
Scott, Carol, and Barbara Soren (2009) ‘Introduction to the special issue — exploring the value of museums’, Museum Management and Curatorship, 24 (3), 189–193.
Seligman, Martin (2011) Flourish: A Visionary New Understanding of Happiness and Wellbeing (New York: Simon & Schuster)
South, Jane (2004) Community-based Arts for Health (Leeds: Metropolitan University).
Stern, Mark, and Susan Seifert (2009) Civic Engagement and the Arts: Issues of Conceptualization and Measurement. (Pennsylvania: Animating Democracy).
Throsby, David (2001) Economics and Culture (Cambridge: Cambridge University Press).
Treasure, Wilfred (2011) Diagnosis and risk management in primary care: words that count, numbers that speak (Oxford: Radcliffe).
UCLG (United Cities and Local Governments) (2010) Culture: The Fourth Pillar of Sustainable Development (Barcelona: UCLG).
UNESCO (2014) Culture for Development Indicators (Paris: UNESCO).
UNESCO (2009) Framework for Cultural Statistics (Montreal: UNESCO).
Ware, Colin (2012) Information Visualization: Perception for Design (Massachusetts: Elsevier).
West, Sue, and Di Cox (2009) A Local Government Reporting Framework for the 21st Century (Melbourne: Community Indicators Victoria).
WolfBrown (2014) Intrinsicimpact.org: measure what matters, website. Accessed 12 June 2014. Available at: https://dashboard.intrinsicimpact.org/demo.
Editor information
Editors and Affiliations
Copyright information
© 2015 Kim Dunphy
About this chapter
Cite this chapter
Dunphy, K. (2015). A Holistic Framework for Evaluation of Arts Engagement. In: MacDowall, L., Badham, M., Blomkamp, E., Dunphy, K. (eds) Making Culture Count. New Directions in Cultural Policy Research. Palgrave Macmillan, London. https://doi.org/10.1007/978-1-137-46458-3_16
Download citation
DOI: https://doi.org/10.1007/978-1-137-46458-3_16
Publisher Name: Palgrave Macmillan, London
Print ISBN: 978-1-349-56539-9
Online ISBN: 978-1-137-46458-3
eBook Packages: Palgrave Media & Culture CollectionLiterature, Cultural and Media Studies (R0)