Skip to main content
Top

2014 | OriginalPaper | Chapter

15. A Hybrid VFT-GQM Method for Developing Performance Criteria and Measures

Authors : Corlane Barclay, Kweku-Muata Osei-Bryson

Published in: Advances in Research Methods for Information Systems Research

Publisher: Springer US

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter utilizes the principles of the Value Focused Thinking (VFT) and Goal Question Metric (GQM) to present a tool for managing the foundation processes of projects, programs and portfolios. The Project Performance Development Framework (PPDF) promotes the use of formal steps for identifying project criteria and measures that are used as the basis to evaluate the performance of the project. It addresses critical problems in project management where objectives typically are not clearly defined and stakeholders have multiple views and objectives on what is important to them in the project, which in turn impacts how the project performance is perceived. The PPDF has several iterative steps including stakeholder identification, objectives identification and structuring, definition of project measurement and prioritization to aid in stakeholder management and project objectives identification, prioritization and management. The PPDF artifact presented is demonstrated and evaluated for utility through a single Process Quality Management Development Project. The findings support the goals of PPDF and show that the formal approach provides added advantages in identifying important values of the stakeholders thereby improving the likelihood of managing stakeholders’ needs and achieving identified goals.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Agarwal N, Rathod U (2006) Defining ‘success’ for software projects: an exploratory revelation. Int J Proj Manage 24(4):358–370CrossRef Agarwal N, Rathod U (2006) Defining ‘success’ for software projects: an exploratory revelation. Int J Proj Manage 24(4):358–370CrossRef
go back to reference Ala-Risku T, Kärkkäinen M (2006) Material delivery problems in construction projects: a possible solution. Int J Prod Econ 104(1):19–29CrossRef Ala-Risku T, Kärkkäinen M (2006) Material delivery problems in construction projects: a possible solution. Int J Prod Econ 104(1):19–29CrossRef
go back to reference Alleman GB (2005) Agile project management for it projects. In: Y-HK, Carayannis EG, Anbari FT (eds) The story of managing projects: an interdisciplinary approach. Greenwood Press, New York, pp 373 Alleman GB (2005) Agile project management for it projects. In: Y-HK, Carayannis EG, Anbari FT (eds) The story of managing projects: an interdisciplinary approach. Greenwood Press, New York, pp 373
go back to reference APM (2006) The apm body of knowledge, 5th edn. The Association of Project Management APM (2006) The apm body of knowledge, 5th edn. The Association of Project Management
go back to reference Arshinder, Kanda A, Deshmukh SG (2008) Supply chain coordination: Perspectives, empirical studies and research directions. Int J Prod Econ 115(2):316–335 Arshinder, Kanda A, Deshmukh SG (2008) Supply chain coordination: Perspectives, empirical studies and research directions. Int J Prod Econ 115(2):316–335
go back to reference Atkinson R (1999) Project management: Cost, time and quality, two best guesses and a phenomenon, its time to accept other success criteria. Int J Proj Manage 17(6):337–342CrossRef Atkinson R (1999) Project management: Cost, time and quality, two best guesses and a phenomenon, its time to accept other success criteria. Int J Proj Manage 17(6):337–342CrossRef
go back to reference Atkinson R, Crawford L, Ward S (2006) Fundamental uncertainties in projects and the scope of project management. Int J Proj Manage 24:687–698CrossRef Atkinson R, Crawford L, Ward S (2006) Fundamental uncertainties in projects and the scope of project management. Int J Proj Manage 24:687–698CrossRef
go back to reference Azzone G, Masella C, Bertele U (1991) Design of performance measures for time-based companies. Int J Oper Prod Manage 11(3):77–85CrossRef Azzone G, Masella C, Bertele U (1991) Design of performance measures for time-based companies. Int J Oper Prod Manage 11(3):77–85CrossRef
go back to reference Baccarini D (1999) The logical framework method for defining project success. Proj Manage J 30(4):25–32 Baccarini D (1999) The logical framework method for defining project success. Proj Manage J 30(4):25–32
go back to reference Barclay C (2008) Towards an integrated measurement of is project performance: The project performance scorecard. Inf Syst Front 10:331–345CrossRef Barclay C (2008) Towards an integrated measurement of is project performance: The project performance scorecard. Inf Syst Front 10:331–345CrossRef
go back to reference Barclay C, Osei-Bryson KM (2008) The project objectives measurement model (POMM): An alternative view to information systems project measurement. Electron J Inf Syst Eval 11(3):139–154 Barclay C, Osei-Bryson KM (2008) The project objectives measurement model (POMM): An alternative view to information systems project measurement. Electron J Inf Syst Eval 11(3):139–154
go back to reference Basili VR (1999) Foreword. In: Solingen R, Berghout E (eds) The goal/question/metric method, a practical method for quality improvement of software development. McGraw Hill, London Basili VR (1999) Foreword. In: Solingen R, Berghout E (eds) The goal/question/metric method, a practical method for quality improvement of software development. McGraw Hill, London
go back to reference Basili VR, Weiss DM (1984) A methodology for collecting valid software engineering data. IEEE Trans Softw Eng 10(6):728–738CrossRef Basili VR, Weiss DM (1984) A methodology for collecting valid software engineering data. IEEE Trans Softw Eng 10(6):728–738CrossRef
go back to reference Belassi W, Tukel OI (1996) A new framework for determining critical success/failure factors in projects. Int J Proj Manage 14(3):141–151CrossRef Belassi W, Tukel OI (1996) A new framework for determining critical success/failure factors in projects. Int J Proj Manage 14(3):141–151CrossRef
go back to reference Bhushan N, Rai K (2004) Strategic decision making: applying the analytic hierarchy process. Springer, London Bhushan N, Rai K (2004) Strategic decision making: applying the analytic hierarchy process. Springer, London
go back to reference Bourne L, Walker DHT (2006) Using a visualising tool to study stakeholder influence—two australian examples. Proj Manage J 37(1):5–21 Bourne L, Walker DHT (2006) Using a visualising tool to study stakeholder influence—two australian examples. Proj Manage J 37(1):5–21
go back to reference Bryde DJ, Robinson L (2005) Client versus contractor perspectives on project success criteria. Int J Proj Manage 23(8):622–629CrossRef Bryde DJ, Robinson L (2005) Client versus contractor perspectives on project success criteria. Int J Proj Manage 23(8):622–629CrossRef
go back to reference Brynjolfsson E (1993) The productivity paradox of information technology. Commun ACM 36(12):67–77CrossRef Brynjolfsson E (1993) The productivity paradox of information technology. Commun ACM 36(12):67–77CrossRef
go back to reference Bryson N (1997) Supporting consensus formation in group support systems using the qualitative discriminant process. Interface between information systems and operations research. Ann Oper Res 71:75–91 Bryson N (1997) Supporting consensus formation in group support systems using the qualitative discriminant process. Interface between information systems and operations research. Ann Oper Res 71:75–91
go back to reference Cannon-Bowers JA, Salas E, Converse S (1993) Shared mental models in expert team decision making. In: Castellan JNJ (ed) Individual and group decision making: current issues. Lawrence Erlbaum, Hillsdale, pp 221–246 Cannon-Bowers JA, Salas E, Converse S (1993) Shared mental models in expert team decision making. In: Castellan JNJ (ed) Individual and group decision making: current issues. Lawrence Erlbaum, Hillsdale, pp 221–246
go back to reference Caldiera VRBG, Rombach HD (1994) The goal question metric approach. Encycl Softw Eng 2:528–532. Caldiera VRBG, Rombach HD (1994) The goal question metric approach. Encycl Softw Eng 2:528–532.
go back to reference Chen SC, Dhillon GS (2003) Interpreting dimensions of consumer trust in e-commerce. J Inf Technol Manage 4(2–3):303–318 Chen SC, Dhillon GS (2003) Interpreting dimensions of consumer trust in e-commerce. J Inf Technol Manage 4(2–3):303–318
go back to reference CMMI (2002) Capability maturity model® integration (cmmism), version 1.1, cmu/sei-2002-tr-011 CMMI (2002) Capability maturity model® integration (cmmism), version 1.1, cmu/sei-2002-tr-011
go back to reference Cohen DJ, Graham RJ (2001) The project manager’s mba: How to translate project decisions into business success. Wiley, London Cohen DJ, Graham RJ (2001) The project manager’s mba: How to translate project decisions into business success. Wiley, London
go back to reference Collins A, Baccarini D (2004) Project success—a survey. J Constr Res 5(2):211–231CrossRef Collins A, Baccarini D (2004) Project success—a survey. J Constr Res 5(2):211–231CrossRef
go back to reference Cooke-Davies T (2002) The “real” success factors on projects. Int J Proj Manage 20(3):185–190CrossRef Cooke-Davies T (2002) The “real” success factors on projects. Int J Proj Manage 20(3):185–190CrossRef
go back to reference Darke P, Shanks G, Broadbent M (1998) Sucessfully completing case study research: Combining rigor, relevance and pragmatism. Inf Syst J 8:273–289CrossRef Darke P, Shanks G, Broadbent M (1998) Sucessfully completing case study research: Combining rigor, relevance and pragmatism. Inf Syst J 8:273–289CrossRef
go back to reference Dhillon G, Torkzadeh G (2006) Value-focused assessment of information system security in organizations. Inf Syst J 16:293–314CrossRef Dhillon G, Torkzadeh G (2006) Value-focused assessment of information system security in organizations. Inf Syst J 16:293–314CrossRef
go back to reference Dixon JR, Nanni AJ, Vollmann TE (1990) New performance challenge: Measuring operations for world-class competition (irwin/apics series in production management). McGraw-Hill Professional Publishing, Homewood Dixon JR, Nanni AJ, Vollmann TE (1990) New performance challenge: Measuring operations for world-class competition (irwin/apics series in production management). McGraw-Hill Professional Publishing, Homewood
go back to reference Drevin L, Kruger HA, Steyn T (2007) Value-focused assessment of ict security awareness in an academic environment. Comput & Secur 26(1):36–43CrossRef Drevin L, Kruger HA, Steyn T (2007) Value-focused assessment of ict security awareness in an academic environment. Comput & Secur 26(1):36–43CrossRef
go back to reference Engwall M (2003) No project is an island: Linking projects to history and context. Res Policy 32:789–808CrossRef Engwall M (2003) No project is an island: Linking projects to history and context. Res Policy 32:789–808CrossRef
go back to reference Esteves JM, Pastor J, Casanovas J (2003) A goal/question/metric research proposal to monitor user involvement and participation in ERP implementation projects. Paper presented at the information resources management association conference (IRMA), Philadelphia, USA Esteves JM, Pastor J, Casanovas J (2003) A goal/question/metric research proposal to monitor user involvement and participation in ERP implementation projects. Paper presented at the information resources management association conference (IRMA), Philadelphia, USA
go back to reference Ewusi-Mensah K (1997) Critical issues in abandoned information systems development projects. Commun ACM 40(9):71–80CrossRef Ewusi-Mensah K (1997) Critical issues in abandoned information systems development projects. Commun ACM 40(9):71–80CrossRef
go back to reference Fitzgerald G (1998) Evaluating information systems project: a multidimensional approach. J Inf Technol 13(1):15–27CrossRef Fitzgerald G (1998) Evaluating information systems project: a multidimensional approach. J Inf Technol 13(1):15–27CrossRef
go back to reference Folan P, Browne J (2005) A review of performance measurement: towards performance management. Comput Ind 56:663–680CrossRef Folan P, Browne J (2005) A review of performance measurement: towards performance management. Comput Ind 56:663–680CrossRef
go back to reference Fortune J, White D (2006) Framing of project critical success factors by a systems model. Int J Proj Manage 24(1):53–65CrossRef Fortune J, White D (2006) Framing of project critical success factors by a systems model. Int J Proj Manage 24(1):53–65CrossRef
go back to reference Freeman M, Beale P (1992) Measuring project success. Proj Manage J 23(1):8–17 Freeman M, Beale P (1992) Measuring project success. Proj Manage J 23(1):8–17
go back to reference Glass RL (2005) IT failure rates—70% or 10–15%?. Software IEEE 22(3):112–111 Glass RL (2005) IT failure rates—70% or 10–15%?. Software IEEE 22(3):112–111
go back to reference Globerson S (1985) Issues in developing a performance criteria system for an organisation. Int J Prod Res 23(4):639–646CrossRef Globerson S (1985) Issues in developing a performance criteria system for an organisation. Int J Prod Res 23(4):639–646CrossRef
go back to reference Hartman F, Ashrafi RA (2002) Project management in the lnformation systems and lnformation technologies industries. Proj Manage J 33(3):5–15 Hartman F, Ashrafi RA (2002) Project management in the lnformation systems and lnformation technologies industries. Proj Manage J 33(3):5–15
go back to reference Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. MIS Q 28(1):75–105 Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. MIS Q 28(1):75–105
go back to reference Huber G (1991) Organizational learning: the contributing processes and the literatures. Organ Sci 2(1):88–115CrossRef Huber G (1991) Organizational learning: the contributing processes and the literatures. Organ Sci 2(1):88–115CrossRef
go back to reference ISO/IEC (2000) Quality management systems—requirements: international organization for standardization ISO/IEC (2000) Quality management systems—requirements: international organization for standardization
go back to reference Kaplan RS, Norton DP (1992) The balanced scorecard: Measures that drive performance. Harvard Bus Rev 70(1):71–79 Kaplan RS, Norton DP (1992) The balanced scorecard: Measures that drive performance. Harvard Bus Rev 70(1):71–79
go back to reference Katzenbach JR, Smith DK (2003) The wisdom of teams: Creating the high-performance organization. Harper Collins, New York Katzenbach JR, Smith DK (2003) The wisdom of teams: Creating the high-performance organization. Harper Collins, New York
go back to reference Keeney RL (1992) Value-focused thinking: a path to creative decision making. Harvard University Press, Cambridge Keeney RL (1992) Value-focused thinking: a path to creative decision making. Harvard University Press, Cambridge
go back to reference Keeney RL (1996) Value-focused thinking: identifying decision opportunities and creating alternatives. Eur J Oper Res 92:537–549CrossRef Keeney RL (1996) Value-focused thinking: identifying decision opportunities and creating alternatives. Eur J Oper Res 92:537–549CrossRef
go back to reference KPMG (2005) Global it project management survey: KPMG Information Risk Management KPMG (2005) Global it project management survey: KPMG Information Risk Management
go back to reference Kumar RL (2003) Understanding the value of information technology enabled responsiveness. Electron J Inf Syst Eval, EJISE 1(1) Kumar RL (2003) Understanding the value of information technology enabled responsiveness. Electron J Inf Syst Eval, EJISE 1(1)
go back to reference Leonard-Barton D (1990) A dual methodology for case studies: synergistic use of a longitudinal single site with replicated multiple sites. Organ Sci 1(3):248–266 Leonard-Barton D (1990) A dual methodology for case studies: synergistic use of a longitudinal single site with replicated multiple sites. Organ Sci 1(3):248–266
go back to reference Lim CS, Mohamed MZ (1999) Criteria of project success: an exploratory re-examination. Int J Proj Manage 17(4):243–248CrossRef Lim CS, Mohamed MZ (1999) Criteria of project success: an exploratory re-examination. Int J Proj Manage 17(4):243–248CrossRef
go back to reference Lyytinen K, Hirschheim R (1988) Information systems failures—a survey and classification of the empirical literature. In: Zorkoczy P (ed) Oxford surveys in information technology. Oxford University Press Inc, New York, pp 257–309 Lyytinen K, Hirschheim R (1988) Information systems failures—a survey and classification of the empirical literature. In: Zorkoczy P (ed) Oxford surveys in information technology. Oxford University Press Inc, New York, pp 257–309
go back to reference March ST, Smith GF (1995) Design and natural science research on information technology. Decis Support Syst 15:251–266CrossRef March ST, Smith GF (1995) Design and natural science research on information technology. Decis Support Syst 15:251–266CrossRef
go back to reference Martinsons M, Davison R, Tse D (1999) The balanced scorecard: a foundation for the strategic management of information systems. Decis Support Syst 25:71–88CrossRef Martinsons M, Davison R, Tse D (1999) The balanced scorecard: a foundation for the strategic management of information systems. Decis Support Syst 25:71–88CrossRef
go back to reference Melville N, Kraemer K, Gurbaxani V (2004) Review: information technology and organisational performance: An integrative model of it business value. MIS Q 28(2):283–322 Melville N, Kraemer K, Gurbaxani V (2004) Review: information technology and organisational performance: An integrative model of it business value. MIS Q 28(2):283–322
go back to reference Milis K, Mercken R (2002) Success factors regarding the implementation of ict investment projects. Int J Prod Econ 80(1):105–117CrossRef Milis K, Mercken R (2002) Success factors regarding the implementation of ict investment projects. Int J Prod Econ 80(1):105–117CrossRef
go back to reference Morris P (2004) Current trends in project and programme management. Association for Project Management (APM), High Wycombe Morris P (2004) Current trends in project and programme management. Association for Project Management (APM), High Wycombe
go back to reference Nelson RR (2005) Project retrospectives: evaluating project success, failure and everything in between. MIS Q Executive 4(3):361–372 Nelson RR (2005) Project retrospectives: evaluating project success, failure and everything in between. MIS Q Executive 4(3):361–372
go back to reference Niebecker K, Eager D, Kubitza K (2008) Improving cross-company project management performance with a collaborative project scorecard. Int J Manag Proj Bus 1(3):368–386CrossRef Niebecker K, Eager D, Kubitza K (2008) Improving cross-company project management performance with a collaborative project scorecard. Int J Manag Proj Bus 1(3):368–386CrossRef
go back to reference PMI (2004) A guide to project management body of knowledge, 3rd edn. Project Management Institute, Newtown Square PMI (2004) A guide to project management body of knowledge, 3rd edn. Project Management Institute, Newtown Square
go back to reference Pouloudi A, Whitley EA (1997) Stakeholder identification in inter-organizational systems: Gaining insights for drug use management systems. Eur J Inf Syst 6:1–14CrossRef Pouloudi A, Whitley EA (1997) Stakeholder identification in inter-organizational systems: Gaining insights for drug use management systems. Eur J Inf Syst 6:1–14CrossRef
go back to reference Saaty TL (1990) How to make a decision: the analytic hierarchy process. Eur J Oper Res 48(1):9–26CrossRef Saaty TL (1990) How to make a decision: the analytic hierarchy process. Eur J Oper Res 48(1):9–26CrossRef
go back to reference Sharp H, Finkelstein A, Galal G (1999) Stakeholder identification in the requirements engineering process. Paper presented at the 10th international workshop on database & expert systems applications Sharp H, Finkelstein A, Galal G (1999) Stakeholder identification in the requirements engineering process. Paper presented at the 10th international workshop on database & expert systems applications
go back to reference Shenhar AJ, Dvir D, Levy O, Maltz AC (2001) Project success: a multi-dimensional strategic perspective. Long Range Plan 34:699–725CrossRef Shenhar AJ, Dvir D, Levy O, Maltz AC (2001) Project success: a multi-dimensional strategic perspective. Long Range Plan 34:699–725CrossRef
go back to reference Shenhar AJ, Tisler A, Dvir D, Lipostevsky S, Lechler T (2002) Refining the search for project success factors: a multivariate typographical approach. R & D Manage 32(2):111–126CrossRef Shenhar AJ, Tisler A, Dvir D, Lipostevsky S, Lechler T (2002) Refining the search for project success factors: a multivariate typographical approach. R & D Manage 32(2):111–126CrossRef
go back to reference Siau K, Sheng H, Nah FF-H (2004) The value of mobile commerce to customers. Paper presented at the third annual workshop on HCI research in MIS, Washington, D.C. Siau K, Sheng H, Nah FF-H (2004) The value of mobile commerce to customers. Paper presented at the third annual workshop on HCI research in MIS, Washington, D.C.
go back to reference Stewart RA (2008) A framework for the life cycle management of information technology projects: ProjectIT. Int J Proj Manage 26:203–212CrossRef Stewart RA (2008) A framework for the life cycle management of information technology projects: ProjectIT. Int J Proj Manage 26:203–212CrossRef
go back to reference Thamhain H (1994) Designing modern project management systems for a radically changing world. Proj Manage J 25(4):6 Thamhain H (1994) Designing modern project management systems for a radically changing world. Proj Manage J 25(4):6
go back to reference The Standish Group (2004) 2004 third quarter research report: The standish group international The Standish Group (2004) 2004 third quarter research report: The standish group international
go back to reference Wateridge J (1998) How can is/it projects be measured for success? Int J Proj Manage 16(1):59–63CrossRef Wateridge J (1998) How can is/it projects be measured for success? Int J Proj Manage 16(1):59–63CrossRef
go back to reference Wegelius-Lehtonen T (2001) Performance measurement in construction logistics. Int J Prod Econ 69(1):107–116CrossRef Wegelius-Lehtonen T (2001) Performance measurement in construction logistics. Int J Prod Econ 69(1):107–116CrossRef
go back to reference White D, Fortune J (2002) Current practice in project management—an empirical study. Int J Proj Manage 20:1–11CrossRef White D, Fortune J (2002) Current practice in project management—an empirical study. Int J Proj Manage 20:1–11CrossRef
go back to reference Winter M, Smith C, Cooke-Davies T, Cicmil S (2006a) The importance of ‘process’ in rethinking project management: the story of a uk government-funded research network. Int J Proj Manage 24:650–662CrossRef Winter M, Smith C, Cooke-Davies T, Cicmil S (2006a) The importance of ‘process’ in rethinking project management: the story of a uk government-funded research network. Int J Proj Manage 24:650–662CrossRef
go back to reference Winter M, Smith C, Morris P, Cicmil S (2006b) Directions for future research in project management: the main findings of a uk government-funded research network. Int J Proj Manage 24:638–649CrossRef Winter M, Smith C, Morris P, Cicmil S (2006b) Directions for future research in project management: the main findings of a uk government-funded research network. Int J Proj Manage 24:638–649CrossRef
go back to reference Yin RK (1994) Case study research: design and methods, 2nd edn. Sage Publishing, Beverly Hills Yin RK (1994) Case study research: design and methods, 2nd edn. Sage Publishing, Beverly Hills
go back to reference Yin RK (2003) Case study research: designs and methods, 3rd edn. Sage Publishing, Beverly Hills Yin RK (2003) Case study research: designs and methods, 3rd edn. Sage Publishing, Beverly Hills
Metadata
Title
A Hybrid VFT-GQM Method for Developing Performance Criteria and Measures
Authors
Corlane Barclay
Kweku-Muata Osei-Bryson
Copyright Year
2014
Publisher
Springer US
DOI
https://doi.org/10.1007/978-1-4614-9463-8_15

Premium Partner