Skip to main content
Top
Published in: Research in Engineering Design 3/2019

16-03-2019 | Original Paper

Design decisions: concordance of designers and effects of the Arrow’s theorem on the collective preference ranking

Authors: Fiorenzo Franceschini, Domenico Maisano

Published in: Research in Engineering Design | Issue 3/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The problem of collective decision by design teams has received considerable attention in the scientific literature of engineering design. A much debated problem is that in which multiple designers formulate their individual preference rankings of different design alternatives and these rankings should be aggregated into a collective one. This paper focuses the attention on three basic research questions: (1) “How can the degree of concordance of designer rankings be measured?”, (2) “For a given set of designer rankings, which aggregation model provides the most coherent solution?”, and (3) “To what extent is the collective ranking influenced by the aggregation model in use?”. The aim of this paper is to present a novel approach that addresses the above questions in a relatively simple and agile way. A detailed description of the methodology is supported by a practical application to a real-life case study.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
This concept will be clarified later.
 
2
I.e., the solution that best reflects designer rankings.
 
Literature
go back to reference Arrow KJ (2012) Social choice and individual values, 3rd edn. Yale University Press, New HavenMATH Arrow KJ (2012) Social choice and individual values, 3rd edn. Yale University Press, New HavenMATH
go back to reference Arrow KJ, Rayanaud H (1986) Social choice and multicriterion decision-making. MIT Press, CambridgeMATH Arrow KJ, Rayanaud H (1986) Social choice and multicriterion decision-making. MIT Press, CambridgeMATH
go back to reference Borda JC (1781) Mémoire sur les élections au scrutin, Comptes Rendus de l’Académie des Sciences. Translated by Alfred de Grazia as Mathematical derivation of an election system. Isis 44:42–51 Borda JC (1781) Mémoire sur les élections au scrutin, Comptes Rendus de l’Académie des Sciences. Translated by Alfred de Grazia as Mathematical derivation of an election system. Isis 44:42–51
go back to reference Bormann NC, Golder M (2013) Democratic electoral systems around the world. Electoral Stud 32(2):1946–2011, 360–369CrossRef Bormann NC, Golder M (2013) Democratic electoral systems around the world. Electoral Stud 32(2):1946–2011, 360–369CrossRef
go back to reference Cagan J, Vogel CM (2012) Creating breakthrough products: innovation from product planning to program approval, 2nd edn. FT Press, Upper Saddle River Cagan J, Vogel CM (2012) Creating breakthrough products: innovation from product planning to program approval, 2nd edn. FT Press, Upper Saddle River
go back to reference Chen S, Liu J, Wang H, Augusto JC (2012) Ordering based decision making—a survey. Inf Fusion 14(4):521–531CrossRef Chen S, Liu J, Wang H, Augusto JC (2012) Ordering based decision making—a survey. Inf Fusion 14(4):521–531CrossRef
go back to reference Chiclana F, Herrera F, Herrera-Viedma E (2002) A note on the internal consistency of various preference representations. Fuzzy Sets Syst 131(1):75–78MathSciNetMATHCrossRef Chiclana F, Herrera F, Herrera-Viedma E (2002) A note on the internal consistency of various preference representations. Fuzzy Sets Syst 131(1):75–78MathSciNetMATHCrossRef
go back to reference Dong A, Hill AW, Agogino AM (2004) A document analysis method for characterizing design team performance. J Mech Des 126(3):378–385CrossRef Dong A, Hill AW, Agogino AM (2004) A document analysis method for characterizing design team performance. J Mech Des 126(3):378–385CrossRef
go back to reference Dwarakanath S, Wallace KM (1995) Decision-making in engineering design—observations from design experiments. J Eng Des 6(3):191–206CrossRef Dwarakanath S, Wallace KM (1995) Decision-making in engineering design—observations from design experiments. J Eng Des 6(3):191–206CrossRef
go back to reference Dym CL, Wood WH, Scott MJ (2002) Rank ordering engineering designs: pairwise comparison charts and Borda counts. Res Eng Des 13:236–242CrossRef Dym CL, Wood WH, Scott MJ (2002) Rank ordering engineering designs: pairwise comparison charts and Borda counts. Res Eng Des 13:236–242CrossRef
go back to reference Fishburn PC (1973a) Voter concordance, simple majorities, and group decision methods. Behav Sci 18:364–376CrossRef Fishburn PC (1973a) Voter concordance, simple majorities, and group decision methods. Behav Sci 18:364–376CrossRef
go back to reference Fishburn PC (1973b) The theory of social choice. Princeton University Press, PrincetonMATH Fishburn PC (1973b) The theory of social choice. Princeton University Press, PrincetonMATH
go back to reference Franceschini F, Maisano D (2015a) Checking the consistency of the solution in ordinal semi-democratic decision-making problems. Omega 57(1):188–195CrossRef Franceschini F, Maisano D (2015a) Checking the consistency of the solution in ordinal semi-democratic decision-making problems. Omega 57(1):188–195CrossRef
go back to reference Franceschini F, Maisano D (2017) Consistency analysis in quality classification problems with multiple rank-ordered agents. Qual Eng 29(4):672–689CrossRef Franceschini F, Maisano D (2017) Consistency analysis in quality classification problems with multiple rank-ordered agents. Qual Eng 29(4):672–689CrossRef
go back to reference Franceschini F, Maisano D (2018) Fusion of partial orderings for decision problems in quality management. In: Proceedings of the 3rd international conference on quality engineering and management (ICQEM 2018), July 11–13, 2018, Barcelona (Spain) Franceschini F, Maisano D (2018) Fusion of partial orderings for decision problems in quality management. In: Proceedings of the 3rd international conference on quality engineering and management (ICQEM 2018), July 11–13, 2018, Barcelona (Spain)
go back to reference Franceschini F, Maisano D, Mastrogiacomo L (2015b) Customer requirements prioritization on QFD: a new proposal based on the Generalized Yager’s Algorithm. Res Eng Des 26(2):171–187CrossRef Franceschini F, Maisano D, Mastrogiacomo L (2015b) Customer requirements prioritization on QFD: a new proposal based on the Generalized Yager’s Algorithm. Res Eng Des 26(2):171–187CrossRef
go back to reference Franceschini F, Galetto M, Maisano D, Mastrogiacomo L (2015c) Prioritization of engineering characteristics in QFD in the case of customer requirements orderings. Int J Prod Res 53(13):3975–3988CrossRef Franceschini F, Galetto M, Maisano D, Mastrogiacomo L (2015c) Prioritization of engineering characteristics in QFD in the case of customer requirements orderings. Int J Prod Res 53(13):3975–3988CrossRef
go back to reference Franceschini F, Maisano D, Mastrogiacomo L (2016) A new proposal for fusing individual preference orderings by rank-ordered agents: a generalization of the Yager’s algorithm. Eur J Oper Res 249(1):209–223MathSciNetMATHCrossRef Franceschini F, Maisano D, Mastrogiacomo L (2016) A new proposal for fusing individual preference orderings by rank-ordered agents: a generalization of the Yager’s algorithm. Eur J Oper Res 249(1):209–223MathSciNetMATHCrossRef
go back to reference Franceschini F, Galetto M, Maisano D (2019) Designing performance measurement systems: theory and practice of key performance indicators, Springer, Cham. ISBN: 978-3-030-01191-8CrossRef Franceschini F, Galetto M, Maisano D (2019) Designing performance measurement systems: theory and practice of key performance indicators, Springer, Cham. ISBN: 978-3-030-01191-8CrossRef
go back to reference Franssen M (2005) Arrow’s theorem, multi-criteria decision problems and multi-attribute preferences in engineering design. Res Eng Des 16(1–2):42–56CrossRef Franssen M (2005) Arrow’s theorem, multi-criteria decision problems and multi-attribute preferences in engineering design. Res Eng Des 16(1–2):42–56CrossRef
go back to reference Frey DDet al (2009) The Pugh controlled convergence method: model-based evaluation and implications for design theory. Res Eng Des 20(1):41–58CrossRef Frey DDet al (2009) The Pugh controlled convergence method: model-based evaluation and implications for design theory. Res Eng Des 20(1):41–58CrossRef
go back to reference Frey DD et al (2010) Research in engineering design: the role of mathematical theory and empirical evidence. Res Eng Des 21(3):145–151CrossRef Frey DD et al (2010) Research in engineering design: the role of mathematical theory and empirical evidence. Res Eng Des 21(3):145–151CrossRef
go back to reference Fu K, Cagan J, Kotovsky K (2010) Design team convergence: the influence of example solution quality. J Mech Des 132(11):111005CrossRef Fu K, Cagan J, Kotovsky K (2010) Design team convergence: the influence of example solution quality. J Mech Des 132(11):111005CrossRef
go back to reference Hazelrigg GA (1996) The implications of Arrow’s impossiblity theorem on approaches to optimal engineering design. J Mech Des 118(2):161–164CrossRef Hazelrigg GA (1996) The implications of Arrow’s impossiblity theorem on approaches to optimal engineering design. J Mech Des 118(2):161–164CrossRef
go back to reference Hazelrigg GA (1999) An axiomatic framework for engineering design. J Mech Des 121(3):342CrossRef Hazelrigg GA (1999) An axiomatic framework for engineering design. J Mech Des 121(3):342CrossRef
go back to reference Hazelrigg GA (2010) The Pugh controlled convergence method: model-based evaluation and implications for design theory. Res Eng Des 21(3):143–144CrossRef Hazelrigg GA (2010) The Pugh controlled convergence method: model-based evaluation and implications for design theory. Res Eng Des 21(3):143–144CrossRef
go back to reference Herrera-Viedma E, Cabrerizo FJ, Kacprzyk J, Pedrycz W (2014) A review of soft consensus models in a fuzzy environment. Inf Fusion 17:4–13CrossRef Herrera-Viedma E, Cabrerizo FJ, Kacprzyk J, Pedrycz W (2014) A review of soft consensus models in a fuzzy environment. Inf Fusion 17:4–13CrossRef
go back to reference Hoyle C, Chen W (2011) Understanding and modelling heterogeneity of human preferences for engineering design. J Eng Des 22(8):583–601CrossRef Hoyle C, Chen W (2011) Understanding and modelling heterogeneity of human preferences for engineering design. J Eng Des 22(8):583–601CrossRef
go back to reference Jacobs JF, van de Poel I, Osseweijer P (2014) Clarifying the debate on selection methods for engineering: Arrow’s impossibility theorem, design performances, and information basis. Res Eng Des 25(1):3–10CrossRef Jacobs JF, van de Poel I, Osseweijer P (2014) Clarifying the debate on selection methods for engineering: Arrow’s impossibility theorem, design performances, and information basis. Res Eng Des 25(1):3–10CrossRef
go back to reference Kaldate A et al (2006) Engineering parameter selection for design optimization during preliminary design. J Eng Des 17(March 2015):291–310CrossRef Kaldate A et al (2006) Engineering parameter selection for design optimization during preliminary design. J Eng Des 17(March 2015):291–310CrossRef
go back to reference Katsikopoulos KV (2012) Decision methods for design: insights from psychology. J Mech Des 134(8):084504CrossRef Katsikopoulos KV (2012) Decision methods for design: insights from psychology. J Mech Des 134(8):084504CrossRef
go back to reference Keeney RL (2009) The foundations of collaborative group decisions. Int J Collab Eng 1:4CrossRef Keeney RL (2009) The foundations of collaborative group decisions. Int J Collab Eng 1:4CrossRef
go back to reference Kendall (1962) Rank correlation methods. Griffin & C., London Kendall (1962) Rank correlation methods. Griffin & C., London
go back to reference Legendre P (2005) Species associations: the Kendall coefficient of concordance revisited. J Agric Biol Environ Stat 10:226CrossRef Legendre P (2005) Species associations: the Kendall coefficient of concordance revisited. J Agric Biol Environ Stat 10:226CrossRef
go back to reference Legendre P (2010) Coefficient of concordance. In: Salkind NJ (ed) Encyclopedia of research design, vol 1. SAGE Publications, Inc., Los Angeles, pp 164–169 Legendre P (2010) Coefficient of concordance. In: Salkind NJ (ed) Encyclopedia of research design, vol 1. SAGE Publications, Inc., Los Angeles, pp 164–169
go back to reference Li H, Bingham JB, Umphress EE (2007) Fairness from the top? Perceived procedural justice and collaborative problem solving in new product development. Organ Sci 18(2):200–216CrossRef Li H, Bingham JB, Umphress EE (2007) Fairness from the top? Perceived procedural justice and collaborative problem solving in new product development. Organ Sci 18(2):200–216CrossRef
go back to reference McComb C, Goucher-Lambert K, Cagan J(2015), Fairness and manipulation: an empirical study of Arrow’s impossibility theorem. In: International conference on engineering design, Milan, Italy, pp 267–276 McComb C, Goucher-Lambert K, Cagan J(2015), Fairness and manipulation: an empirical study of Arrow’s impossibility theorem. In: International conference on engineering design, Milan, Italy, pp 267–276
go back to reference McComb C, Goucher-Lambert K, Cagan J (2017) Impossible by design? Fairness, strategy and Arrow’s impossibility theorem. Des Sci 3:1–26CrossRef McComb C, Goucher-Lambert K, Cagan J (2017) Impossible by design? Fairness, strategy and Arrow’s impossibility theorem. Des Sci 3:1–26CrossRef
go back to reference Nisan N (2007) Algorithmic game theory. Cambridge University Press, CambridgeCrossRef Nisan N (2007) Algorithmic game theory. Cambridge University Press, CambridgeCrossRef
go back to reference Nurmi H (2012) On the relevance of theoretical results to voting system choice. In: Felsenthal DS, Machover M (eds) Electoral systems: studies in choice and welfare. Springer, Berlin, pp 255–274 Nurmi H (2012) On the relevance of theoretical results to voting system choice. In: Felsenthal DS, Machover M (eds) Electoral systems: studies in choice and welfare. Springer, Berlin, pp 255–274
go back to reference Olewnik AT, Lewis K (2008) Limitations of the house of quality to provide quantitative design information. Int J Qual Reliabil Manag 25(2):125–146CrossRef Olewnik AT, Lewis K (2008) Limitations of the house of quality to provide quantitative design information. Int J Qual Reliabil Manag 25(2):125–146CrossRef
go back to reference Önüt S, Kara SS, Efendigil T (2008) A hybrid fuzzy MCDM approach to machine tool selection. J Intell Manuf 19(4):443–453CrossRef Önüt S, Kara SS, Efendigil T (2008) A hybrid fuzzy MCDM approach to machine tool selection. J Intell Manuf 19(4):443–453CrossRef
go back to reference Paulus PB, Dzindolet MT, Kohn N (2011) Collaborative creativity, group creativity and team innovation. In: Mumford MD (ed) Handbook of organizational creativity. Elsevier, Oxford, pp 327–357 Paulus PB, Dzindolet MT, Kohn N (2011) Collaborative creativity, group creativity and team innovation. In: Mumford MD (ed) Handbook of organizational creativity. Elsevier, Oxford, pp 327–357
go back to reference Saari DG (2011b) Decision and elections. Cambridge University Press, Cambridge Saari DG (2011b) Decision and elections. Cambridge University Press, Cambridge
go back to reference Saari DG, Sieberg KK (2004) Are partwise comparisons reliable? Res Eng Des 15(1):62–71CrossRef Saari DG, Sieberg KK (2004) Are partwise comparisons reliable? Res Eng Des 15(1):62–71CrossRef
go back to reference Scott MJ, Antonsson EK (1999) Arrow’s theorem and engineering design decision making. Res Eng Des 11:218–228CrossRef Scott MJ, Antonsson EK (1999) Arrow’s theorem and engineering design decision making. Res Eng Des 11:218–228CrossRef
go back to reference See TK, Lewis K (2006) A formal approach to handling conflicts in multiattribute group decision making. J Mech Des 128(4):678CrossRef See TK, Lewis K (2006) A formal approach to handling conflicts in multiattribute group decision making. J Mech Des 128(4):678CrossRef
go back to reference Weingart LR et al. (2005) Functional diversity and conflict in cross-functional product development teams: considering representational gaps and task characteristics. In Neider LL, Schriesheim CA (eds) Understanding teams. Information Age Publishing, Charlotte, pp 89–110 Weingart LR et al. (2005) Functional diversity and conflict in cross-functional product development teams: considering representational gaps and task characteristics. In Neider LL, Schriesheim CA (eds) Understanding teams. Information Age Publishing, Charlotte, pp 89–110
go back to reference Yeo SH, Mak MW, Balon SAP (2004) Analysis of decision-making methodologies for desirability score of conceptual design. J Eng Des 15(2):195–208CrossRef Yeo SH, Mak MW, Balon SAP (2004) Analysis of decision-making methodologies for desirability score of conceptual design. J Eng Des 15(2):195–208CrossRef
Metadata
Title
Design decisions: concordance of designers and effects of the Arrow’s theorem on the collective preference ranking
Authors
Fiorenzo Franceschini
Domenico Maisano
Publication date
16-03-2019
Publisher
Springer London
Published in
Research in Engineering Design / Issue 3/2019
Print ISSN: 0934-9839
Electronic ISSN: 1435-6066
DOI
https://doi.org/10.1007/s00163-019-00313-9

Other articles of this Issue 3/2019

Research in Engineering Design 3/2019 Go to the issue

Premium Partners