Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
Erschienen in:
An Introduction to Experimental Design Research Kapitel lesen Erstes Kapitel lesen

2016 | OriginalPaper | Buchkapitel

2. Evaluation of Empirical Design Studies and Metrics

verfasst von : Mahmoud Dinar, Joshua D. Summers, Jami Shah, Yong-Seok Park

Erschienen in: Experimental Design Research

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Engineering design is a complex multifaceted and knowledge-intensive process. No single theory or model can capture all aspects of such an activity. Various empirical methods have been used by researchers to study particular aspects of design thinking and cognition, design processes, design artefacts, and design strategies. Research methods include think-aloud protocol analysis and its many variants, case studies, controlled experiments of design cognition, and fMRI. The field has gradually progressed from subjective to objective analyses, requiring well-defined metrics since design of experiments (DOE) involves controlling or blocking particular variables. DOE also requires setting experiment variables at particular levels, which means that each variable needs to be characterized and quantified. Without such quantification, statistical analyses cannot be carried out. This chapter focuses on quantifiable characteristics of designers, targeted users, artefacts, and processes.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Vorheriges Kapitel An Introduction to Experimental Design Research
Nächstes Kapitel Quantitative Research Principles and Methods for Human-Focused Research in Engineering Design
Literatur
Ahn J, Crawford R (1994) Complexity analysis of computational engineering design. In: ASME international design engineering technical conferences and computers and information in engineering conference. ASME, Minneapolis, pp 205–220
Amabile T (1996) Creativity in context: update to the social psychology of creativity. Westview Press, Boulder
Ameri F, Summers JD, Mocko GM, Porter M (2008) Engineering design complexity: an investigation of methods and measures. Res Eng Des 19:161–179CrossRef
Arrighi P, Le Masson P, Weil B (2015) Addressing constraints creatively: how new design software helps solve the dilemma of originality and feasibility. Creat Innov Manag 24:247–260CrossRef
Arrow KJ (1950) A difficulty in the concept of social welfare. J Polit Econ 58:328–346
Balazs M, Brown D (2002) Design simplification by analogical reasoning. In: From knowledge intensive CAD to knowledge intensive engineering. Kluwer Academic Publishers, Norwell, pp 29–44
Barzilai J (2006) Preference modeling in engineering design. In: Lewis KE, Chen W, Schmidt LC (eds) ASME. New York, USA
Bashir HA, Thomson V (2004) Estimating design effort for GE hydro project. Comput Ind Eng 46:195–204CrossRef
Bashir HA, Thomson V (2001) An analogy-based model for estimating design effort. Des Stud 22:157–167CrossRef
Bearden DA (2003) A complexity-based risk assessment of low-cost planetary missions: when is a mission too fast and too cheap? Acta Astronaut 52:371–379CrossRef
Boothroyd G, Dewhurst P, Knight W (2002) Product design for manufacture and assembly. M. Dekker, New York
Braha D, Maimon O (1998a) The measurement of a design structural and functional complexity. IEEE Trans Syst Man Cybern (Part A—Syst Hum) 28:527–535
Braha D, Maimon O (1998b) A mathematical theory of design: foundations, algorithms, and applications. Kluwer Academic Publishers, Dordrecht
Callaghan A, Lewis K (2000) A 2-phase aspiration-level and utility theory approach to large scale design. In: ASME design automation conference, Baltimore, MD, DETC00/DTM-14569. Citeseer
Cham JG, Yang MC (2005) Does sketching skill relate to good design? In: Proceedings of ASME DETC. Long Beach, CA
Chen W, Hoyle C, Wassenaar HJ (2012) Decision-based design: integrating consumer preferences into engineering design. Springer Science & Business Media
Chen W, Hoyle C, Wassenaar HJ (2013) Hierarchical choice modeling to support complex systems design. In: Decision-based design. Springer, pp 205–233
Cheng P, Mugge R, Schoormans JPL (2014) A new strategy to reduce design fixation: presenting partial photographs to designers. Des Stud 35:374–391CrossRef
Chiu I, Salustri FA (2010) Evaluating design project creativity in engineering design courses
Chulvi V, González-Cruz MC, Mulet E, Aguilar-Zambrano J (2012a) Influence of the type of idea-generation method on the creativity of solutions. Res Eng Des 1–9
Chulvi V, Mulet E, Chakrabarti A et al (2012b) Comparison of the degree of creativity in the design outcomes using different design methods. J Eng Des 23:241–269
Cross N (1997) Creativity in design: analyzing and modeling the creative leap. Leonardo 30:311–317
Deerwester S, Dumais ST, Furnas GW et al (1990) Indexing by latent semantic analysis. J Am Soc Inf Sci 41:391–407CrossRef
Dinar M, Shah JJ (2014) Enhancing design problem formulation skills for engineering design students. In: Proceedings of ASME IDETC/CIE. ASME, Buffalo
Dinar M, Danielescu A, MacLellan C et al (2015a) Problem Map: an ontological framework for a computational study of problem formulation in engineering design. J Comput Inf Sci Eng 15:1–10. doi:10.​1115/​1.​4030076
Dinar M, Park Y-S, Shah JJ (2015b) Evaluating the effectiveness of problem formulation and ideation skills learned throughout an engineering design course. In: Proceedings of ASME IDETC/CIE, Boston, MA, USA
Dinar M, Park Y-S, Shah JJ, Langley P (2015c) Patterns of creative design: predicting ideation from problem formulation. In: Proceedings of ASME IDETC/CIE, Boston, MA, USA
Dinar M, Shah JJ, Todeti SR (2015d) Towards a comprehensive test of problem formulation skill in design. In: Chakrabarti A, Taura T, Nagai Y (eds) Proceedings of the third international conference on design creativity. Bangalore, India, pp 19–26
Dixon J, Duffey M, Irani R et al (1988) A proposed taxonomy of mechanical design problems. Computers in engineering conference. ASME, New York, pp 41–46
El-Haik B, Yang K (1999) The components of complexity in engineering design. IIE Trans 31:925–934
Eris O (2002) Perceiving, comprehending, and measuring design activity through the questions asked while designing, Stanford University
Eris O (2004) Effective inquiry for innovative engineering design. Kluwer Academic Publishers, BostonCrossRef
Fishburn PC (1967) Additive utilities with incomplete product set: applications to priorities and sharings
Fitzhorn P (1994) Engineering design as a computable function. Artif Intell Eng Des Anal Manuf 8:35–44CrossRef
Fu K, Cagan J, Kotovsky K, Wood KL (2013a) Discovering structure in design databases through functional and surface based mapping. J Mech Des 135:031006. doi:10.​1115/​1.​4023484
Fu K, Chan J, Cagan J et al (2013b) The meaning of “Near” and “Far”: the impact of structuring design databases and the effect of distance of analogy on design output. J Mech Des 135:021007. doi:10.​1115/​1.​4023158
Glier MW, McAdams DA, Linsey JS (2014) Exploring automated text classification to improve keyword corpus search results for bioinspired design. J Mech Des 136:111103. doi:10.​1115/​1.​4028167
Green M, Seepersad CC, Hölttä-Otto K (2014) Crowd-sourcing the evaluation of creativity in conceptual design: a pilot study. In: Proceedings of ASME IDETC/CIE. ASME, Portland, p V007T07A016
Green PE, Carmone FJ (1970) Multidimensional scaling and related techniques in marketing analysis. Allyn and Bacon, Boston
Green PE, Srinivasan V (1990) Conjoint analysis in marketing: new developments with implications for research and practice. J Mark 54:3–19
Green PE, Srinivasan V (1978) Conjoint analysis in consumer research: issues and outlook. J Consum Res 5:103–123
Green PE, Tull DS (1970) Research for marketing decisions
Gu X, Renaud JE, Ashe LM et al (2002) Decision-based collaborative optimization. J Mech Des 124:1–13CrossRef
Hamade R (2009) Profiling the desirable CAD trainee: technical background, personality attributes, and learning preferences. ASME Trans J Mech Des 131:121–130CrossRef
Harrison W, Magel K (1981) A complexity measure based on nesting level. SIGPLAN Not 16:63–74CrossRef
Hazelrigg GA (1996) The implications of Arrow’s impossibility theorem on approaches to optimal engineering design. Trans Soc Mech Eng J Mech Des 118:161–164
Holtta K, Otto K (2005) Incorporating design effort complexity measures in product architectural design and assessment. Des Stud 26:463–485CrossRef
Hoyle C, Chen W, Wang N, Koppelman FS (2010) Integrated Bayesian hierarchical choice modeling to capture heterogeneous consumer preferences in engineering design. J Mech Des 132:121010CrossRef
Hoyle C, Chen W (2007) Next generation QFD: decision-based product attribute function deployment
Hoyle CJ, Chen W (2009) Product attribute function deployment (PAFD) for decision-based conceptual design. Eng Manag IEEE Trans 56:271–284CrossRef
Johnson RM (1970) Multiple discriminant analysis: applications to marketing research. Market Facts, Incorporated
Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Global Optim 13(4):455–492
Joshi S, Summers JD (2012) Representation: metrics for analyzing sketches. In: International design engineering technical conferences and computers and information in engineering conference, Chicago, IL, pp DETC2012–71425
Kogure M, Akao Y (1983) Quality function deployment and CWQC in Japan. Qual Prog 16:25–29
Kolmogorov A (1983) Combinatorial foundations of information theory and the calculus of probabilities. Russ Math Surv 38:29–40MathSciNetCrossRefMATH
Landauer TK, Foltz PW, Laham D (1998) An introduction to latent semantic analysis. Discourse Process 25:259–284CrossRef
Lau K, Oehlberg L, Agogino A (2009) Sketching in design journals: an analysis of visual representations in the product design process. Eng Des Graph J 73
Le Dain M-A, Blanco E, Summers JD (2013) Assessing design research quality: investigating verification and validation criteria. In: International conference on engineering design. The Design Society, Seoul
Lee JH, Gu N, Ostwald MJ (2015) Creativity and parametric design? Comparing designer’s cognitive approaches with assessed levels of creativity. Int J Des Creat Innov 3:78–94CrossRef
Linsey JS, Clauss EF, Kurtoglu T et al (2011) An experimental study of group idea generation techniques: understanding the roles of idea representation and viewing methods. J Mech Des 133:031008. doi:10.​1115/​1.​4003498 CrossRef
Linsey JS, Green MG, Murphy J, Wood K (2005a) Collaborating to Success: an experimental study of group idea generation techniques. In: Proceedings of the IDETC/CIE 2005 conference. ASME, Long Beach, CA, pp DETC2005–85351
Linsey JS, Green MG, Van Wie M, et al (2005b) Functional representations in conceptual design: a first study in experimental design and evaluation. In: Proceedings of 2005 American society for engineering education annual conference. Citeseer
Linsey JS, Viswanathan VK (2014) Overcoming cognitive challenges in bioinspired design and analogy. In: Biologically inspired design. Springer, pp 221–244
Linsey JS, Wood KL, Markman AB (2008) Modality and representation in analogy. AI EDAM (Artificial Intell Eng Des Anal Manuf) 22:85
Mathieson JL, Summers JD (2010) Complexity metrics for directional node-link system representations: theory and applications. In: ASME international design engineering technical conferences and computers and information in engineering conference. ASME, Montreal, Canada, pp DETC2010–28561
Mathieson JL, Summers JD (2009) Relational DSMs in connectivity complexity measurement. In: Proceedings of the 11th international DSM conference, pp 15–26
McGown A, Green G, Rodgers PA (1998) Visible ideas: information patterns of conceptual sketch activity. Des Stud 19:431–453CrossRef
McKoy FL, Vargas-Hernandez N, Summers JD, Shah JJ (2001) Influence of design representation on effectiveness of idea generation
Namouz E, Summers JD (2014) Comparison of graph generation methods for structural complexity based assembly time estimation. ASME Trans J Comput Inf Sci Eng 14:021003. doi:10.​1115/​1.​4026293 CrossRef
Oman S, Tumer IY, Stone R (2014) Reducing the subjectivity in creativity assessment. In: Proceedings of ASME IDETC/CIE. ASME, Portland, p V007T07A043
Oman SK, Tumer IY, Wood KL, Seepersad C (2012) A comparison of creativity and innovation metrics and sample validation through in-class design projects. Res Eng Des 24:65–92. doi:10.​1007/​s00163-012-0138-9 CrossRef
Owensby JE, Namouz EZ, Shanthakumar A, Summers JD (2012) Representation: extracting mate complexity from assembly models to automatically predict assembly times. In: ASME international design engineering technical conferences and computers and information in engineering conference. ASME, Chicago, IL, pp DETC2012–70995
Owensby JE, Summers JD (2014) Assembly time estimation: assembly mate based structural complexity metric predictive modelling. ASME Trans J Comput Inf Sci Eng. doi:10.​1115/​1.​4025808
Pahl G, Beitz W, Wallace K, Blessing L (2007) Engineering design: a systematic approach, 3rd edn. Springer-Verlag, London Limited, LondonCrossRef
Park YS (2014) Theory and methodology for forming creative design teams in a globally distributed and culturally diverse environment
Phukan A, Kalava M, Prabhu V (2005) Complexity metrics for manufacturing control architecture based on software and information flow. Comput Ind Eng 49:1–20CrossRef
Pugh S (1991) Total design: integrated methods for successful product engineering. Addison-Wesley Publishing Company, Workingham
Pugh S, Clausing D (1996) Creating innovtive products using total design: the living legacy of Stuart Pugh. Addison-Wesley Longman Publishing Co., Inc
Ramachandran R, Caldwell BW, Mocko GM (2011) A user study to evaluate the functional model and function interaction model for concept generation. In: International design engineering technical conferences and computers and information in engineering conference. ASME, Washington, DC, p DETC–47660
Roser CH (2000) A flexible design methodology
Saaty TL (1980) The analytical hierarchical process
Schmidt LC, Vargas-Hernandez N, Kremer G, Linsey JS (2010) Pilot of systematic ideation study with lessons learned. In: International design engineering technical conferences and computers and information in engineering conference. ASME, Montreal, Canada, pp DETC2010–28785
Sedgewick R (1990) Algorithms in C++. Addison-Wesley
Sen C, Ameri F, Summers JD (2010) An entropic method for sequencing discrete design decisions. J Mech Des 132:101004CrossRef
Shafiei-Monfared S, Jenab K (2012) A novel approach for complexity measure analysis in design projects. J Eng Des 23:185–194CrossRef
Shah JJ (2005) Identification, measurement and development of design skills in engineering education. In: Samuel A, Lewis W (eds) Proceedings of the 15th international conference on engineering design (ICED05). Melbourne, Australia, p DS35_557.1
Shah JJ, Kulkarni SV, Vargas-Hernandez N (2000) Evaluation of idea generation methods for conceptual design: effectiveness metrics and design of experiments. J Mech Des 122:377–384. doi:10.​1115/​1.​1315592 CrossRef
Shah JJ, Runger G (2011) Misuse of information-theoretic dispersion measures as design complexity metrics. In: ASME international design engineering technical conferences and computers and information in engineering conference. ASME, Washington, DC, p DETC2011/DTM–48295
Shah JJ, Smith SM, Vargas-Hernandez N (2003) Metrics for measuring ideation effectiveness. Des Stud 24:111–134CrossRef
Simon H (1998) The sciences of the artificial. MIT Press, Cambridge
Singh G, Balaji S, Shah JJ, et al (2012) Evaluation of network measures as complexity metrics. In: ASME international design engineering technical conferences and computers and information in engineering conference. ASME, Chicago, IL, pp DETC2012–70483
Sinha K, de Weck OL (2013a) A network-based structural complexity metric for engineered complex systems. In: 2013 IEEE international on systems conference (SysCon), pp 426–430
Sinha K, de Weck OL (2013b) Structural complexity quantification for engineered complex systems and implications on system architecture and design. In: ASME 2013 international design engineering technical conferences and computers and information in engineering conference. American Society of Mechanical Engineers, pp V03AT03A044–V03AT03A044
Sonalkar N, Jung M, Mabogunje A, Leifer L (2014) A structure for design theory. In: Chakrabarti A, Blessing LTM (eds) An anthology of theories and models of design. Springer, London, pp 67–81CrossRef
Stahovich TF (2000) LearnIT: an instance-based approach to learning and reusing design strategies. J Mech Des 122:249–256CrossRef
Suh N (1999) A theory of complexity, periodicity, and the design axioms. Res Eng Des 11:116–131CrossRef
Suh N (2001) Axiomatic design: advances and applications. Oxford University Press, New York
Summers JD, Ameri F (2008) An algorithm for assessing design complexity through a connectivity view
Summers JD, Miller MG, Mathieson JL et al (2014) Manufacturing assembly time estimation using structural complexity metric trained artificial neural networks. J Comput Inf Sci Eng 14:11005. doi:10.​1115/​1.​4025809 CrossRef
Summers JD, Shah JJ (2010) Mechanical engineering design complexity metrics: size, coupling, and solvability. J Mech Des 132:21004CrossRef
Tilstra A, Seepersad CC, Wood KL (2009) A Systematic method of product design for flexibility for future evolution. In: Proceedings of 2009 NSF engineering research and innovation conference, Honolulu, HI
Tovares N, Boatwright P, Cagan J (2014) Experiential conjoint analysis: an experience-based method for eliciting, capturing, and modeling consumer preference. J Mech Des 136:101404. doi:10.​1115/​1.​4027985 CrossRef
Ulrich KT, Eppinger SD (2004) Product design and development. McGraw-Hill, Boston
Ulrich KT, Eppinger SD (1988) Product design and development, 1995
United States Government Accountability Office (2008) Defense Acquisitions: Assessments of Selected Weapon Programs (GAO-08-467SP)
Varma D, Trachterberg E (1990) On the estimation of logic complexity for design automation applications. In: International conference on computer design: VLSI in computers and processors, Cambridge, MA
Wassenaar HJ, Chen W (2003) An approach to decision-based design with discrete choice analysis for demand modeling. J Mech Des 125(3):490. doi:10.​1115/​1.​1587156
Weber C (2005) What is complexity. In: Proceedings of 15th international conference on engineering design. The Design Society, p DS35_485.49
White C, Wood K, Jensen D (2012) From brainstorming to C-sketch to principles of historical innovators: ideation techniques to enhance student creativity. J STEM Educ 13:12
Wilde DJ (2008) Teamology: the construction and organization of effective teams. Springer
Wilde DJ (2011) Jung’s personality theory quantified. Springer Science & Business Media
Wood M, Chen P, Fu K, et al (2012) The role of design team interaction structure on individual and shared mental models. In: Design Computing and Cognition2, College Station, TX, USA
Worinkeng E, Summers JD, Joshi S (2013) Can a pre-sketching activity improve idea generation? In: Smart product engineering. Springer, pp 583–592
Yang MC (2003) Concept generation and sketching: correlations with design outcome. ASME international design engineering technical conferences and computers and information in engineering conference. ASME, Chicago, IL, pp 829–834
Yang MC (2009) Observations on concept generation and sketching in engineering design. Res Eng Des 20:1–11CrossRef
Zuse H (1991) Software complexity: measures and methods. Walter de Gruyter and Co., New YorkMATH
Metadaten
Titel
Evaluation of Empirical Design Studies and Metrics
verfasst von
Mahmoud Dinar
Joshua D. Summers
Jami Shah
Yong-Seok Park
Copyright-Jahr
2016
Buch
Experimental Design Research

Print ISBN: 978-3-319-33779-1

Electronic ISBN: 978-3-319-33781-4

Copyright-Jahr: 2016

DOI
https://doi.org/10.1007/978-3-319-33781-4_2

Premium Partner

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen. 

    Zur Marktübersicht
    Bildnachweise