nach oben

Erschienen in:

2024 | OriginalPaper | Buchkapitel

Can Measurement Misdirect System Design?

verfasst von : Casey E. Eaton, Christopher White, Bryan Mesmer

Erschienen in: The Proceedings of the 2023 Conference on Systems Engineering Research

Verlag: Springer Nature Switzerland

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Measurement may seem a rudimentary concept: temperature can be measured in degrees using a thermometer; length can be measured in distance using a ruler. Measurement for system design is more complex, given that measures are implicitly intended to assess the “goodness” of a design. This research proposes that measures in systems design can direct a design away from its goals through measurement challenges. Three types of measurement challenges are considered: challenges from the measures themselves, challenges from weighting the measures, and challenges from the use of the measures. This research illustrates measurement challenges for system design mathematically, graphically, and through real-world case study examples. The goal of this research is to demonstrate through multiple forms of evidence that measurement can misdirect system design. Establishing that measures in system design can influence a design away from its goals enables future research to investigate why these measurement challenges occur and how to prevent them.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel An Integrated Testbed for Supporting Sustained Military Installation Decision-Making and Modernization

Nächstes Kapitel Technical Concept Development, Testing, and Modeling: Development of a Shape-Memory Alloy (SMA) Tire Insert for Flat Tire Prevention and Airless Conversions

M. Strathern, ‘Improving ratings’: Audit in the British University system. Eur. Rev. 5(3), 305–321 (1997). https://doi.org/10.1002/(SICI)1234-981X(199707)5:3<305::AID-EURO184>3.0.CO;2-4CrossRef

C.A.E. Goodhart, Problems of monetary management: The UK experience, in Monetary Theory and Practice: The UK Experience, ed. by C.A.E. Goodhart, (Macmillan Education UK, 1984), pp. 91–121. https://doi.org/10.1007/978-1-349-17295-5_4CrossRef

C.A.E. Goodhart, Goodhart’s law, in The Encyclopedia of Central Banking, ed. by L.P. Rochon, S. Rossi, (Edward Elgar Publishing, 2015)

R.E. Lucas, Econometric policy evaluation: A critique. Carnegie-Rochester Conf. Ser. Public Policy. 1, 19–46 (1976). https://doi.org/10.1016/S0167-2231(76)80003-6CrossRef

D.T. Campbell, Assessing the impact of planned social change. Eval. Program Plann. 2(1), 67–90 (1979). https://doi.org/10.1016/0149-7189(79)90048-XMathSciNetCrossRef

H.W. Jones, Don’t Trust a Management Metric, Especially in Life Support. 2014. https://ntrs.nasa.gov/citations/20140011163. Accessed 23 Sept 2021

H. Ashton, Causal Campbell-Goodhart’s law and Reinforcement Learning. ArXiv201101010 Cs Econ Q-Fin. Published online February 18, 2021. http://arxiv.org/abs/2011.01010. Accessed 25 Feb 2022

D. Manheim, S. Garrabrant, Categorizing variants of Goodhart’s Law. ArXiv Prepr ArXiv180304585. Published online 2018

R.L. Thomas, D. Uminsky, Reliance on metrics is a fundamental challenge for AI. Ethics of Data Science Conference. (2020)

10.

NASA Systems Engineering Handbook. NASA. Published September 16, 2019. http://www.nasa.gov/seh/6-4-technical-risk-management. Accessed 14 May 2020

11.

T.W. Simpson, S.W. Miller, E.B. Tibor, et al., Adding Value to Trade Space Exploration When Designing Complex Engineered Systems. Published 2017. https://onlinelibrary.wiley.com/doi/abs/10.1002/sys.21384. Accessed 11 Mar 2019

12.

G. Roedler, R. Madachy, Systems Engineering Book of Knowledge (SEBoK): Measurement. Published online May 17, 2021

13.

Expanded Guidance for NASA Systems Engineering. Volume 1: Systems Engineering Practices. Published online 2016

14.

A.M. Sidorkin, Campbell’s law and the ethics of immensurability. Stud. Philos. Educ. 35(4), 321–332 (2016). https://doi.org/10.1007/s11217-015-9482-3CrossRef

15.

Systems Engineering Measurement Primer v2.0: A Basic Introduction to Measurement Concepts and Use for Systems Engineering. Published online November 2010

16.

Annual Report of the Isthmian Canal Commission, 1908/1909. Washington, Government Printing Office, 1909. https://hdl.handle.net/2027/uc1.b2925124

17.

Annual Report of the Isthmian Canal Commission, 1909/1910. Washington, Government Printing Office, 1910. https://hdl.handle.net/2027/uc1.b2925125

18.

Annual Report of the Isthmian Canal Commission, 1910/1911. Washington, Government Printing Office, 1911. https://hdl.handle.net/2027/uc1.b2925127

19.

Annual Report of the Isthmian Canal Commission, 1911/1912. Washington, Government Printing Office, 1912. https://hdl.handle.net/2027/uc1.b2925128

20.

Annual Report of the Isthmian Canal Commission, 1912/1913. Washington, Government Printing Office, 1913. https://hdl.handle.net/2027/uc1.b2925130

21.

Annual Report of the Isthmian Canal Commission, 1907/1908. Washington, Government Printing Office, 1908. https://hdl.handle.net/2027/uc1.b2925123

22.

G.F. Becker, Mechanics of the Panama Canal Slides (U.S. Geological Survey, 1917)CrossRef

23.

G. Berman, Landslides on the Panama Canal, in Energy and Mineral Potential of the Central American-Caribbean Region, Circum-Pacific Council for Energy and Mineral Resources Earth Science Series, ed. by R.L. Miller, G. Escalante, J.A. Reinemund, M.J. Bergin, (Springer, 1995), pp. 391–395. https://doi.org/10.1007/978-3-642-79476-6_53CrossRef

24.

L.M. Applegate, R. Montealegre, C.I. Knoop, H.J. Nelson, BAE Automated Systems (A): Denver International Airport Baggage-Handling System. Published online April 12, 1996. https://www.hbs.edu/faculty/Pages/item.aspx?num=13754. Accessed 30 Oct 2020

25.

R. De Neufville, The baggage system at Denver: prospects and lessons. J. Air Transp. Manag. 1(4), 229–236 (1994)CrossRef

26.

A. Coolman, Lessons Learned from Project Failure at Denver International Airport: Why Checking Bags Is Still a Pain. Published 2014. https://www.wrike.com/blog/lessons-learned-from-project-failure-at-denver-international-airport-why-checking-bags-is-still-a-pain/. Accessed 30 Oct 2020

27.

A. Sylte, Next Question: Has there been any effort to resurrect DIA’s failed ‘baggage system from hell? KUSA.com. Published 2019. https://www.9news.com/article/news/local/next/next-question-has-there-been-any-effort-to-resurrect-dias-failed-baggage-system-from-hell/73-cd5c7bc7-7e3a-4c6a-92c5-ed710bdefdc8. Accessed 30 Oct 2020

28.

Case Study – Denver International Airport Baggage Handling System – An Illustration of Ineffectual Decision Making. Published online 2008

29.

A.J.M. Donaldson, A Case Narrative of the Project Problems with the Denver Airport Baggage Handling System (DABHS), 2002

30.

S. Dalal, R. Chhillar, Case Studies of Most Common and Severe Types of Software System Failure. undefined. Published 2012. /paper/Case-Studies-of-Most-Common-and-Severe-Types-of-Dalal-Chhillar/bcd8a75acc9fadbdb34c1b1df2adedfc8d6fc969. Accessed 5 Nov 2020

31.

M. Schloh, Analysis of the Denver International Airport Baggage System. Published online 1996

32.

T.R. Weiss, United axes troubled baggage system at Denver airport. Computerworld. Published June 10, 2005. https://www.computerworld.com/article/2556725/united-axes-troubled-baggage-system-at-denver-airport.html. Accessed 30 Oct 2020

33.

R. Montealegre, M. Keil, De-escalating information technology projects: lessons from the Denver International Airport. MIS Q. 24, 417–447 (2000). https://doi.org/10.2307/3250968CrossRef

34.

D.C. Aloisio, Lessons from Systems Engineering Failures: Determining Why Systems Fail, the State of Systems Engineering Education, and Building an Evidence-Based Network to Help Systems Engineers Identify and Fix Problems on Complex Projects, thesis. Purdue University Graduate School, 2019. https://doi.org/10.25394/PGS.7488569.v1

35.

J.S. Szyliowicz, A.R. Goetz, Getting realistic about megaproject planning: The case of the new Denver International Airport. Policy. Sci. 28(4), 347–367 (1995). https://doi.org/10.1007/BF01000249CrossRef

36.

C.J. White, B. Mesmer, P. Collopy, Affordability Through the Eyes of Industry: Preliminary Results. AIAA Scitech 2019 Forum, 2019:0767

37.

B. Bohem, et al., Tradespace and Affordability – Phase 1, 2013. https://apps.dtic.mil/sti/pdfs/ADA590751.pdf. Accessed 8 Dec 2022

38.

S. Keller, P. Collopy, P. Componation, What is wrong with space system cost models? A survey and assessment of cost estimating approaches. Acta Astronaut. 93, 345–351 (2014). https://doi.org/10.1016/j.actaastro.2013.07.014CrossRef

39.

G. Mesri, J.R. Funk, Settlement of the Kansai International Airport Islands. J. Geotech. Geoenviron. Eng. 141(2), 04014102 (2015). https://doi.org/10.1061/(ASCE)GT.1943-5606.0001224CrossRef

40.

Super Structures of the World: Kansai International Airport. Published online 1998

41.

J. Funk, Settlement of the Kansai International Airport Islands. Published online August 22, 2013. https://hdl.handle.net/2142/45602. Accessed 11 Dec 2022

42.

B. Wojdyla, Ford Pinto Fuel Tanks: Epic Auto Failures. Popular Mechanics. Published May 20, 2011. https://www.popularmechanics.com/cars/news/industry/top-automotive-engineering-failures-ford-pinto-fuel-tanks. Accessed 15 Nov 2021

43.

R. Dardis, C. Zent, The Economics of the Pinto Recall. J Consum. Aff. Published online 1982. https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1745-6606.1982.tb00175.x. Accessed 11 Dec 2022

44.

C. Irwin, 50 Years Ago: The Pinto Becomes Ford’s “Embarrassment.” Ultimate Classic Rock. Published 2020. https://ultimateclassicrock.com/ford-pinto-history/. Accessed 15 Nov 2021

45.

M. Lee, E.D. Pinto, “Madness” as a Flawed Landmark Narrative: An Organizational and Network Analysis. Published online 1999. https://academic.oup.com/socpro/article-abstract/46/1/30/2925335. Accessed 15 Nov 2021

46.

D.M. Pinto Madness, Mother Jones. Published online 1977. https://www.motherjones.com/politics/1977/09/pinto-madness/. Accessed 11 Dec 2022

47.

Motor Vehicle Safety Act of 1966

48.

S. Strother, When making money is more important than saving lives: Revisiting the Ford Pinto case. J. Int. Interdiscip. Bus. Res. 5(1), 166–181 (2018)

49.

R.M. Dawes, B. Corrigan, Linear models in decision making. Psychol. Bull. 81(2), 95–106 (1974). https://doi.org/10.1037/h0037613CrossRef

50.

H. Wainer, Estimating coefficients in linear models: It don’t make no nevermind. Psychol. Bull. 83(2), 213–217 (1976). https://doi.org/10.1037/0033-2909.83.2.213CrossRef

51.

Mačaitytė I, Virbašiūtė G. Volkswagen emission scandal and corporate social responsibility – A case study. Bus. Ethics Leadersh. 2018;2(1). https://essuir.sumdu.edu.ua/\allowbreak{}bitstream-download/123456789/\allowbreak{}68151/1/Ma%c4%8daityt%c4%97_\allowbreak{}Virba%c5%a1i%c5%abt%c4%97_\allowbreak{}Emission.pdf;jsessionid=\allowbreak{}8CE9A1BACC097772427C53EEFF922200. Accessed 11 Dec 2022

52.

L. Bovens, The ethics of dieselgate. Midwest Stud. Philos. 40(1), 262–283 (2016). https://doi.org/10.1111/misp.12060CrossRef

53.

R. Bernier, Was the Navy’s F-111 Really That Bad? Air & Space Magazine. Published 2018. https://www.airspacemag.com/military-aviation/13_sep2018-cancelled-f111b-1-180969916/. Accessed 10 Nov 2021

54.

G.K. Richey, F-111 Systems Engineering Case Study. Air Force Center for Systems Engineering, Dayton. Published online 2005

55.

H. Eccles, The TFX F-111 aircraft: A perspective in military command and defense management. Nav War Coll. Rev. 23(8), 23 (1971)

56.

Statement of Elmer B. Staats, Comptroller General of the United States Before The Permanent Subcommittee on Investigations Committee on Government Operations, United States Senate on the F-111 Aircraft Program

Titel: Can Measurement Misdirect System Design?
verfasst von: Casey E. Eaton
Christopher White
Bryan Mesmer
Verlag: Springer Nature Switzerland
Buch: The Proceedings of the 2023 Conference on Systems Engineering Research
Print ISBN: 978-3-031-49178-8

Electronic ISBN: 978-3-031-49179-5

Copyright-Jahr: 2024
DOI: https://doi.org/10.1007/978-3-031-49179-5_18

Neuer Inhalt

Bildnachweise

VDI-Icon, Profil Icon, inhalt2, Springer Professional Modul/© Springer Fachmedien Wiesbaden GmbH, Internationaler Motorenkongress/© [M] ATZlive | Chisnikov / Fotolia.com, Search Icon, Banner Hanser, Gardiner von Trapp/© Alpega Group, Benny Hahn/© ZEP GmbH, Customer Experience/© © oatawa / Getty Images / iStock, Zeitschrift Wissensmanagement Cover, PatentFit-Logo/© Springer Fachmedien Wiesbaden GmbH, 2023_Antrieb/© supervisuell, ATZ-Webinar: Prototypenfreie Entwicklung durch Offline- und Driver-in-the-Loop-HiL-Tests /© (c) VI-grade, chassis.tech plus 2023/© [M] ATZlive / TÜV SÜD PRODUCT SERVICE GMBH

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Neuer Inhalt

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.