Skip to main content
Top

2013 | OriginalPaper | Chapter

Moving Toward Evidence-Based Software Production

Authors : David M. Weiss, James Kirby Jr., Robyn R. Lutz

Published in: Perspectives on the Future of Software Engineering

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Computer software is increasingly critical to the products, infrastructure, and science upon which society depends. However, the production of society’s software is known to be problematic. Current understanding of software production, largely based on anecdotes, is inadequate. Achieving the deeper understanding needed to transform software production experiences into software production improvements requires collecting and using evidence on a large scale. This paper proposes some steps toward that outcome, with particular attention to what government can do to stimulate software engineering studies that will advance the capabilities of software production.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Occupational data for Table 2 and Figs. 1, 2, 3, 4, 5, 6, 7, 8, and 9 comes from [11].
 
Literature
1.
go back to reference National Research Council: Critical Code: Software Producibility for Defense. The National Academies Press, Washington, DC (2010a) National Research Council: Critical Code: Software Producibility for Defense. The National Academies Press, Washington, DC (2010a)
2.
go back to reference Markoff, J.: Google cars drive themselves, in traffic. New York Times, 9 Oct 2010 Markoff, J.: Google cars drive themselves, in traffic. New York Times, 9 Oct 2010
4.
go back to reference National Research Council: Measuring and Sustaining the New Economy, Software, Growth, and the Future of the U.S. Economy. The National Academies Press, Washington, DC (2010b) National Research Council: Measuring and Sustaining the New Economy, Software, Growth, and the Future of the U.S. Economy. The National Academies Press, Washington, DC (2010b)
5.
go back to reference Institute for Defense Analyses.: Assessment of DoD enterprise resource planning business systems (2011) Institute for Defense Analyses.: Assessment of DoD enterprise resource planning business systems (2011)
6.
go back to reference Fast Track Action Committee on Computational Modeling and Simulation, Committee on Technology, National Science and Technology Council.: Simulation-Based Engineering and Science for Discovery and Innovation (2010) Fast Track Action Committee on Computational Modeling and Simulation, Committee on Technology, National Science and Technology Council.: Simulation-Based Engineering and Science for Discovery and Innovation (2010)
7.
go back to reference President’s Council of Advisors on Science and Technology.: Leadership Under Challenge: Information Technology R&D in a Competitive World (2007) President’s Council of Advisors on Science and Technology.: Leadership Under Challenge: Information Technology R&D in a Competitive World (2007)
8.
go back to reference Kirby, J., Weiss, D., Lutz, R.: Evidence-based software production. In: Future of Software Engineering Research Workshop, pp. 191–194. Santa Fe (2010) Kirby, J., Weiss, D., Lutz, R.: Evidence-based software production. In: Future of Software Engineering Research Workshop, pp. 191–194. Santa Fe (2010)
9.
go back to reference National Institute of Standards & Technology.: The economic impacts of inadequate infrastructure for software testing. Planning report 02–3 (2002) National Institute of Standards & Technology.: The economic impacts of inadequate infrastructure for software testing. Planning report 02–3 (2002)
10.
go back to reference Gawande, A.: How the Senate bill would contain the cost of health care. The New Yorker. 17 Dec 2009 Gawande, A.: How the Senate bill would contain the cost of health care. The New Yorker. 17 Dec 2009
11.
go back to reference U.S. Bureau of Labor Statistics.: Industry-occupation matrix data, by occupation. http:www.bls.gov/emp/ep_table_108.htm (2012) U.S. Bureau of Labor Statistics.: Industry-occupation matrix data, by occupation. http:www.bls.gov/emp/ep_table_108.htm (2012)
14.
go back to reference Jackson, D., Thomas, M., Millett, L.I. (eds.): Software for Dependable Systems: Sufficient Evidence? Committee on Certifiably Dependable Software Systems, National Research Council (2007) Jackson, D., Thomas, M., Millett, L.I. (eds.): Software for Dependable Systems: Sufficient Evidence? Committee on Certifiably Dependable Software Systems, National Research Council (2007)
15.
go back to reference SIGSOFT Software Engineering Notes. Risks to the public SIGSOFT Software Engineering Notes. Risks to the public
16.
go back to reference Kitchenham, B., Dyba, T., Jørgensen, M.: Evidence-based Software Engineering. In: Proceedings of the 26th ICSE, Edinburgh, pp. 273–281 (2004) Kitchenham, B., Dyba, T., Jørgensen, M.: Evidence-based Software Engineering. In: Proceedings of the 26th ICSE, Edinburgh, pp. 273–281 (2004)
17.
go back to reference Barr, E., Bird, C., Hyatt, E., Menzies, T., Robies, G.: On the shoulders of giants. In: Future of Software Engineering Research Workshop. Santa Fe (2010) Barr, E., Bird, C., Hyatt, E., Menzies, T., Robies, G.: On the shoulders of giants. In: Future of Software Engineering Research Workshop. Santa Fe (2010)
18.
go back to reference National Research Council: Continuing Innovation in Information Technology. The National Academies Press, Washington, DC (2010c) National Research Council: Continuing Innovation in Information Technology. The National Academies Press, Washington, DC (2010c)
20.
go back to reference Kuhn, D.R.: Sources of failure in the public switched telephone network. IEEE Comput. 30(4), 31–36 (1997)CrossRef Kuhn, D.R.: Sources of failure in the public switched telephone network. IEEE Comput. 30(4), 31–36 (1997)CrossRef
21.
go back to reference Basili, V., Caldiera, G., McGarry, F., et al.: The software engineering laboratory: an operational software experience factory. In: Proceedings of the 14th ICSE, Melbourne, pp. 370–381 (1992) Basili, V., Caldiera, G., McGarry, F., et al.: The software engineering laboratory: an operational software experience factory. In: Proceedings of the 14th ICSE, Melbourne, pp. 370–381 (1992)
22.
go back to reference Basili, V., Rombach, H.D.: The TAME project: towards improvement-oriented software environments. IEEE Trans. Softw. Eng. SE-14(6), 758–773 (1988)CrossRef Basili, V., Rombach, H.D.: The TAME project: towards improvement-oriented software environments. IEEE Trans. Softw. Eng. SE-14(6), 758–773 (1988)CrossRef
24.
go back to reference Denning, P.: The great principles of computing. Am. Sci., Sept–Oct 2010 Denning, P.: The great principles of computing. Am. Sci., Sept–Oct 2010
26.
go back to reference Boehm, B.: Software Engineering Economics. Prentice-Hall, Englewood Cliffs (1981)MATH Boehm, B.: Software Engineering Economics. Prentice-Hall, Englewood Cliffs (1981)MATH
28.
go back to reference Parnas, D.L., Clements, P.C.: A rational design process: how and why to fake it. IEEE Trans. Softw. Eng. SE-12, 251–257 (1986)CrossRef Parnas, D.L., Clements, P.C.: A rational design process: how and why to fake it. IEEE Trans. Softw. Eng. SE-12, 251–257 (1986)CrossRef
29.
go back to reference Hackbarth, R., Palframan, J., Mockus, A., Weiss, D.: Assessing the state of software in a large enterprise. Empirical Softw. Eng. 15(3), 219–249 (2010)CrossRef Hackbarth, R., Palframan, J., Mockus, A., Weiss, D.: Assessing the state of software in a large enterprise. Empirical Softw. Eng. 15(3), 219–249 (2010)CrossRef
30.
go back to reference Grady, R., Caswell, D.: Software Metrics: Establishing a Company-Wide Program. Prentice Hall, Englewood Cliffs (1987) Grady, R., Caswell, D.: Software Metrics: Establishing a Company-Wide Program. Prentice Hall, Englewood Cliffs (1987)
32.
go back to reference Boehm, B.: A spiral model of software development and enhancement. SIGSOFT SEN 11(4), 14–24 (1986) Boehm, B.: A spiral model of software development and enhancement. SIGSOFT SEN 11(4), 14–24 (1986)
33.
go back to reference Weiss, D., Lai, C.R.T.: Software Product Line Engineering. Addison-Wesley, Boston (1999) Weiss, D., Lai, C.R.T.: Software Product Line Engineering. Addison-Wesley, Boston (1999)
34.
go back to reference Fenton, N.E., Pfleeger, S.L.: Software Metrics: A Rigorous and Practical Approach, 2nd edn. Course Technology (1998) Fenton, N.E., Pfleeger, S.L.: Software Metrics: A Rigorous and Practical Approach, 2nd edn. Course Technology (1998)
35.
go back to reference Lutz, R., Lavin, M., Lux, J., Peters, K., Rouquette, N.: Mining requirements knowledge from operational experience. In: Maalej, W., Thurimella, A.K. (eds.) Managing Requirements Knowledge. Springer, New York (2013) Lutz, R., Lavin, M., Lux, J., Peters, K., Rouquette, N.: Mining requirements knowledge from operational experience. In: Maalej, W., Thurimella, A.K. (eds.) Managing Requirements Knowledge. Springer, New York (2013)
36.
go back to reference Basili, V., Weiss, D.: Evaluating software development by analysis of changes: some data from the software engineering laboratory. IEEE Trans. Softw. Eng. 11(2), 157–168 (1985) Basili, V., Weiss, D.: Evaluating software development by analysis of changes: some data from the software engineering laboratory. IEEE Trans. Softw. Eng. 11(2), 157–168 (1985)
37.
go back to reference Basili, V., Caldiera, G., Rombach, H.D.: Goal question metric approach. In: Encyclopedia of Software Engineering, pp. 528–532. Wiley (1994) Basili, V., Caldiera, G., Rombach, H.D.: Goal question metric approach. In: Encyclopedia of Software Engineering, pp. 528–532. Wiley (1994)
39.
go back to reference Rombach, H.D., Achatz, R.: Research collaborations between academia and industry. FOSE 2007, pp. 29–36 (2007) Rombach, H.D., Achatz, R.: Research collaborations between academia and industry. FOSE 2007, pp. 29–36 (2007)
40.
go back to reference President’s Council of Advisors on Science and Technology: Designing a Digital Future: Federally Funded Research and Development in Networking and Information Technology. President’s Council of Advisors on Science and Technology (PCAST), Washington, DC (2013) President’s Council of Advisors on Science and Technology: Designing a Digital Future: Federally Funded Research and Development in Networking and Information Technology. President’s Council of Advisors on Science and Technology (PCAST), Washington, DC (2013)
41.
go back to reference Lutz, R., Mikulski, C.: Empirical analysis of safety-critical anomalies during operations. IEEE Trans. Softw. Eng. 30(3), 172–180 (2004)CrossRef Lutz, R., Mikulski, C.: Empirical analysis of safety-critical anomalies during operations. IEEE Trans. Softw. Eng. 30(3), 172–180 (2004)CrossRef
Metadata
Title
Moving Toward Evidence-Based Software Production
Authors
David M. Weiss
James Kirby Jr.
Robyn R. Lutz
Copyright Year
2013
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-37395-4_18

Premium Partner