skip to main content
research-article

A systematic review of theory use in studies investigating the motivations of software engineers

Published:04 June 2009Publication History
Skip Abstract Section

Abstract

Motivated software engineers make a critical contribution to delivering successful software systems. Understanding the motivations of software engineers and the impact of motivation on software engineering outcomes could significantly affect the industry's ability to deliver good quality software systems. Understanding the motivations of people generally in relation to their work is underpinned by eight classic motivation theories from the social sciences. We would expect these classic motivation theories to play an important role in developing a rigorous understanding of the specific motivations of software engineers. In this article we investigate how this theoretical basis has been exploited in previous studies of software engineering. We analyzed 92 studies of motivation in software engineering that were published in the literature between 1980 and 2006. Our main findings are that many studies of software engineers' motivations are not explicitly underpinned by reference to the classic motivation theories. Furthermore, the findings presented in these studies are often not explicitly interpreted in terms of those theories, despite the fact that in many cases there is a relationship between those findings and the theories. Our conclusion is that although there has been a great deal of previous work looking at motivation in software engineering, the lack of reference to classic theories of motivation means that the current body of work in the area is weakened and our understanding of motivation in software engineering is not as rigorous as it may at first appear. This weakness in the current state of knowledge highlights important areas for future researchers to contribute towards developing a rigorous and usable body of knowledge in motivating software engineers.

References

  1. Adams, J. S. 1963. Toward an understanding of inequity, J. Abnormal Social Psych. 67, 422--436.Google ScholarGoogle ScholarCross RefCross Ref
  2. Agarwal, R., De, P., and Ferratt, T. W. 2002. Explaining an IT professional's preferred employment duration: Empirical tests of a causal model of antecedents. In Proceedings of the ACM SIGCPR Conference. ACM Press, New York, 14--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Agarwal, R. and Ferratt, T. W. 2000. Retention and the career motives of IT professionals, In Proceedings of the ACM SIGCPR Conference. ACM Press, New York, 158--166. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Agarwal, R. and Ferratt, T. W. 2001. Crafting an HR strategy to meet the need for IT workers. Comm. ACM 44, 7, 58--64. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Agarwal, R. and Ferratt, T. W. 2002. Toward understanding the relationship between IT human resource management systems and retention: An empirical analysis based on multiple theoretical and measurement approaches. In Proceedings of the ACM SIGCPR Conference. ACM Press, New York, 126--138. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Baroudi, J. J. and Ginzberg, M. J. 1986. Impact of the technological environment of programmer/analyst job outcomes. Comm. ACM 29, 6, 546--555. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Bartol, K. M. and Martin, D. C. 1982. Managing information systems personnel: A review of the literature and managerial implications. MIS Quart. 6, 49--70.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Basili, V. 1996. The role of experimentation: Past, current, and future. In Proceedings of the 18th International Conference on Software Engineering (ICSE'96). 442. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Beecham, S., Baddoo, N., Hall T., Robinson, H., and Sharp, H. Motivation in software engineering: A systematic literature review. Inform. Syst. Techn. J. (To appear). Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Beecham, S., Baddoo, N., Hall, T., Robinson, H., and Sharp, H. 2006. Protocol of a systematic literature review of motivation in software engineering. Tech. rep. 453, School of Computer Science, Faculty of Engineering and Information Sciences, University of Hertfordshire. http://homepages.feis.herts.ac.uk/~ssrg/MOMSEProto.htm.Google ScholarGoogle Scholar
  11. Boehm, B. W. 1981.Software Engineering Economics. Prentice-Hall, Englewood Cliffs, NJ. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., and Khalil, M. 2007. Lessons from applying the systematic literature review process within the software engineering domain. J. Syst. Softw. 80, 4, 571--583. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Burn, J. M., Couger, J. D., and Ma, L. 1992. Motivating IT professionals. The Hong Kong challenge. Inform. Manage. 22, 5, 269--280. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Capretz, L. F. 2003. Personality types in software engineering. Int. J. Hum.-Comput. Stud. 58, 2, 207--214. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Carayon, P., Hoonakker, P., Marchand, S., and Schwarz, J. 2003. Job characteristics and quality of working life in the IT workforce: The role of gender. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. ACM Press, 58--63. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Checchio, R. A. 1990. Creating a motivating environment in software development. Experience with the management of software projects 1989. In Proceedings of the 3rd IFAC/IFIP Workshop. 81--86.Google ScholarGoogle Scholar
  17. Cheney, P. H. 1984. Effects of individual characteristics, organizational factors and task characteristics on computer programmer productivity and job satisfaction. Inform. Manage. 7, 4, 209--214. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Couger, J. D. and Zawacki, R. A. 1980. Motivating and Managing Computer Personnel. John Wiley & Sons. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Couger, J. D. 1988. Motivators vs. demotivators in the IS environment. J. Syst. Manage. 39, 6, 36--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Couger, J. D. and Adelsberger, H. 1988. Environments: Austria compared to the United States. SIGCPR Comput. Pers. 11, 4, 13--17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Couger, J. D., Adelsberger, H., Borovits, I., Zviran, M., and Motiwalla, J. 1990. Commonalities in motivating environments for programmer/analysts in Austria, Israel, Singapore, and the U.S.A. Inform. Manage. 18, 1, 41--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Crepeau, R. G., Crook, C. W., Goslar, M. D., and McMurtrey, M. E. 1992. Career anchors of information systems personnel. J. Manage. Inform. Syst. 9, 2, 145--160. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Crook, C. W., Crepeau, R. G., and McMurtrey, M. E. 1991. Utilization of the career anchor/career orientation constructs for management of I/S professionals. SIGCPR Comput. Pers. 13, 2, 12--23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Darcy, D. P. and Ma, M. 2005. Exploring individual characteristics and programming performance: Implications for programmer selection. In Proceedings of the 38th Annual IEEE Hawaii International Conference on System Sciences (HICSS '05). 314a. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Dittrich, J. E., Couger, D. J., and Zawacki, R. A. 1985. Perceptions of equity, job satisfaction, and intention to quit among data processing personnel. Inform. Manage. 9, 2, 67--75. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Enns, H. G., Ferratt, T. W., and Prasad, J. 2006. Beyond stereotypes of IT professionals: Implications for IT HR practices. Comm. ACM 49, 4, 106--109. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Ferratt, T. W. and Short, L. E. 1986. Are information systems people different: An investigation of motivational differences. Manage. Inform. Syst. Quart. 10, 4, 377--387. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Ferratt, T. W., Enns, H. G., and Prasad, J. 2004. Employment arrangement fit for IT professionals: An examination of the importance of fit components. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 25--29. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Ferratt, T. W., Enns, H. G., and Prasad, J. 2003. Instrument validation for investigating a model of employment arrangement fit for IT professionals. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 168--178. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Frangos, S. A. 1997. Motivated humans for reliable software products. Microprocess. Microsyst. 21, 10, 605--610.Google ScholarGoogle ScholarCross RefCross Ref
  31. Gambill, S. E., Clark, W. J., and Wilkes, R. B. 2000. Toward a holistic model of task design for IS professionals. Inform. Manage. 37, 5, 217--228. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Garden, A. 1988. Behavioural and organisational factors involved in the turnover of high tech professionals. SIGCPR Comput. Pers. 11, 4, 6--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Garza, A. I., Lunce, S. E., and Maniam, B. 2003. Career anchors of Hispanic information systems professionals. In Proceedings of the Annual Meeting of the Decision Sciences Institute. 1067--1072.Google ScholarGoogle Scholar
  34. Glass, R. L., Vessey, I., and Ramesh, V. 2002. Research in software engineering: An analysis of the literature. Inform. Softw. Technol. 44, 8, 491--506. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Goldstein, D. K. 1988. An updated measure of supervisor-rated job performance for programmer/analysis. In Proceedings of the ACM SIGCPR Conference on Management of Information Systems Personnel. ACM Press, 148--152. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Goldstein, D. K. and Rockart, J. F. 1984. An examination of work-related correlates of job satisfaction in programmer/analysts. MIS Quart. 8, 2, 103--115.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Hackman, J. R. and Oldman, G. R. 1976. Motivation Through the Design of Work: Test of a Theory. Academic Press, New York.Google ScholarGoogle Scholar
  38. Hall, M., Camacho, F., Dugan, E., and Balkrishman, R. 2002. Trust in the medical profession: Conceptual and measurement issues. Health Serv. Res. 37, 5,1419--1439.Google ScholarGoogle ScholarCross RefCross Ref
  39. Hannay, J. E., Sjoberg, D. I. K., and Dyba, T. 2007. A systematic review of theory use in software engineering experiments. IEEE Trans. Softw. Eng. 33, 2, 87--107. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Hertel, S., Niedner, S., and Hermann, G. 2003. Motivation of software developers in Open Source projects: An Internet-based survey of contributors to the Linux kernel. Res. Policy 32, 1159--1177.Google ScholarGoogle ScholarCross RefCross Ref
  41. Herzberg, F., Mausner, B., and Snyderman, B. B. 1959. Motivation to Work (2nd Ed.). Wiley, New York.Google ScholarGoogle Scholar
  42. Hoffman, A. 2002. A conceptualisation of trust in international relations. Eur. J. Int. Relations 8, 3, 375--401.Google ScholarGoogle ScholarCross RefCross Ref
  43. Honda, K., Azuma, M., Komatubara, A., and Yokomizo, Y. 1985. Research on work environment for software productivity improvement. In Proceedings of the IEEE Compouter Society 9th International Computer Software and Applications Conference. 241--248.Google ScholarGoogle Scholar
  44. Hsu, M. K., Chen, H. G., J. J. J., and Klein, G. 2003a. Career satisfaction for managerial and technical anchored IS personnel in later career stages. SIGMIS Datab. 34, 4, 64--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Hsu, M. K., Jiang, J. J., Klein, G., and Tang, Z. 2003b. Perceived career incentives and intent to leave. Inform. Manage. 40, 5, 361--369. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Igbaria, M., Meredith, G., and Smith, D. C. 1995. Career orientations of information systems employees in South Africa. J. Strategic Inform. Syst. 4, 4, 319--340.Google ScholarGoogle ScholarCross RefCross Ref
  47. Ituma, A. 2006. The internal career: An explorative study of the career anchors of information technology workers in Nigeria. In Proceedings of the ACM SIGMIS Conference on Computer Personnel Research (CPR'06): Forty Four Years of Computer Personnel Research: Achievements, Challenges and the Future. ACM Press, 205--212. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Jordan, E. and Whiteley, A. M. 1994. HRM practices in information technology management. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 57--64. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Khalil, O. E. M., Zawacki, R. A., Zawacki, P. A., and Selim, A. 1997. What motivates Egyptian IS managers and personnel: Some preliminary results. In Proceedings of the ACM SIGCPR Conference. ACM Press, New York, 187--192. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Kitchenham, B. 2004. Procedures for Performing Systematic Reviews. Keele University and National ICT Australia Ltd., 1--28.Google ScholarGoogle Scholar
  51. Kitchenham, B., Dybå, T., and Jørgensen, M. 2004. Evidence-Based software engineering. InProceedings of the 26th International Conference on Software Engineering (ICSE). IEEE Computer Society, Los Alamitos, CA, 273--281. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Kym, H. and Park, W.-W. 1992. Effect of cultural fit/misfit on the productivity and turnover of IS personnel. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 184--190. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Leduc, A. L. J. 1980. Motivation of programmers. SIGMIS Datab. 11, 4, 4--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Lee, P. C. 2002a. Career plateau and professional plateau: Impact on work outcomes of information technology professionals. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 25--38.Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Lee, P. C. 2002b. The social context of turnover among information technology professionals. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 145--153. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Lending, D. and Chervany, N. L. 1997. The changing systems development job: A job characteristics approach. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 127--137. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Li, Y., Tan, C.-H., Teo, H.-H., and Talib Matttar, A. 2006. Motivating open source software developers: Influence of transformational and transactional leaderships. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 34--43. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Linberg, K. R. 1999. Software developer perceptions about software project failure: A case study. J. Syst. Softw. 49, 2-3, 177--192. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Locke, E. A. 1968. Toward a theory of task motivation and incentives. Organisation Behav. Hum. Perform. 3, 157--189.Google ScholarGoogle ScholarCross RefCross Ref
  60. Luo, Y. 2002. Building trust in cross-cultural collaborations. J. Manage. 28, 5, 669--694.Google ScholarGoogle ScholarCross RefCross Ref
  61. Mak, B. L. and Sockel, H. 2001. A confirmatory factor analysis of IS employee motivation and retention. Inform. Manage. 38, 5, 265--276. Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Maslow, A. 1954. Motivation and Personality. Harper & Row, New York.Google ScholarGoogle Scholar
  63. Mata-Toledo, R. A. and Unger, E. A. 1985. Another look at motivating data processing professionals. SIGCPR Comput. Pers. 10, 1, 1--7. Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. McClelland, D. C. 1961. The Achieving Society. Van Nostrand, Princeton, NJ.Google ScholarGoogle Scholar
  65. McConnell, S. 1998. Problem programmers. IEEE Softw. 15, 2, 126--128. Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. McLean, E. R., Smits, S. J., and Tanner, J. R. 1996. The importance of salary on job and career attitudes of information systems professionals. Inform. Manage. 30, 6, 291--299. Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Miller, W. C., Couger, J. D., and Higgins, L. F. 1993. Comparing innovation styles profile of IS personnel to other occupations. In Proceedings of the IEEE 26th Hawaii International Conference on System Sciences. 378--386.Google ScholarGoogle Scholar
  68. Myers, M. E. 1991. Motivation and performance in the information sytems field: A survey of related studies. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 44--49. Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Nadler, D. and Lawler, E. 1983. Quality of work life: Perspective and directions. Organisational Dynam. 11, 3, 20--23.Google ScholarGoogle ScholarCross RefCross Ref
  70. Nelson, A. C. and Lerouge, C. 2001. Self-Esteem: Moderator between role stress fit and satisfaction and commitment? In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 74--77. Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Ouchi, W. G. 1981.Theory Z: How American Business can meet the Japanese Challenge. Addison-Wesley, Reading, MA.Google ScholarGoogle Scholar
  72. Peters, L. 2003. Managing software professionals. In Proceedings of the IEMC Conference: Managing Technologically Driven Organizations. IEEE, 61--6.Google ScholarGoogle ScholarCross RefCross Ref
  73. Procaccino, J. D., Verner, J. M., Shelfer, K. M., and Gefen, D. 2005. What do software practitioners really think about project success: An exploratory study. J. Syst. Softw. 78, 2, 194--203. Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Ramachandran, S. and Rao, S. V. 2006. An effort towards identifying occupational culture among information systems professionals. In Proceedings of the ACM SIGMIS Conference on Computer Personnel Research (CPR'06): Forty Four Years of Computer Personnel Research: Achievements, Challenges and the Future. ACM Press, 198--204. Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Rasch, R. H. and Tosi, H. L. 1992. Factors affecting software developers' performance: An integrated approach. Manage. Inform. Syst. Quart. 16, 3, 395--413. Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Reid, M. F., Allen, M. W., Riemenschnider, C. K., and Armstrong, D. J. 2006. Affective commitment in the public sector: The case of IT employees. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 321--332. Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Ridings, C. M. and Eder, L. B. 1999. An analysis of IS technical career paths and job satisfaction. SIGCPR Comput. Pers. 20, 2, 7--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  78. Roberts, J., Hann, I., and Slaughter, S. 2004. Understanding the motivations, participation and performance of open source software developers: A longitudinal study of the Apache projects. Carnegie Mellon University working paper.Google ScholarGoogle Scholar
  79. Robson, C. 2002. Real World Research: A Resource for Social Scientists and Practitioner-Researchers (2nd Ed.). Blackwell Publishing, Malden, MA.Google ScholarGoogle Scholar
  80. Rubin, H. I. and Hernandez, E. F. 1988. Motivations and behaviors of software professionals. In Proceedings of the ACM SIGCPR Conference on Management of Information Systems Personnel. ACM Press, 62--71. Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. Santana, M. and Robey, D. 1995. Perceptions of control during systems development: Effects on job satisfaction of systems professionals. SIGCPR Comput. Pers. 16, 1, 20--34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. Schein, E. H. 1990. Career Anchors. Pfeiffer, San Diego, CA.Google ScholarGoogle Scholar
  83. Schein, E. H. 1996. Career anchors revisited: Implications for career development in the 21st century. Academ. Manage. Executive 10, 4, 80--88.Google ScholarGoogle Scholar
  84. Skinner, B. F. 1976. Walden Two. Prentice Hall, Upper Saddle River, NJ.Google ScholarGoogle Scholar
  85. Smith, D. C. and Speight, H. L. 2006. Antecedents of turnover intention and actual turnover among information systems personnel in South Africa. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 123--129. Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. Smits, S. J., McLean, E. R., and Tanner, J. R. 1992. Managing high achieving information systems professionals. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. A. L. Lederer, Ed. ACM Press, 314--327. Google ScholarGoogle ScholarDigital LibraryDigital Library
  87. Smits, S. J., McLean, E. R., and Tanner, J. R. 1997. A longitudinal study of I/S careers: Synthesis, conclusion, and recommendations. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. ACM Press, 36--48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. Sumner, M., Yager, S., and Franke, D. 2005. Career orientation and organizational commitment of IT personnel. In Proceedings of the ACM SIGCPR Conference on Computer Personnel Research. 75--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  89. Tanner, F. R. 2003. On motivating engineers. In Proceedings of the Engineering Management Conference (IEMC'03). 214--218.Google ScholarGoogle ScholarCross RefCross Ref
  90. Tanniru, M. R. and Taylor, S. M. 1981. Causes of turnover among data processing professionals—Some preliminary findings. In Proceedings of the 18th Annual ACM SIGCPR Computer Personnel Research Conference. ACM Press, 224--247. Google ScholarGoogle ScholarDigital LibraryDigital Library
  91. Thatcher, J. B., Liu, Y., and Stepina, L. P. 2002. The role of the work itself: An empirical examination of intrinsic motivation's influence on IT workers attitudes and intentions. In Proceedings of the ACM SIGCPR Conference. ACM Press, 25--33. Google ScholarGoogle ScholarDigital LibraryDigital Library
  92. Thomas, S. A., Hurley, S. F., and Barnes, D. J. 1996. Looking for the human factors in software quality management. Int. Softw. 28, 1, 19--38.Google ScholarGoogle Scholar
  93. Turley, R. T. and Bieman, J. M. 1995. Competencies of exceptional and nonexceptional software engineers. J. Syst. Softw. 28, 1, 19--38. Google ScholarGoogle ScholarDigital LibraryDigital Library
  94. Vroom, V. H. 1964. Work and Motivation. Wiley, New York.Google ScholarGoogle Scholar
  95. Xin Li, Valacich, J. S., and Hess, T. J. 2004. Predicting user trust in information systems: A comparison of competing trust models. In Proceedings of the 37th Annual Hawaii International Conference on System Sciences. Google ScholarGoogle ScholarDigital LibraryDigital Library
  96. Zawacki, R. A. 1992. Motivating the IS people of the future. Inform. Syst. Manage. 9, 2, 73--75.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. A systematic review of theory use in studies investigating the motivations of software engineers

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Software Engineering and Methodology
          ACM Transactions on Software Engineering and Methodology  Volume 18, Issue 3
          May 2009
          142 pages
          ISSN:1049-331X
          EISSN:1557-7392
          DOI:10.1145/1525880
          Issue’s Table of Contents

          Copyright © 2009 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 4 June 2009
          • Accepted: 1 November 2007
          • Revised: 1 October 2007
          • Received: 1 August 2007
          Published in tosem Volume 18, Issue 3

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader