Skip to main content
SpringerLink
Log in

An Approach to Evaluating E-Business Information Systems Projects

  • Published:
Information Systems Frontiers Aims and scope Submit manuscript

Abstract

Capital investments in the e-business infrastructure add complexity to the IT payoff question because e-business interorganizational investments are deployed across multiple platforms, projects, vendors and partners. Traditional MIS research has been devoted to measuring the payoff from information technology (IT) investment without any specific focus on e-business. Flaws in the mature MIS performance measures seem to yield weak guidance for managers when evaluating IT success, thus diluting the potential for these measures to be adapted for use in the new e-business environment. A review of the conventional MIS payoff literature indicates that these measures may be incomplete, inaccurate, or inefficient for application to electronic commerce investments. This paper brings four new points to the e-business IT investment evaluation dialogue: (1) we first explore performance measurement validity flaws in our long established measures; (2) the paper discusses a two-by-two matrix delineating the gap between the quantitative versus qualitative performance measures of management information systems (MIS) initiatives; (3) sample e-business payoff techniques are discussed and reviewed in light of these historical imperfections, and (4) fourth, the paper proposes and describes an innovative framework derived from production theory economics for future research in evaluating e-business MIS implementations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Ackoff RL. Management misinformation systems. Management Science 1967;14(4):147-156.

    Google Scholar 

  • Alpar P, Porembski M, Pickerodt S. Measuring efficiency of web site traffic generation. International Journal of Electronic Commerce 2001;6(1):53-74.

    Google Scholar 

  • Bailey JE, Pearson SW. Development of a tool for measuring and analyzing computer user satisfaction. Management Science 1983;29(5):350-545.

    Google Scholar 

  • Bariff M, Lusk EN. Cognitive personality tests for the design of MIS. Management Science 1977;23(8):820-829.

    Google Scholar 

  • Barua A, Kriebel CH, Mukhopadhyay T. Information technologies and business value: An analytical emprical investigation. Information Systems Research 1995;6(1):3-23.

    Google Scholar 

  • Benbasat I, Zmud RW. Empirical research in information systems: The practice of relevance. MIS Quarterly 1999;23(1):3-16.

    Google Scholar 

  • Blair MM, Wallman SMH (eds.). Unseen Wealth: Report of the Brookings Task Force on Intangibles. Washington, DC: Brookings Institution Press, 2001.

    Google Scholar 

  • Brynjolfsson E. The productivity paradox of information technology. Communications of the ACM 1993;36(12):67-77.

    Google Scholar 

  • Brooks FP Jr. The Mythical Man-Month. 2nd edition. Reading, MA: Addison-Wesley, 1995.

    Google Scholar 

  • Brynjolfsson E, Smith MD. Frictionless commerce? A comparison of internet and conventional retailers. Management Science 2000;46:563-585.

    Google Scholar 

  • Carmines EG, Zeller RA. Reliability and Validity Assessment. Newbury Park: Sage Publications, 1979.

    Google Scholar 

  • Cash JI, Konsynski BR. IS Redraws competitive boundaries. Harvard Business Review, March-April 1985. Reprinted in Revolution in Real Time: Managing Information Technology in the 1990s. Boston, MA: Harvard Business Review Book, 1991:95-111.

    Google Scholar 

  • Cronbach LJ, Meehl PE. Construct validity in psychological tests. In: Jackson DN, Messick S, eds. Problems in Human Assessment. New York: McGraw-Hill Book Co., 1959:57-77.

    Google Scholar 

  • Cusumano MA, Yoffie DB. Competing on Internet Time: Lessons from Netscape and its Battle with Microsoft. New York: The Free Press, 1998.

    Google Scholar 

  • Cyert RM, March JG. A Behavioral Theory of the Firm. Englewood Cliffs, NJ: Prentice-Hall, 1963.

    Google Scholar 

  • Davenport T. Process Innovation: Reengineering Work Through Information Technology. Boston: Harvard Business School Press, 1992.

    Google Scholar 

  • Dearden J. MIS is a mirage. Harvard Business Review 1972;50(1):90-99.

    Google Scholar 

  • DeLone WH, McLean ER. Information systems success: The quest for the dependent variable. Information Systems Research 1992;3(1):60-95.

    Google Scholar 

  • Doll W, Torkzadeh G. The measurement of end user computing satisfaction. MIS Quarterly 1988;(June):259-274.

  • Dos Santos B. Justifying investments in new information technologies. Journal of Management Information Systems 1994;7(4);71-90.

    Google Scholar 

  • Dos Santos B, Peffers K, Mauer D. The impact of information technology investment announcements on the market value of the firm. Information Systems Research 1993;4(1):1-23.

    Google Scholar 

  • Eilon S. Measuring quality of information systems. OMEGA 1993;21(2):135-138.

    Google Scholar 

  • Floyd SW, Woolridge W. Path analysis of the relationship between competitive strategy, information technology, and financial performance. Journal of Management Information Systems 1990;7(1):47-64.

    Google Scholar 

  • Grove HD, Frank HS, Hanbery G. The effect of information system intangibles on the market value of the firm. Journal of Information Systems 1990;Fall:36-47.

    Google Scholar 

  • Grover V, Teng TC, Fiedler KD. Information technology enabled business process redesign: An integrated planning framework. OMEGA Int. J. of Management Science 1993;21(4):433-447.

    Google Scholar 

  • Harris SE, Katz JL. Organizational performance and information technology investment intensity in the insurance industry. Organization Science 1991;2(3):263-295.

    Google Scholar 

  • Hammer M. Reengineering work: Don't automate, obliterate. Harvard Business Review July/August, 1990.

  • Hammer M, Champy J. Reengineering the Corporation. New York: Harper and Row, 1992.

    Google Scholar 

  • Hitt L, Brynjolfsson E. The three faces of IT value: Theory and evidence. In: Proceedings of the 15th International Conference of Information Systems, Vancouver, Dec. 1994:263-277.

  • Hong Se-Joon. Information processing costs in online stock trading. Electronic Markets 2000;10(3):192-196.

    Google Scholar 

  • Ives B, Olson M, Baroudi J. The measurement of user information satisfaction. Communications of the ACM 1983;26(10):785-793.

    Google Scholar 

  • Keen Peter GW. Competing In Time: Using Telecommunications for Competitive Advantage. Ballinger Publishing Company, 1988.

  • Kemerer C. “IT”Shapes Competition. Boston: Kluwer Academic Publishers, 1998.

    Google Scholar 

  • Klein S, O'Keefe B. Refining the measurement of e-commerce. International Journal of Electronic Commerce 2001;6(1):9.

    Google Scholar 

  • Kuhn TS. The Structure of Scientific Revolutions, 2nd edn. Chicago: The University of Chicago Press, enlarged, 1970. Originally published in 1962.

    Google Scholar 

  • Markus ML, Robey D. Information technology and organizational change-causal-structure in theory and research. Management Science 1988;34(5):583-598.

    Google Scholar 

  • Lee C. Valuation of the internet infomediaries.Working Paper, June 2, 1999, National Taiwan University.

  • Lester RK. The Productive Edge. New York: W.W. Norton and Co., 1998.

    Google Scholar 

  • Lucas HC Jr. Information Technology and the Productivity Paradox. New York: Oxford University Press, 1999.

    Google Scholar 

  • Melone N. A theoretical assessment of the user-satisfaction construct in information systems research. Management Science 1990;36(1):76-91.

    Google Scholar 

  • Perkins AB, Perkins MC. The Internet Bubble: Inside the Overvalued World of High-Tech Stocks. New York: HarperBusiness, 1999.

    Google Scholar 

  • Porter M, Millar V. How information gives you competitive advantage. Harvard Business Review July/August, 1985.

  • Powell TC, DentMicallef A. Information technology as competitive advantage: The role of human, business and technology resources. Strategic Management Journal 1997;18(5):375-405.

    Google Scholar 

  • Rangone A, Balocco R. A performance measurement system for planning and controlling a B2C e-commerce strategy. Electronic Markets 2000;10(2):130-143.

    Google Scholar 

  • Reynolds PD. A Primer in Theory Construction. New York: MacMillan Publishing Co., 1971.

    Google Scholar 

  • Sethi V, King WR. Construct measurement in information systems research. Decision Sciences 1991;22:455-472.

    Google Scholar 

  • Shiller RJ. Irrational Exuberance. Princeton, NJ: Princeton University Press, 2000.

    Google Scholar 

  • Steinbart PJ, Nath R. Problems and issues in the management of international data communications networks: The experience of American companies. MIS Quarterly 1992;(March):55-73.

  • Stewart TA. Intellectual Capital: The New Wealth of Organizations. New York: Doubleday, 1997.

    Google Scholar 

  • Strassmann PA. The Business Value of Computers: An Executive's Guide. New Canaan, CT: The New Information Economics Press, 1990.

    Google Scholar 

  • Tam KY. The impact of information technolgoy investments on firm performance and evaluation: Evidence from newly industrialized economies. Information Systems Research 1998;9(1):85-98.

    Google Scholar 

  • Vehovar V, Manfreda KL, Batagelj Z. Sensitivity of e-commerce measurement to the survey instrument. International Journal of Electronic Commerce 2001;6(1):31-51.

    Google Scholar 

  • Weill P. The relationship between investment in information technology and firm performance: A study of the valve manufacturing sector. Information Systems Research 1992;3(4):307-333.

    Google Scholar 

  • Weill P, Olson MH. Managing investment in information technology: Mini case examples and implications. MIS Quarterly 1989;(March):3-17.

Download references

Author information

Authors and Affiliations

  1. College of Business and Economics, West Virginia University, PO Box 6025, Morgantown, WV, 26506-6025, USA

    Virginia Franke Kleist

Authors
  1. Virginia Franke Kleist
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kleist, V.F. An Approach to Evaluating E-Business Information Systems Projects. Information Systems Frontiers 5, 249–263 (2003). https://doi.org/10.1023/A:1025693109442

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1025693109442

Search

Navigation