skip to main content
10.1145/1005686.1005694acmconferencesArticle/Chapter ViewAbstractPublication PagesmetricsConference Proceedingsconference-collections
Article

Interposed proportional sharing for a storage service utility

Published:01 June 2004Publication History

ABSTRACT

This paper develops and evaluates new share-based scheduling algorithms for differentiated service quality in network services, such as network storage servers. This form of resource control makes it possible to share a server among multiple request flows with probabilistic assurance that each flow receives a specified minimum share of a server's capacity to serve requests. This assurance is important for safe outsourcing of services to shared utilities such as Storage Service Providers.Our approach interposes share-based request dispatching on the network path between the server and its clients. Two new scheduling algorithms are designed to run within an intermediary (e.g., a network switch), where they enforce fair sharing by throttling request flows and reordering requests; these algorithms are adaptations of Start-time Fair Queuing (SFQ) for servers with a configurable degree of internal concurrency. A third algorithm, Request Windows (RW), bounds the outstanding requests for each flow independently; it is amenable to a decentralized implementation, but may restrict concurrency under light load. The analysis and experimental results show that these new algorithms can enforce shares effectively when the shares are not saturated, and that they provide acceptable performance isolation under saturation. Although the evaluation uses a storage service as an example, interposed request scheduling is non-intrusive and views the server as a black box, so it is useful for complex services with no internal support for differentiated service quality.

References

  1. Tarek F. Abdelzaher, Kang G. Shin, and Nina Bhatti. Performance guarantees for Web server end-systems: A control-theoretical approach. IEEE Transactions on Parallel and Distributed Systems, To appear 2001.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Darrell C. Anderson and Jeffrey S. Chase. Fstress: A flexible network file service benchmark. Technical Report CS-2002-01, Duke University, Department of Computer Science, January 2002.]]Google ScholarGoogle Scholar
  3. Darrell C. Anderson, Jeffrey S. Chase, and Amin M. Vahdat. Interposed request routing for scalable network storage. ACM Transactions on Computer Systems (TOCS) special issue: selected papers from the Fourth Symposium on Operating System Design and Implementation (OSDI), October 2000, 20(1), February 2002.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Mohit Aron. Differentiated and Predictable Quality of Service in Web Server Systems. PhD thesis, Department of Computer Science, Rice University, October 2000.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Gaurav Banga, Peter Druschel, and Jeffrey C. Mogul. Resource containers: A new facility for resource management in server systems. In Proceedings of the Third Symposium on Operating Systems Design and Implementation (OSDI), February 1999.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Jon C. R. Bennett and Hui Zhang. wf2q: Worst-case fair weighted fair queuing. In Proceedings of IEEE INFOCOM'96, San Francisco, CA, March 1996.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Jon C. R. Bennett and Hui Zhang. Hierarchical packet fair queueing algorithms. IEEE/ACM Transactions on Networking, 5(5):675--689, October 1997.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Josep M. Blanquer and Banu Ozden. Fair queuing for aggregated multiple links. In ACM SIGCOMM, August 2001.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. John Bruno, Jose Brustoloni, Banu Ozden, and Abraham Silberschatz. Disk scheduling with quality of service guarantees. In IEEE International Conference on Multimedia Computing and Systems (ICMCS '99), June 1999.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. David D. Chambliss, Guillermo A. Alvarez, Prashant Pandey, Divyesh Jadav, and Tzongyu P. Lee Jian Xu, Ram Menon. Performance virtualization for large-scale storage systems. In 22nd International Symposium on Reliable Distributed Systems (SRDS '03), October 2003.]]Google ScholarGoogle Scholar
  11. Abhishek Chandra, Micah Adler, Pawan Goyal, and Prashant Shenoy. Surplus fair scheduling: A proportional-share CPU scheduling algorithm for symmetric multiprocessors. In Fourth Symposium on Operating System Design and Implementation (OSDI), October 2000.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Abhishek Chandra, Micah Adler, and Prashant Shenoy. Deadline fair scheduling: Bridging the theory and practice of proportionate fair scheduling in multiprocessor systems. In Seventh Real-Time Technology and Applications Symposium (RTAS '01), May 2001.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Jeffrey S. Chase, Darrell C. Anderson, Prachi N. Thakar, Amin M. Vahdat, and Ronald P. Doyle. Managing Energy and Server Resources in Hosting Centers. In Proceedings of the 18th ACM Symposium on Operating System Principles (SOSP), pages 103--116, October 2001.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Alan Demers, Srinivasan Keshav, and Scott Shenker. Analysis and simulation of a fair queuing algorithm. ACM SIGCOMM 89, 19(4):2--12, August 19-22, 1989.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Ron Doyle, Jeffrey S. Chase, Omer Asad, Wei Jin, and Amin Vahdat. Model-based resource provisioning in a Web service utility. In Proceedings of the Fourth Symposium on Internet Technologies and Systems (USITS), Seattle, Washington, USA, March 2003.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Boris Dragovic, Keir Fraser, Steve Hand, Tim Harris, Alex Ho, Ian Pratt, Andrew Warfield, Paul Barham, and Rolf Neugebauer. Xen and the Art of Virtualization. In Proceedings of the ACM Symposium on Operating Systems Principles, October 2003.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. S. Jamal Golestani. A self-clocked fair queuing scheme for broadband applications. In Proceedings of the 13th Annual Joint Conference of the IEEE Computer and Communications Societies on Networking for Global Communciation. Volume 2, pages 636--646, Los Alamitos, CA, USA, June 1994. IEEE Computer Society Press.]]Google ScholarGoogle Scholar
  18. P. Goyal, X. Guo, and H. Vin. A hierarchical CPU scheduler for multimedia operating systems. In Proceedings of Operating System Design and Implementation (OSDI'96), Seattle, pages 107--122, October 1996.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Pawan Goyal and Harrick M. Vin. Generalized guaranteed rate scheduling algorithms: a framework. IEEE/ACM Transactions on Networking, 5(4):561--571, August 1997.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Pawan Goyal, Harrick M. Vin, and Haichen Chen. Start-time fair queuing: A scheduling algorithm for integrated services packet switching networks. IEEE/ACM Transactions on Networking, 5(5):690--704, October 1997.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Lan Huang, Gang Peng, and Tzi cker Chiueh. Multi-dimensional storage virtualization. In Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS/Performance '04), June 2004.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Zhen Liu, Mark Squillante, and Joel Wolf. On maximizing service-level-agreement profits. In Proceedings of the 3rd ACM Conference on Electronic Commerce (EC-01), pages 213--223, New York, October 14-17 2001. ACM Press.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Christopher Lumb, Arif Merchant, and Guillermo A. Alvarez. Facade: Virtual storage devices with performance guarantees. In Proceedings of the 2nd USENIX Conference on File and Storage Technologies, San Francisco, CA, March 2003. ACM Press.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Kostas Magoutis, Salimah Addetia, Alexandra Fedorova, Margo Seltzer, Jeff Chase, Richard Kisley, Andrew Gallatin, Rajiv Wickremisinghe, and Eran Gabber. Structure and performance of the Direct Access File System. In USENIX Technical Conference, pages 1--14, June 2002.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Abhay K. Parekh and Robert G. Gallager. A generalized processor sharing approach to flow control in integrated services networks: the single-node case. IEEE/ACM Transactions on Networking, 1(3):344--357, June 1993.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Prashant J. Shenoy and Harrick M. Vin. Cello: A disk scheduling framework for next generation operating systems. In Proceedings of the 1998 ACM Sigmetrics Conference on Measurement and Modeling of Computer Systems, pages 44--55, 1998.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Dimitrios Stiliadis and Anujan Varma. Latency-rate servers: a general model for analysis of traffic scheduling algorithms. IEEE/ACM Transactions on Networking, 6(5):611--624, October 1998.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Bhuvan Urgaonkar, Prashant Shenoy, and Timothy Roscoe. Resource overbooking and application profiling in shared hosting platforms. In Proceedings of the Fifth Symposium on Operating Systems Design and Implementation (OSDI), Boston, MA, USA, December 2002.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Carl A. Waldspurger. Memory Resource Management in VMware ESX Server. In Symposium on Operating Systems Design and Implementation, December 2002.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Carl A. Waldspurger and William E. Weihl. Lottery Scheduling: Flexible Proportional-Share Resource Management. In Proceedings of the First Symposium on Operating Systems Design and Implementation (OSDI), pages 1--11, November 1994.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. John Wilkes. Traveling to Rome: QoS specifications for automated storage system management. Lecture Notes in Computer Science, 2092:75--92, 2001.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Kenneth G. Yocum, Darrell C. Anderson, Jeffrey S. Chase, and Amin Vahdat. Anypoint: Extensible transport switching on the edge. In Proceedings of the Fourth USENIX Symposium on Internet Technologies and Systems (USITS), March 2003.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Lixia Zhang. Virtual Clock: A new traffic control algorithm for packet switching networks. In SIGCOMM '90 Symposium: Communications Architectures and Protocols, pages 19--29, September 1990.]] Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Interposed proportional sharing for a storage service utility

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in
              • Published in

                cover image ACM Conferences
                SIGMETRICS '04/Performance '04: Proceedings of the joint international conference on Measurement and modeling of computer systems
                June 2004
                450 pages
                ISBN:1581138733
                DOI:10.1145/1005686
                • cover image ACM SIGMETRICS Performance Evaluation Review
                  ACM SIGMETRICS Performance Evaluation Review  Volume 32, Issue 1
                  June 2004
                  432 pages
                  ISSN:0163-5999
                  DOI:10.1145/1012888
                  Issue’s Table of Contents

                Copyright © 2004 ACM

                Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 1 June 2004

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • Article

                Acceptance Rates

                Overall Acceptance Rate459of2,691submissions,17%

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader