William J. Bolosky
Abstract
We consider an architecture for a serverless distributed file system that does not assume mutual trust among the client computers. The system provides security, availability, and reliability by distributing multiple encrypted replicas of each file among the client machines. To assess the feasibility of deploying this system on an existing desktop infrastructure, we measure and analyze a large set of client machines in a commercial environment. In particular, we measure and report results on disk usage and content; file activity; and machine uptimes, lifetimes, and loads. We conclude that the measured desktop infrastructure would passably support our proposed system, providing availability on the order of one unfilled file request per user per thousand days.
- 1 T. Anderson, M. Dahtin, J. Neefe, D. Patterson, D. Roselli, R. Wang. Serverless Network File Systems. 15th SOSP, p. 109-126, Dec I995. Google Scholar
Digital Library
- 2 T. Anderson, D. Culler, D. Patterson, the NOW team. A Case for NOW (Networks of Workstations). IEEE Micro. p. 54-64. Feb 1995. Google ScholarDigital Library
- 3 R. Arpaci, A. Dusseau, A. V ahdat, L. Liu, T. Anderson, D. Patterson. The Interaction of Parallel and Sequential Workloads on a Network of Workstations. 1995 SIGMETRICS '95, p. 267-278, May 1995. Google ScholarDigital Library
- 4 M. Baker, J. Hartmann, M. Kupfer, K. Shirriff, J. Ousterhout. Measurement of a Distributed File System. 13th SOSP, p. 198-212, Oct 1991. Google ScholarDigital Library
- 5 W.J. Bolosky, S. Corbin, D. Goebel, J. R. Douceur. Single Instance Storage in Windows 2000. To appear in 4th Usenix Windows System Symposium, Aug 2000. Google ScholarDigital Library
- 6 L. Breslau, P. Cao, L. Fan, G. Phillips, S. Shenker. Web caching and Zipf-like distributions: Evidence and implications. INFOCOM '99, p. 126-134, Mar 1999.Google ScholarCross Ref
- 7 J.R. Douceur, W. J. Bolosky. A Large-Scale Study of File- System Contents. SIGMETRICS '99 27(1), p. 59-70, May t999. Google ScholarDigital Library
- 8 J. R. Douceur, W. J. Bolosky. Sanitized Data Set from "'A Large-Scale Study of File-System Contents." CD-ROM. Microsoft Research, 1999.Google Scholar
- 9 F. Douglis, J. Ousterhout. Transparent Process Migration; Design Alternatives and the Sprite Implementation. Software - Practice and Experience 21(8), p. 757-785, Aug 1991. Google ScholarDigital Library
- 10 J. E. Freund. Mathematical Statistics, Fifth Edition. Prentice Hall, 1992. Google ScholarDigital Library
- 11 K. F. Gauss. Theoria combinationis observationum erroribus minimis obnoxiae, 1823.Google Scholar
- 12 D. K. Gifford. Weighted voting for replicated data. 7th SOSP, p. 150-162, 1979. Google ScholarDigital Library
- 13 J. Howard, M. Kazar, S. Menees, D. Nichols, M. Satyanarayanan, R. Sidebotham, M. West. Scale and Performance in a Distributed File System. TOCS 6(1), p. 51- 81, Feb 1988. Google ScholarDigital Library
- 14 J. Kistler, M. Satyanarayanan. Disconnected operation in the Coda File System. TOCS 10(1), p. 3-25, Feb 1992. Google ScholarDigital Library
- 15 E. Lee, C. Thekkath. Petal: Distributed virtual disks. 7th ASPLOS, p. 84-92, Oct 1996. Google ScholarDigital Library
- 16 M. McKusick, W. Joy, S. Leffler, R. Fabry. A Fast File System for UNIX. TOCS, 2(3):181m197, Aug 1984. Google ScholarDigital Library
- 17 L. Mummert, M. Satyanarayanan. Long Term Distributed File Reference Tracing: Implementation and Experience. Software - Practice and Experience 26(6), p. 705-736, Nov 1994. Google ScholarDigital Library
- 18 M. M. Mutka, M. Livny. The Available Capacity of a Privately Owned Workstation Environment. Performance Evaluation 12(4), p. 269-284, Jut 1991. Google ScholarDigital Library
- 19 M. Nelson, B. Welch, J. Ousterhout. Caching in the Sprite Network Filesystem. TOCS 6(1), p. 134-154, Feb 1988. Google ScholarDigital Library
- 20 J. Ousterhout, H. Da Costa, D. Harrison, J. Junze, M. Kupfer, J. Thompson. A Trace-Driven Analysis of the UNIX 4.2 BSD File System. lOth SOSP, p. 15-24, Dec 1985. Google ScholarDigital Library
- 21 D. Patterson, G. Gibson, R. Katz. A Case for Redundant Arrays of Inexpensive Disks (RAID). Internat. Conf. on Management of Data, p. 109-116, Jun 1988. Google ScholarDigital Library
- 22 R. Rashid, A. Tevanian, M. Young, D. Golub, R. Baron, D. Black, W. Bolosky, J. Chew. Machine-Independent Virtual Memory Management for Paged Uniprocessor and Multiprocessor Architectures. 2nd ASPLOS, p. 31-41, Oct 1987. Google ScholarCross Ref
- 23 R. Sandberg, D. Goldberg, S. Kleiman, D. Walsh, B. Lyon. Design and Implementation of the Sun Network File System. Summer USENIX Proceedings, 1985.Google Scholar
- 24 M. Satyanarayanan. Scalable, Secure and Highly Available Distributed File Access. IEEE Computer 23(5), May 1990. Google ScholarDigital Library
- 25 Seagate Technology, Inc. http://seagate.comGoogle Scholar
- 26 D. Solomon. Inside Windows NT Second Edition. Microsoft Press, 1998. Google ScholarDigital Library
- 27 C. Thekkath, T. Mann, E. Lee. Frangipani: A Scalable Distributed File System. 16th SOSP, p. 224-237, Dec 1997. Google ScholarDigital Library
- 28 S. Travaglia. BOFH. http://www.theregister.co.uk/cgibi n/SearchA rticles.pl?search=BOFHGoogle Scholar
- 29 W. Vogels. File system usage in Windows NT 4.0. 17th SOSP, p. 93-109, Dec 1999. Google ScholarDigital Library
- 30 B. Walker, G. Popek, R. English, C. Kline, G. Thiel. The LOCUS Distributed Operating System, 9th SOSP, p. 49-70, Oct 1983. Google ScholarDigital Library
Index Terms
- Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs
Recommendations
Serverless network file systems
Special issue on operating system principlesWe propose a new paradigm for network file system design: serverless network file systems. While traditional network file systems rely on a central server machine, a serverless system utilizes workstations cooperating as peers to provide all file system ...
Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs
SIGMETRICS '00: Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systemsWe consider an architecture for a serverless distributed file system that does not assume mutual trust among the client computers. The system provides security, availability, and reliability by distributing multiple encrypted replicas of each file among ...
Comments