Skip to main content

2016 | OriginalPaper | Buchkapitel

A Portable and Platform Independent File System for Large Scale Peer-to-Peer Systems and Distributed Applications

verfasst von : Andreas Barbian, Stefan Nothaas, Timm J. Filler, Michael Schoettner

Erschienen in: Advances in Parallel and Distributed Computing and Ubiquitous Services

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Virtual microscopy is an evolving medical application used for teaching and learning at universities. We have developed a peer-to-peer based solution called Omentum, aiming at bringing virtual microscopy to an Internet-scale community. Omentum has to manage more than 10,000 large proprietary microscopic images that are converted to easily dividable JPEG-trees, each consisting of millions of very small-scaled image parts. In this paper we propose a portable and platform independent user space file system (USPFS) for addressing the application-specific access patterns, security concerns and data integrity. USPFS is able to efficiently manage huge capacities (roughly 9 × 1018 slices with 9,000 Petabytes each) with a theoretically infinite number of storable objects while providing highly important platform independency, data integrity checks as well as an easily extendable API. The evident metadata overhead is only 0.3 % and the performance evaluation shows promising results for both read and write operations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Best S (2000) Jfs log: how the journaled file system performs logging. In: Proceedings of the 4th annual Linux showcase and conference, pp 163–168, October 2000 Best S (2000) Jfs log: how the journaled file system performs logging. In: Proceedings of the 4th annual Linux showcase and conference, pp 163–168, October 2000
2.
Zurück zum Zitat Blake CA, Lavoie HA, Millette CF (2003) Teaching medical histology at the university of south Carolina school of medicine: transition to virtual slides and virtual microscopes. Anatom Rec (New Anat) 275B:196–206CrossRef Blake CA, Lavoie HA, Millette CF (2003) Teaching medical histology at the university of south Carolina school of medicine: transition to virtual slides and virtual microscopes. Anatom Rec (New Anat) 275B:196–206CrossRef
3.
Zurück zum Zitat Bonwick J, Ahrens M, Henson V, Maybee M, Shellenbaum M (2003) The zettabyte file system. Technical report, SUN Microsystems Bonwick J, Ahrens M, Henson V, Maybee M, Shellenbaum M (2003) The zettabyte file system. Technical report, SUN Microsystems
4.
Zurück zum Zitat Card R, Ts’o T, Tweedie S (1994) Design and implementation of the second extended filesystem. In: Brokken FB, Kubat K (eds) Proceedings of the first Dutch international symposium on Linux. State University of Groningen, December 1994 Card R, Ts’o T, Tweedie S (1994) Design and implementation of the second extended filesystem. In: Brokken FB, Kubat K (eds) Proceedings of the first Dutch international symposium on Linux. State University of Groningen, December 1994
5.
Zurück zum Zitat Heidger PM Jr, Dee F, Leaven T, Duncan J, Kreiter C (2002) Integrated approach to teaching and testing in histology with real and virtual imaging. Anatom Rec (New Anat) 269(2):107–112CrossRef Heidger PM Jr, Dee F, Leaven T, Duncan J, Kreiter C (2002) Integrated approach to teaching and testing in histology with real and virtual imaging. Anatom Rec (New Anat) 269(2):107–112CrossRef
6.
Zurück zum Zitat Jaegermann A, Filler TJ, Schoettner M (2013) Distributed architecture for a peer-to-peer-based virtual microscope. In: Dowling J, Taiani F (eds) Distributed applications and interoperable systems. Springer, pp 199–204, June 2013 Jaegermann A, Filler TJ, Schoettner M (2013) Distributed architecture for a peer-to-peer-based virtual microscope. In: Dowling J, Taiani F (eds) Distributed applications and interoperable systems. Springer, pp 199–204, June 2013
7.
Zurück zum Zitat Mathur A, Cao M, Bhattacharya S, Dilger A, Tomas A, Vivier L (2007) The new ext4 filesystem: current status and future plans. In: Proceedings of the Linux symposium, vol 2, pp 21–33, Ottawa, Ontario, Canada, June 2007 Mathur A, Cao M, Bhattacharya S, Dilger A, Tomas A, Vivier L (2007) The new ext4 filesystem: current status and future plans. In: Proceedings of the Linux symposium, vol 2, pp 21–33, Ottawa, Ontario, Canada, June 2007
8.
Zurück zum Zitat Mazières D (2001) A toolkit for user-level file systems. In: Proceedings of the 2001 USENIX annual technical conference, Boston, Massachusetts, USA, June 2001 Mazières D (2001) A toolkit for user-level file systems. In: Proceedings of the 2001 USENIX annual technical conference, Boston, Massachusetts, USA, June 2001
9.
Zurück zum Zitat Rajgarhia A, Gehani A (2010) Performance and extension of user space file systems. In: Proceedings of the 2010 ACM symposium on applied computing, Sierre, Switzerland, March 2010. ACM New York, NY, USA, pp 206–213 Rajgarhia A, Gehani A (2010) Performance and extension of user space file systems. In: Proceedings of the 2010 ACM symposium on applied computing, Sierre, Switzerland, March 2010. ACM New York, NY, USA, pp 206–213
10.
Zurück zum Zitat Rojo MG, García GB, Mateos CP, García JG, Vincente MC (2006) Critical comparison of 31 commercially available digital slide systems in pathology. Int J Surg Pathol 14(4):285–305 Rojo MG, García GB, Mateos CP, García JG, Vincente MC (2006) Critical comparison of 31 commercially available digital slide systems in pathology. Int J Surg Pathol 14(4):285–305
11.
Zurück zum Zitat Shvachko K, Kuang H, Radia S, Chansler R (2010) The hadoop distributed file system. In: Proceedings of the IEEE 26th symposium on mass storage systems and technologies (MSST). IEEE, pp 1–10, May 2010 Shvachko K, Kuang H, Radia S, Chansler R (2010) The hadoop distributed file system. In: Proceedings of the IEEE 26th symposium on mass storage systems and technologies (MSST). IEEE, pp 1–10, May 2010
Metadaten
Titel
A Portable and Platform Independent File System for Large Scale Peer-to-Peer Systems and Distributed Applications
verfasst von
Andreas Barbian
Stefan Nothaas
Timm J. Filler
Michael Schoettner
Copyright-Jahr
2016
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-0068-3_6

Premium Partner