Skip to main content
Top

2021 | OriginalPaper | Chapter

Benchmarking Performance of Erasure Codes for Linux Filesystem EXT4, XFS and BTRFS

Authors : Shreya Bokare, Sanjay S. Pawar

Published in: Progress in Advanced Computing and Intelligent Engineering

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Over the past few years, erasure coding has been widely used as an efficient fault tolerance mechanism in distributed storage systems. There are various implementations of erasure coding available in the research community. Jerasure is one of the widely used open-source library in erasure coding. In this paper, we compared various implementations of Jerasure library in encoding and decoding scenario. Our goal is to compare codes with different filesystems data to understand its impact on code performance. The number of failure scenarios is evaluated to understand performance characteristics of Jerasure code implementation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
8.
go back to reference Singh K, Learning Ceph- A practical guide to designing, implementing, and managing your software-defined, massively scalable Ceph storage system. Packet publishing Singh K, Learning Ceph- A practical guide to designing, implementing, and managing your software-defined, massively scalable Ceph storage system. Packet publishing
9.
go back to reference Plank JS, Xu L (July 2006) Optimizing Cauchy Reed-Solomon codes for fault-tolerant network storage applications. In: NCA-06: 5th IEEE international symposium on network computing applications, Cambridge, MA Plank JS, Xu L (July 2006) Optimizing Cauchy Reed-Solomon codes for fault-tolerant network storage applications. In: NCA-06: 5th IEEE international symposium on network computing applications, Cambridge, MA
10.
go back to reference Macwilliams FJ, Sloane NJA (1977) The theory of error-correcting codes, part I. North-Holland Publishing Company, AmsterdamMATH Macwilliams FJ, Sloane NJA (1977) The theory of error-correcting codes, part I. North-Holland Publishing Company, AmsterdamMATH
11.
go back to reference Plank JS, Luo J, Schuman CD, A performance evaluation and examination of open-source erasure coding libraries for storage. In: FAST ’09 Proceedings of the 7th conference on File and storage technologies technologies Plank JS, Luo J, Schuman CD, A performance evaluation and examination of open-source erasure coding libraries for storage. In: FAST ’09 Proceedings of the 7th conference on File and storage technologies technologies
12.
go back to reference Blaum M, Roth RM (1999) On lowest density MDS codes. IEEE Trans Inf Theory 45(1):46–59 Blaum M, Roth RM (1999) On lowest density MDS codes. IEEE Trans Inf Theory 45(1):46–59
13.
go back to reference Plank JS (2008) The RAID-6 Liberation codes. In: FAST-2008: 6th Usenix conference on file and storage technologies San Jose, February 2008, pp 97–110 Plank JS (2008) The RAID-6 Liberation codes. In: FAST-2008: 6th Usenix conference on file and storage technologies San Jose, February 2008, pp 97–110
14.
go back to reference Plank JS (2006) A new minimum density RAID-6 code with a word size of eight. In: NCA-08: 7th IEEE international symposium on network computing applications, Cambridge, MA, July 2008 Plank JS (2006) A new minimum density RAID-6 code with a word size of eight. In: NCA-08: 7th IEEE international symposium on network computing applications, Cambridge, MA, July 2008
15.
go back to reference Nanal N, white paper on File system throughput performance on RedHawk™Linux Nanal N, white paper on File system throughput performance on RedHawk™Linux
16.
go back to reference Burihabwa D, Felber P, Mercier H, Schiavoni V (2016) A performance evaluation of erasure coding libraries for cloud-based data stores (Practical Experience Report). In: IFIP international federation for information processing 2016, pp 160–173 Burihabwa D, Felber P, Mercier H, Schiavoni V (2016) A performance evaluation of erasure coding libraries for cloud-based data stores (Practical Experience Report). In: IFIP international federation for information processing 2016, pp 160–173
17.
go back to reference Vujicic D, Markovic D, Djordjevic B, Ranić S (2016) Benchmarking Performance of EXT4, XFS and BTRFS as Guest File Systems Under Linux Environment, IcETRAN 2016, At Zlatibor, Serbia Vujicic D, Markovic D, Djordjevic B, Ranić S (2016) Benchmarking Performance of EXT4, XFS and BTRFS as Guest File Systems Under Linux Environment, IcETRAN 2016, At Zlatibor, Serbia
Metadata
Title
Benchmarking Performance of Erasure Codes for Linux Filesystem EXT4, XFS and BTRFS
Authors
Shreya Bokare
Sanjay S. Pawar
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-6584-7_32