Skip to main content

2016 | OriginalPaper | Buchkapitel

Caching: QoS Enabled Metadata Processing Scheme for Data Deduplication

verfasst von : Jyoti Malhotra, Jagdish Bakal, L. G. Malik

Erschienen in: Proceedings of the International Congress on Information and Communication Technology

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Increase in digital data demands a smart storage technique which provides quick storage and faster recovery of the stored data. This voluminous data needs an intelligent data science tools and methods to struggle for the space required for efficiently storing the data. Deduplication is one the emerging and widely used techniques these days for reducing the data size and then transferring it over the network thus reducing the network bandwidth. Main aim of Deduplication is to reduce storage space by allowing only unique data. In this paper, we present the review of existing Deduplication solutions and propose enhanced cache mechanism approach for efficient Deduplication over distributed system.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Archives are file containers containing one or more compressed files.
 
Literatur
1.
Zurück zum Zitat BingChun Chang, “A Running Time Improvement for Two Threshold Two Divisors Algortihm” 2009. BingChun Chang, “A Running Time Improvement for Two Threshold Two Divisors Algortihm” 2009.
2.
Zurück zum Zitat Nagapramod Mandagere, Pin Zhou, Mark A Smith, Sandeep Uttamchandani, “Demystifying data de-duplication”, Proceedings of the ACM/IFIP/USENIX Middleware ‘08. Nagapramod Mandagere, Pin Zhou, Mark A Smith, Sandeep Uttamchandani, “Demystifying data de-duplication”, Proceedings of the ACM/IFIP/USENIX Middleware ‘08.
3.
Zurück zum Zitat Jyoti Malhotra, Jagdish Bakal, “A survey and comparative study of data deduplication techniques”, Pervasive Computing (ICPC), 2015 International Conference on, IEEE ICPC 2015, Pages 1–5. Jyoti Malhotra, Jagdish Bakal, “A survey and comparative study of data deduplication techniques”, Pervasive Computing (ICPC), 2015 International Conference on, IEEE ICPC 2015, Pages 1–5.
4.
Zurück zum Zitat W. Dong, F. Douglis, K. Li, H. Patterson, S. Reddy, and P. Shilane. “Tradeoffs in scalable data routing for deduplication clusters”. In Proceedings of the 9th USENIX conference on File and Storage Technologies, FAST’11, pages 15–29, Berkeley, CA, USA, 2011. USENIX Association. W. Dong, F. Douglis, K. Li, H. Patterson, S. Reddy, and P. Shilane. “Tradeoffs in scalable data routing for deduplication clusters”. In Proceedings of the 9th USENIX conference on File and Storage Technologies, FAST’11, pages 15–29, Berkeley, CA, USA, 2011. USENIX Association.
5.
Zurück zum Zitat Yinjin Fu, Hong Jiang, and Nong Xiao. A Scalable Inline Cluster Deduplication Framework for Big Data Framework. Middleware ‘12 Proceedings of the 13th International Middleware Conference Pages 354–373. Yinjin Fu, Hong Jiang, and Nong Xiao. A Scalable Inline Cluster Deduplication Framework for Big Data Framework. Middleware ‘12 Proceedings of the 13th International Middleware Conference Pages 354–373.
6.
Zurück zum Zitat David Frey, Anne-Marie Kermarrec, “Probabilistic Deduplication for Cluster-based storage system deduplication” in Proc. ACM Cloud Computing, October 2012. David Frey, Anne-Marie Kermarrec, “Probabilistic Deduplication for Cluster-based storage system deduplication” in Proc. ACM Cloud Computing, October 2012.
7.
Zurück zum Zitat Jin San Kong, Min Ja Kim, Wan Yeon Lee, Young Woong Ko. Two-Level Metadata Management for Data Deduplication System. IST 2013, ASTL Vol. 23, pp. 299–303. Jin San Kong, Min Ja Kim, Wan Yeon Lee, Young Woong Ko. Two-Level Metadata Management for Data Deduplication System. IST 2013, ASTL Vol. 23, pp. 299–303.
8.
Zurück zum Zitat Yinjin Fu, Hong Jiang, Nong Xiao, Lei Tian, Fang Liu, Lei Xu, “Application-Aware Source Deduplication for Cloud Backup Services of Personal Storage,” IEEE Transactions on Parallel and Distributed Systems, 2013. Yinjin Fu, Hong Jiang, Nong Xiao, Lei Tian, Fang Liu, Lei Xu, “Application-Aware Source Deduplication for Cloud Backup Services of Personal Storage,” IEEE Transactions on Parallel and Distributed Systems, 2013.
9.
Zurück zum Zitat W. Dong, F. Douglis, K. Li, H. Patterson, S. Reddy, and P. Shilane. “Tradeoffs in scalable data routing for deduplication clusters”. In Proceedings of the 9th USENIX conference on File and Storage Technologies, FAST’11, pages 15–29, Berkeley, CA, USA, 2011. USENIX Association. W. Dong, F. Douglis, K. Li, H. Patterson, S. Reddy, and P. Shilane. “Tradeoffs in scalable data routing for deduplication clusters”. In Proceedings of the 9th USENIX conference on File and Storage Technologies, FAST’11, pages 15–29, Berkeley, CA, USA, 2011. USENIX Association.
10.
Zurück zum Zitat Yujuan Tan, Hong Jiang, Dan Feng, Lei Tian, Zhichao Yan, Guohui Zhou “SAM: A Semantic-AwareMulti-Tiered Source De-duplication Framework for Cloud Backup” 2010 39th International Conference on Parallel Processing. Yujuan Tan, Hong Jiang, Dan Feng, Lei Tian, Zhichao Yan, Guohui Zhou “SAM: A Semantic-AwareMulti-Tiered Source De-duplication Framework for Cloud Backup” 2010 39th International Conference on Parallel Processing.
11.
Zurück zum Zitat Yujuan Tan, Hong Jiang, Dan Feng, Lei Tian, Zhichao Yan “CABdedupe: A Causality-based Deduplication Performance Booster for Cloud Backup Services”. Yujuan Tan, Hong Jiang, Dan Feng, Lei Tian, Zhichao Yan “CABdedupe: A Causality-based Deduplication Performance Booster for Cloud Backup Services”.
12.
Zurück zum Zitat Archana Agrawal, Jyoti Malhotra, “Clustered Outband Deduplication on Primary Data” 2015 IEEE International Conference on Computing Communication Control and Automation. Archana Agrawal, Jyoti Malhotra, “Clustered Outband Deduplication on Primary Data” 2015 IEEE International Conference on Computing Communication Control and Automation.
Metadaten
Titel
Caching: QoS Enabled Metadata Processing Scheme for Data Deduplication
verfasst von
Jyoti Malhotra
Jagdish Bakal
L. G. Malik
Copyright-Jahr
2016
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-0755-2_58

Neuer Inhalt