10. Deduplication Practices for Multimedia Data in the Cloud

Data deduplication has been a promising and effective technology that provides storage saving in data centers and clouds. It is the process of identifying the redundancy in data, removing all but one copy (or n copies) of duplicate data, and making all references point to that copy. Existing techniques often require access to the content of data in order to establish redundancy. As more sensitive information is stored on clouds, encryption is commonly used to protect this information, which obscures the content of the data to Cloud Service Providers (CSPs). This chapter deals with how to provide deduplication services, while protecting data privacy. Most of the data stored today is multimedia content, with one estimate putting this type of content at about 80% of all corporate and public unstructured big data (Venter and Stein, Images & videos: really big data. http://analytics-magazine.org/images-a-videos-really-big-data/. Accessed 24 August 2016, 2012). In this chapter, we will give an overview of some of the best practices to achieve efficient deduplication for multimedia content.