Journal
PROCEEDINGS OF THE IEEE
Volume 104, Issue 9, Pages 1681-1710Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JPROC.2016.2571298
Keywords
Data compression; data deduplication; data reduction; delta compression; storage security; storage systems
Categories
Funding
- National Science Foundation of China (NSFC) [61502190, 61232004]
- 863 Project [2013AA013203]
- State Key Laboratory of Computer Architecture [CARCH201505]
- Fundamental Research Funds for the Central Universities, HUST [2015MS073]
- U.S. National Science Foundation (NSF) [CNS-1116606, CNS-1016609]
- Key Laboratory of Information Storage System, Ministry of Education, China
- EMC Corporation
- Direct For Computer & Info Scie & Enginr
- Division Of Computer and Network Systems [1116606] Funding Source: National Science Foundation
Ask authors/readers for more resources
Data deduplication, an efficient approach to data reduction, has gained increasing attention and popularity in large-scale storage systems due to the explosive growth of digital data. It eliminates redundant data at the file or subfile level and identifies duplicate content by its cryptographically secure hash signature (i.e., collision-resistant fingerprint), which is shown to be much more computationally efficient than the traditional compression approaches in large-scale storage systems. In this paper, we first review the background and key features of data deduplication, then summarize and classify the state-of-the-art research in data deduplication according to the key workflow of the data deduplication process. The summary and taxonomy of the state of the art on deduplication help identify and understand the most important design considerations for data deduplication systems. In addition, we discuss the main applications and industry trend of data deduplication, and provide a list of the publicly available sources for deduplication research and studies. Finally, we outline the open problems and future research directions facing deduplication-based storage systems.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available