Efficient Hybrid Inline and Out-of-line Deduplication for Backup Storage
Yan Kit Li, Min Xu, Chun Ho Ng, Patrick P. C. Lee

TL;DR
RevDedup is a hybrid deduplication system that combines inline and out-of-line techniques to optimize backup storage, improving performance and deletion efficiency while maintaining high storage savings.
Contribution
It introduces a novel hybrid deduplication approach that balances inline and out-of-line methods for better backup storage management.
Findings
High performance in backup, restore, and deletion operations.
Storage efficiency comparable to traditional inline deduplication.
Effective handling of duplicate removal in both recent and older backups.
Abstract
Backup storage systems often remove redundancy across backups via inline deduplication, which works by referring duplicate chunks of the latest backup to those of existing backups. However, inline deduplication degrades restore performance of the latest backup due to fragmentation, and complicates deletion of ex- pired backups due to the sharing of data chunks. While out-of-line deduplication addresses the problems by forward-pointing existing duplicate chunks to those of the latest backup, it introduces additional I/Os of writing and removing duplicate chunks. We design and implement RevDedup, an efficient hybrid inline and out-of-line deduplication system for backup storage. It applies coarse-grained inline deduplication to remove duplicates of the latest backup, and then fine-grained out-of-line reverse deduplication to remove duplicates from older backups. Our reverse deduplication…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCloud Data Security Solutions · Caching and Content Delivery · Advanced Data Storage Technologies
