Adaptive Redundancy Management for Durable P2P Backup

TL;DR

This paper introduces an adaptive redundancy management mechanism for P2P backup systems that optimizes data durability and reduces redundancy, leading to storage and backup time improvements at the cost of longer restore times.

Contribution

It presents a novel online redundancy management approach tailored for P2P backups, focusing on data durability rather than availability, with trace-driven simulation validation.

Findings

Reduces redundancy by a factor of 2-3 compared to availability-focused policies.

Decreases storage requirements and backup times.

Increases restore times, which is acceptable for backup applications.

Abstract

We design and analyze the performance of a redundancy management mechanism for Peer-to-Peer backup applications. Armed with the realization that a backup system has peculiar requirements -- namely, data is read over the network only during restore processes caused by data loss -- redundancy management targets data durability rather than attempting to make each piece of information availabile at any time. In our approach each peer determines, in an on-line manner, an amount of redundancy sufficient to counter the effects of peer deaths, while preserving acceptable data restore times. Our experiments, based on trace-driven simulations, indicate that our mechanism can reduce the redundancy by a factor between two and three with respect to redundancy policies aiming for data availability. These results imply an according increase in storage capacity and decrease in time to complete backups, at the expense of longer times required to restore data. We believe this is a very reasonable price to pay, given the nature of the application. We complete our work with a discussion on practical issues, and their solutions, related to which encoding technique is more suitable to support our scheme.