[OpenAFS] Re: Current OpenAFS Backup Recommendations

Russ Allbery rra@stanford.edu
Fri, 18 Dec 2009 17:37:38 -0800

Adam Megacz <adam@megacz.com> writes:
> Russ Allbery <rra@stanford.edu> writes:

>> Given the low churn of most of our AFS space and compression of the vos
>> dump files, the backups actually take slightly less space than the
>> entirety of our cell, with 30 day retention.

> You can get remarkably good compression by using xdelta3 on dump
> files.  I have almost two years worth of *daily* backups and they
> consume only 10x the space of the active data itself (and lives on
> much cheaper/slower storage).

Don't you have to do full dumps in order to calculate the xdelta3
differences?  I'm worried that would be pretty slow.  (We initially tried
to use bzip2 compression and had to fall back to gzip for performance
reasons, although I may try again with xz and doing compressions in
parallel to use more cores.)

Russ Allbery (rra@stanford.edu)             <http://www.eyrie.org/~eagle/>