...

Challenges to doing backups: The problem to solve

The quantity and number of files

...

can put demand on the headnode and may take too long

...

• Will the backup put too much demand on the computer, competing with the computer's research usersprimary research purpose?
• Will the backups take too long?

The number of files

• 100's of millions of small files, along with "normal" files.

...

• $850-1,650/yr, depending on level of file compression.

Ideas to consider for above options

Software to sync data, ideally with versioning

EZ-Backup

CrashPlan

Compare

• http://www.crashplan.com/consumer/compare.html

Real-time Backup Version Retention

• http://support.crashplan.com/doku.php/feature/version_retention_and_backup_frequency^{Image Added}

Backup Frequency and Version Retention

• http://support.crashplan.com/doku.php/reference/version_retention_and_backup_frequency

Backing Up Very Large File Selections

• http://support.crashplan.com/doku.php/how_to/seed_archive#backing_up_very_large_file_selections^{Image Added}

Use software that backs up changes to the partition, not looking at files per se.