Personal tools
You are here: Home → Data Storage → Long-term Storage → Archiving systems at RZG
 

Archiving systems at RZG

RZG offers several possibilities to archive data. Which one is appropriate depends on the life time, the amount of data, where they come from where they should be used.

All archive systems at RZG finally store their data on tapes in robot systems managed by TSM (Tivoli Storage Manager) or HPSS (High Performance Storage System). There are always two tape copies one in the RZG and the other one at the LRZ.

 

  1. TSM archives

    Can be created and used on all computers for which TSM client software is available.

    Advantages:

    Simple standard solution
    Whole trees are packed in a single archive

    Disadvantages:

    Not filesystem, before using data from an archive it has to be unpacked.
    Not thought for long time preservation.

     

  2. HPSS-HSM filesystem

    From the special GPFS filesystem /r on the HPC system large files automatically are migrated onto tape without having to be moved through the network.

    Advantages:

    High data throughput between HPC system and archive.

    Disadvantages:

    Currently only usable on HPC systems.
    Not thought for long time preservation.

     

  3. AFS m-tree

    Under the surface of AFS large files are stored directly into HPSS. It is suitable for long time preservation because changes or replacements of the underlying technology are handled by the RZG and remain unvisible for the user.

    Advantages:

    On all computers with AFS-client world-wide usable.
    Pathes remain constant for long time.

    Disadvantages:

    Lower data transfer rate than native HPSS-HSM filesystem.
    Trees have to be explicitly packed by 'tar' or 'zip'.

Document Actions