HPRCheader.jpg

From TAMU High Performance Research Computing
Jump to: navigation, search

Data Storage Policy

******** ABBREVIATIONS USED ********
HPRC stands for the Texas A&M High Performance Research Computing

Who can store data

Only HPRC staff and HPRC users can store data on HPRC systems, be those compute or just systems dedicated to archiving.

Permitted Data

Only the following types of data are permitted for storage on HPRC systems:

  • Data that serve as input to executables that are run on HPRC systems
  • Data that is output from executables that are run on HPRC systems
  • Executable files that are run on HPRC systems
  • Other directly relevant files: source code, object files, user libraries, include files, make files, etc

Core File Deletion

Users should regularly delete core files in their directories. Core files that are useful to a user should be renamed with a name that does not contain the "core" substring. All disk-resident core files will be periodically deleted.

Archiving of Home

The HPRC staff archives on a regular (nightly) basis all user home directories (/home/$USER) on all computational servers

Backing up of Non-Home Files on the Archive

User files that are not stored in users' home directories are not backedup/archived. You can, however, manually back up on the archive system any files you consider valuable. Instructions on how to archive data files can be found in the user guides.

Quotas

Disk file quotas for home directories are 500MB on all compute servers. For other disk areas consult the appropriate user guide. The default file quota per user on the archive is 50GB. That however can be extended upon request.

Disk-Resident Data Retention

All disk-resident user data, on all compute servers, will be deleted six months after account deactivation unless a user has made prior arrangements with the HPRC staff and/or the affected data are covered by special provisions. (An account is deactivated if it is not renewed yearly during the August - September 15 period)

Compute Server Disk is Not for Long Time Storage

All non-home disk-resident areas (e.g., /scratch), on all compute servers, are made available to meet the current needs of active users. Such areas are not meant in any way to provide long-term storage. Users are expected to continually delete or move elsewhere files that are not being used for current work. The staff will periodically delete older user files when the fill level reaches 90% of capacity. The HPRC will send out notices before such action takes place.

Archive Resident Data Retention

All archive-resident user data will be deleted 18 months after account deactivation. Before the 18-month period expires, users can engage in any of the following:

  • Delete their archived files and/or
  • Copy their data files to an external, non-HPRC storage and/or
  • Arrange with the HPRC staff (to be initiated by an e-mail request) for a tenure extension, if possible, of their files and/or
  • Any combination of the above

Contractual Conditions

Faculty and/or student users who plan to leave Texas A&M and whose archive area contains files that contractually must be preserved must contact the HPRC staff in writing to that effect in order to make secure arrangements for their eventual disposition.

Three Years Maximum Tenure

Three (3) years is the maximum residency period for an archived file since its most recent use, if space is available. Extensions can be granted by written notification (to helpdesk) or at account renewal time. But, past the 3-year period and with no extension granted such files will be deleted.

Personal tools
Namespaces
    Notice: Undefined index: namespace_urls in /var/www/mediawiki119/skins_local/Vector.php on line 354 Warning: Invalid argument supplied for foreach() in /var/www/mediawiki119/skins_local/Vector.php on line 354

Notice: Undefined index: variant_urls in /var/www/mediawiki119/skins_local/Vector.php on line 365 Warning: Invalid argument supplied for foreach() in /var/www/mediawiki119/skins_local/Vector.php on line 365

Variants
Views
    Notice: Undefined index: view_urls in /var/www/mediawiki119/skins_local/Vector.php on line 387 Warning: Invalid argument supplied for foreach() in /var/www/mediawiki119/skins_local/Vector.php on line 387
Actions
Important Info
User Guides
Helpful Pages
Tools