Data Storage Policy
Last updated: May 17, 2018
Who can store data
Only HPRC staff and HPRC users can store data on HPRC systems, be those compute or just systems dedicated to archiving.
Only the following types of data are permitted for storage on HPRC systems:
- Data that serve as input to executables that are run on HPRC systems
- Data that is output from executables that are run on HPRC systems
- Executable files that are run on HPRC systems
- Other directly relevant files: source code, object files, user libraries, include files, make files, etc
Any data containing any confidential information as per the TAMU Data Classification Standard CANNOT BE STORED ON HPRC RESOURCES.
Core File Deletion
Users should regularly delete core files in their directories. Core files that are useful to a user should be renamed with a name that does not contain the "core" substring. All disk-resident core files will be periodically deleted.
Archiving of Home
The HPRC staff archives on a regular (nightly) basis all user home directories (
/home/$USER) on all computational servers
Backing up of Non-Home Files on the Archive
User files that are not stored in users' home directories are not backed up. You can, however, manually back up any files you consider valuable to the archive system. Users are strongly encouraged to also copy their data to storage outside of the HPRC resources. Instructions on how to archive data files can be found in the user guides.
Disk file quotas for home directories are normally 10GB on all compute clusters. For other disk areas consult the appropriate user guide. The default file quota per user on the archive is 10TB. That however can be extended upon request.
Disk-Resident Data Retention
All disk-resident user data, on all compute servers, will be deleted six months after account deactivation unless a user has made prior arrangements with the HPRC staff and/or the affected data are covered by special provisions. (An account is deactivated if it is not renewed yearly during the August - September 15 period)
Compute Server Disk is Not for Long Time Storage
All non-home disk-resident areas (e.g., /scratch), on all compute servers, are made available to meet the current needs of active users. Such areas are not meant in any way to provide long-term storage. Users are expected to continually delete or move elsewhere files that are not being used for current work. The staff will periodically delete older user files when the fill level reaches 90% of capacity. The HPRC will send out notices before such action takes place.
Archive Resident Data Retention
All archive-resident user data will be deleted 18 months after account deactivation. Before the 18-month period expires, users can engage in any of the following:
- Delete their archived files and/or
- Copy their data files to an external, non-HPRC storage and/or
- Arrange with the HPRC staff (to be initiated by an e-mail request) for a tenure extension, if possible, of their files and/or
- Any combination of the above
Faculty and/or student users who plan to leave Texas A&M and whose archive area contains files that contractually must be preserved must contact the HPRC staff in writing to that effect in order to make secure arrangements for their eventual disposition.
Three Years Maximum Tenure
Three (3) years is the maximum residency period for an archived file since its most recent use, if space is available. Extensions can be granted by written notification (to helpdesk) or at account renewal time. But, past the 3-year period and with no extension granted such files will be deleted.